JP6171919B2 - Information providing program, information providing method, and information providing apparatus - Google Patents

Description

  The present invention relates to an information providing program, an information providing method, and an information providing apparatus.

  Conventionally, there is a service called account aggregation that aggregates and displays information on a plurality of sites on one screen. According to account aggregation, for example, information on a plurality of accounts of different financial institutions held by depositors in Internet banking or the like can be aggregated and displayed on a list screen.

  As related prior art, for example, a screen including information that changes with the passage of time is captured as image data, and character recognition is used for the image data to acquire and store information that changes with time. There is a technology to display in the designated area. In addition, there is a technology for sending account settlement information acquired from each financial institution from each financial institution through a user terminal to the database marketing system by Internet banking, and consolidating a plurality of account settlement information by the database marketing system and returning the information to the user terminal. In addition, there is a web page information extraction system for extracting a part that a user needs.

JP 2007-206908 A JP 2001-306804 A JP 2003-308275 A

  However, according to the prior art, when the screen configuration of the site and the contents of the site are changed, it is not possible to obtain the information as intended by the user. Takes time and effort.

  In one aspect, an object of the present invention is to provide an information providing program, an information providing method, and an information providing apparatus capable of supporting a setting change for information acquired from a site.

  According to one aspect of the present invention, based on pre-recorded site identification information and position information of an area set when the site screen is output, the acquired image data of the site screen is obtained. When the character recognition process is performed on the extracted image data of the area and the character recognition process cannot recognize the character, the image data on the acquired screen image of the site is located at the position specified by the position information. An information providing program, an information providing method, and an information providing apparatus that superimpose and output information indicating a region are proposed.

  According to one aspect of the present invention, there is an effect that it is possible to support a setting change for information acquired from a site.

FIG. 1 is an explanatory diagram of an example of the information providing method according to the embodiment. FIG. 2 is an explanatory diagram illustrating a system configuration example of the system 200. FIG. 3 is a block diagram illustrating a hardware configuration example of the information providing apparatus 101. FIG. 4 is a block diagram illustrating a hardware configuration example of the server 201. FIG. 5 is an explanatory diagram showing an example of the contents stored in the account aggregation information DB 220. FIG. 6 is an explanatory diagram showing an example of the contents stored in the list information DB 230. FIG. 7 is an explanatory diagram illustrating a screen example of a list setting screen. FIG. 8 is an explanatory diagram illustrating a screen example of an area initial setting screen. FIG. 9 is an explanatory diagram illustrating a screen example of a list screen. FIG. 10 is a block diagram illustrating a functional configuration example of the information providing apparatus 101. FIG. 11 is an explanatory diagram illustrating a screen example of the area resetting screen. FIG. 12 is a flowchart illustrating an example of an information provision processing procedure of the information provision apparatus 101. FIG. 13 is a flowchart illustrating an example of a specific processing procedure of the new registration process. FIG. 14 is a flowchart illustrating an example of a specific processing procedure of the list display processing. FIG. 15 is a flowchart illustrating an example of a specific processing procedure of the target data setting process. FIG. 16 is a flowchart illustrating an example of a specific processing procedure of the area reset screen display process.

  Exemplary embodiments of an information providing program, an information providing method, and an information providing apparatus according to the present invention will be described below in detail with reference to the drawings.

(One example of information providing method)
FIG. 1 is an explanatory diagram of an example of the information providing method according to the embodiment. In FIG. 1, an information providing apparatus 101 is a computer having a function of collecting and outputting information on a plurality of sites on one screen. A site is a page or a set of pages, for example, a website.

  The page is information disclosed on the network, for example, a web page. The page includes an electronic document (html data, xhtml data) or image data described by html (HyperText Markup Language) or xhtml (Extensible HyperText Markup Language).

  Here, it is assumed that information on the bank site S1, the securities company site S2, and the pension site S3 is collected and output on the list screen 110. In this case, the user sets in advance which part of each site information is to be acquired for each of the bank site S1, the securities company site S2, and the pension site S3.

  As an example, it is assumed that the acquisition annual amount (expected) of the welfare pension information page of the pension site S3 is acquired. In this case, for example, in the initial setting screen 120, an area 130 for displaying the acquisition annual amount (expected) of the welfare pension information page of the pension site S3 is set by a user operation input. Thereby, the information in the area 130 of the welfare pension information page of the pension site S3 can be displayed at a preset position on the list screen 110.

  On the other hand, the provider of each site is often different, and the screen configuration and posted content of each site are arbitrarily changed by the provider. If the screen configuration or posted content of each site is changed, the position of a region (for example, region 130) set in advance for each site may be shifted, and information as intended by the user may not be displayed on the list screen 110. . Therefore, in order to display information as intended by the user on the list screen 110, settings for information acquired from each site are changed in accordance with changes in the screen configuration and posted contents of each site.

  However, every time the screen configuration or posted content of each site is changed, it takes time and effort for the user to access each site to check the changed content and change the settings for information acquired from each site. Take it. In addition, the user may not be aware that the screen configuration or posted content of each site has been changed, and may not be aware of information displayed on the list screen 110 that is different from the user's intention.

  Therefore, in this embodiment, when the site screen configuration and posted contents are changed and information that the user intended can no longer be acquired, it is reset as to which part of the site information is acquired. An information providing method for facilitating and reducing the labor required for setting changes will be described. Hereinafter, an embodiment of the information providing process of the information providing apparatus 101 will be described.

  (1) The information providing apparatus 101 acquires image data of the screen of the site S with reference to the identification information of the site S recorded in advance. Here, the site S is one of a plurality of sites that collect and display information on one screen. The identification information of the site S is information for identifying the site S, and is, for example, a URL (Uniform Resource Locator) of the site S.

  Specifically, for example, first, the information providing apparatus 101 refers to the URL of the pension site S3, accesses the employee pension information page of the pension site S3, and acquires screen information of the employee pension information page. Here, the screen information is information for displaying the welfare pension information page, and is, for example, html data or xhtml data of the welfare pension information page.

  Then, the information providing apparatus 101 captures the welfare pension information page based on the screen information of the welfare pension information page, and acquires the image data 140 of the welfare pension information page. Note that capture means saving a screen image displayed on the display as image data.

  (2) The information providing apparatus 101 obtains the screen of the site S acquired based on the position information of the region T set when the screen of the site S is output in advance in association with the identification information of the site S. The image data of the region T is extracted from the image data. Here, the region T is a range including information acquired from the site S in the image data of the screen of the site S.

  Further, the position information of the region T is information indicating the position of the region T in the image data of the screen of the site S, and is, for example, the coordinates (x coordinate, y coordinate) of the vertex forming the region T. For example, when the region T is a rectangle, the position information of the region T may be the coordinates of two vertices on the diagonal of the rectangle. When the region T is a circle, the position information of the region T may be the coordinates and radius of the center of the circle. In the example of FIG. 1, the image data 150 of the area 130 is extracted from the image data 140 of the screen of the employee pension information page of the pension site S3.

  (3) The information providing apparatus 101 performs character recognition processing on the image data of the extracted region T. Here, the character recognition process is a process of identifying a character from image data based on the shape of the character and converting it into character data that can be handled on a computer. The character recognition process is, for example, an OCR (Optical Character Recognition) process.

  (4) When the information providing apparatus 101 cannot recognize the character by the character recognition process, the information providing apparatus 101 outputs the acquired image data of the screen of the site S. In the example of FIG. 1, since the content posted on the welfare pension information page of the pension site S3 has been changed, the position of the region 130 set in advance is shifted from the portion displaying the acquisition annual amount (expected). For this reason, the number string “2480000” indicating the acquisition annual amount (expected) is not recognized.

  In this case, the information providing apparatus 101 outputs the image data 140 of the welfare pension information page of the acquired pension site S3. Specifically, for example, the information providing apparatus 101 outputs a resetting screen 170 that displays information indicating the region 130 in a superimposed manner at a position on the image data 140 specified from the position information of the region 130.

  Here, the information indicating the region 130 indicates the presence of the region 130, and is information for specifying the range of the region 130, for example. In the example of FIG. 1, on the resetting screen 170, a range frame 160 that specifies the range of the region 130 is displayed superimposed on the image data 140. The reset screen 170 is a screen for resetting the region T in the employee pension information page of the pension site S3.

  Thus, according to the information providing apparatus 101, the image data of the region T extracted from the acquired image data of the screen of the site S based on the identification information of the site S and the position information of the region T recorded in advance. Character recognition processing can be performed. Further, according to the information providing apparatus 101, when the character cannot be recognized by the character recognition process, the region T is indicated at the position specified by the position information of the region T on the image data of the screen of the acquired site S. Information can be superimposed and output.

  This makes it easier to reconfigure which part of the site S is to be acquired when the screen configuration and posted content of the site S are changed and the information as intended by the user cannot be acquired. It is possible to reduce the time and effort required to change settings.

  For example, when it becomes impossible to acquire information as intended by the user from the pension site S3, the resetting screen 170 is displayed so that the user can be aware that the posted content of the pension site S3 has been changed. Further, in the resetting screen 170, it is possible to reset the area 130 for the welfare pension information page of the pension site S3.

  Further, on the resetting screen 170, by displaying the range frame 160 superimposed on the position on the image data 140 where the area 130 has been set, it is possible for the user to know in which state the intended information cannot be acquired. The region 130 can be easily corrected by making it easy to grasp.

(System configuration example of system 200)
Next, a system configuration example of the system 200 according to the embodiment will be described.

  FIG. 2 is an explanatory diagram illustrating a system configuration example of the system 200. In FIG. 2, the system 200 includes an information providing apparatus 101 and a server 201. In the system 200, the information providing apparatus 101 and the server 201 are connected to each other via a wired or wireless network 210 so that they can communicate with each other. The network 210 is, for example, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), or the like.

  Here, the information providing apparatus 101 includes an account aggregation information DB (database) 220 and a list information DB 230. Specifically, for example, the information providing apparatus 101 is a PC (Personal Computer) installed with a browser, a notebook PC, a tablet PC, a smartphone, a mobile phone, or the like.

  Note that the account aggregation information DB 220 and the list information DB 230 will be described later with reference to FIGS. 5 and 6.

  The server 201 is a computer that transmits screen information of the site S including html data and images in response to a request from the information providing apparatus 101. The information providing apparatus 101 can display the screen of the site S based on the screen information of the site S from the server 201. Specifically, for example, the server 201 is a Web server.

(Example of hardware configuration of information providing apparatus 101)
FIG. 3 is a block diagram illustrating a hardware configuration example of the information providing apparatus 101. In FIG. 3, the information providing apparatus 101 includes a CPU (Central Processing Unit) 301, a memory 302, a disk drive 303, a disk 304, a display 305, an I / F (Interface) 306, a keyboard 307, a mouse. 308, a scanner 309, and a printer 310. Each component is connected by a bus 300.

  Here, the CPU 301 governs overall control of the information providing apparatus 101. The memory 302 includes, for example, a ROM, a RAM, a flash ROM, and the like. Specifically, for example, a flash ROM or ROM stores various programs, and a RAM is used as a work area for the CPU 301. The program stored in the memory 302 is loaded into the CPU 301 to cause the CPU 301 to execute the coded process.

  The disk drive 303 controls reading / writing of data with respect to the disk 304 according to the control of the CPU 301. The disk 304 stores data written under the control of the disk drive 303. Examples of the disk 304 include a magnetic disk and an optical disk.

  A display 305 displays data such as a document, an image, and function information as well as a cursor, an icon, or a tool box. As the display 305, for example, a CRT, a TFT liquid crystal display, a plasma display, or the like can be adopted.

  The I / F 306 is connected to the network 210 via a communication line, and is connected to another computer (for example, the server 201) via the network 210. The I / F 306 controls an internal interface with the network 210 and controls data input / output from other computers. For example, a modem or a LAN adapter may be employed as the I / F 306.

  The keyboard 307 includes keys for inputting characters, numbers, various instructions, and the like, and inputs data. The keyboard 307 may be a touch panel type input pad or a numeric keypad. The mouse 308 performs cursor movement, range selection, window movement, size change, and the like.

  The scanner 309 optically reads an image and takes in image data into the information providing apparatus 101. The scanner 309 may have an OCR function. The printer 310 prints image data and document data. As the printer 310, for example, a laser printer or an ink jet printer can be employed. Note that the information providing apparatus 101 may not include the scanner 309, the printer 310, or the like among the above-described components.

(Hardware configuration example of server 201)
FIG. 4 is a block diagram illustrating a hardware configuration example of the server 201. In FIG. 4, the server 201 includes a CPU 401, a memory 402, an I / F 403, a disk drive 404, and a disk 405. Each component is connected by a bus 400.

  Here, the CPU 401 governs overall control of the server 201. The memory 402 includes, for example, a ROM, a RAM, a flash ROM, and the like. Specifically, for example, a flash ROM or ROM stores various programs, and the RAM is used as a work area of the CPU 401. The program stored in the memory 402 is loaded on the CPU 401 to cause the CPU 401 to execute the coded process.

  The I / F 403 is connected to the network 210 via a communication line, and is connected to another computer (for example, the information providing apparatus 101 shown in FIG. 2) via the network 210. The I / F 403 controls an internal interface with the network 210 and controls input / output of data from other computers. For example, a modem or a LAN adapter may be employed as the I / F 403.

  The disk drive 404 controls reading / writing of data with respect to the disk 405 according to the control of the CPU 401. The disk 405 stores data written under the control of the disk drive 404. Examples of the disk 405 include a magnetic disk and an optical disk. Note that the server 201 may include, for example, a keyboard, a mouse, a display, and the like in addition to the components described above.

(Contents stored in the account aggregation information DB 220)
Next, the contents stored in the account aggregation information DB 220 included in the information providing apparatus 101 will be described. The account aggregation information DB 220 is realized by, for example, a storage device such as the memory 302 and the disk 304 of the information providing apparatus 101 illustrated in FIG.

  FIG. 5 is an explanatory diagram showing an example of the contents stored in the account aggregation information DB 220. In FIG. 5, the account aggregation information DB 220 has fields of ID, PW, login URL, and data URL. By setting information in each field, account aggregation information (account aggregation information 500-1 to 500-7) is stored as a record.

  Here, ID (identification) is an identifier for identifying a user of the site S. PW (password) is a user password for logging in to the site S. The login URL is a URL for displaying a Web page (so-called login screen) for logging into the site S.

  The data URL is a URL for displaying a Web page including information on the site S to be displayed on the list screen. The list screen is a screen that aggregates and displays information on a plurality of sites S. Here, the data URL is a URL of a CGI (Common Gateway Interface) script.

  For example, the account aggregation information 500-1 indicates ID “12345”, PW “P111111”, login URL “A.html”, and data URL “A / 12345.cgi”.

  In the following description, the information on the site S displayed on the list screen may be referred to as “target data”. In addition, a Web page including target data may be referred to as “target page”.

(Storage contents of the list information DB 230)
Next, the contents stored in the list information DB 230 of the information providing apparatus 101 will be described. The list information DB 230 is realized by a storage device such as the memory 302 and the disk 304 of the information providing apparatus 101, for example.

  FIG. 6 is an explanatory diagram showing an example of the contents stored in the list information DB 230. In FIG. 6, the list information DB 230 includes fields for data URL, coordinates (upper left / lower right), data attributes, and list position. By setting information in each field, list information (for example, list information 600-1 to 600-5) is stored as a record.

  Here, the data URL is a URL for displaying the target page of the site S. The coordinates (upper left / lower right) are information indicating the position of the region T including the target data on the screen of the target page. Here, the region T is rectangular, and the coordinates (upper left / lower right) indicate the upper left coordinates (x coordinate, y coordinate) and the lower right coordinates (x coordinate, y coordinate) of the region T.

  The data attribute is an attribute of the target data. Examples of data attributes include numerical values, kanji, kana, kana, and alphabet. The list position is information indicating a position where the target data of the site S is displayed on the list screen. Here, the list position indicates the number of a box (for example, boxes B1 to B3 shown in FIG. 7) in the list screen.

  For example, the list information 600-1 indicates a data URL “A / 12345.cgi”, coordinates (upper left / lower right) “100, 150/200, 200”, a data attribute “numerical value”, and a list position “1”.

(Example of list setting screen)
Next, a screen example of the list setting screen displayed on the display 305 of the information providing apparatus 101 will be described. The list setting screen is a screen for setting the screen configuration of the list screen displaying the target data of the plurality of sites S and the posting contents.

  FIG. 7 is an explanatory diagram illustrating a screen example of a list setting screen. In FIG. 7, a list setting screen 700 is a screen for setting item names and display positions of target data to be displayed on the list screen. In the list setting screen 700, an item name of target data to be displayed on the list screen can be set by a user operation input using the keyboard 307 or the mouse 308 shown in FIG.

  In the example of FIG. 7, the item names “number of months of pension participation”, “pension receipt (expected) amount” and “bank balance of X bank” of the target data displayed on the list screen are set. The “months of pension participation” and “pension receipt (expected) amount” are information on a certain pension site. Further, “deposit balance of bank X” is information on a certain bank site.

  In the list setting screen 700, a box for displaying target data can be set by a user operation input. In the example of FIG. 7, the box B1 that displays the target data of the item name “pension participation months”, the box B2 that displays the target data of the item name “pension receipt (expected) amount”, and the item name “bank X deposit balance”. The box B3 for displaying the target data “is set.

(Example of initial area setting screen)
Next, a screen example of the area initial setting screen displayed on the display 305 of the information providing apparatus 101 will be described. The area initial setting screen is a screen for setting an area T including target data on the screen of the target page.

  FIG. 8 is an explanatory diagram illustrating a screen example of an area initial setting screen. In FIG. 8, a region initial setting screen 800 is a screen for setting a region T including target data on the screen of the welfare pension information page of the pension site. The area initial setting screen 800 displays image data 810 of the pension site welfare pension information page.

  In the region initial setting screen 800, the region T including the target data on the screen of the welfare annuity information page can be set by selecting a range including the target data on the image data 810 by a user operation input. In the example of FIG. 8, areas T <b> 1 and T <b> 2 including target data on the welfare pension information page screen are set.

  Here, the region T1 is a region including a numeric string indicating the number of months of participation in the employee pension information page. The region T2 is a region including a numeric string indicating an acquisition yearly amount (expected) of the employee pension information page. On the region initial setting screen 800, when the setting completion button 820 is clicked (pressed) by a user operation input, the setting of the region T is completed.

(Screen example of list screen)
Next, a screen example of a list screen displayed on the display 305 of the information providing apparatus 101 will be described. The list screen is a screen that aggregates and displays the target data of a plurality of sites S.

  FIG. 9 is an explanatory diagram illustrating a screen example of a list screen. In FIG. 9, a list screen 900 is a screen that collectively displays the purpose data of the welfare pension information page of the pension site and the purpose data of the account information page of the bank site. Specifically, on the list screen 900, the number of months of participation on the welfare pension information page of the pension site is displayed in box B1, and the pension receipt (expected) amount is displayed in box B2.

  In the list screen 900, the deposit balance of the bank site account information page is displayed in a box B3. According to the list screen 900, the user can confirm at a glance the number of months of enrollment on the welfare pension information page of the pension site, the pension receipt (expected) amount, and the deposit balance on the account information page of the bank site.

(Functional configuration example of the information providing apparatus 101)
FIG. 10 is a block diagram illustrating a functional configuration example of the information providing apparatus 101. In FIG. 10, the information providing apparatus 101 includes a reception unit 1001, an acquisition unit 1002, a registration unit 1003, a display control unit 1004, a recognition unit 1005, and a determination unit 1006. The receiving unit 1001 to the determining unit 1006 are functions as control units. Specifically, for example, by causing the CPU 301 to execute a program stored in a storage device such as the memory 302 and the disk 304 illustrated in FIG. Alternatively, the function is realized by the I / F 306. The processing result of each functional unit is stored in a storage device such as the memory 302 and the disk 304, for example.

<When a new registration request is accepted>
First, processing contents of each functional unit when a new registration request is received will be described. The new registration request is a request for new registration of target data displayed on the list screen.

  The accepting unit 1001 accepts a new registration request. Specifically, for example, the reception unit 1001 receives a new registration request by a user operation input using the keyboard 307 or the mouse 308. The receiving unit 1001 may receive a new registration request by receiving a new registration request from an external computer.

  The acquisition unit 1002 acquires the ID, PW, login URL, and data URL of the site S in response to receiving a new registration request. Specifically, for example, the acquisition unit 1002 acquires the ID, PW, login URL, and data URL of the site S by a user operation input. At this time, the acquisition unit 1002 may acquire the data URL of the target page by changing the screen to the target page by a user operation input.

  Further, the ID, PW, login URL, and data URL of the site S may be included in the new registration request. In this case, the acquisition unit 1002 acquires the ID, PW, login URL, and data URL of the site S from the accepted new registration request.

  The registration unit 1003 registers the acquired ID, PW, login URL, and data URL of the site S in the account aggregation information DB 220. Specifically, for example, the registration unit 1003 sets the acquired site S ID, PW, login URL, and data URL in each field of the account aggregation information DB 220. As a result, new account aggregation information is newly registered in the account aggregation information DB 220.

  The acquisition unit 1002 acquires image data of the screen of the target page. Specifically, for example, first, the acquisition unit 1002 accesses the login screen of the site S using the acquired login URL of the site S. Then, the acquisition unit 1002 logs in to the site S using the acquired ID and PW of the site S. Next, the acquisition unit 1002 acquires HTML data of the target page of the site S using the acquired data URL of the site S. Then, the acquisition unit 1002 acquires the image data of the screen of the target page by capturing the screen of the target page based on the acquired HTML data.

  The display control unit 1004 outputs the acquired image data of the screen of the target page. Specifically, for example, the display control unit 1004 displays an area initial setting screen (for example, the area initial setting screen 800 shown in FIG. 8) including the image data of the screen of the target page on the display 305.

  The accepting unit 1001 accepts selection of an area T including the target data on the image data of the output target page screen. Specifically, for example, the accepting unit 1001 selects an area T (for example, areas T1 and T2) including target data on the image data 810 (see FIG. 8) by a user operation input on the area initial setting screen 800. Accept.

  The acquisition unit 1002 acquires position information of the selected region T. Specifically, for example, the acquisition unit 1002 acquires the upper left coordinates (x coordinate, y coordinate) and the lower right coordinates (x coordinate, y coordinate) of the selected region T. The acquisition unit 1002 has a function of acquiring data attributes and list positions of target data. Specifically, for example, the acquisition unit 1002 receives a data attribute of the target data (for example, numeric value, kanji, kana, kana, alphabet, etc.) and a list position (for example, a box number in the list screen) in response to a user operation input. ) To get.

  The registration unit 1003 registers the acquired position information of the region T, the data attribute of the target data, and the list position in the list information DB 230 in association with the data URL of the target page. Specifically, for example, the registration unit 1003 sets the data URL of the target page, the coordinates of the area T, the data attribute of the target data, and the list position in each field of the list information DB 230. As a result, new list information is newly registered in the list information DB 230.

<When a list display request is accepted>
Next, processing contents of each functional unit when a list display request is received will be described. The list display request is a display request for a list screen (for example, the list screen 900 shown in FIG. 9) that aggregates and displays the target data of a plurality of sites S.

  The accepting unit 1001 accepts a list display request. Specifically, for example, the reception unit 1001 receives a list display request by a user operation input. The receiving unit 1001 may receive a list display request by receiving a list display request from an external computer.

  The acquisition unit 1002 acquires the image data of the screen of the target page in response to receiving the list display request. Specifically, for example, first, the acquisition unit 1002 acquires account aggregation information (record) from the account aggregation information DB 220. Next, the acquisition unit 1002 accesses the login screen of the site S using the login URL of the acquired account aggregation information. Then, the acquisition unit 1002 logs into the site S using the ID and PW of the acquired account aggregation information. Next, the acquisition unit 1002 acquires HTML data of the target page of the site S using the data URL of the acquired account aggregation information. Then, the acquisition unit 1002 acquires the image data of the screen of the target page by capturing the screen of the target page based on the acquired HTML data.

  The recognition unit 1005 performs character recognition processing on the image data of the region T extracted from the acquired image data of the screen of the target page. Specifically, for example, the recognition unit 1005 first acquires list information corresponding to the data URL of the acquired account aggregation information from the list information DB 230. Next, the recognition unit 1005 extracts image data of the region T specified by the coordinates (upper left / lower right) of the acquired list information from the image data of the screen of the target page. Then, the recognition unit 1005 performs OCR processing on the extracted image data of the region T.

  The determination unit 1006 determines whether or not a character has been recognized by the character recognition process based on the result of the character recognition process on the image data in the region T. Specifically, for example, when the character is not recognized from the image data in the region T or a part of the image data in the region T is not recognized as a character, the determining unit 1006 performs character recognition processing. Judge that it was not recognized.

  When the character cannot be recognized by the character recognition process, the display control unit 1004 displays information indicating the region T at the position specified by the position information of the region T on the acquired image data of the screen of the target page. Superimpose and output. Specifically, for example, the display control unit 1004 superimposes an item that can reset the region T on the position on the image data of the screen specified by the coordinates (upper left / lower right) of the acquired list information. An area reset screen to be displayed is displayed on the display 305.

  Here, the item capable of resetting the region T is image data in which the range of the region T can be changed by a user operation input. For example, the item that can reset the region T is a range frame having the same size as the region T specified by the coordinates (upper left / lower right) of the list information. By selecting an item that can reset the region T by user operation input, the range of the region T can be enlarged or reduced, or the region T can be moved. A screen example of the area resetting screen will be described later with reference to FIG.

  As a result, when the screen configuration and posting contents of the target page are changed and the characters in the region T cannot be recognized, the region resetting for resetting the region T including the target data on the screen of the target page after the change A screen can be displayed on the display 305.

  The accepting unit 1001 accepts selection of an area T including the target data on the image data of the output target page screen. Specifically, for example, the accepting unit 1001 accepts selection of an area T including target data on the image data 1110 (see FIG. 11) by a user operation input on an area resetting screen 1100 described later.

  The acquisition unit 1002 acquires position information of the selected region T. Specifically, for example, the acquisition unit 1002 performs upper left coordinates (x coordinates, y coordinates) and lower right coordinates (x coordinates, y coordinates) of the area T selected on the area resetting screen 1100 (see FIG. 11). ) To get.

  The registration unit 1003 updates the position information of the area T recorded in advance in association with the data URL of the target page, using the acquired position information of the area T. Specifically, for example, the registration unit 1003 uses the coordinates of the acquired area T (upper left / lower right) as coordinates of the list information in the list information DB 230 corresponding to the data URL of the target page (upper left / lower right). Overwrite to. Thereby, the list information in the list information DB 230 is updated.

  Further, when a character is recognized by the character recognition process, the determination unit 1006 determines whether the attribute of the character matches the character attribute recorded in advance in association with the position information of the region T. It may be. Here, the character attributes are data attributes such as numerical values, kanji, kana, kana, and alphabet. Specifically, for example, the determination unit 1006 determines whether the data attribute of the character recognized by the character recognition process matches the data attribute of the list information in the list information DB 230 corresponding to the data URL of the target page. to decide.

  In addition, when the character attributes do not match, the display control unit 1004 superimposes information indicating the region T on the position specified by the position information of the region T on the acquired image data of the screen of the target page. May be output. As a result, when the screen configuration or posted content of the target page is changed and the data attribute of the character in the region T is changed, the region reset for resetting the region T including the target data on the screen of the target page after the change is performed. A setting screen can be displayed on the display 305.

  The display control unit 1004 outputs a list screen in which characters recognized by the recognition unit 1005 are inserted at positions recorded in advance in association with the position information of the region T on the list screen. Specifically, for example, the display control unit 1004 may output the list screen when the data attribute of the character recognized by the character recognition process matches the data attribute of the character recorded in advance. .

  More specifically, for example, first, the display control unit 1004 generates html data of the list screen 900 in which the target data is not inserted, based on the html data of the list setting screen 700 (see FIG. 7). Next, the display control unit 1004 specifies the list position of the list information in the list information DB 230 corresponding to the data URL of the target page. Then, the display control unit 1004 generates html data of the list screen 900 in which the recognized data is inserted at the specified list position and displays it on the display 305. As a result, a list screen can be displayed on the display 305 that aggregates and displays the target data of the plurality of sites S.

  In the above description, the information providing apparatus 101 has the function units 1001 to 1006. However, the server 201 may have the function units 1001 to 1006. Specifically, for example, the system 200 may be realized by SaaS (Software as a Service) that enables the information providing apparatus 101 to use a necessary function as a required service.

(Screen example of area reset screen)
Next, a screen example of the area resetting screen displayed on the display 305 of the information providing apparatus 101 will be described. The area reset screen is a screen for resetting the area T including the target data on the screen of the target page.

  FIG. 11 is an explanatory diagram illustrating a screen example of the area resetting screen. In FIG. 11, an area resetting screen 1100 is a screen for resetting an area T including target data on the screen of the welfare annuity information page of the pension site. In the area resetting screen 1100, image data 1110 of the welfare pension information page of the pension site is displayed.

  By clicking the items 1120 and 1130 on the image data 1110 by the user's operation input on the area resetting screen 1100, the area T including the target data on the screen of the welfare annuity information page can be reset. Here, the item 1120 is image data in which the range of the region T1 (see FIG. 8) can be changed. The item 1130 is image data that can change the range of the region T2 (see FIG. 8).

  In the example of FIG. 11, the item 1120 is dragged and dropped by the user's operation input, and the area T <b> 1 including the number string indicating the target data “number of months of participation” on the screen of the welfare pension information page is reset. In addition, the item 1130 is dragged and dropped by the user's operation input, and the region T2 including the number string indicating the target data “acquired annual amount (expected)” on the screen of the welfare annuity information page is reset. In addition, when the setting completion button 1140 is clicked (pressed) on the region resetting screen 1100 by a user operation input, the resetting of the region T is completed.

  Thus, according to the area reset screen 1100, the areas T1 and T2 including the target data on the screen of the welfare pension information page of the pension site can be reset. Further, according to the area resetting screen 1100, since a plurality of areas T1 and T2 set on the welfare pension information page of the pension site can be corrected in a lump, it takes time and effort to change the settings of the areas T1 and T2. It is possible to improve the convenience of the user by omitting. Further, according to the items 1120 and 1130, it is possible to make it easier for the user to grasp in which state the intended information cannot be acquired, and to easily correct the regions T1 and T2.

(Information provision processing procedure of information provision apparatus 101)
Next, an information providing process procedure of the information providing apparatus 101 will be described.

  FIG. 12 is a flowchart illustrating an example of an information provision processing procedure of the information provision apparatus 101. In the flowchart of FIG. 12, first, the information providing apparatus 101 determines whether a new registration request has been received (step S1201).

  If a new registration request is received (step S1201: Yes), the information providing apparatus 101 executes a new registration process (step S1202). A series of processes according to this flowchart is terminated. A specific processing procedure of the new registration processing will be described later with reference to the flowchart of FIG.

  On the other hand, if a new registration request has not been received (step S1201: No), the information providing apparatus 101 determines whether a list display request has been received (step S1203). Here, when the list display request is not received (step S1203: No), the information providing apparatus 101 returns to step S1201.

  On the other hand, when a list display request is received (step S1203: Yes), the information providing apparatus 101 executes list display processing (step S1204). A series of processing by this flowchart is complete | finished. A specific processing procedure of the list display processing will be described later with reference to a flowchart of FIG.

<Specific processing procedure of new registration processing>
Next, a specific processing procedure of the new registration processing in step S1202 shown in FIG. 12 will be described.

  FIG. 13 is a flowchart illustrating an example of a specific processing procedure of the new registration process. In the flowchart of FIG. 13, first, the information providing apparatus 101 acquires the ID, PW, login URL, and data URL of the site S (step S1301).

  The information providing apparatus 101 registers the ID, PW, login URL, and data URL of the acquired site S in the account aggregation information DB 220 (step S1302). As a result, new account aggregation information is newly registered in the account aggregation information DB 220.

  Next, the information providing apparatus 101 acquires html data of the target page of the site S using the acquired ID, PW, login URL, and data URL of the site S (step S1303). Then, the information providing apparatus 101 acquires image data of the target page by capturing the target page based on the acquired html data (step S1304).

  Next, the information providing apparatus 101 displays a region initial setting screen including the acquired image data of the target page on the display 305 (step S1305). Then, the information providing apparatus 101 determines whether or not the region T including the target data on the image data of the target page is selected by the user's operation input on the region initial setting screen (step S1306).

  Here, the information providing apparatus 101 waits for the area T to be selected (step S1306: No). When the region T is selected (step S1306: Yes), the information providing apparatus 101 acquires the position information of the selected region T (step S1307). The position information of the area T is the upper left coordinates and the lower right coordinates of the area T in the image data of the target page.

  Next, the information providing apparatus 101 determines whether or not the data attribute and list position of the target data have been acquired by a user operation input (step S1308). Here, the information providing apparatus 101 waits to acquire the data attribute and list position of the target data (step S1308: No).

  If the data attribute and the list position of the target data are acquired (step S1308: Yes), the information providing apparatus 101 associates the acquired position information, data attribute, and list position with the data URL of the target page as the list information. Registration in the DB 230 (step S1309) returns to the step that called the new registration process. As a result, new list information is newly registered in the list information DB 230.

<Specific processing procedure of list display processing>
Next, a specific processing procedure of the list display processing in step S1204 shown in FIG. 12 will be described.

  FIG. 14 is a flowchart illustrating an example of a specific processing procedure of the list display processing. In the flowchart of FIG. 14, first, the information providing apparatus 101 generates html data of a list screen in which target data is not inserted (step S1401).

  Next, the information providing apparatus 101 acquires the number n of records in the account aggregation information DB 220 (step S1402) and sets “i = 1” (step S1403). The information providing apparatus 101 executes target data setting processing (step S1404). A specific processing procedure of the target data setting process will be described later with reference to the flowchart of FIG.

  Next, the information providing apparatus 101 increments “i” (step S1405), and determines whether “i” is greater than “n” (step S1406). If “i” is equal to or less than “n” (step S1406: NO), the information providing apparatus 101 returns to step S1404.

  On the other hand, when “i” becomes larger than “n” (step S1406: Yes), the information providing apparatus 101 displays the html data of the list screen on the display 305 (step S1407) and calls the list display processing. Return to step.

  As a result, a list screen (for example, list screen 900) in which target data of a plurality of sites S are aggregated can be displayed on the display 305.

<Specific processing procedure of target data setting processing>
Next, a specific processing procedure of the target data setting process in step S1404 shown in FIG. 14 will be described.

  FIG. 15 is a flowchart illustrating an example of a specific processing procedure of the target data setting process. In the flowchart of FIG. 15, first, the information providing apparatus 101 acquires the i-th record (hereinafter referred to as “record Ra”) of the account aggregation information DB 220 (step S1501).

  Next, the information providing apparatus 101 accesses the login screen of the site S using the acquired login URL of the record Ra, and logs in to the site S using the ID and PW of the record Ra (step S1502). The information providing apparatus 101 acquires the html data of the target page of the site S using the data URL of the record Ra (step S1503).

  Next, the information providing apparatus 101 acquires image data of the target page by capturing the target page based on the acquired html data (step S1504). Then, the information providing apparatus 101 acquires a record (hereinafter referred to as “record Rb”) corresponding to the data URL of the acquired record Ra from the list information DB 230 (step S1505).

  When there are a plurality of records Rb corresponding to the data URL of the record Ra, the information providing apparatus 101 acquires the plurality of records Rb from the list information DB 230.

  Next, the information providing apparatus 101 extracts the image data of the area T specified by the coordinates (upper left / lower right) of each acquired record Rb from the acquired image data of the target page, and each area T OCR processing of the image data is performed (step S1506). Then, the information providing apparatus 101 determines whether or not a character is recognized from the data obtained by each OCR process (step S1507).

  Here, when a character is recognized (step S1507: Yes), the information provision apparatus 101 specifies the data attribute of the data obtained by each OCR process (step S1508). Then, the information providing apparatus 101 determines whether the specified data attribute matches the data attribute of each record Rb (step S1509).

  Here, when the data attributes match (step S1509: Yes), the information providing apparatus 101 inserts the data obtained by the OCR process into the html data of the list screen based on the list position of each record Rb. Then, the process returns to the step that called the target data setting process (step S1510). As a result, it is possible to generate html data of a list screen in which the target data of the site S is embedded at a preset list position.

  If no character is recognized in step S1507 (step S1507: No), the information providing apparatus 101 executes region reset screen display processing (step S1511), and proceeds to step S1510. A specific processing procedure of the area reset screen display process will be described later with reference to the flowchart of FIG.

  If the data attributes do not match in step S1509 (step S1509: No), the information providing apparatus 101 proceeds to step S1511.

<Specific processing procedure of area reset screen display processing>
Next, a specific processing procedure of the area resetting screen display process in step S1511 shown in FIG. 15 will be described.

  FIG. 16 is a flowchart illustrating an example of a specific processing procedure of the area reset screen display process. In the flowchart of FIG. 16, the information providing apparatus 101 first acquires image data of the target page by capturing the target page based on the html data of the target page (step S1601).

  Next, the information providing apparatus 101 superimposes and displays an item that can reset the region T at the position on the image data of the target page specified by the coordinates (upper left / lower right) of each record Rb. An area reset screen is displayed on the display 305 (step S1602).

  Then, the information providing apparatus 101 determines whether or not each of the regions T including the target data on the image data of the target page has been selected by the user's operation input on the region reset screen (step S1603). Here, the information providing apparatus 101 waits for the area T to be selected (step S1603: No).

  When the region T is selected (step S1603: Yes), the information providing apparatus 101 acquires the position information of each selected region T (step S1604). The position information of the area T is the upper left coordinates and the lower right coordinates of the area T in the image data of the target page.

  Next, the information providing apparatus 101 updates the list information DB 230 by overwriting the acquired position information of the region T on the corresponding record Rb (step S1605). Thereby, the stored content of the list information DB 230 can be updated in accordance with the change of the screen configuration of the target page and the posted content.

  Then, the information providing apparatus 101 extracts the image data of the region T specified by the acquired position information of each region T from the image data of the target page, and performs the OCR process on the image data of each region T. (Step S1606), the process returns to the step that called the area reset screen display process.

  When a plurality of records Rb corresponding to the data URL of the record Ra are collectively processed, the target data setting in step S1404 shown in FIG. 14 is performed for the record having the same data URL as the record Ra in the account aggregation information DB 220. Processing can be skipped. Thereby, the processing load of the information providing apparatus 101 related to the list display process can be reduced.

  As described above, according to the information providing apparatus 101 according to the embodiment, it is possible to perform the character recognition processing of the image data of the region T extracted from the acquired image data of the screen of the site S. Further, according to the information providing apparatus 101, when the character cannot be recognized by the character recognition process, the position specified by the position information of the region T recorded in advance on the image data of the screen of the acquired site S is displayed. Items that can reset the region T can be superimposed and output.

  As a result, it is possible to determine whether or not information as intended by the user can no longer be acquired due to a change in the screen configuration of the target page or the posted content, depending on whether or not the character has been recognized by the character recognition process. Further, when it becomes impossible to acquire information as intended by the user, it is easy to re-set which part of the target page information is to be acquired, and it is possible to reduce the trouble of changing the setting.

  Further, according to the information providing apparatus 101, the position information of the area T recorded in advance can be updated with the position information of the area T set on the output image data of the target page. Thereby, the stored content of the list information DB 230 can be updated in accordance with the change of the screen configuration of the target page and the posted content.

  Further, according to the information providing apparatus 101, when a character is recognized by the character recognition process, it is determined whether or not the attribute of the character matches the attribute of the character recorded in advance in association with the position information of the region T. Judgment can be made. Further, according to the information providing apparatus 101, when the attribute of the character recorded in advance does not match, the position specified by the position information of the region T recorded in advance on the image data of the screen of the site S acquired. , Items that can reset the region T can be superimposed and output.

  As a result, even if the character is recognized by the character recognition processing, if the data attribute of the recognized character is different from the data attribute recorded in advance, it is determined that the information as intended by the user can no longer be acquired, and the target page The item that can reset the region T can be superimposed and output on the image data.

  Also, according to the information providing apparatus 101, when the attribute of the character recorded in advance is matched, the character recognized by the character recognition process is displayed at the list position recorded in advance in association with the position information of the region T. The inserted list screen can be output. As a result, a list screen (for example, list screen 900) in which target data of a plurality of sites S are aggregated can be displayed on the display 305.

  The data URL of the account aggregation information DB 220 and the list information DB 230 is the URL of the cgi script, but is not limited thereto. Any URL that can identify and access the location of data on the network may be used. Further, the data attributes of the list information DB 230 are not limited to those acquired by user operation input. The acquisition unit 1002 may automatically recognize and set at the time of new registration processing or resetting.

  The information providing method described in the present embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. The information providing program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The information providing program may be distributed via a network such as the Internet.

  The following additional notes are disclosed with respect to the embodiment described above.

(Supplementary note 1)
Characters of the image data of the area extracted from the acquired image data of the screen of the site based on the site identification information recorded in advance and the position information of the area set when the screen of the site is output Perform recognition processing,
If the character cannot be recognized by the character recognition process, the information indicating the region is superimposed and output on the position specified by the position information on the image data of the acquired screen of the site.
An information providing program for executing a process.

(Supplementary note 2) The output process is
The information providing program according to claim 1, wherein an item that can reset the area is superimposed and output at a position specified by the position information.

(Supplementary note 3)
The information according to appendix 1 or 2, wherein a process of updating the position information of the area recorded in advance is executed according to the position information of the area set on the output image data of the screen of the site. Offer program.

(Supplementary note 4)
When a character is recognized by the character recognition process, a process of determining whether or not the attribute of the character matches the character attribute recorded in advance in association with the position information of the region,
The output process is as follows:
When the pre-recorded character attribute does not match, the information indicating the region is superimposed and output at the position specified by the position information on the image data of the screen of the site. The information providing program according to any one of appendices 1 to 3.

(Supplementary note 5)
When the attribute of the pre-recorded character is matched, the character recognition process is performed at a position pre-recorded in association with the position information of the area on a list screen that displays information of a plurality of sites in an aggregated manner. 5. The information providing program according to appendix 4, wherein a process for outputting the list screen in which the characters recognized by the method are inserted is executed.

(Appendix 6)
Characters of the image data of the area extracted from the acquired image data of the screen of the site based on the site identification information recorded in advance and the position information of the area set when the screen of the site is output Perform recognition processing,
If the character cannot be recognized by the character recognition process, the information indicating the region is superimposed and output on the position specified by the position information on the image data of the acquired screen of the site.
An information providing method characterized by executing processing.

(Supplementary Note 7) A storage unit that associates and stores site identification information and position information of an area set when the screen of the site is output;
Based on the storage content of the storage unit, perform character recognition processing of the image data of the region extracted from the acquired image data of the screen of the site, and when the character recognition process could not recognize the character, the acquired A control unit that superimposes and outputs information indicating the region at a position specified by the position information on image data of a screen of a site;
An information providing apparatus comprising:

(Appendix 8)
Characters of the image data of the area extracted from the acquired image data of the screen of the site based on the site identification information recorded in advance and the position information of the area set when the screen of the site is output Perform recognition processing,
If the character cannot be recognized by the character recognition process, the information indicating the region is superimposed and output on the position specified by the position information on the image data of the acquired screen of the site.
An information-providing program for executing processing is recorded on the computer-readable recording medium.

101 Information Providing Device 200 System 201 Server 220 Account Aggregation Information DB
230 List information DB
1001 Reception unit 1002 Acquisition unit 1003 Registration unit 1004 Display control unit 1005 Recognition unit 1006 Judgment unit

Claims (7)

On the computer,
Characters of the image data of the area extracted from the acquired image data of the screen of the site based on the site identification information recorded in advance and the position information of the area set when the screen of the site is output Perform recognition processing,
If the character cannot be recognized by the character recognition process, the information indicating the region is superimposed and output on the position specified by the position information on the image data of the acquired screen of the site.
An information providing program for executing a process. The output process is as follows:
The information providing program according to claim 1, wherein an item capable of resetting the area is superimposed and output at a position specified by the position information. In the computer,
The process of updating the position information of the area recorded in advance according to the position information of the area set on the outputted image data of the screen of the site is executed. Information provision program. In the computer,
When a character is recognized by the character recognition process, a process of determining whether or not the attribute of the character matches the character attribute recorded in advance in association with the position information of the region,
The output process is as follows:
When the pre-recorded character attribute does not match, the information indicating the region is superimposed and output at the position specified by the position information on the image data of the screen of the site. The information provision program as described in any one of Claims 1-3. In the computer,
When the attribute of the pre-recorded character is matched, the character recognition process is performed at a position pre-recorded in association with the position information of the area on a list screen that displays information of a plurality of sites in an aggregated manner. The information providing program according to claim 4, wherein a process of outputting the list screen in which the character recognized by is executed is executed. Computer
Characters of the image data of the area extracted from the acquired image data of the screen of the site based on the site identification information recorded in advance and the position information of the area set when the screen of the site is output Perform recognition processing,
If the character cannot be recognized by the character recognition process, the information indicating the region is superimposed and output on the position specified by the position information on the image data of the acquired screen of the site.
An information providing method characterized by executing processing. A storage unit that associates and stores site identification information and position information of an area set when the screen of the site is output;
Based on the storage content of the storage unit, perform character recognition processing of the image data of the region extracted from the acquired image data of the screen of the site, and when the character recognition process could not recognize the character, the acquired A control unit that superimposes and outputs information indicating the region at a position specified by the position information on image data of a screen of a site;
An information providing apparatus comprising:

Images