JP6673405B2 - Electronic flyer information processing system, terminal device, and program - Google Patents

Description

  The present invention relates to an electronic flyer information processing system, a terminal device, and a program.

2. Description of the Related Art There is known an electronic flyer distribution system that distributes an electronic flyer from a server to a terminal device and allows the terminal device to browse the electronic flyer (for example, see Patent Document 1).
For example, a user (customer) is an effective source of information for deciding a product to purchase, such as finding a product that is of interest to him and that has been discounted from the products posted on the electronic flyer. As an electronic flyer can be utilized. In addition, for the advertiser, by distributing the electronic flyer, it is possible to expect an advertising effect such as, for example, having more customers go to the store and purchasing a product.

JP 2013-109771 A

  However, it can be said that the utility of the electronic flyer as described above can be similarly obtained for a paper medium, for example. Therefore, it is preferable that the value of the electronic flyer be further enhanced by effectively utilizing the characteristic of the electronic flyer that the flyer is converted into data.

  The present invention has been made in view of such circumstances, and an object of the present invention is to make it possible to further effectively utilize an electronic flyer.

  One embodiment of the present invention that solves the above-described problem is that, in response to a flyer partial image selecting operation for selecting a part of an electronic flyer image as a flyer partial image performed on the terminal device, the selected flyer part is selected. A flyer partial image information acquiring unit for acquiring a flyer partial image information indicating an image, and performing character recognition on the flyer partial image indicated by the flyer partial image information acquired by the flyer partial image information acquiring unit; A character recognition unit that obtains a character string related to a product to be purchased, and a character string obtained by the character recognition unit is output as a changeable character string that can be changed. An electronic flyer information processing system including a purchase target product information management unit that manages purchase target product information that is included as attribute information related to the product.

  Further, according to one embodiment of the present invention, a character string recognized by performing character recognition on a flyer partial image which is a partial image selected from an electronic flyer image is set as a changeable character string that can be changed. A terminal device including a purchase target product information management unit that outputs a purchase target product information including the change target character string as attribute information related to the purchase target product in a storage unit.

  Further, according to one embodiment of the present invention, a computer can change a character string recognized by performing character recognition on a flyer partial image which is a part of images selected from an electronic flyer image. A program for outputting as a target character string and functioning as a purchase target product information management unit for storing in a storage unit purchase target product information including the change target character string as attribute information related to the purchase target product.

  As described above, according to the present invention, there is an effect that the electronic flyer can be further effectively utilized.

It is a figure showing the example of composition and the example of the outline of the operation procedure of the electronic flyer information processing system in a 1st embodiment. It is a figure showing an example of a mode of an electronic flyer browsing screen displayed on a terminal unit in a 1st embodiment. It is a figure showing an example of a mode of an electronic flyer cutout operation screen displayed on a terminal unit in a 1st embodiment. It is a figure showing an example of a mode in case movement and size change of an electronic flyer image are performed as an electronic flyer cutout operation screen displayed on a terminal device in a 1st embodiment. It is a figure showing the example of a mode of the registration confirmation screen displayed on the terminal unit in a 1st embodiment. It is a figure showing the example of a mode of the registration completion screen displayed on the terminal unit in a 1st embodiment. It is a figure showing the example of a mode of the purchase target goods list screen displayed on the terminal unit in a 1st embodiment. It is a figure showing the example of composition of the terminal unit in a 1st embodiment. It is a figure showing the example of composition of the electronic flyer server in a 1st embodiment. It is a flowchart which shows the example of a processing procedure which a terminal device and electronic flyer server in 1st Embodiment perform in connection with registration of the goods for purchase. It is a figure showing the example of composition of the electronic flyer information processing system in a 2nd embodiment, and the example of the outline of the operation procedure. It is a figure showing the example of composition of the electronic flyer server in a 2nd embodiment. It is a figure showing the example of composition of the character recognition result information table in a 2nd embodiment. It is a figure showing the example of composition and the example of the outline of the operation procedure of the electronic flyer information processing system in a 3rd embodiment. It is a figure showing the example of composition of flyer partial image attribute information in a 3rd embodiment. It is a flow chart which shows an example of a processing procedure for an electronic flyer server in a 3rd embodiment to give a flyer partial image attribute information to an electronic flyer.

<First embodiment>
[Configuration example of electronic flyer information processing system]
FIG. 1 illustrates a configuration example of an electronic flyer information processing system according to the present embodiment. The electronic flyer information processing system shown in FIG. 1 includes a terminal device 100 and an electronic flyer server 200 (an example of an information processing server). The terminal device 100 and the electronic flyer server 200 can communicate via the network 300.

The terminal device 100 is a network terminal used by a user. The terminal device 100 is, for example, a smartphone, a tablet terminal, a mobile phone, or the like.
The electronic flyer server 200 is a server that distributes an electronic flyer to the terminal device 100 via the network 300.

[Example of outline of operation procedure in electronic flyer information processing system]
With reference to FIGS. 1 and 2 to 7, an outline of an operation procedure of the terminal device 100 and the electronic flyer server 200 in the electronic flyer information processing system of the present embodiment will be described. The following description is performed according to the procedures 1 to 7 shown in FIG.

Procedure 1: The electronic flyer server 200 distributes the electronic flyer to the terminal device 100. The data as the distributed electronic flyer includes, for example, image data for displaying an image of the electronic flyer on the screen of the terminal device 100.
The terminal device 100 receives the distributed electronic flyer. The terminal device 100 displays the received image of the electronic flyer on the screen. By displaying the image of the electronic flyer on the terminal device 100, the user can browse the electronic flyer. The display of the electronic flyer may be performed by an electronic flyer browsing application having a function of displaying the electronic flyer. Alternatively, the display of the electronic flyer may be performed on a web browser.

Step 2: The user can perform a flyer cutout operation (an example of a flyer partial image selection operation) for selecting a part of the electronic flyer image as a flyer partial image. In the flyer clipping operation, when there is a product (purchase target product) that the user wants to browse and purchase the electronic flyer displayed on the terminal device 100, the purchase target product is posted on the electronic flyer. It is performed in the sense of cutting out the part that is.
In other words, the flyer clipping operation is performed when a user finds a product to be purchased by looking at a leaflet on a paper medium, so that the consumer can write on the flyer to remember the product to be purchased or use scissors to scribble the product to be purchased. This is equivalent to the act of cutting out and keeping the posted part of the document.

FIG. 2 shows an example of an electronic flyer browsing screen displayed on the screen of the terminal device 100. The electronic flyer browsing screen is a screen on which an image of the electronic flyer selected as a browsing target from the electronic flyers distributed from the electronic flyer server 200 is displayed.
In the following description, a case where the screen of the terminal device 100 is configured as a touch panel and an operation by touching an operation tool such as a finger or a stylus pen on the screen of the display unit is given as an example. .

In the figure, an electronic flyer display area AR1 is an area where an image of an electronic flyer selected as a viewing target is displayed. The image of the electronic flyer displayed in the electronic flyer display area AR1 can be moved in any direction according to a slide operation on the screen. Thereby, the image portion of the electronic flyer that has protruded from the electronic flyer display area AR1 can be displayed.
In addition, the image of the electronic flyer displayed in the electronic flyer display area AR1 can be enlarged or reduced by a pinch-out, pinch-in operation, or the like.
Through these operations, the user can browse any part of the electronic flyer to be browsed at an appropriate size.

  An electronic flyer selection area AR2 is displayed on the screen of the terminal device 100 so as to be superimposed on the electronic flyer display area AR1. The electronic flyer selection area AR2 is an area where an operation of selecting an electronic flyer to be viewed is performed. The electronic handbill selection area AR2 can be deleted by a predetermined operation.

  In the electronic handbill selection area AR2, thumbnail images corresponding to the electronic handbills as viewing target candidates are arranged. The user performs a touch operation on a thumbnail image indicating an electronic flyer to be viewed from among the arranged thumbnail images. In response to this touch operation, an electronic flyer image corresponding to the thumbnail image on which the touch operation has been performed is displayed in the electronic flyer display area AR1.

On the screen of the terminal device 100, a store name area AR3 and a flyer title area AR4 are displayed above the electronic flyer display area AR1.
The store name area AR3 is an area in which the name of the store that is the provider of the electronic flyer displayed in the electronic flyer display area AR1 is displayed.
The flyer title area AR4 is an area where the title given to the electronic flyer displayed in the electronic flyer display area AR1 is displayed.

Here, when the user browses the electronic flyer displayed in the electronic flyer display area AR1, finds a product that he / she wants to buy, and intends to register the found product in the purchase target product management application, Perform the following operations.
That is, the user operates the “register for shopping memo” button BT1 arranged below the electronic flyer display area AR1 in FIG. The operation on the “register in shopping memo” button BT1 is an operation for instructing a transition to an operation screen (electronic flyer clipping operation screen) for registering a part of the image of the electronic flyer in the purchase target product management application.

In response to the operation performed on the “register in shopping memo” button BT1, for example, a purchase target product management application is activated. Here, the activation of the purchase target product management application means that the purchase target product management application is activated and becomes active (enabled), or the purchase target product management application that has already been started but is not active. To the active state.
By activating the purchase target product management application in this way, the electronic flyer clipping operation screen shown in FIG. 3 is displayed on the screen of the terminal device 100. The electronic flyer cutout operation screen is a screen on which an operation for cutting out (selecting) a part (flyer partial image) from the image of the electronic flyer is performed.

The electronic flyer clipping operation screen shown in FIG. 3 is a screen displayed on the purchase target product management application started as described above.
On the electronic flyer clipping operation screen, the electronic flyer image P1 of the clipping source (acquisition source) is displayed, and the clipping frame FL is displayed so as to be superimposed on the displayed electronic flyer image P1.

  The electronic flyer image P1 is the same electronic flyer image that was displayed in the electronic flyer display area AR1 when the “register for shopping memo” button BT1 was operated on the electronic flyer browsing screen shown in FIG. .

  The cutout frame FL is a frame displayed to indicate an image portion cut out from the electronic flyer image P1. The cutout frame FL is displayed on the screen of the terminal device 100 in a state where the cutout frame FL is fixed on the position and the size shown in FIG.

The user can move the electronic flyer image P1 in an arbitrary direction according to a slide operation on the screen of the terminal device 100. Further, the user can change the size of the electronic flyer image P1 by a predetermined operation. Specifically, the user can enlarge the electronic flyer image P1 by performing a pinch-out operation on the screen, and reduce the electronic flyer image P1 by performing a pinch-in operation.
Through these operations, the user adjusts the electronic flyer image P1 so that the image portion to be clipped is included in the clipping frame FL. The image portion of the electronic flyer image P1 stored in the cutout frame FL by such an operation is a portion that the user wants to cut out, that is, a portion in the electronic flyer image P1 where a product that the user wants to purchase is posted.

  As an example, FIG. 4 shows one product listed in the electronic flyer image P1 on the electronic flyer cutout operation screen as a result of performing operations such as moving and enlarging the electronic flyer image P1 from the state of FIG. A state in which the cut image portion is accommodated in the cutout frame FL is shown.

When the user confirms that the portion to be cut out from the electronic flyer image P1 is included in the cutout frame FL as intended, the user operates the determination button BT11 superimposed and displayed on the electronic flyer image P1.
In response to an operation on the determination button BT11, a partial image of the electronic flyer that was contained in the frame FL is cut out from the electronic flyer. Specifically, the terminal device 100 copies the partial image of the electronic flyer contained in the frame FL from the image of the electronic flyer, and acquires image data of the copied partial image.
As described above, in the present embodiment, a partial image (flyer partial image) is obtained from an electronic flyer in accordance with a flyer cutting operation performed by the user.

Step 3: In response to the acquisition of the flyer partial image as described above, the terminal device 100 generates flyer partial image information indicating the acquired flyer partial image. The handbill partial image information is generated including, for example, information on the position of the handbill partial image in the electronic handbill, the size of the handbill partial image, and the electronic handbill ID of the acquisition-source electronic handbill.
Then, the terminal device 100 transmits the generated flyer partial image information to the electronic flyer server 200 via the network 300.
Note that the terminal device 100 can use the obtained flyer partial image as a thumbnail image representing the product in the registration information when registering the purchase target product in the purchase target product management application.

Step 4: The electronic flyer server 200 executes character recognition on the flyer partial image indicated by the received flyer partial image information in response to receiving the flyer partial image information from the terminal device 100.
For this purpose, the electronic flyer server 200 acquires the flyer partial image indicated by the received flyer partial image information in response to receiving the flyer partial image information from the terminal device 100.
That is, the electronic flyer server 200 stores the distribution data of the electronic flyer from which the flyer partial image indicated by the currently received flyer partial image information is acquired. Therefore, the electronic flyer server 200 acquires the image data of the electronic flyer indicated by the electronic flyer ID included in the received flyer partial image information from the stored distribution data.

Then, the electronic flyer server 200 acquires, as the flyer partial image, a partial area specified by the position and the size included in the received flyer partial image information from the acquired electronic flyer image data. In this way, the electronic flyer server 200 acquires the flyer partial image indicated by the received flyer partial image information.
After that, the electronic flyer server 200 executes character recognition on the acquired flyer partial image. That is, the electronic flyer server 200 executes a process of recognizing characters included in the flyer partial image.

As illustrated in FIG. 4, the flyer partial image includes characters related to the product name such as “K”, “A”, “B”, and “T”, and “9”, “8”, Characters related to price, such as "yen", are included. The electronic flyer server 200 recognizes each of the above characters by character recognition.
Then, the electronic flyer server 200 recognizes the word of the product name of “cabbage” and executes the analysis process such as morphological analysis and dictionary reference, and recognizes the word indicating the price of “98 yen”.

Note that the flyer partial image information may be image data itself as a flyer partial image. In this case, the electronic flyer server 200 can execute the character recognition on the received flyer partial image as the flyer partial image information as it is.
On the other hand, when the flyer partial image information is information including the electronic flyer ID and the position and size of the flyer partial image as in the present embodiment, there are cases where the flyer partial image information is the image data itself as a flyer partial image. In comparison, the size of the flyer partial image information becomes smaller. Therefore, the processing load when transmitting the flyer partial image information from the terminal device 100 to the electronic flyer server 200 is reduced, and the traffic is also suppressed.

  Step 5: The electronic flyer server 200 transmits the registered attribute information including the character string of the product name “cabbage” and the character string of the price “98 yen” acquired to the terminal device 100 as described above. .

  Step 6: Upon receiving the registration attribute information, the terminal device 100 inputs the character strings of the product name and price included in the received registration attribute information as the product name and price in the purchase target product information as follows.

Here, in response to the operation of the enter button BT11, the purchase target product management application operating on the terminal device 100 displays the registration confirmation screen shown in FIG.
The registration confirmation screen shown in the figure is a screen for confirming the registered contents of the purchase target product corresponding to the flyer partial image cut out from the electronic flyer image P1. In the registration confirmation screen shown in the figure, a registration confirmation image P2, input boxes Bx1 to Bx4, a cancel button BT21, and a registration button BT22 are displayed.

  The registration confirmation image P2 shows a flyer partial image that was included in the cutout frame FL when the enter button BT11 was operated on the electronic flyer cutout operation screen shown in FIG. 3 or FIG. By viewing the registration confirmation image P2, the user can confirm whether or not the flyer partial image cut out from the electronic flyer is as intended.

Each of the input boxes Bx1 to Bx4 is an area in which a character string indicating the content of a predetermined attribute of the product to be purchased is input.
The input box Bx1 is an area where a character string indicating a product name is input as an attribute of the product to be purchased.
The input box Bx2 is an area where a character string (numerical value) indicating a planned quantity when purchasing the purchase target product is input as an attribute of the purchase target product.
The input box Bx3 is an area in which a character string indicating a price is input as an attribute of the purchase target product.
The input box Bx4 is an area where a character string indicating the name (store name) of a store where the purchase target product is sold is input as an attribute of the purchase target product.

Each of the input boxes Bx1 to Bx4 can input an arbitrary character string in accordance with a character input operation by the user.
Then, in the present embodiment, for the input box Bx1 in which the character string of the product name is input, using the character string of the product name included in the registration attribute information received from the electronic flyer server 200, “cabbage Is input as an initial value.
Similarly, a character string of "98 yen" is input as an initial value for the input box Bx3 in which the price is input, using the character string of the price included in the received registration attribute information.
That is, in the present embodiment, the input box corresponding to the same attribute as that included in the registered attribute information received from the electronic flyer server 200 includes, among the character strings included in the received registered attribute information, The character string of the attribute is input.

  As described above, in the present embodiment, the appropriate character strings as the product name and the price are respectively input as the initial values to the input boxes Bx1 and Bx3 by the procedure 6 shown in FIG. This eliminates the need for the user to perform the operation of inputting the product name and price by himself.

In the input box Bx4, the store name given as metadata to the electronic flyer from which the flyer partial image displayed in the registration confirmation image P2 is obtained is input as an initial value. That is, the user does not need to perform the input operation for the store name in addition to the above-mentioned product name and price.
Each character string input as an initial value in the input boxes Bx1, Bx3, and Bx4 can be changed by the user performing a character input operation.

  The user looks at the contents of the registration confirmation screen shown in FIG. 5, and operates the cancel button BT21 if the user wants to discard the contents of the registration confirmation screen, for example, to redo the operation on the electronic flyer clipping operation screen. . In response to the operation of the cancel button BT21, the screen of the terminal device 100 returns to, for example, the electronic flyer cutout operation screen shown in FIG.

Step 7: On the other hand, if the content of the registration confirmation screen shown in FIG. 5 is acceptable, the user operates the registration button BT22. In response to the operation of the registration button BT22, the purchase target product management application stores purchase target product information including the content shown on the registration confirmation screen in FIG. For example, the purchase target product information includes a leaflet partial image displayed in the registration confirmation image P2, and attribute information such as a product name, a quantity, a price, and a store name based on a character string input to each of the input boxes Bx1 to Bx4. Is included.
By storing the purchase target product information, a new purchase target product is registered in accordance with the current registration operation. Further, in response to the operation of the registration button BT22, the screen of the terminal device 100 transits to the display of the registration completion screen shown in FIG.

  On the registration completion screen shown in FIG. 6, the same registration confirmation image P2 as that displayed on the registration confirmation screen of FIG. 5 is displayed. By viewing the registration confirmation image P2 displayed on the registration completion screen, the user can confirm that the same content as that confirmed on the registration confirmation screen has been registered.

Further, on the registration completion screen, a registration continue button BT31 and a purchase target product confirmation button BT32 are arranged.
When the registration continuation button BT31 is operated, the screen of the terminal device 100 returns to, for example, the electronic flyer clipping operation screen shown in FIG. Thus, the user can perform an operation of cutting out an image portion corresponding to another product from the electronic flyer and registering the image portion in the purchase target product management application.

On the other hand, when the purchase target product confirmation button BT32 is operated, the screen of the terminal device 100 transits to the display of the purchase target product list screen as shown in FIG. The purchase target product list screen is an image that presents a list of purchase target products registered on the purchase target product management application.
In the purchase target product list screen of FIG. 7, a purchase target product list area AR21 is arranged. In the purchase target product list area AR21, a list item corresponding to each registered purchase target product is displayed. In the drawing, an example is shown in which three list items corresponding to three registered purchase target products are displayed. In each list item, a thumbnail image, and information such as a product name, a price, and a store name are indicated by character strings.

Here, the thumbnail image displayed in the column of one list item is cut out from the electronic flyer by the flyer cutout operation, and a flyer partial image displayed as the registration confirmation image P2 illustrated in FIG. 6 is shown.
The product name in the list item reflects the character string input to the input box Bx1 in FIG. The price in the list item reflects the character string input to the input box Bx3 in FIG.
As described above, the content displayed in the list item of the purchase target product list screen in the present embodiment reflects the result of character recognition performed on the handbill partial image acquired from the electronic handbill.
Further, the character string input to the input box Bx4 of FIG. 5 is also reflected on the store name in the list item. That is, as for the store name in the list item, the information of the store name acquired from the distribution data of the electronic flyer from which the flyer partial image is acquired is reflected.

As will be understood from the above description, in the electronic flyer information processing system of the present embodiment, a purchase target product can be registered by a flyer cutout operation on the electronic flyer. Then, when registering the purchase target product, attribute information to be included in the purchase target product information, such as the product name and the price, is obtained by character recognition of the flyer partial image obtained by the flyer clipping operation.
As described above, the electronic flyer according to the present embodiment is not limited to being used by the user, but the contents of the electronic flyer are effectively used for acquiring the attribute information included in the purchase target product information.

Note that the purchase target product management application can be started in response to a normal start operation of touching an icon of the purchase target product management application displayed on the home screen, for example, like other general applications. it can.
As described above, when the purchase target product management application is started by the normal start operation, the purchase target product list screen of FIG. 7 is displayed first. The purchase target product list screen displayed in this way reflects the registered contents of the purchase target product information stored in the purchase target product information storage unit 131 at that time. That is, the main screen in the purchase target product management application is a purchase target product list screen.
However, in the present embodiment, as described above, when the purchase target product management application is activated in response to the operation of the “register for shopping memo” button BT1 of the electronic flyer browsing screen of FIG. Instead of the screen, an electronic flyer clipping operation screen is displayed as shown in FIG. Thereby, the operation of cutting out the image selected from the electronic flyer and registering the purchase target product in the purchase target product management application is smoothly performed.

[Configuration example of terminal device]
Next, a configuration example of the terminal device 100 according to the present embodiment will be described with reference to FIG.
The terminal device 100 illustrated in FIG. 1 includes a communication unit 101, a control unit 102, a storage unit 103, an operation unit 104, and a display unit 105.
The communication unit 101 communicates with the electronic flyer server 200 via the network 300.

The control unit 102 executes various controls for realizing the function as the terminal device 100. The function as the control unit 102 is realized, for example, by a CPU (Central Processing Unit) configuring the control unit 102 executing a program stored in the storage unit 103.
The control unit 102 according to the present embodiment includes electronic flyer browsing control unit 121, flyer partial image information acquisition unit 122, and purchase target product information management unit 123 as functional units corresponding to browsing of electronic flyers and management of purchase target product information. Is provided.
The function as the electronic flyer browsing control unit 121 is realized, for example, by the CPU executing an electronic flyer browsing application program. The functions of the flyer partial image information acquisition unit 122 and the purchase target product information management unit 123 are each realized by executing a program as a purchase target product management application.

The electronic flyer browsing control unit 121 executes various processes corresponding to browsing the electronic flyer. For example, the electronic flyer browsing control unit 121 executes a process for receiving distribution of the electronic flyer from the electronic flyer server 200.
The electronic flyer browsing control unit 121 executes control for displaying an image of the electronic flyer on the display unit 105 so that the user can browse the electronic flyer received from the electronic flyer server 200.

  The flyer partial image information acquiring unit 122 acquires flyer partial image information indicating a flyer partial image selected from the electronic flyer image in accordance with the flyer clipping operation described with reference to FIGS. In other words, the flyer partial image information acquisition unit 122 generates the flyer partial image information including each information of the position and size of the acquired flyer partial image in the electronic flyer and the electronic flyer ID of the electronic flyer from which the flyer was acquired. .

  The purchase target product information management unit 123 manages purchase target product information. As will be understood from the above description, the purchase target product information corresponding to one purchase target product includes the flyer partial image acquired by the flyer partial image information acquisition unit 122 and predetermined attribute information. The attribute information is information indicating the contents of predetermined attributes related to the purchase target product, such as a product name, a price, a quantity, and a store name (the name of a store that sells the purchase target product).

As described with reference to FIG. 5, the purchase target product information management unit 123 stores the purchase target product information including the content shown on the registration confirmation screen in response to the operation of the registration button BT22 on the registration confirmation screen. The information is stored in the purchase target product information storage unit 131 of the storage unit 103. That is, the purchase target merchandise information management unit 123 stores the purchase target including the flyer partial image displayed on the registration confirmation image P2 on the registration confirmation screen and the attribute information based on the character string of each attribute input to the input boxes Bx1 to Bx4. The product information is stored in the storage unit 103.
Further, the purchase target product information management unit 123 displays the purchase target product list screen illustrated in FIG. 7 by using the purchase target product information stored in the purchase target product information storage unit 131.

The storage unit 103 stores various information used by the control unit 102, including programs executed by the control unit 102.
The storage unit 103 includes a purchase target product information storage unit 131. In the purchase target product information storage unit 131, purchase target product information is stored by the purchase target product information management unit 123. By storing the purchase target product information in the purchase target product information storage unit 131, the purchase target product is registered on the purchase target product management application.

The operation unit 104 collectively shows operators and operation devices included in the terminal device 100. For example, when the terminal device 100 includes a touch panel integrated with the display unit 105 as an operation device, the operation unit 104 includes a touch panel.
The operation unit 104 outputs an operation signal to the control unit 102 in accordance with an operation performed on an operation element or an operation device. The control unit 102 executes a predetermined process according to the input operation signal.
The display unit 105 displays an image under the control of the control unit 102.

[Configuration example of electronic flyer server]
A configuration example of the electronic flyer server 200 according to the present embodiment will be described with reference to FIG. The electronic flyer server 200 shown in FIG. 1 includes a communication unit 201, a control unit 202, and a storage unit 203.
The communication unit 201 performs communication with the terminal device 100 via the network 300.

  The control unit 202 executes various controls for realizing the function as the electronic flyer server 200. The function as the control unit 202 is realized by, for example, a CPU constituting the control unit 202 executing a program stored in the storage unit 203.

  The control unit 202 according to the present exemplary embodiment includes an electronic flyer distribution unit 221 and a character unit corresponding to distribution of an electronic flyer, character recognition for a flyer partial image, and information processing for a character recognition result. A recognition unit 222 and an information processing unit 223 are provided.

  The electronic flyer distribution unit 221 distributes (transmits) the distribution data of the electronic flyer stored in the electronic flyer storage unit 231 of the storage unit 203 from the communication unit 201 to the terminal device 100 via the network 300.

The character recognition unit 222 performs character recognition on the flyer partial image indicated by the flyer partial image information acquired by the flyer partial image information acquisition unit 122 of the terminal device 100.
The flyer partial image information acquisition unit 122 in the terminal device 100 described above generates the flyer partial image information indicating the flyer partial image selected by the flyer cutout operation, and transmits the generated flyer partial image information to the electronic flyer server 200. Send to.
The character recognition unit 222 receives the handbill partial image information transmitted from the terminal device 100 as described above. The received handbill partial image information includes an electronic handbill ID indicating the electronic handbill from which the corresponding handbill partial image is acquired, and information indicating the position and size of the handbill partial image in the acquired handbill electronic flyer. .
Therefore, the character recognizing unit 222 acquires, from the electronic flyer storage unit 231, image data of the electronic flyer indicated by the same electronic flyer ID included in the flyer partial image information. The character recognition unit 222 acquires a portion corresponding to the position and size included in the handbill partial image information in the acquired electronic flyer image data. In this way, the character recognition unit 222 acquires the flyer partial image indicated by the flyer partial image information.
Then, the character recognizing unit 222 performs character recognition on the flyer partial image acquired as described above.

  The character recognition unit 222 in the present embodiment obtains a character string related to the purchase target product included in the purchase target product information by performing character recognition on the flyer partial image. Specifically, in correspondence with the example described with reference to FIG. 4, the character recognition unit 222 acquires a character string indicating each of the product name and the price of the purchase target product as a character recognition result.

The information processing unit 223 performs a predetermined process using the character recognition result by the character recognition unit 222.
Specifically, the information processing unit 223 according to the present embodiment causes the character string related to the purchase target product to be included as attribute information in the purchase target product information managed by the purchase target product information management unit 123 in the terminal device 100. To control.

For this purpose, the information processing unit 223 transmits the character string related to the purchase target product acquired as the character recognition result by the character recognition unit 222 to the terminal device 100 as registration attribute information.
As a specific example, in correspondence with FIG. 4, the registration attribute information transmitted by the information processing unit 223 includes a character string of “cabbage” indicating the content of the attribute as “product name”, and the attribute of “price” Includes a character string of "98 yen" indicating the content.

The terminal device 100 inputs the character string for each attribute indicated by the received registration attribute information into the input box of the corresponding input item on the registration confirmation screen as illustrated in FIG. Thereby, the character string corresponding to the attribute related to the purchase target product is included in the purchase target product information.
As described above, the information processing unit 223 in the electronic flyer server 200 of the present embodiment transmits the registration attribute information so that the character string corresponding to the attribute related to the purchase target product is included in the purchase target product information. Control is implemented.

The storage unit 203 stores various information used by the control unit 202, in addition to programs executed by the control unit 202.
The storage unit 203 includes an electronic flyer storage unit 231 and a dictionary storage unit 232.
The electronic flyer storage unit 231 stores electronic flyer distribution data distributed by the electronic flyer distribution unit 221.
The dictionary storage unit 232 stores a dictionary. The dictionary stored in the dictionary storage unit 232 includes, for example, a similar character string dictionary and an attribute dictionary as dictionaries.
The similar character string dictionary is, for example, a dictionary in which similar character strings are associated with each word or morpheme. This is a dictionary used by the character recognition unit 222 for character recognition. As an example, in the similar character string dictionary, the word “ramen” includes a character string that is likely to be obtained when incorrect character recognition is performed, such as “rameso” and “ram Xin”. Correlated. When the character recognition unit 222 refers to the similar character string dictionary, the probability that a correct character string can be determined as the recognition result even when the character recognition result is incorrect increases.
The attribute dictionary is a dictionary that indicates various attributes for each word and morpheme. The attribute dictionary is used, for example, when the information processing unit 223 specifies an attribute to which a character string obtained as a result of character recognition by the character recognition unit 222 corresponds.

[Processing procedure example]
Next, an example of a processing procedure executed by the terminal device 100 and the electronic flyer server 200 in connection with registration of a purchase target product will be described with reference to a flowchart of FIG.
First, an example of a processing procedure executed by the terminal device 100 will be described. The processing of the terminal device 100 shown in FIG. 4 starts from the stage where the operation of the determination button BT11 is performed as described in FIG. 4 and the area of the flyer partial image selected by the flyer cutout operation is determined. Be started.

  The purchase target product information management unit 123 in the terminal device 100 transmits the flyer partial image information indicating the flyer partial image selected by the flyer cutout operation to the electronic flyer server 200 (step S101).

  In response to the transmission of the flyer partial image information in step S101, the electronic flyer server 200 transmits the registration attribute information. As described above, the registered attribute information is information indicating each attribute such as a product name and a price of a purchase target product corresponding to the flyer partial image indicated by the flyer partial image information transmitted in step S101.

In response to receiving the registration attribute information transmitted from the electronic flyer server 200, the purchase target product information management unit 123 displays a registration confirmation screen on the display unit 105 as illustrated in FIG. 5 (step S102). .
In displaying the registration confirmation screen in step S102, the purchase target product information management unit 123 uses the flyer partial image selected in step S101 and the registration attribute information received from the electronic flyer server 200.
That is, the purchase target product information management unit 123 displays the flyer partial image selected in step S101 for the registration confirmation image P2.
In addition, the purchase target product information management unit 123 inputs a character string as a product name included in the registration attribute information for the input box Bx1 corresponding to the product name.
In addition, the purchase target product information management unit 123 inputs the character string of the attribute as the price included in the registered attribute information for the input box Bx3 corresponding to the price.
In addition, the purchase target product information management unit 123 inputs a character string as the store name of the input box Bx4 using the information of the store name of the advertising source indicated in the distribution data of the electronic flyer from which the flyer partial image is obtained. Can be.

Then, after displaying the registration confirmation screen in step S102, the purchase target product information management unit 123 executes the following processing in response to a registration operation (operation on the registration button BT22).
In other words, in response to the registration operation, the purchase target product information management unit 123 stores the leaflet partial image displayed on the registration confirmation image P2 and the attribute for each attribute input to each of the input boxes Bx1 to Bx4. Newly generate purchase target product information including a character string. Then, the purchase target product information management unit 123 stores the generated purchase target product information in the purchase target product information storage unit 131 (Step S103).
By storing the purchase target product information in the purchase target product information storage unit 131 in this way, the purchase target product is registered.

Next, an example of a processing procedure executed by the electronic flyer server 200 will be described with reference to FIG. In the electronic flyer server 200, in response to receiving the flyer partial image information transmitted from the terminal device 100 in step S101, the character recognition unit 222 stores the flyer partial image indicated by the received flyer partial image information in the electronic flyer storage unit. 231 (step S201).
Next, the character recognizing unit 222 performs character recognition on the flyer partial image acquired in step S201 (step S202). At this time, the character recognition unit 222 can determine the character string as a character recognition result by referring to the similar character string dictionary stored in the dictionary storage unit 232 as described above.
The information processing unit 223 analyzes the characters obtained by the character recognition in step S202, and acquires, for example, a character string corresponding to each attribute related to the purchase target product (step S203). At this time, the information processing unit 223 refers to the attribute dictionary stored in the dictionary storage unit 232 and can specify the character string corresponding to the product to be purchased among the character strings recognized in step S202. it can. Thus, in step S203, a character string corresponding to each attribute is obtained.
Then, the information processing unit 223 transmits the registered attribute information including the character string for each attribute acquired in Step S203 to the terminal device 100 (Step S204).

  By executing the processing shown in FIG. 10 in this way, the purchase target product information is registered in the terminal device 100 in accordance with the flyer cutout operation for the electronic flyer displayed on the terminal device 100. Then, at this time, the character recognition for the flyer partial image is performed, so that the user does not perform a character input operation, and the attribute information by the character string indicating the product name, the price, etc. of the purchase target product is included in the purchase target product. Can be

In the above description, the browsing of the electronic flyer and the registration and management of the purchase target product according to the flyer clipping operation in the terminal device 100 are performed by the electronic flyer browsing application and the purchase target product management application, respectively. ing.
However, for example, one application in which the function of the electronic flyer browsing application and the function of the purchase target product management application are integrated may be mounted on the terminal device 100. In this case, the browsing of the electronic flyer on the terminal device 100 and the registration and management of the product to be purchased according to the flyer cutout operation can be realized by one application.

<Second embodiment>
[Example of outline of operation procedure of each device in electronic flyer information processing system]
Subsequently, a second embodiment will be described. In the first embodiment, the result of character recognition performed by the electronic flyer server 200 for the flyer partial image selected by the terminal device 100 is attribute information to be included in purchase target product information managed by the terminal device 100. Was used as.
In the second embodiment, for example, similarly to the first embodiment, the registration of the purchase target product information may be performed in the terminal device 100 in accordance with the flyer cutout operation. Then, in the second embodiment, the result of character recognition performed by the electronic flyer server 200 on the flyer partial image is used for data analysis.

With reference to FIG. 11, an example of an outline of an operation procedure executed for data analysis by the electronic flyer information processing system in the present embodiment will be described. The following description will be made according to the procedures 1 to 6 shown in FIG.
First, distribution of an electronic flyer as procedure 1 shown in FIG. 11 and clipping of an electronic flyer as procedure 2 (selection of a flyer partial image according to a flyer clipping operation) are the same as those in FIG. Also, the transmission of the flyer partial image information from the terminal device 100 to the electronic flyer server 200 as the procedure 3 is the same as that in FIG.

Also, in the character recognition process in step 4, the electronic flyer server 200 obtains a character string related to the product from the recognized individual character by morphological analysis, reference to a dictionary, or the like, as in the case of FIG. do it.
In the first embodiment, a character string corresponding to an attribute included in purchase target product information, such as “product name” and “price”, is acquired as a character recognition result. On the other hand, if the electronic flyer server 200 in the second embodiment recognizes a character string classified other than the attribute information included in the purchase target product information, the electronic flyer server 200 acquires such a character string as well. Good.
Specifically, as a character string that is classified in addition to the attribute information included in the purchase target product information, for example, words that promote the desire to purchase, such as “Daily Sale”, “Super Special Price”, and “Limited Items” (catch copy ( advertising slogan).

  Step 5: The electronic flyer server 200 accumulates character recognition result information indicating the character recognition result obtained by the character recognition in step 4. The electronic flyer server 200 stores, for example, character recognition result information corresponding to each flyer partial image. The stored character recognition result information is also associated with the user ID of the user of the terminal device 100 that has performed the flyer clipping operation on the corresponding flyer partial image.

  Step 6: The electronic flyer server 200 executes data analysis using the character recognition result information accumulated so far. The mode of data analysis is not particularly limited, and is various. A specific example of data analysis in the present embodiment will be described later.

[Configuration example of electronic flyer server]
Next, a configuration example of the electronic flyer server 200 according to the present embodiment will be described with reference to FIG. In this figure, the same parts as those in FIG.

9, the control unit 202 further includes an information accumulation control unit 224 in addition to the configuration of FIG.
The information storage control unit 224 causes the character recognition result information storage unit 233 in the storage unit 203 to store character recognition result information indicating the character recognition result by the character recognition unit 222. Each time the character recognition unit 222 obtains the character recognition result information, the information storage control unit 224 causes the character recognition result information storage unit 233 to store the character recognition result information, thereby accumulating the character recognition result information.

The storage unit 203 further includes a character recognition result information storage unit 233 in addition to the configuration shown in FIG. The character recognition result information storage unit 233 stores character recognition result information.
The character recognition result information storage unit 233 stores the character recognition result information in the form of a character recognition result information table.

FIG. 13 shows a structural example of a character recognition result information table stored in the character recognition result information storage unit 233.
In the character recognition result information table shown in the figure, one line (one record) corresponds to one flyer partial image targeted for character recognition.
The record corresponding to one flyer partial image stores flyer partial image information, a user ID, an acquisition date and time, and character recognition result information.
The flyer partial image information is flyer partial image information indicating a corresponding flyer partial image. The flyer partial image information is transmitted from the terminal device 100 and indicates an electronic flyer ID indicating the electronic flyer of the acquisition source, and the position and size of the corresponding flyer partial image in the electronic flyer. That is, the corresponding flyer partial image is uniquely specified by the flyer partial image information.

The user ID is an identifier that uniquely indicates the user of the terminal device 100 that has transmitted the corresponding flyer partial image. The user ID stored in the character recognition result information table may be, for example, a user ID registered corresponding to the purchase target product management application.
The terminal device 100 according to the present embodiment transmits the user ID together with transmitting the flyer partial image information according to the procedure 3 in FIG. The character recognition result information table stores the user ID transmitted together with the flyer partial image information.

The acquisition date and time indicates the date and time when the corresponding flyer partial image was acquired. Specifically, the acquisition date and time may be, for example, the date and time when the flyer partial image information was transmitted to the electronic flyer server 200 in accordance with the procedure 3 in FIG.
The character recognition result information is information indicating the character recognition result for the corresponding flyer partial image. The character recognition result information is information indicating, for example, a word (character string) recognized by character recognition and a classification result (for example, a product name, a price, a catch phrase, etc.) corresponding to each word.
The configuration of the terminal device 100 in the present embodiment may be the same as that in FIG.

[Example of data analysis]
The information processing unit 223 in the electronic flyer server 200 of the present embodiment executes data analysis using the character recognition result information stored in the character recognition result information storage unit 233. The following is a specific example of data analysis.
The information processing unit 223 can predict the number of products sold on the electronic flyer during a period in which the electronic flyer is valid, as data analysis using the character recognition result information. Such a prediction result can be reflected, for example, in determining the number of purchased products.

In addition, the information processing unit 223 can estimate a purchase tendency of a product for each user as data analysis using the character recognition result information.
For example, the information processing unit 223 can determine which store, at what store, and at what price, one user is likely to be purchased.
In addition, the information processing unit 223 can also estimate a purchase tendency of a product for each store. Such an estimation result of the sales tendency can be used as a reference for future price setting in the store.
Further, the information processing unit 223 can also select an electronic flyer to be delivered to the user by using a tendency of purchasing a product for each user.

  The information processing unit 223 may specify, for example, a plurality of users (approximate users) having similar purchase target products. Then, the electronic flyer server 200 may enable the information of the partial flyer image to be shared between the approximate users. That is, the electronic flyer server 200 can distribute the partial flyer image selected by a certain approximate user to the terminal device 100 of another approximate user. When distributing the partial flyer image, information such as the corresponding product name, price, and store name is also transmitted, so that the terminal device 100 of another approximate user displays the partial flyer image, and displays the product name, price, and store name. It is preferable that such information as is also displayed.

In addition, the information processing unit 223 may use the character recognition result information to specify an area where a large number of users have performed a flyer clipping operation in one electronic flyer. Then, the electronic flyer server 200 may generate distribution data of the electronic flyer in which the specified area is highlighted as the area where the popular product is posted, and may distribute the distribution data.
Thereby, when an electronic flyer is displayed on the terminal device 100, a popular product can be highlighted on the image of the electronic flyer.
The data analysis using the character recognition result information and the mode of using the data analysis result are not limited to the contents described above.

In the second embodiment, as described above, registration of purchase target product information may be performed in the terminal device 100 in response to a flyer cutout operation as in the first embodiment. In this case, the transmission of the flyer partial image information according to the flyer clipping operation may be performed by the purchase target product management application.
In the second embodiment, a flyer partial image corresponding to a flyer cutout operation may be stored in the electronic flyer server 200 without registering purchase target product information. In this case, the acquisition of the flyer partial image and the transmission of the flyer partial image information according to the flyer clipping operation may be performed by the electronic flyer browsing application.

<Third embodiment>
[Example of outline of operation procedure of each device in electronic flyer information processing system]
Subsequently, a third embodiment will be described. In the third embodiment, based on character recognition result information obtained for the flyer partial image indicated by the flyer partial image information transmitted from the terminal device 100, attribute information indicating the attribute of the flyer partial image (flyer partial image Attribute information) is generated. Then, the generated attribute information is added as metadata (tag) of the electronic flyer from which the flyer partial image is obtained.

With reference to FIG. 14, an example of an outline of an operation procedure executed by the electronic flyer information processing system according to the present embodiment for adding metadata to the electronic flyer will be described. The following description is made in accordance with Procedures 1 to 6 shown in FIG.
First, the distribution of the electronic flyer as the procedure 1 shown in FIG. 14 and the clipping of the electronic flyer as the procedure 2 are the same as those in FIG. Also, the transmission of the flyer partial image information from the terminal device 100 to the electronic flyer server 200 as the procedure 3 is the same as that in FIG.
Also, in the character recognition process as the procedure 4, the electronic flyer server 200 performs, for example, a morphological analysis or a similar character string dictionary stored in the dictionary storage unit 232 from the recognized individual characters, as in the case of FIG. What is necessary is just to acquire a character string related to the product by reference or the like.

Step 5: Then, the electronic flyer server 200 associates the obtained character string with any one of a plurality of predetermined attributes according to, for example, a predetermined algorithm. At this time, for example, the electronic flyer server 200 can specify the attribute corresponding to the character string by referring to the attribute dictionary stored in the dictionary storage unit 232, and associate the character string with each specified attribute.
By such a process, depending on the procedure 4, each of the character strings recognized by the character recognition is generated as attribute information (flyer partial image attribute information) indicating an attribute related to the flyer partial image.

  Step 6: Then, the electronic flyer server 200 adds the generated flyer partial image attribute information as metadata of the electronic flyer from which the corresponding flyer partial image is obtained.

The configurations of the terminal device 100 and the electronic flyer server 200 in the present embodiment may be the same as those in FIGS.
In addition, the information processing unit 223 of the electronic flyer server 200 according to the present embodiment performs a predetermined process using the character recognition result on the basis of the character string recognized by the character Attribute information (flyer partial image attribute information) to be generated. Then, the information processing unit 223 performs control so that the generated flyer partial image attribute information is added as metadata to the electronic flyer.

The distribution data of the electronic flyer stored in the electronic flyer storage unit 231 according to the present embodiment has a structure in which metadata is added to the image data of the electronic flyer.
FIG. 15 shows an example of the structure of flyer partial image attribute information added as metadata of electronic flyer image data in distribution data corresponding to one electronic flyer stored in the electronic flyer storage unit 231. The flyer partial image attribute information shown in the drawing is an example of the flyer partial image attribute information added to the electronic flyer with the electronic flyer ID = 0000001.

In the structure shown in the drawing, one row (record) is flyer partial image attribute information corresponding to one flyer partial image.
The flyer partial image attribute information is associated with the position and size of the corresponding flyer partial image. The area occupied by the flyer partial image in the corresponding electronic flyer is specified by the combination of the position and the size.

The leaflet partial image attribute information stores a plurality of attributes such as attribute 1, attribute 2, attribute 3, and so on, as illustrated in FIG. In the example of FIG. 7, the attribute 1 indicates the classification of the corresponding product. Attribute 2 indicates the product name of the corresponding product. Attribute 3 indicates the price of the corresponding product. As described above, the information for each attribute is obtained by the information processing unit 223 based on the result of character recognition by the character recognition unit 222.
In the present embodiment, such flyer partial image attribute information is included as metadata in the distribution data of the electronic flyer. Then, the flyer partial image attribute information included in the distribution data of the electronic flyer increases as the flyer partial image information is transmitted from a large number of users. As a result, the metadata as flyer partial image attribute information in the distribution data of the electronic flyer stored in the electronic flyer server 200 is enriched by the user's flyer clipping operation.

[Example of electronic flyer server processing procedure]
Subsequently, an example of a processing procedure for the electronic flyer server 200 of the present embodiment to add the flyer partial image attribute information to the electronic flyer will be described with reference to a flowchart of FIG. Note that, in the figure, steps that are the same as those in FIG. 10 are denoted by the same reference numerals.

  The character recognition unit 222 in the electronic flyer server 200 acquires the flyer partial image indicated by the flyer partial image information received from the terminal device 100 from the electronic flyer storage unit 231 (Step S201). The character recognition unit 222 performs character recognition on the flyer partial image obtained in step S201 (step S202).

Then, the information processing unit 223 generates flyer partial image attribute information using the character recognition result in step S202 (step S211). That is, as described above, the information processing unit 223 associates the character string acquired as the character recognition result with any one of a plurality of predetermined attributes. The character string associated with the attribute in this manner is the flyer partial image attribute information.
Then, the information processing section 223 adds the flyer partial image attribute information generated in step S211 as metadata of the electronic flyer (step S222). That is, the information processing unit 223 stores the flyer partial image attribute information generated in step S211 in the electronic flyer storage unit 231 so as to be included in the distribution data of the electronic flyer from which the flyer partial image obtained in step S201 is obtained. Let it.

[Example of using leaflet partial image attribute information]
The flyer partial image attribute information included as metadata in the distribution data of the electronic flyer as described above can be used as follows.
For example, the flyer partial image attribute information included as metadata in the distribution data of the electronic flyer can be used for a search for the electronic flyer by the user.
That is, the user inputs search conditions for searching for an electronic flyer by operating the terminal device 100. As the search condition, for example, a product name such as "cabbage" can be input. Further, any two or more search conditions such as a product name, a price (for example, a price range, an upper limit price, a lower limit price, and the like), a store name, and the like may be combined and input. .

After inputting the search conditions as described above, the terminal device 100 transmits the search conditions to the electronic flyer server 200 in response to the user performing an operation for instructing the search. The electronic flyer server 200 acquires from the electronic flyer storage unit 231 distribution data of the electronic flyer having metadata (flyer partial image attribute information) that matches the received search condition. The electronic flyer server 200 transmits the obtained distribution data of the electronic flyer to the terminal device 100.
The terminal device 100 causes the display unit 105 to display the received distribution data of the electronic flyer as a search result.
Note that the electronic flyer server 200 transmits a leaflet partial image (and corresponding leaflet partial image attribute information) having metadata (flyer partial image attribute information) that matches the received search condition to the terminal device 100 as a search result. Can also.
As described above, by using the flyer partial image attribute information included as metadata in the distribution data of the electronic flyer, it is possible to search for an electronic flyer on which a product that meets a condition desired by the user is posted.

In addition, by receiving the distribution data of the electronic flyer, the terminal device 100 of the present embodiment can also receive the flyer partial image attribute information together with the electronic flyer image data.
Therefore, when a flyer partial image is selected from the electronic flyer by the flyer cutout operation, the purchase target product information management unit 123 in the terminal device 100 adds the flyer partial image attribute information corresponding to the selected flyer partial image to the distribution data. It is determined whether or not it is included. If the leaflet partial image attribute information is included, the purchase target product information management unit 123 acquires the leaflet partial image attribute information corresponding to the selected flyer partial image. By using the leaflet partial image attribute information acquired in this way, the purchase target product information management unit 123, for example, on the registration confirmation screen shown in FIG. You can enter a character string in the input box for name, price, etc.).

Then, the purchase target product information management unit 123 generates purchase target product information including the acquired flyer partial image attribute information in accordance with the user's registration operation of the purchase target product, and stores the generated purchase target product information in the purchase target product information. It is stored in the product information storage unit 131.
That is, the terminal device 100 according to the third embodiment registers a character string as an attribute such as a product name and a price to be included in the purchase target product information when registering the purchase target product, with the leaflet partial image included in the electronic flyer distribution data. Can be obtained from attribute information. In this case, the terminal device 100 does not need to transmit the flyer partial image information for registering the purchase target product.

Note that, in the third embodiment as well, similar to the first embodiment, the registration of the purchase target product information may be performed in the terminal device 100 in accordance with the flyer cutout operation. In this case, the transmission of the flyer partial image information according to the flyer clipping operation may be performed by the purchase target product management application.
Also in the third embodiment, the transmission of the flyer partial image information to the electronic flyer server 200 according to the flyer clipping operation may be performed without registering the purchase target product information. In this case, the acquisition of the flyer partial image and the transmission of the flyer partial image information according to the flyer clipping operation may be performed by the electronic flyer browsing application.

  In each of the above embodiments, the electronic flyer server 200 includes a server having a function of distributing an electronic flyer, and a server which performs character recognition on a flyer partial image and executes information processing according to the character recognition result. May be divided. That is, the electronic flyer distribution server including the electronic flyer distribution unit 221 and the information processing server including the character recognition unit 222 and the information processing unit 223 may be separated.

  In each of the above embodiments, the character recognition is executed by the electronic flyer server 200. However, the terminal device 100 may be configured to execute character recognition. In the case of such a configuration, it is possible to complete the terminal device 100 alone and input a product name, a price, and the like into the input boxes Bx1, Bx3, etc. shown in FIG. That is, in the case of the first embodiment, the configuration of the electronic flyer information processing system of the present embodiment including the character recognition unit 222 and the information processing unit 223 can be realized by the terminal device 100 alone.

  In the case of the second embodiment, the terminal device 100 performs character recognition, and the electronic flyer server 200 performs data analysis using the character recognition result transmitted from the terminal device 100. can do. Similarly, in the case of the third embodiment, the terminal device 100 performs character recognition, and the electronic flyer server 200 uses the character recognition result transmitted from the terminal device 100 to generate an electronic flyer of the flyer partial image attribute information. It can be configured to execute a process for giving to the user.

  A program for realizing the functions of the terminal device 100 or the electronic flyer server 200 in each of the above embodiments is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read by a computer system. , The process as the terminal device 100 or the electronic flyer server 200 described above may be performed. Here, "to make the computer system read and execute the program recorded on the recording medium" includes installing the program in the computer system. The “computer system” here includes an OS and hardware such as peripheral devices. Further, the “computer system” may include a plurality of computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, and a dedicated line. The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in a computer system. As described above, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The recording medium also includes an internal or external recording medium accessible from the distribution server for distributing the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by the terminal device. That is, any format can be stored in the distribution server as long as it can be downloaded from the distribution server and installed in a form executable by the terminal device. The program may be divided into a plurality of programs, downloaded at different timings, and then combined by the terminal device, or the distribution server that distributes each of the divided programs may be different. Further, the “computer-readable recording medium” holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system serving as a server or a client when the program is transmitted via a network. Shall be included. Further, the program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

Reference Signs List 100 terminal device, 101 communication unit, 102 control unit, 103 storage unit, 104 operation unit, 105 display unit, 121 electronic flyer browsing control unit, 122 flyer partial image information acquisition unit, 123 purchase target product information management unit, 131 purchase target Product information storage unit, 200 electronic flyer server, 201 communication unit, 202 control unit, 203 storage unit, 221 electronic flyer distribution unit, 222 character recognition unit, 223 information processing unit, 224 information storage control unit, 231 electronic flyer storage unit, 232 dictionary storage unit, 233 character recognition result information storage unit

Claims (5)

A flyer partial image for acquiring flyer partial image information indicating the selected flyer partial image in response to a flyer partial image selecting operation for selecting a part of the electronic flyer image as a flyer partial image being performed on the terminal device. An information acquisition unit;
A character recognition unit that performs character recognition on the flyer partial image indicated by the flyer partial image information acquired by the flyer partial image information acquisition unit, and acquires a character string related to the purchase target product as a character recognition result,
The character string acquired by the character recognition unit is output as a changeable character string that can be changed, and purchase target product information including the change target character string as attribute information related to the purchase target product is stored in the storage unit. and a purchase target product information management unit which,
The purchase target product information management unit,
An electronic flyer information processing system for displaying, on a terminal device, a screen on which an operation for changing the change target character string is possible, the screen including the change target character string and a flyer partial image targeted for character recognition . The purchase target product information management unit,
The electronic handbill information processing system according to claim 1 , wherein on the screen, a character string associated with the purchase target product acquired by a character recognition unit is presented in association with a predetermined attribute of the purchase target product. Electronic flyer information processing system according to claim 1 or 2 further comprising an information processing unit for acquiring a character string corresponding to each attribute associated with the purchased item from among the characters example recognized by the character recognition unit. A character string recognized by performing character recognition on a flyer partial image, which is a partial image selected from the electronic flyer image, is output as a changeable character string that can be changed, and the changeable character string is output. A purchase target product information management unit that stores purchase target product information including attribute information related to the purchase target product in the storage unit ,
The purchase target product information management unit,
A terminal device for displaying a screen on which an operation of changing the change target character string is possible, the screen including the change target character string and a handbill partial image targeted for character recognition . Computer
A character string recognized by performing character recognition on a flyer partial image, which is a partial image selected from the electronic flyer image, is output as a changeable character string that can be changed, and the changeable character string is output. Is a program for causing a storage unit to store purchase target product information including attribute information related to the purchase target product as a purchase target product information management unit .
The purchase target product information management unit,
A program for displaying a screen on which an operation of changing the change-target character string is possible, the screen including the change-target character string and a handbill partial image targeted for character recognition .

Images