JP6562441B2 - Marking determination device, purchase / sales support device, marking determination system, purchase / sales support system, marking determination method and program - Google Patents

Description

  The present invention relates to a marking determination device, a purchase sales support device, a marking determination system, a purchase sales support system, a marking determination method, and a program.

  In recent years, business models using the Internet have been created. As the business model, for example, there is a system in which products can be purchased at a shopping site on the Internet. In recent shopping sites, for example, as described in Patent Document 1, a product that has the same attributes as a product purchased by the user is presented to the user as a product that suits the user's preference, and the product is presented to the user. Various ideas have been made, such as incentives to purchase.

JP 2012-198716 A

  However, recent net systems for purchase are not considered for elderly people who are not familiar with the operation of terminals such as personal computers or smartphones. For this reason, an elderly person etc. will be excluded from the object of a purchase net system. Here, there is an actual situation that elderly people and the like often look at advertisement media using paper such as leaflets. Therefore, if a net system for purchasing can be constructed by utilizing advertising media using paper media, even a person who is not familiar with terminal operations such as the elderly can purchase through the net system. .

  Therefore, an object of the present invention is to provide a marking determination device and a marking determination method that are useful for constructing a purchasing net system by utilizing an advertisement medium using a paper medium.

In order to achieve the above object, the marking determination apparatus of the present invention provides:
Image data storage means for storing paper medium image data in advance in association with the identification mark;
Image data acquisition means for acquiring paper medium image data with an identification mark that is a marking determination target;
By comparing the acquired identification mark of the paper medium image data with the identification mark of the paper medium image data stored in the storage means, the identification information stored in the storage means coincides with the acquired paper medium image data. Paper medium image data specifying means for specifying paper medium image data;
Marking information acquisition means for acquiring marking information of the acquired paper medium image data by the difference processing of the both paper medium image data;
Marking information judging means for judging the meaning of the acquired marking information;
including.

The marking judgment method of the present invention is:
An image data storage step for storing paper medium image data in advance in association with an identification mark;
An image data acquisition step for acquiring paper medium image data with an identification mark that is a marking determination target;
The paper medium stored in the storage step that matches the acquired paper medium image data by collating the identification mark of the acquired paper medium image data with the identification mark of the paper medium image data stored in the storage step A paper medium image data specifying step for specifying image data;
A marking information acquisition step of acquiring marking information of the acquired paper medium image data by the difference processing of the both paper medium image data;
A marking information judging step for judging the meaning of the acquired marking information;
It is characterized by including.

  According to the marking determination apparatus and the marking determination method of the present invention, it can be useful for constructing a purchasing net system by utilizing a paper medium advertising medium.

FIG. 1 is a block diagram illustrating an example of a marking determination system according to the present invention. FIG. 2 is a block diagram showing a configuration of an example of the marking determination apparatus of the present invention. 3A to 3D are explanatory views showing an example of the alignment detection means of the present invention. 4A to 4B are explanatory views showing an example of the marking information judging means of the present invention. FIG. 5 is a block diagram showing a configuration of an example of the marking information management device of the present invention. FIG. 6 is a block diagram showing a configuration of an example of the user determination device of the present invention. FIG. 7 is a flowchart showing an example of the marking determination method of the present invention. FIG. 8 is a flowchart showing an example of the marking information management method of the present invention. FIG. 9 is a flowchart showing the configuration of an example of the user determination method of the present invention. FIG. 10 is a flowchart showing an example of the purchase and sales support method of the present invention. FIGS. 11A to 11C show a part of a flow of an example of the purchase and sales support method of the present invention. 12A to 12D show a part of a flow of an example of the purchase and sales support method of the present invention. FIGS. 13A to 13D show a part of a flow of an example of the purchase and sales support method of the present invention. 14A to 14E show a part of a flow of an example of the purchase and sales support method of the present invention. FIGS. 15A to 15B show a part of a flow of another example of the purchase and sales support method of the present invention.

  Next, the marking determination device, the purchase sales support device, the marking determination system, the purchase sales support system, the marking determination method, and the program according to the present invention will be described with examples. However, the present invention is not limited to the following description. In the following FIGS. 1 to 15, the same parts are denoted by the same reference numerals, and the description thereof may be omitted.

[Embodiment 1]
(Marking judgment system)
FIG. 1 is a block diagram illustrating a configuration of an example of the marking determination system 10 according to the present embodiment. As shown in the figure, in the present system 10, a server 6 including a marking determination device 1, a marking information management device 2, and a user determination device 3, a user terminal 4, and a paper medium provider terminal (provider terminal) 5. And including. As illustrated, the server 6, the user terminal 4, and the provider terminal 5 can be connected via a communication network 7. The communication line network 7 is not particularly limited, and a known communication line network can be used. Specific examples include an Internet line, a telephone line, a LAN (Local Area Network), and the like, and may be wireless or wired. But you can. Examples of the user terminal 4 include a mobile phone, a smartphone, a personal computer (PC) and a tablet terminal, a scanner, and the like provided with image capturing means such as a CCD (Charge Coupled Device) camera and a CMOS (Complementary Metal Oxide Semiconductor) camera. Can be mentioned. Examples of the provider terminal 5 include a mobile phone, a smartphone, a personal computer (PC), a tablet terminal, a telephone, and a fax machine. In the present embodiment, the marking information management device 2, the user determination device 3, and the user terminal 4 are optional components.

  In this system 10, the user is not particularly limited. For example, an elderly person in a depopulated area, an elderly person who is unfamiliar with computer operation, an elderly person or a person with a disability who receives support at a meeting place, a resident in a residential area, an interview People, supporters, investigators, etc. On the other hand, the provider is not particularly limited, and examples thereof include a local private store trader, a production / sale company, a trader who operates a retail business in a shopping street, a supermarket, an interviewer, a volunteer, a researcher, and the like.

  In the system 10, the paper medium is not particularly limited, and for example, advertising paper media such as flyers, posters, catalogs, questionnaire paper, scoring paper, recruitment paper, entry paper such as diagnostic paper, purchase paper, survey paper, etc. , Electronic paper, plastic board, etc., preferably the advertising medium, more preferably a flyer.

  In the present system 10, the image of the paper medium preferably includes four corners of the entire paper medium. Moreover, it is preferable that the four corners are not hidden by a mark attached by the user. The image on the paper medium is preferably free from blur or distortion, and it is preferable that no image that adversely affects reading of image data is added to the image.

  In the present system 10, the marking information is not particularly limited. For example, the marking information is a mark or a character entered by the user with a pen, pencil, fountain pen, highlighter pen, or the like on the paper medium. Although it does not restrict | limit especially as said mark, For example, numbers, such as a round mark, a cross mark, a check, a diagonal line, a strikethrough, these combinations, etc., a positive mark, a Chinese numeral, an Arabic numeral, and a Roman numeral. Although it does not restrict | limit especially as said character, For example, letters, such as an alphabet, hiragana, and katakana, and these combination are mentioned. Specifically, for example, “2 pieces”, “tuna fillet 200 g” and the like can be mentioned. In addition, the marking information may be a combination of the mark and characters. For example, “2 pieces” and “tuna fillet 200 g” may be handwritten on the side of a product selected by a circle. Further, the mark may be a mark uniquely created by a user.

(Marking judgment device 1)
FIG. 2 is a block diagram illustrating a configuration of an example of the marking determination apparatus 1 according to the present embodiment. The apparatus 1 shown in FIG. 1 includes an image data storage unit 11 (hereinafter, simply referred to as a storage unit 11), an image data acquisition unit 12, a paper medium image data specifying unit 13, a positioning unit 14, Marking information acquisition means 15, marking information determination means 16, and marking information transmission means 17 are included. The image data storage means 11 stores paper medium image data in advance in association with the identification mark. The image data acquisition unit 12 acquires paper medium image data with an identification mark that is a marking determination target. The paper medium image data specifying unit 13 compares the acquired paper medium image data identification mark with the identification mark of the paper medium image data stored in the storage unit 11, thereby The paper medium image data stored in the matching storage unit 11 is specified. The alignment unit 14 aligns the acquired paper medium image data with the paper medium image data stored in the specified storage unit 11. The marking information acquisition means 15 acquires the marking information of the acquired paper medium image data by the difference process of the both paper medium image data. The marking information determination unit 16 determines the meaning of the acquired marking information. The marking information transmission means 17 transmits the marking information to the marking information management device 2 via the communication line network 7. The alignment unit 14 and the marking information transmission unit 17 are optional components, and may not be included in the marking determination apparatus of the present invention, but are preferably included. In the case where the apparatus 1 includes the alignment unit 14, the marking information acquisition unit 15 acquires the marking information by the difference processing of the both paper medium image data aligned by the alignment unit 14.

  Examples of the image data storage means 11 include a database or server, a random access memory (RAM), a read only memory (ROM), a hard disk (HD), an optical disk, a floppy (registered trademark) disk (FD), and the like. Further, the image data storage unit 11 may be, for example, a device built-in type or an external type such as an external storage device.

  In the present embodiment, examples of the identification mark include a bar code, a QR code (registered trademark), and a general marker used for image recognition. Examples of general markers used for the image recognition include a position detection marker, a vertical / horizontal detection marker, a character detection marker, and an image pattern detection marker described later. Further, image data may be identified using the entire image of the paper medium as the identification mark.

  In the present embodiment, examples of the paper medium image data include data including the image information and paper medium information.

  Examples of the image information include the entire paper medium and the image size, position data, vertical and horizontal, and image pattern for each area in the paper medium.

  Examples of the paper medium information include paper medium identification information, paper medium description information, paper medium provider information, and the like. Examples of the paper medium identification information include an identification number, a description type name, and a provider name. Examples of the paper medium description information include product information when the paper medium is an advertising medium, and item information described when the paper medium is an entry sheet. Examples of the merchandise information include a merchandise number, a merchandise name, a merchandise shipping location, a shipper, a shipping date, a stock quantity, a product photo image, a unit price, a production location information, a cooking method, and merchandise supplement information. Examples of the item information described include a description item, a unit price, a size, a weight, and an attribute item. Examples of the paper medium provider information include identity information and location information of the paper medium provider. Examples of the identity information include the name of the provider, the name of the representative, and the name of the organization to which the provider belongs. Examples of the location information include a mail address, an address, a telephone number, and a fax number. The paper medium information may be updated periodically.

  An example of the paper medium image data will be specifically described later with reference to FIG.

  Examples of the image data acquiring unit 12 include a unit that acquires an image captured by the image capturing unit of the user terminal 4. For example, if an advertising media image such as a flyer is taken by an imaging means such as a camera and sent by e-mail, the means for receiving the image data, if the entry form such as a questionnaire form is read by a scanner, Examples include means for acquiring the read data.

  As the paper medium image data specifying means 13, the acquired paper medium image data is collated with the identification mark of the obtained paper medium image data and the identification mark of the paper medium image data stored in the storage means 11. Any means may be used as long as it can identify the paper medium image data stored in the storage unit 11 that coincides with.

  Examples of the alignment means 14 include an apparatus that performs alignment using a position identification mark given to the paper medium image data. Examples of the position identification mark include four position detection markers arranged at the four corners of the paper medium.

  In the following, a specific example of means for aligning using the four position detection markers will be described with reference to the explanatory diagrams of FIGS.

  FIG. 3A shows an example of a sheet including a position detection marker. Four position detection markers 32 to 35 are added to the sheet 31 shown in FIG. The position detection markers 32 to 35 are composed of a black outer frame and a blank surrounded by the black outer frame as shown in FIG. Here, among the four corners of each of the position detection markers 32 to 35, the inner corners 32 </ b> A to 35 </ b> A and the four corners of the paper medium are aligned, and the paper medium is arranged on the paper 31. FIG. 4B shows a state when a paper medium is placed on the paper 31. Here, in order to identify each of the position detection markers 32 to 35, the user puts different marks on the margins of the position detection markers 32 to 35 as shown in FIG. In FIG. 5B, for example, the user attaches a color (indicated by hatching in FIG. 5B) to the upper side 32B of the margin of each position detection marker 32-35, and the position detection marker 32- The sides 32C to 35C excluding the upper side of the outer periphery of the 35 margins are respectively given different colors (indicated by hatching in FIG. 5B). Thereby, for example, as shown in FIG. 4D, even if the position of the acquired paper medium image 36 is shifted from the position of the paper medium image 37 stored in the storage unit 11 shown in FIG. Then, it is possible to acquire image data in which the position of the acquired paper medium image 36 is matched with the position of the paper medium image 37 stored in the storage unit 11 (FIG. 5C).

  Examples of the marking information acquisition unit 15 include a unit that determines that the difference detected by the difference process between the aligned both-paper-medium image data is large or that the difference continues is marking information.

  The difference processing is not particularly limited and may be performed according to a general method. For example, the binarization process may be performed by deleting the background image from both the paper medium images. As the binarization processing, for example, when the gray value of each pixel is equal to or greater than a threshold value, the pixel value is set to “1”, the other pixel values are set to “0”, and the pixel value is set. A binarization method and the like can be mentioned.

  The marking information acquisition means 15 is preferably means for acquiring marking information for each area of the acquired paper medium image data.

  In addition, when the paper medium includes a user entry field for a user to input characters, for example, the marking information acquisition unit 15 can acquire the characters input by the user as marking information. preferable. Specifically, for example, the user may input a user name, a registration number, an ID number, and the like. Thereby, for example, the user can input the marking information and the user information all at once, so that the network system can be used with a simpler operation.

  The user entry field includes, for example, a plurality of areas for the user to input the characters one by one.

  The marking information determination unit 16 may be performed in accordance with a general method. For example, the marking information determination unit 16 may be a unit that determines the meaning of the acquired marking information after machine learning has already been performed. Specifically, for example, the teaching data samples shown in FIGS. 4A to 4B may be machine-learned in advance to determine the meaning of the acquired marking information. In FIG. 6A, the above-described means includes marking information 42 to 43 (substantially a round shape), marking information 44 (a rounded shape), marking information 45 (substantially triple cancellation). The shape with a line) is machine-learned, and the acquired marking information 46 to 49 is determined as the meaning of a circle or a cross as shown in FIG.

  The marking information determination means 15 may be a means for determining the meaning of the acquired marking information by shape recognition. Specifically, as the means, for example, when the semantic information is a circle, a certain range may be provided for the shape of the circle, and a shape corresponding to the range may be determined as a circle.

  The marking information transmission unit 17 is not particularly limited, and any unit may be used as long as it is a unit that transmits the marking information to the marking information management apparatus 2 via the communication line network 7.

(Marking information management device)
FIG. 5 is a block diagram illustrating a configuration of an example of the marking information management device 2 according to the present embodiment. The marking information management device 2 shown in the figure includes a marking information storage unit 21, a user terminal transmission unit 22, and a paper medium provider terminal transmission unit 23 as main components. The marking information storage unit 21 stores the marking information received from the marking information transmission unit 17. The user terminal transmission means 22 transmits the marking information to the user terminal. The paper medium provider terminal transmission means 23 receives the information for confirming the marking information from the user terminal 4 for the marking information transmitted to the user terminal 4, and confirms the confirmation to the paper medium provider terminal 5. The marking result information is transmitted.

(User judgment device)
FIG. 6 is a block diagram illustrating a configuration of an example of the user determination device 3 of the present embodiment. The user determination device 3 shown in the figure includes a user information storage unit 51, a user identification unit 52, and a user information transmission unit 53. The user information storage unit 51 stores user information including identification information for identifying the user, and the user specifying unit 52 stores the acquired identification information of the user information and the user information storage unit 51. By collating the identification information of the stored user information, the user information stored in the user information storage unit 51 that matches the acquired user information is specified, and the user information transmission unit 53 The identified user information is transmitted to the marking information management device 2. Then, the marking information storage unit 21 of the marking information management apparatus may store the determined marking information and the corresponding user information as a marking result in association with each other, for example.

  The user information storage unit 51 is not particularly limited, and may be, for example, the one exemplified as the image data storage unit 11. Further, the image data storage unit 11 and the user information storage unit 51 may be the same, or the paper medium image data and the user information may be stored in different areas. .

  The user identification unit 52 compares the acquired identification information of the user information with the identification information of the user information stored in the user information storage unit 51, thereby matching the acquired user information. Any means for identifying user information stored in the information storage means 51 may be used.

  In the present embodiment, the user information includes, for example, a user's name, a representative or group, a user's address, a phone number, a FAX number, location information such as an e-mail address, the user's date of birth, gender, etc. Attribute information, settlement method, delivery method, and the like. The identification information is not particularly limited, and includes a member number, a card number, an ID number, and the like. The user information may be transmitted from the user terminal 1 by an e-mail address or the like, or may be acquired by guiding the user to a registration form on the server using a QR code (registered trademark). It may be acquired by the user registering as a member through the registration form on the server 6, or through the application form for the user to issue an ID or card or the application form on the server 6. You may do it. The method for acquiring the identification information may be acquired, for example, by having the user write in an e-mail address attached with the captured image file, or uploading the captured image to the user on the server 6 The identification information may be obtained by having the user input it. The user may attach identification information to the paper medium. In this case, for example, the marking information determination unit 16 determines the identification information as a mark and the corresponding semantic information as the user identification information.

(Purchase / Sales Support Device)
Next, an example when the marking determination apparatus of this embodiment is applied as a purchase sales support apparatus will be described. However, the present embodiment is not limited to being applied to the purchase and sales support apparatus. In the purchase support apparatus of this embodiment, the marking information determination means of the marking determination apparatus determines the meaning of the acquired marking information as order instruction information.

  The order instruction information is not particularly limited and includes, for example, the order quantity of the marked product, non-order information, order cancellation (cancellation) information, order determination information, and the like.

  The purchase / sales support apparatus may further include ordering means. The ordering unit includes an advertisement medium provider terminal transmitting unit. The advertisement medium provider terminal transmission means transmits the order instruction information to the advertisement medium provider terminal, for example.

  The ordering unit may further include, for example, an order instruction information storage unit and a user terminal transmission unit. The order instruction information storage means stores the order instruction information determined by the marking information determination means in association with user information as an order instruction result. The user terminal transmission means transmits the order instruction result to the user terminal. In this case, the advertisement medium provider terminal transmitting means receives the information confirming the order instruction result from the user terminal for the order instruction result transmitted to the user terminal, for example. Order instruction information may be transmitted to the provider terminal.

(Purchase and sales support system)
In the present embodiment, the purchase / sales support device may be a purchase / sales support system that is one of the components of the system. The purchase / sales support system includes a server including the purchase / sales support device and an advertisement medium provider terminal. The purchase / sale support system may include a user terminal as necessary. The server and both terminals can be connected via a communication network.

(Marking judgment method)
Next, the marking determination method of this embodiment will be described in more detail with reference to the flowchart of FIG. The marking determination method of this embodiment is implemented as follows using the marking determination apparatus 1 of this embodiment shown in FIG. 2, for example. However, the marking determination method of the present embodiment is not limited to using the marking determination device 1.

  First, a paper medium is prepared prior to the implementation of the marking determination method of the present embodiment. Then, the paper medium image data is stored in advance in the database (storage means 11) in association with the identification mark.

  Next, as shown in FIG. 7, the image data acquisition unit 12 acquires paper medium image data with an identification mark as a marking recognition target (paper medium image data acquisition step (S11)). Next, the obtained identification mark of the paper medium image data is collated with the identification mark of the paper medium image data stored in the database 11 (S12-1). When the acquired paper medium image data matches the paper medium image data stored in the database 11 as a result of the collation (YES), the paper medium image data stored in the database 11 is used as the acquired paper medium image data. Data is specified (S12-2). If they do not match (NO), for example, an error is determined and an error message is transmitted to the user terminal 3 (S12-3). In the present embodiment, S12-1 to S12-3 correspond to the paper medium image data specifying step. Next, the alignment means 14 aligns the acquired paper medium image data with the paper medium image data stored in the specified database 11 (alignment step (S13)). In the marking determination method of the present embodiment, the step S13 is an optional step and may not be performed. Next, the marking information acquisition means 15 acquires the marking information of the acquired paper medium image data by the difference processing of the both paper medium image data (marking information acquisition step (S14)). When the step S13 is included, in the step S14, the marking information acquisition unit 15 acquires the marking information of the acquired paper medium image data by the difference processing of the aligned both paper medium image data. Next, the meaning of the acquired marking information is determined by a marking information determination step (marking information determination step (S15)). Next, the marking information transmission means 17 transmits the meaning information of the marking information to the marking information management device 2 (marking information transmission step (S16)). As described above, according to the marking determination method of this embodiment, the user can easily use the network system only by handwriting operation such as a pen and image photographing operation of a paper medium. For example, when the paper medium is a flyer or the like, it can be purchased simply by photographing a product image of a product to be purchased. Further, it is possible to provide a network system that can expand the range of the target layer even for a system provider or a service provider that provides services using the system.

(Marking information management method)
Next, the marking information management method of this embodiment will be described in more detail with reference to the flowchart of FIG. The marking information management method of this embodiment is implemented as follows using the marking information management apparatus 2 of this embodiment shown in FIG. 5, for example. However, the marking information management method of the present embodiment is not limited to using the marking information management device 2.

  The marking information management device 2 manages the marking information determined by the marking determination device according to the following S21 to 23. That is, first, the marking information determined by the marking information determination unit 16 is stored in the marking information storage unit 21 as a marking result (marking information storage step (S21)). Next, the marking result is transmitted to the user terminal by the user terminal transmission means 22 (user terminal transmission step (S22)). Next, when the information for confirming the marking result is received from the user terminal 4 for the marking result transmitted to the user terminal 4 by the paper medium provider terminal transmission unit 23, the provider terminal 5 sends the information to the provider terminal 5 The confirmed marking result is transmitted (paper medium provider terminal transmission step (S23)).

(User judgment method)
Next, the user determination method of this embodiment will be described in more detail with reference to the flowchart of FIG. The user determination method of this embodiment is implemented as follows using the user determination apparatus of this embodiment shown in FIG. 6, for example. The user determination method of the present embodiment is not limited to using the user determination device 3.

  First, prior to the execution of the user determination method, user information including identification information for identifying a user is stored in the user information storage means 51.

  Next, the user specifying means 52 matches the acquired user information by comparing the acquired identification information of the user information with the identification information of the user information stored in the user information storage means 51. The user information stored in the user information storage means 51 is specified (user information specifying step (S31)). Next, the user information transmission means 53 transmits the specified user information to the marking information management device 2 (user information transmission step (S32)). Thereafter, for example, the marking information management apparatus 2 may associate the determined marking information with the corresponding user information and store the marking information in the marking information storage unit 21 as a marking result.

  Next, an example in which the marking determination method of the present embodiment is applied as a purchase sales support method will be described with reference to the flowchart of FIG. However, the marking determination method of the present embodiment is not limited to being applied to the purchase sales support method. In the purchase and sales support determination method of the present embodiment, the paper medium is an advertising medium, and in the marking information determination step, the meaning of the acquired marking information is determined as order instruction information.

  The purchase and sales support method of the present embodiment may further include an ordering process (S41 to S43) as shown in FIG. The ordering step includes an order instruction information storage step (S41), a user terminal transmission step (S42), and an advertisement medium provider terminal transmission step (S43). In S42, the order instruction information determined in the marking information determination step is stored in association with user information as an order instruction result. In S43, the order instruction result is transmitted to the user terminal. S43 transmits the order instruction information to the advertisement medium provider terminal 5 when the information for confirming the order instruction result is received from the user terminal 4 with respect to the order instruction result transmitted to the user terminal 4. In the present embodiment, S41 to S42 do not have to be arbitrary steps. In this case, S43 transmits the order instruction information to the advertisement medium provider terminal.

  The purchase / sales support method of this embodiment may further perform an ordered product delivery process. That is, first, the seller who has received the confirmed order instruction information delivers the ordered product to the user. In this case, the delivery method is not particularly limited, and examples thereof include joint delivery (milk run). In this case, for example, the delivery company may collect the ordered products from each retailer in the shopping street, or may deliver regularly to a residential area or a temporary meeting place. Alternatively, for example, a store such as a supermarket may instruct a delivery plan to a delivery company and perform delivery.

  The purchase / sales support method of the present embodiment may be performed by the seller himself / herself, but may be performed by a third party as a service provider. When the service provider performs, for example, the purchase sales support method may be provided as a cloud service. As a result, for example, a retailer such as a shopping street can describe the product to be sold and instruct the service provider of a flyer, a poster, a catalog, etc. Available as a seller.

  In this case, for example, the service provider may charge the system usage fee from the seller, and may, for example, charge a part of the sales of the product as the system usage fee.

  Below, the specific example at the time of applying the marking judgment method of this embodiment as a purchase sales support method is demonstrated. Below, the paper medium is an advertisement flyer for a wholesale market, the paper medium provider is a wholesale marketer, and the user is an elderly person in a depopulated area or an elderly person supporter. An example will be described with reference to FIGS.

  FIGS. 11A to 11C show a series of flows until the wholesale marketer A has the system provider B register a product to be sold in the database. First, wholesale marketer A sends advertising flyer 101 with a product to be sold to system provider B ((A) in the figure). As shown in FIG. 4B, four markers 102 are added to the four corners of the advertising flyer. The marker 102 is the same as the marker shown in FIG. 3 and functions as a position detection marker and also functions as an identification mark. The advertising flyer is provided with a plurality of areas, in which the product name and price are written. For example, in the area 103, “Bincho tuna block” is described as the product name and “100 yen per 100 g” is described as the price. Then, the staff of the system provider B stores the paper medium image data in the database 104 in association with the marker 102 as shown in FIG. As shown in FIG. 6C, the database 104 includes, as paper medium image data, an advertisement flyer identification number 1184 and overall positions (0, 0), (300, 0), (0, 150), ( 300, 150) are stored. The database 104 also stores image data for each area. For example, as shown in FIG. 2452, the product name “bincho tuna block” and the price “100 yen per 100 g” are the position information (identification data) (150, 130), (150, 150), (170, 150), (170, 130). It is stored in the database 104 in association with identification data.

  12 (A) to 12 (D) show the image data of the marked flyer 105 when an elderly person or an elderly supporter C marks a product to be purchased among the products displayed on the flyer 105 at the meeting place. Shows the flow to send to the server on the system. First, an elderly person or an elderly person supporter C marks a product to be purchased in the leaflet 105 as shown in FIG. For example, as shown in the figure, a circle 106 is attached to the area 103 in the leaflet 105. Then, as shown in FIG. 5B, the elderly person or the elderly supporter C arranges the leaflet 105 on the paper 107 to which the marker 102 is added. Then, as shown in FIG. 3C, the leaflet 105 including the marker 102 is photographed with the smartphone 108. Then, as shown in FIG. 6D, the photographed image data is attached and sent to the mail address (xxx @ xxx) of the system provider.

  FIGS. 13A to 13D show a flow from S11 to S16 in the marking determination method of the present embodiment. First, the system provider B receives the image data 109 transmitted by the elderly person or the elderly person supporter C. Then, as shown in FIG. 9A, the paper medium image specifying means (not shown) collates the acquired marker 102 of the image data 109 with the marker of the image data stored in the database 104. Since the received image data 109 matches the leaflet image data 108 stored in the database 104 (FIG. 5B), the received image data 109 is stored in the database 104. 108 is specified. Next, as shown in FIG. 2B, the marker 102 is used to align the leaflet image data 109 with the leaflet image data 108 stored in the database 104. Next, as shown in FIG. 3C, marking information 106 of the image data 109 is acquired by a difference processing of the image data 109 and 108 of the both leaflets aligned by a marking information acquisition means (not shown). . Next, as shown in FIG. 4D, the marking information judging means (not shown) indicates that the marking information 106 has an order for the product name “bincho tuna block” and the price “100 yen per 100 g”. Judge as. Then, the semantic information of the marking information is transmitted to the marking information management device 2.

  14A to 14E show a flow from S31 to S33 in the user determination method of this embodiment and a flow from S21 to 23 in the marking information management method.

  Next, as shown in FIG. 6A, the user specifying means (not shown) stores the acquired identification information (user's mail address) of the elderly person or elderly person supporter C in the database 107 in advance. The user information of the elderly person or elderly person supporter C is specified by collating with the mail address of the elderly person or elderly person person supporter C memorize | stored. Then, the user information transmitting means transmits the specified user information to the marking information management device 2. Next, as shown in FIG. 5B, the marking information management apparatus 2 associates the determined marking information with the corresponding user information of the elderly person or elderly person supporter C, and performs the marking result. Is stored in the database 118 as Next, as shown in FIG. 5C, the marking result is transmitted to the e-mail address of the user's elderly person or elderly person supporter C by the user terminal transmission means (not shown). Next, as shown in FIG. 4D, the elderly person or elderly person supporter C receives the mail with the smartphone 119, confirms the content of the received mail, confirms it, and transmits it to the marking information management apparatus 2. . Next, as shown in FIG. 5E, since the information to be confirmed is received by the paper medium provider terminal transmission means (not shown), the marking result confirmed to the wholesale marketer C is displayed as FAX 110 (or e-mail). Or an electronic data file). After that, the wholesale marketer C confirms the marking result by FAX 110 (or e-mail or electronic data file), confirms the payment conditions from the service provider, and then consigns and delivers the ordered product to the delivery company.

  In this example, for example, as shown in FIGS. 15A to 15B, a user entry column may be provided in the advertising flyer 120. If it is the same figure (A), the elderly person or elderly person supporter C will fill in a brand name (bin butterfly tuna block) and quantity (one piece) in several squares, for example. If it is the same figure (B), elderly person or elderly person supporter C will fill in identification ID of elderly person or elderly person supporter C, for example. In this case, marking information acquisition means (not shown) recognizes these written characters as marking information.

  As mentioned above, although the specific example at the time of applying the marking judgment method of this embodiment as a purchase sales support method was demonstrated, this embodiment is not limited to this. For example, when the paper medium is a questionnaire sheet, the paper medium provider can acquire the result information of the collected completed questionnaire sheet by using the marking determination method of the present embodiment.

[Embodiment 2]
The program of the present embodiment is a program that can execute the marking determination method or the purchase sales support method of the first embodiment on a computer. Or the program of this embodiment may be recorded on a computer-readable recording medium, for example. The recording medium is not particularly limited, and examples thereof include a read only memory (ROM), a hard disk (HD), an optical disk, a floppy (registered trademark) disk (FD), and the like.

  While the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  A part or all of the above embodiment can be described as in the following supplementary notes, but is not limited to the following.

(Appendix 1)
Image data storage means for storing paper medium image data in advance in association with the identification mark;
Image data acquisition means for acquiring paper medium image data with an identification mark that is a marking determination target;
By comparing the acquired identification mark of the paper medium image data with the identification mark of the paper medium image data stored in the storage means, the identification information stored in the storage means coincides with the acquired paper medium image data. Paper medium image data specifying means for specifying paper medium image data;
Marking information acquisition means for acquiring marking information of the acquired paper medium image data by the difference processing of the both paper medium image data;
Marking information judging means for judging the meaning of the acquired marking information;
Marking judgment device including.

(Appendix 2)
The marking determination device according to supplementary note 1, wherein the marking information acquisition unit acquires marking information for each area of the acquired paper medium image data.

(Appendix 3)
The paper medium includes a user entry field for a user to input characters,
The marking determination device according to supplementary note 1 or 2, wherein the marking information acquisition unit acquires a character input by the user as marking information.

(Appendix 4)
The marking determination device according to attachment 3, wherein the user entry field includes a plurality of areas for the user to input the characters one by one.

(Appendix 5)
And further includes alignment means,
The alignment means aligns the acquired paper medium image data with the specified paper medium image data stored in the storage means,
The marking determination device according to any one of appendices 1 to 4, wherein the marking information acquisition unit acquires the marking information by a difference process between the aligned both-paper medium image data.

(Appendix 6)
The marking determining apparatus according to any one of appendices 1 to 5, wherein the alignment unit performs alignment using a position identification mark given to the paper medium image data.

(Appendix 7)
Including the marking determination device according to any one of appendices 1 to 6,
The paper medium is an advertising medium;
A marking information determination unit of the marking determination device is a purchase and sales support device that determines the meaning of the acquired marking information as order instruction information.

(Appendix 8)
Furthermore, including ordering means,
The ordering means includes an advertising medium provider terminal transmitting means,
The purchase and sales support device according to appendix 7, wherein the advertising medium provider terminal transmitting means transmits the order instruction information to the advertising medium provider terminal.

(Appendix 9)
A server including the marking determination device according to any one of appendices 1 to 6, and a paper medium provider terminal;
A marking determination system in which the server and the paper medium provider terminal are connectable via a communication network.

(Appendix 10)
A server including the purchase sales support device according to appendix 7 or 8, and an advertisement medium provider terminal;
The server and the advertisement medium provider terminal can be connected via a communication line network.

(Appendix 11)
An image data storage step for storing paper medium image data in advance in association with an identification mark;
An image data acquisition step for acquiring paper medium image data with an identification mark that is a marking determination target;
The paper medium stored in the storage step that matches the acquired paper medium image data by collating the identification mark of the acquired paper medium image data with the identification mark of the paper medium image data stored in the storage step A paper medium image data specifying step for specifying image data;
A marking information acquisition step of acquiring marking information of the acquired paper medium image data by the difference processing of the both paper medium image data;
A marking information judging step for judging the meaning of the acquired marking information;
Marking judgment method including.

(Appendix 12)
The marking determination method according to appendix 11, wherein in the marking information acquisition step, marking information is acquired for each area of the acquired paper medium image data.

(Appendix 13)
The paper medium includes a user entry field for a user to input characters,
The marking determination method according to appendix 11 or 12, wherein in the marking information acquisition step, characters input by the user are acquired as marking information.

(Appendix 14)
The marking determination method according to supplementary note 13, wherein the user entry field includes a plurality of areas for the user to input the characters one by one.

(Appendix 15)
Furthermore, it includes an alignment process,
In the alignment step, the acquired paper medium image data and the paper medium image data stored in the specified storage step are aligned,
15. The marking determination method according to any one of appendices 11 to 14, wherein, in the marking information acquisition step, the marking information is acquired by a difference process between the aligned both-paper medium image data.

(Appendix 16)
16. The marking determination method according to any one of appendices 11 to 15, wherein in the alignment step, alignment is performed using a position identification mark given to the paper medium image.

(Appendix 17)
The marking determination method according to any one of appendices 11 to 16 is a purchase sales support method,
The paper medium is an advertising medium;
A purchase / sales support method for determining the meaning of the acquired marking information as order instruction information in the marking information determination step.

(Appendix 18)
In addition, the ordering process includes
The ordering step includes an advertisement medium provider terminal transmission step,
18. The purchase and sales support method according to appendix 17, wherein, in the advertisement medium provider terminal transmission step, the order instruction information is transmitted to the advertisement medium provider terminal.

(Appendix 19)
A program that causes a computer to execute the marking determination method according to any one of appendices 11 to 16 or the purchase and sales support method according to appendix 17 or 18.

(Appendix 20)
A computer-readable recording medium on which the program according to appendix 19 is recorded.

DESCRIPTION OF SYMBOLS 1 Marking judgment apparatus 2 Marking information management apparatus 3 User judgment apparatus 4 User terminal 5 Provider terminal 6 Server 7 Communication network 10 Marking judgment system

Claims (11)

Image data storage means for storing paper medium image data in advance in association with the identification mark;
Image data acquisition means for acquiring paper medium image data with an identification mark that is a marking determination target;
The image data storage means that matches the acquired paper medium image data by collating the identification mark of the acquired paper medium image data with the identification mark of the paper medium image data stored in the image data storage means Paper medium image data specifying means for specifying the paper medium image data stored in
Marking information acquisition means for acquiring marking information of the acquired paper medium image data by the difference processing of the both paper medium image data;
Recognizing whether the mark of the acquired marking information corresponds to decision information or decision cancellation information , and the position information on the paper medium and the paper medium image data stored in the image data storage means by preliminarily made to correspond to the paper medium information included, when the recognition result is the determination information based on the paper medium information corresponding to the positional information of the obtained marking information, is the acquisition Marking information determination means that does not perform the determination when the meaning of the marking information is determined as processing information and the recognition result is the decision cancellation information ;
Only including,
In the marking information determination means, the character information is further recognized by associating the character information with the paper medium information included in the paper medium image data stored in the image data storage means in advance. A marking determination apparatus that determines the meaning of the acquired marking information as processing information based on the paper medium information corresponding to the character information .   The marking determination apparatus according to claim 1, wherein the marking information acquisition unit acquires the marking information for each area of the acquired paper medium image data. And further includes alignment means,
The alignment means aligns the acquired paper medium image data and the paper medium image data stored in the specified image data storage means,
3. The marking determination device according to claim 1, wherein the marking information acquisition unit acquires the marking information by a difference process between the aligned both-paper-medium image data. The marking determination apparatus according to claim 3 , wherein the alignment unit performs alignment using a position identification mark given to the paper medium image data. The marking determination apparatus according to any one of claims 1 to 4 , wherein the image data acquisition unit acquires paper medium image data with an identification mark as a marking determination target from a user's portable terminal. Including the marking judging device according to any one of claims 1 to 5 ,
A marking information determination unit of the marking determination device is a purchase and sales support device that determines the meaning of the acquired marking information as order instruction information. Furthermore, including ordering means,
The ordering means includes an advertising medium provider terminal transmitting means,
The purchase / sales support apparatus according to claim 6, wherein the advertisement medium provider terminal transmitting unit transmits the order instruction information to the advertisement medium provider terminal. A server including the marking determination device according to any one of claims 1 to 5 ; and a paper medium provider terminal.
A marking determination system in which the server and the paper medium provider terminal are connectable via a communication network. A server including the purchase and sales support device according to claim 6 and 7 and an advertisement medium provider terminal,
A purchase and sales support system in which the server and the advertisement medium provider terminal are connectable via a communication network. An image data storage step for storing paper medium image data in advance in association with an identification mark;
An image data acquisition step for acquiring paper medium image data with an identification mark that is a marking determination target;
In the image data storage step that matches the acquired paper medium image data by collating the identification mark of the acquired paper medium image data with the identification mark of the paper medium image data stored in the image data storage step. A paper medium image data specifying step for specifying the stored paper medium image data;
A marking information acquisition step of acquiring marking information of the acquired paper medium image data by the difference processing of the both paper medium image data;
Recognizing whether the mark of the acquired marking information corresponds to decision information or decision cancellation information , and is included in the paper medium position data and the paper medium image data stored in the image data storage step In this case, when the recognition result is the determination information, the acquired paper medium information is preliminarily associated with the obtained paper medium information based on the paper medium information corresponding to the position information of the acquired marking information . A marking information determination step in which the meaning of marking information is determined as processing information, and the determination result is not determined when the recognition result is the determination cancellation information ,
Including
In the marking information determination step, the acquired marking information is further recognized by associating the character information with the paper medium information included in the paper medium image data stored in the image data storage step in advance. Based on the paper medium information corresponding to the character information, the meaning of the acquired marking information is determined as processing information,
A marking determination method, wherein each step is executed by a computer. A program for causing a computer to execute the marking determination method according to claim 10 .

Images