CN104794831B - Image information processing device and its control method - Google Patents

Image information processing device and its control method Download PDF

Info

Publication number
CN104794831B
CN104794831B CN201410799219.2A CN201410799219A CN104794831B CN 104794831 B CN104794831 B CN 104794831B CN 201410799219 A CN201410799219 A CN 201410799219A CN 104794831 B CN104794831 B CN 104794831B
Authority
CN
China
Prior art keywords
commodity
candidate
determined
image
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410799219.2A
Other languages
Chinese (zh)
Other versions
CN104794831A (en
Inventor
岡村敦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba TEC Corp
Original Assignee
Toshiba TEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toshiba TEC Corp filed Critical Toshiba TEC Corp
Priority to CN201710813377.2A priority Critical patent/CN107665556B/en
Publication of CN104794831A publication Critical patent/CN104794831A/en
Application granted granted Critical
Publication of CN104794831B publication Critical patent/CN104794831B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00Cash registers
    • G07G1/12Cash registers electronically operated
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/752Contour matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes

Abstract

The invention discloses a kind of image information processing device and its control method, it is also to be to wait for from shown candidate's commodity selection commodity until being determined that it, which can be such that operator resolutely determines, and the image information processing device includes:Collection portion, the image for the commodity that collection image pickup part is imaged;Candidate display portion, when the identifying processing of the image by the commodity collected based on the collection portion can not be automatically determined to specify commodity, shows the commodity candidate for extracting the candidate for the commodity out from the benchmark commodity stored;And informing portion, when the commodity of the upper of the commodity candidate shown by the candidate display portion are the non-determined commodity of the advance commodity for being defined as automatically determining, inform based on the uncertain specified commodity of the commodity candidate.

Description

Image information processing device and its control method
The application advocate the applying date be on 01 21st, 2014, Application No. JP2014-008953 Japanese publication be excellent First weigh, and quote the content of above-mentioned application.
Technical field
The present invention relates to a kind of image information processing device and its control method.
Background technology
Such a technology is currently, there are, by the feature for extracting the article out from the view data for having imaged article Amount, and with representing that pre-prepd verification is compared with the data of the characteristic quantity of article, species of the article etc. is carried out Identification.Moreover, motion has a kind of image information processing device, by the way that the technology is used for into vegetable in the shops such as supermarket, convenience store The identification (discrimination) of the commodity of dish and fruit etc., performs the merchandise sales processing of identified commodity.
In involved image information processing device, it is known that because commodity are different, there are it is readily identified to specify one The commodity of individual commodity, because of color, camera position, camera angle of commodity for being imaged etc. recognize that the resolution of commodity is become Change, so it is difficult to being identified as the commodity of a commodity specified.Therefore, each commodity measurement of correspondence is identified as a commodity really Determine rate, and pair low commodity of determination rate do not automatically determine into a commodity, and multiple commodity as candidate are shown, and pass through Salesman selects the commodity being consistent to be determined from shown commodity.
But, in above-mentioned existing image information processing device, it is not known that be to determine the shop of the situation of the low commodity of rate The operator of member etc., the commodity low to the determination rate that has imaged, are to be selected from candidate's commodity or expect to be defined as one Individual commodity and changing camera angle and waited while position until being determined, the situation for the judgement that hesitates has a lot, Increase the burden of operator.
The content of the invention
In view of the above problems, it is an object of the invention to provide a kind of image information processing device and its control method, its It is also to be to wait for from shown candidate's commodity selection commodity until being determined that operator can be made, which resolutely to determine,.
To solve the above problems, the image information processing device involved by first aspect present invention includes:Collection portion, collection The image for the commodity that image pickup part is imaged;Candidate display portion, when the image of commodity by being collected based on the collection portion Identifying processing can not automatically determine to specify during commodity, show the candidate extracted out from the benchmark commodity stored as the commodity Commodity candidate;And informing portion, when the commodity of the upper of the commodity candidate shown by the candidate display portion are quilts in advance During the non-determined commodity for the commodity for being defined as automatically determining, inform based on the uncertain specified commodity of the commodity candidate.
The control method of image information processing device involved by second aspect of the present invention comprises the following steps:Collection step Suddenly, the image for the commodity that collection image pickup part is imaged;Candidate display step, as the business by being collected based on the acquisition step The identifying processing of the image of product can not be automatically determined to specify during commodity, and it is described that display is extracted out from the benchmark commodity stored The commodity candidate of the candidate of commodity;And informing step, when by the commodity candidate shown by the candidate display step most When upper commodity are the non-determined commodity of the advance commodity for being defined as automatically determining, inform based on the commodity candidate Uncertain specified commodity.
Brief description of the drawings
Below, image information processing device and its control method involved in the present invention are illustrated referring to the drawings.When When being considered in conjunction with the accompanying, by referring to following detailed description, it can more completely more fully understand the present invention and easily learn The adjoint advantage of many of which, but accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the application A part, schematic description and description of the invention is used to explain the present invention, does not constitute the improper limit to the present invention It is fixed, wherein:
Fig. 1 is to represent the stereogram that the outward appearance of the checkout system involved by first embodiment is constituted;
Fig. 2 is to represent the block diagram that the hardware of the checkout system shown in Fig. 1 is constituted;
Fig. 3 is to show schematically the illustration that the data of the commodity identification master file shown in Fig. 2 are constituted;
Fig. 4 is to show schematically the illustration that the data of the commodity master file shown in Fig. 2 are constituted;
Fig. 5 is an illustration of the data composition for the RAM for representing the commodity identification master file shown in Fig. 2;
Fig. 6 is to represent the functional block diagram that the function of commodity information reading apparatus is constituted;
Fig. 7 is the flow chart for the flow for representing the control process that commodity information reading apparatus is performed;
Fig. 8 is the figure for the display example for representing commodity candidate's picture shown by commodity information reading apparatus;
Fig. 9 is another display illustration for representing commodity candidate's picture shown by commodity information reading apparatus;
Figure 10 is the 3rd display illustration for representing commodity candidate's picture shown by commodity information reading apparatus;
Figure 11 is the 4th display illustration for representing commodity candidate's picture shown by commodity information reading apparatus;
Figure 12 is the block diagram of the hardware composition for the checkout system for representing second embodiment;
Figure 13 is the stereogram of the outward appearance composition for the self-service POS for representing 3rd embodiment;And
Figure 14 is to represent the block diagram that the hardware of the self-service POS shown in Figure 13 is constituted.
Description of reference numerals
11 POS terminals
21 commodity information reading apparatus
41 CPU
43 RAM
44 memory portions
47 image pickup parts
80 self-service POS
100 control units
101 collection portions
102 candidate display portions
103 informing portions
104 merchandise news processing units
442 commodity recognize master file
443 commodity master files
Embodiment
(first embodiment)
Below, referring to figs. 1 to Figure 11, image information processing device and program to first embodiment are carried out in detail It is bright.In addition, in embodiments described below, although regard commodity information reading apparatus as one of image information processing device Illustrate, but the present invention is not defined because of embodiment.
Fig. 1 is to represent the stereogram that the outward appearance of checkout system is constituted.As shown in figure 1, checkout system has POS (Point Of Sales:Point of sale) terminal 11, commodity information reading apparatus 21.
POS terminal 11 is positioned on the upper surface of pulling off device 13 in checkout stand 19.Pulling off device 13 passes through whole from POS 11 open command is held to control opening operation.The operating portion being made up of keyboard etc. operated by operator (salesman etc.) 15, configure above POS terminal 11.From the point of view of operator's angle of operation operating portion 15, set in the inboard of operating portion 15 Operator towards operator's display information is with display part 14.Operator with display part 14 towards operator's display of commodity information, The information such as settlement information.Touch panel 18 is laminated to operator with display part 14.Customer is rotatably stood with display part 16 That to be arranged on operator more inboard with display part 14.Customer is with display part 16 towards customer's display of commodity information, settlement information Etc. information.
Although in addition, customer shown in Fig. 1 with display part 16 be in by display surface towards in Fig. 1 with front side (operator side) State, but with display surface towards making customer be rotated with display part 16 by way of inboard (customer side) in Fig. 1, Gu Keyong Display part 16 is towards customer's display information.
In addition, the sales counter 31 of oblong table shape quilt in the way of the formation L words of checkout stand 19 with being placed with POS terminal 11 Configuration.Form has load receiving surface 32 above sales counter 31.Load receiving surface 32 is placed with the Shopping Basket 33 for storing commodity 2.Purchase Thing basket 33 is it is contemplated that being divided into the first Shopping Basket 34 brought by customer and being positioned in the first Shopping Basket 34 across commodity The second Shopping Basket 35 on the position of information read device 21.
The substantially central portion of the load receiving surface 32 of sales counter 31 is provided with to send with the data of POS terminal 11 and is connected with receiving Commodity information reading apparatus 21.Commodity information reading apparatus 21 has the shell 22 of slim rectangular shape.
Reading window 23 is configured with the front of shell 22.The top of shell 22 is provided with operator with display part 24.In behaviour Work person is provided with touch panel 241 (reference picture 2) with the surface of display part 24.It is configured with operator with the right of display part 24 The operating portion 27 being made up of keyboard etc..From the point of view of operator's angle, it is provided with the operator side that kept left with the back side of display part 24 Customer is with display part 29, for customer communication.
The first Shopping Basket 34 brought by customer is accommodated with customer in the commodity displayed in shop and is put into shopping Commodity 2 in basket 34.Commodity 2 in first Shopping Basket 34 are by operating the operator of commodity information reading apparatus 21 to be moved to Second Shopping Basket 35.In the moving process, commodity are by the reading window 23 towards commodity information reading apparatus 21.At this moment, configure Image pickup part 47 (reference picture 2) shooting commodity 2 in reading window 23.
Fig. 2 is to represent the block diagram that the hardware of commodity information reading apparatus 21 is constituted.Commodity information reading apparatus 21 has in Fig. 2 There are CPU (the Central Processing Unit as control main body:Central processing unit) 41, the ROM of the various programs of storage (Read Only Memory:Read-only storage) 42, RAM (the Random Access Memory of the various data of expansion:Deposit at random Access to memory) 43, the memory portion 44 of various programs of storage etc. etc., CPU41, ROM42, RAM43 and memory portion 44 pass through Data/address bus 45 is connected with each other.CPU41, ROM42, RAM3 constitute control unit 100.That is, control unit 100 passes through CPU41 The control program 441 for storing and deploying in RAM43 according to ROM42 or memory portion 44 is acted, to perform control described later System processing.
RAM43 is also imaged in addition to the various programs headed by control program 441 are deployed with storage by image pickup part 47 And the merchandise news storage unit 431 (reference picture 5) of the merchandise news of the commodity 2 identified by general object identification described later.
Memory portion 44 is HDD (the Hard Disc Drive that storage information is also maintained even if power-off:Hard drive Device), the nonvolatile memory of flash memories etc., it stores program comprising control program 441 etc..In addition, memory portion 44 is deposited Contain commodity identification master file 442 (reference picture 3) and commodity master file 443 (reference picture 4).
Shown in addition, data/address bus 45 is connected with operating portion 27, operator by controller 46 with display part 24, customer Portion 29 and image pickup part 47.
Operating portion 27, which has, to be included starting the start button 271 of the commodity shooting in commodity information reading apparatus 21, is used for Terminate the various keys of the end key 272 of commodity shooting.
Operator is set with the display surface of display part 24 towards operator, and to operator's display information.Used in operator The surface of display part 24 is provided with the touch panel 241 being made up of electrode or transparent film.Pass through touch operation and operator With the touch panel 241 of the corresponding position of key shown by display part 24, the key can be operated.Touch panel 241 is A part for operating portion 27.Customer is set with the display surface of display part 29 towards customer, and to customer's display information.
Image pickup part 47 is made up of color ccd sensor or color cmos sensor etc., carries out shooting alignment reading window 23 Commodity 2.For example, carrying out 30fps video camera in image pickup part 47.Image pickup part 47 is to provide two field picture that frame frequency is imaged successively (photographed images) are stored in RAM43 photographed images storage part 432 (reference picture 5).
In addition, data/address bus 45 is connected with connection I/F (the Inter Face being electrically connected with POS terminal 11:Interface) 48. Connection I/F48 is connected with circuit 49.
In addition, POS terminal 11 has as the CPU61, the ROM62 for storing various programs, expansion for controlling main body respectively in Fig. 2 RAM63, memory portion 64 of the various programs of storage of data etc. are planted, CPU61, ROM62, RAM63 and memory portion 64 pass through Data/address bus 65 is connected with each other.CPU61, ROM62 and RAM63 constitute control unit 200.That is, control unit 200 passes through CPU61 is stored according to ROM62 or memory portion 64 and acted in the RAM63 control programs 641 deployed, aftermentioned to perform Control process.
RAM63 is in addition to various programs of the expansion headed by control program 641, also with storage from commodity information reading apparatus 21 merchandise newss with the corresponding merchandise news of commodity 2 received by circuit 49 described later or connection I/F68 described later Storage part 631.
Memory portion 64 is the nonvolatile memory that HDD, the flash memories of storage information etc. are also maintained even if power-off, its The program of storage comprising control program 641 etc..The commodity master file 642 in addition, memory portion 64 is stored with.The commodity master file 642 and commodity master file 443 (reference picture 4) are identical compositions.
Shown in addition, data/address bus 65 is connected with operating portion 15, operator by controller 66 with display part 14, customer Portion 16, printing merchandise news and settlement information and the printing portion 67 for providing bill.
Operating portion 15 has the various keys of function key, numerical key, the total key for carrying out settlement process etc..
Operator is set with the display surface of display part 14 towards salesman, and to salesman's display information.Operator's display part 14 are provided with touch panel 18 on the display face.By touch operation and operator with the corresponding position of key shown by display part 14 The touch panel 18 put, can be operated to the key.Touch panel 18 is a part for operating portion 15.Customer is with display part 16 Display surface is set towards customer, and to customer's display information.
In addition, data/address bus 65 is connected with connection I/F68.Connection I/F68 is connected with circuit 49.Pass through circuit 49, connection I/F48 and connection I/F68 electrical connections, carry out the friendship of various information between commodity information reading apparatus 21 and POS terminal 11 Change.
Then, commodity identification master file 442 be set be associated in the shop in the commodity 2 of sale and the image of commodity 2 and The data file of characteristic quantity.Fig. 3 is to show schematically the illustration that the data of commodity identification master file 442 are constituted.Such as Fig. 3 institutes Show, the commercial product code portion 4421 for the commercial product code that commodity identification master file 442 is uniquely distributed with each commodity 2 of storage correspondence, The trade name portion 4422, the monovalent portion 4423 of storage cargo price, storage for storing trade name image the commodity figure of the commodity 2 in advance The commodity image portion 4424 of picture.In addition, commodity identification master file 442 has most accurate with corresponding each associated storage of commodity 2 in advance Really represent the characteristic quantity portion 4425 of the characteristic features amount (characteristic quantity that this feature amount is referred to as to benchmark commodity) of the commodity 2.
In the example in figure 3, the commodity of commercial product code " 001 "~commercial product code " 004 " belong to trade name " commodity A "~ " classification of the apple of commodity D " 4 species, characteristic quantity portion 4425 is stored with most accurate expression commercial product code " 001 "~business respectively The characteristic quantity of the benchmark commodity of the feature of the commodity of product code " 004 ".
The storage of commodity image portion 4424 has been imaged when similarity described later judges by the benchmark commodity as comparison other Each commodity image.Commodity image is carried in the display of commodity candidate described later as the image for representing commodity candidate Show.In addition, there are the photographed images from each commodity 2 in characteristic quantity portion 4425 (for example, commodity figure with corresponding commercial product code associated storage Picture) characteristic quantity of the commodity 2 extracted out in advance.Herein, characteristic quantity is exactly surface color and polish, pattern, concavo-convex situation of commodity 2 etc. Represent the information of the feature of commodity 2.
Fig. 4 is to show schematically the illustration that the data of commodity master file 443 are constituted.Commodity master file 443 is to be associated with Specify attribute information (trade name, unit price in the commercial product code of the commodity of store merchandising, the commodity 2 specified by commercial product code Deng) data file.In Fig. 4 commodity master file 443 there is commercial product code portion 4431, it is trade name portion 4432, unit price portion 4433, true Surely command troops 4434, blanket specifying part 4435, single specifying part 4436 and determining section 4437.
Commercial product code portion 4431 is stored with the commercial product codes of specified commodity.Trade name portion 4432 is stored with by commercial product code The trade name for the commodity specified.Monovalent portion 4433 is stored with the unit prices of the commodity specified by commercial product code.
It is determined that the 4434 determination rates for being stored with the commodity specified by commercial product code of commanding troops.The rate of determination is exactly statistical representation root The numeral of the probability for the commodity specified can be defined as according to the commodity image imaged by image pickup part 47, determination rate is represented High commodity are to be defined as the high commodity of the probability of a commodity specified according to the image imaged.
It is different according to commodity, have regardless of how camera angle, direction, distance can extract roughly the same characteristic quantity out Commodity and according to camera angle, direction, distance and extract out characteristic quantity relatively big difference commodity.It is past when relatively big difference The situation that not can determine that the commodity is compared toward the characteristic quantity for there are the benchmark commodity stored with characteristic quantity portion 4425.Determine rate Portion 4434 is stored with the determination rate of the statistics collected more such phenomenon and calculated.Be determined more commodity it is determined that Command troops the high determination rate that is stored with 4434, it is impossible to it is determined that the more commodity of number of times it is determined that low determine that be stored with 4434 of commanding troops Rate.
Blanket 4435 pairs of specifying part determines the high commodity of the 4434 determination rates stored of commanding troops, storage can automatically determine for The numerical value of commodity is specified, a pair determination is commanded troops the low commodity of the 4434 determination rates stored, and the expression that is stored with is to automatically determine Non-determined commodity numerical value.In embodiment, the threshold value of determination rate for being possible to automatically determine is considered as 50%, in Fig. 4 example In son, commodity A, commodity B, commodity D, commodity N are it is determined that the 4434 determination rates stored of commanding troops are more than 50%, in blanket specifying part 4435, which are stored with, represents the numerical value " 1 " that is automatically determined.But, to commodity C by determining 4434 determinations stored of commanding troops Rate is 38%, less than 50%, so blanket specifying part 4435 is stored with, expression is the numerical value for the non-determined commodity not automatically determined “0”.Although the threshold value of determination rate for being possible to automatically determine is considered as 50% and is illustrated, threshold value is not limited to 50%, Can also be other values.
Single specifying part 4436 is with list by way of not automatically determining user (for example, the operator in shop, manager) The region solely set, when being set in the way of not automatically determining, stores numerical value " 0 ".When the example for Fig. 4, commodity A's Determine that rate has exceeded threshold value for 55%, but the commodity considered close to half are not known, so as to individually be carried out on commodity A not certainly The setting of the dynamic non-determined commodity determined.On the non-determined set in single specifying part 4436 in the way of it can not automatically determine Commodity, no matter the specified conditions of blanket specifying part 4435, are not automatically determined.
Determining section 4437 stores the numerical value " 0 " for representing not automatically determine to non-determined commodity.In addition, 4437 pairs of determining section exists It is assigned with automatically determining in blanket specifying part 4435, and do not automatically determined individually in single specifying part 4436 What is set can determine that commodity, and storage table is shown with the numerical value " 1 " automatically determined.When the example for Fig. 4, commodity B, commodity D and business Product N is to can determine that commodity, and the numerical value that is stored with " 1 " is so automatically determined, but commodity A, commodity C are non-determined commodity, storage There is numerical value " 0 " so without automatically determining.
Fig. 5 is to represent the illustration that RAM43 data are constituted.RAM43 has merchandise news storage part 431, shooting in Fig. 5 Image storage part 432 and characteristic quantity storage part 433.
Merchandise news storage part 431 reads fixed merchandise news from commodity master file 443 and stored.Shooting figure As storage part 432 gathers the commodity image imaged by image pickup part 47 and is stored.Characteristic quantity storage part 433 is stored from logical Cross the characteristic quantity for the commodity image extraction that image pickup part 47 has been imaged.
Then, reference picture 6 is to Figure 11, and the control process to commodity information reading apparatus 21 is illustrated.Fig. 6 is to represent business The functional block diagram that the function of product information read device 21 is constituted.Control unit 100 according to ROM42, memory portion 44 by being stored The various programs for including control program 441, at collection portion 101, candidate display portion 102, informing portion 103 and merchandise news Reason portion 104.
Collection portion 101 has the function for the image for gathering the commodity that image pickup part is imaged.
Candidate display portion 102, which has, to work as by the identifying processing based on the commodity image collected by collection portion 101 not It can automatically determine to specify during commodity, show that extraction is the commodity candidate's of the candidate of the commodity from the benchmark commodity stored Function.Benchmark commodity are such as stored in commodity identification master file 442.
There are informing portion 103 commodity of the upper as the commodity candidate shown by candidate display portion 102 to be predetermined For the commodity that can not be automatically determined non-determined commodity when, inform the function based on the uncertain specified commodity of commodity candidate.
Merchandise news processing unit 104 has when the commodity candidate shown by candidate display portion 102 has been selected with one, Perform the function of the merchandise news processing of the commodity of the selection.
Fig. 7 is the flow chart of the flow for the control process for representing POS terminal.Control unit 100 judges the institute of operating portion 27 in Fig. 7 Whether the start button 271 of setting is operated (step S11).Start button 271 be used for make image pickup part 47 in running order from And the key that can be imaged by image pickup part 47, when start button 271 is operated, then image pickup part 47 maintains working condition, Zhi Daojie Beam key 272 is operated.
When judging that start button 271 is operated (step S11's be), control unit 100 is exported to image pickup part 47 and imaged Continuity signal (step S12), so that image pickup part 47 is in running order.That is, can be imaged by image pickup part 47.Connect , the IMAQ that control unit 100 is imaged image pickup part 47 simultaneously stores the (step into RAM43 photographed images storage part 432 S13).In addition, control unit 100 gathers the image imaged by image pickup part 47 with defined timing (time) at any time.
Then, control unit 100 detects commodity in judging whether the photographed images stored from photographed images storage part 432 2 (step S14).The shooting figure that control unit 100 is stored using known mode-matching technique detection photographed images storage part 432 The all or part of contour line for the commodity 2 that picture is included.Or, determine whether to be tested with skin region from photographed images Domain, when being tested with skin area, i.e., when the hand for being tested with operator is when mirroring, by the vicinity of the skin area The detection of above-mentioned contour line is carried out, is attempted so that the profile of the commodity just held to the hand of imaginary operator is extracted out.This When, when the profile of the profile and the object near the profile of hand in addition that are tested with the shape for representing hand, according to this The contour detecting commodity 2 of object.
Carry out it is standby until detecting commodity 2 (step S14's is no), when being judged as detecting commodity 2 (step S14's It is), the commodity 2 that 100 pairs of control unit is detected extract characteristic quantity (step S15) out.Characteristic quantity is to the above-mentioned commodity 2 detected Surface state (color, pattern, the concavo-convex situation on surface etc.) of the photographed images based on commodity 2 is extracted.
Moreover, the characteristic quantity of the commodity 2 of extraction is stored into RAM43 characteristic quantity storage part 433 (step by control unit 100 Rapid S16).Then, the characteristic quantity for the commodity 2 that control unit 100 is stored RAM43 characteristic quantity storage part 433 and commodity identification The characteristic quantity for multiple commodity that the characteristic quantity portion 4425 of master file 442 is stored is compared, and calculates similarity (step S17)。
Each commodity that the characteristic quantity that control unit 100 is stored characteristic quantity storage part 433 is stored with characteristic quantity portion 4425 Reference characteristic amount be compared, calculate the similarity for representing similar which kind of degree of two characteristic quantities.Moreover, if calculating Its value is more than or equal to the commodity of the commercial product code of the commodity of defined threshold (for example, 50%) in the similarity gone out, then control unit 100 The candidate (commodity candidate) for the commodity 2 that the commodity are identified as imaging by image pickup part 47.Moreover, control unit 100 is when in identification When there are the commodity of the similarity (such as 90%) high more than or equal to regulation in the commodity candidate gone out, the commodity are identified as to determine business Product.
Object included in image as described above is identified and is referred to as general object identification (generic object recognition:General object identification).Technology on such general object identification is each in following documents Identification technology is planted to be illustrated.
Liu Jing Kei department, " the modern Hous of general thing body Recognize Knowledge Now shapes と ", feelings Reported processing association Theory text Chi, Vol.48, No.SIG16 [Heisei 25 year 01 month is retrieved on the 24th], イ Application タ ー ネ ッ ト<URL:http://mm.cs.uec.ac.jp/IPSJ- TCVIM-Yanai.pdf>(Liu Jingqi departments, " present situation of general object identification and future ", information processing association paper will, Vol.48, No.SIG16 " Heisei 25 year 01 month is retrieved on the 24th ", internet < URL:http://mm.cs.uec.ac.jp/ IPSJ-TCVIM-Yanai.pdf >)
In addition, carrying out region segmentation to image by each article (purpose thing) of correspondence, the skill of general object identification is carried out Art is illustrated in following document.
Jamie Shotton ら, " Semantic Texton Forests f or Image Categorization And Segmentation ", [Heisei 25 year 01 month is retrieved on the 24th], イ Application タ ー ネ ッ ト<URL:http:// citeseerx.ist.psu.edu/viewdoc/downloadDoi=10.1.1.145.3036&rep=rep 1&type= pdf>(Jamie Shotton ら (Jie meter Xiao Dun et al.), " Semantic Texton Forests for Image Categorization and Segmentation:", " Heisei 25 year 01 month is retrieved on the 24th ", internet < URL:http:// citeseerx.ist.psu.edu/viewdoc/downloadDoi=10.1.1.145.3036&rep=rep1&type= Pdf >)
Then, control unit 100 judges whether to have been identified as commodity 2 really based on the similarity calculated in step S17 Determine commodity (step S18).When being judged as having recognized (step S18's be), control unit 100 recognizes master file 442 from commodity Commercial product code portion 4421 reads the commercial product code for the commodity for being identified as determining commodity.Moreover, (the merchandise news processing of control unit 100 Portion 104) perform merchandise news processing.That is, control unit 100 is corresponding with the commercial product code from the reading of commodity master file 443 Merchandise news (commercial product code, trade name, unit price etc.) and store into merchandise news storage unit 431 (step S19).Moreover, Control unit 100 returns to step S14, standby commodity detection then.The merchandise news that merchandise news storage part 431 is stored exists The stop timing (time) of the transaction is sent to POS terminal 11.
On the other hand, when as the result that similarity is calculated in step S17, judge by commodity 2 it is unidentified be true Determine during commodity (step S18's is no), all commodity 2 that similarity exceedes threshold value are identified as commodity candidate's (step by control unit 100 S31)。
Then, 100 pairs of all commodity 2 as commodity candidate of control unit, retrieve (lookup) whether there is with reference to determining section 4437 Non-determined commodity (step S32).Non-determined commodity be stored with blanket specifying part 4435 " 0 " commodity and specified single Be stored with the commodity of " 0 " in portion 4436.
Moreover, control unit 100, which judges to whether there is in commodity candidate, non-determined commodity (step S33).When judging When there are non-determined commodity (step S33's be), control unit 100 (candidate display portion 102) in step S31 by what is identified Commodity candidate is with making the instruction that operator is shown with display part 24 and customer with display part 29 while being indicated to the (step of controller 46 S34).The controller 46 of instruction is received in operator with display of commodity candidate on display part 24.Moreover, control unit 100 make with It is used as the top accordingly display information of the image of the non-determined commodity identified of the result retrieved in step s 32 Instruction be indicated to controller 46, described information is that the commodity for the commodity candidate for urging (prompting) to show are true without commodity Fixed and operation customer selects the information (step of specified commodity with the touch panel 241 on display part 29 from commodity candidate S35).The controller 46 for receiving instruction determines and operated customer with display alarm on display part 24 in operator without commodity With the touch panel 241 on display part 29, select to specify the information of commodity from commodity candidate.
Fig. 8 to Figure 11 is shown by step S34 and step S35 in operator with commodity candidate shown in display part 24 Four kinds display examples.Customer is with display part 29 also by same display.
Fig. 8 is the display illustration for representing commodity candidate.As shown in figure 8, operator is waited with the commodity shown by display part 24 Picture A1 is selected to include photographed images region A11 and commodity candidate prompting region A12.
Photographed images region A11 is the region for showing the photographed images that photographed images storage part 432 is stored.Commodity Candidate's prompting region A12 is the region for being identified as the commodity image of each registration commodity of commodity candidate etc. for showing.The business The commodity image (G1~G4) of the commodity candidate identified in step S31 is equal by product candidate prompting region A12 with trade name Shi Jinhang is shown.In addition, commodity candidate prompting region A12 can also not appear in the commodity candidate's that is identified in step S31 Commodity image, and display of commodity name.
In addition, being provided with photographed images region A11 bottom for being manually selected from category code, commodity detail etc. The manual register button B1 of (registration) commodity.Control unit 100 is according to manual register button B1 operation, in operator's display part The manual registration picture (not shown) for carrying out goods registration manually is shown on 24.In addition, being registered by registering picture manually Commodity by as it is described later determination commodity handled.
In addition, control unit 100 is close to the top of the image (G1 and G3) of non-determined commodity, display information is not " automatic respectively It is determined that " word S1.The information is to represent that commodity A and commodity C are non-determined commodity, the uncertain finger of commodity 2 to this shooting As long as the commodity determined commodity and be consistent are any one commodity in commodity A and commodity C, it would be desirable that selection commodity A and business The information of any one commodity in product C.The selection of commodity is performed by touch operation touch panel 241.
Fig. 9 is another display illustration for representing commodity candidate.As shown in figure 9, figure of the control unit 100 close to non-determined commodity As the right side of (G1 and G3) shows the mark S2 of finger respectively.The mark S2 of the finger is to represent that commodity A and commodity C are non-true As long as determining commodity, the commodity 2 to this shooting does not know the commodity specified and during the commodity that are consistent are commodity A and commodity C Any one commodity, it would be desirable that selection commodity A and any one commodity in commodity C information.The selection of commodity is by touching Operating touch panel 241 is touched to perform.
Figure 10 is the 3rd display illustration for representing commodity candidate.As shown in Figure 10, control unit 100 is by the figure of non-determined commodity As the background colour S3 of (G1 and G3) is shown in the mode different from the background colour of the image of other commodity.The different background As long as color S3 be represent commodity A and commodity C be non-determined commodity, the uncertain commodity specified of commodity 2 to this shooting and The commodity being consistent are any one commodity in commodity A and commodity C, it would be desirable that select any one in commodity A and commodity C The information of commodity.The selection of commodity is performed by touch operation touch panel 241.
Figure 11 is the 4th display illustration for representing commodity candidate.Control unit 100 is under the A11 of photographed images region in Figure 11 The word S4 of portion's display information " not automatically determining, commodity please be select ".The information is there are in shown commodity candidate Non-determined commodity, the commodity 2 to this shooting do not know the commodity specified and it is desirable that the information for the commodity that selection is consistent. The selection of commodity is performed by touch operation touch panel 241.
Return to Fig. 7 explanation.Control unit 100 judges whether selected to specify from shown commodity candidate one Individual commodity (step S36).Progress is standby, until being judged as having selected (step S36's is no), (step when being judged as having selected S36's is), the commodity selected are used as and determine commodity (step S37) by control unit 100.Moreover, control unit 100 performs step S19 processing.
In addition, when in step S33, it is judged as being not present when there are non-determined commodity (step S33's in commodity candidate It is no), control unit 100 is by the commodity candidate identified in step S31 and makes operator with display part 24 and customer's display part The instruction of 29 displays is indicated to controller 46 (step S38) simultaneously.The controller 46 of instruction is received in operator's display part Display of commodity candidate on 24.Moreover, control unit 100 judges whether that selection has the business specified from shown commodity candidate Product (step S39).When being judged as having selected (step S39's be), control unit 100 performs step S37 processing.In addition, working as When being judged as non-selected (step S39's is no), control unit 100 returns to step S14 and carried out standby.
In addition, when being judged as not operating start button 271 in step s 11 (step S11's is no), control unit 100 is sentenced The disconnected end key 272 (step S41) whether operated set by operating portion 27.When being judged as being operated (step S41's It is), control unit 100 is imaged by signal (step S42) to the output of image pickup part 47, so that image pickup part 47 is in inoperative shape State.Moreover, the end of control unit 100 is handled.In addition, when being judged as not operating end key 272 (step S41's is no), control Portion 100 returns to step S11 and carried out standby.
According to such embodiment, when the commodity for the upper for being judged as shown commodity candidate are non-determined commodity When, display is not known to specify commodity, so operator is from shown candidate's commodity selection commodity or standby to progress It is determined that not wavering.
In addition, according to embodiment, uncertain display is carried out due to corresponding with non-determined commodity, so operator is from institute Commodity are selected in candidate's commodity of display or standby not wavering to being determined.In addition, operator will appreciate that to enter The commodity that product of doing business are determined.
(second embodiment)
Then, reference picture 12, are illustrated to the image information processing device and program of second embodiment.In addition, with In the embodiment of lower explanation, although illustrated exemplified by POS terminal 11 is enumerated as one of image information processing device, but It is that the present invention is not defined because of embodiment.In addition, in fig. 12, the composition of reference marks identical with Fig. 2 is identical with Fig. 2 Composition, so omitting the description.In fig. 12, there are commodity to recognize master file 643 in memory portion 64.Commodity recognize master file 643 and Fig. 4 commodity identification master file 443 is that identical is constituted.
In a second embodiment, control unit 200 performs the step S13~controls of step S39 on an equal basis in the flow chart with Fig. 7 System.The control unit 100 of commodity information reading apparatus 21 performs step S11, step S12, step S41 and step S42 processing.
At this moment, control unit 200 gathers the commodity image sent from commodity information reading apparatus 21 in step s 13.In addition, Control unit 200 is in step S34 and step S38 by the image information of commodity candidate and the image information for showing the commodity candidate Instruction simultaneously export to commodity information reading apparatus 21.In addition, performed in step S19 will be from the commodity main body of a court verdict for control unit 200 The merchandise news storage that part 642 is read is handled to the merchandise news in merchandise news storage part 631.
(3rd embodiment)
Then, reference picture 13 and Figure 14, are illustrated to the image information processing device and program of 3rd embodiment.Separately Outside, in embodiment explained below, although by substantially two side's functions with POS terminal 11 and commodity information reading apparatus 21 The self-checkout device (hereinafter simply referred to as self-service POS) being integrally formed be enumerated as one of image information processing device Example is illustrated, but the present invention is not defined because of embodiment.
Figure 13 is to represent that stereogram, Figure 14 that self-service POS80 outward appearance is constituted are that the hardware for representing self-service POS80 is constituted Block diagram.In addition, in the following, Figure 13 and/or Figure 14 reference marks 81~86,87 and 88,90,97 and 98,300,841~ 843rd, 871,872 and Fig. 2 reference marks 41~46,27 and 25,47~49,100,441~443,271,272 are phase isomorphisms Into.In addition, printing portion 89 and Figure 12 printing portion 67 is identical composition.Therefore, the explanation to these compositions is omitted.
As shown in FIG. 13 and 14, self-service POS80 body 91 has the customer for being equipped with touch panel 881 on the surface Species with display part 88, in order to recognize (detection) commodity etc. and the image pickup part 90 for imaging commodity image.
Such as being used with display part 88 as customer has liquid crystal display.Customer is shown for being accused to customer with display part 88 Know that the commodity that the guide picture, various input pictures, display of self-service POS80 operating method are imaged by image pickup part 90 are believed Registration picture, the Amount in Total of display of commodity, advance payment, small change amount of money of breath etc. and the reconciliation for select method of payment (checkout) picture etc..
Image pickup part 90 is the reading window 901 that the code sign being attached on commodity is aligned to image pickup part 90 by customer, so that logical Cross the device that image pickup part 90 images commodity image.
In addition, being provided with the commodity mounting table for placing the open commodity having been charged into basket on the right side of body 91 92, the commodity mounting table 93 for placing settled commodity is provided with the left side of body 91.In addition, being provided with for mounting Enter the bag hook 95 of the bag of settled commodity, put temporarily for place settled commodity temporarily before bag is loaded Put platform 96.The inside of commodity mounting table 92 and 93 is respectively arranged with the meter (not shown) for the commodity that metering has been loaded, and has There is the function of determining the weight of the commodity before and after clearing for identical situation.
In addition, self-service POS80 body 91 is provided with for carrying out deposit clearing bank note and receiving looking for for small change bank note Zero machine 94.
When applying embodiments of the invention to the self-service POS80 so constituted, self-service POS80 has to be believed as commodity The function of reading device is ceased, and is performed with controlling equal control shown in Fig. 7.In addition, with POS terminal 11 and merchandise news The device being integrally formed of the function of reading device 21, is not limited to the self-service POS80 of above-mentioned composition or does not include The device of the composition of meter.
More than, although embodiments of the invention are illustrated, but these embodiment is proposed as an example, It is not intended to limit the scope invented.These embodiments can be implemented with other various forms, not depart from invention main idea In the range of can carry out it is various omit, replace, change, combination.These embodiments and its deformation are comprised in the scope of invention Or in main idea, moreover, in invention and its impartial scope described in scope included in claim.
For example, in embodiment, the mark of finger is shown near the image of non-determined commodity in the example of figure 9 S2, but as long as being that then what can for the mark such as asterisk.In addition, in Figure 10 example, making the image of non-determined commodity Background colour it is different from the background colour of other images, but it is also possible to change pattern or scenery of background etc. makes background colour to substitute It is different.
In addition, in embodiment, although operator is shown with display part 24 and customer with display part 29 as informing portion Uncertain specified commodity, but means can also be informed using others such as the sound in addition to display.
In addition, in embodiment, set by the shop that can also be connected with commodity information reading apparatus 21 or POS terminal 11 Shop server, our department's server storage commodity identification master file 442 and commodity master file 443 set by our department.In addition, Commodity recognize that master file 442 and commodity master file 443 can also be separately positioned in different devices.
In addition, program installable form or executable performed in the image information processing device of embodiment The file record of form is in CD-ROM, floppy disc (FD), CD-R, DVD (Digital Versatile Disk:Digital multi CD) etc. provide in computer-readable storage medium.
In addition it is also possible to by the program storage performed in the image information processing device of embodiment with internet etc. On the computer of network connection, and provided by being downloaded via network.In addition it is also possible to by the image information of embodiment The program performed in reason device is provided or configured via the network of internet etc..
In addition it is also possible to which the program performed in the image information processing device of embodiment is pre-installed in ROM etc. And provide.

Claims (10)

1. a kind of image information processing device, including:
Collection portion, the image for the commodity that collection image pickup part is imaged;
Candidate display portion, when the identifying processing of the image by the commodity collected based on the collection portion can not automatically determine for When specifying commodity, the commodity candidate for extracting the candidate for the commodity out from the benchmark commodity stored is shown;And
Informing portion, is defined as what can not be automatically determined in advance when there are in the commodity candidate shown by the candidate display portion During the non-determined commodity of commodity, inform based on the uncertain specified commodity of the commodity candidate.
2. image information processing device according to claim 1, wherein,
The informing portion judges the business shown by the candidate display portion when the determination rate based on each commodity preordering of correspondence It there are in product candidate when not meeting regulation and determining the non-determined commodity of rate, inform and refer to based on the commodity candidate is uncertain Determine commodity.
3. image information processing device according to claim 2, wherein,
The informing portion is described in judge to there are in the commodity candidate shown by the candidate display portion and be arbitrarily designated During non-determined commodity, inform based on the uncertain specified commodity of the commodity candidate.
4. image information processing device according to any one of claim 1 to 3, wherein,
Informing portion display corresponding with the display location of the non-determined commodity represents the information of uncertain specified commodity.
5. image information processing device according to any one of claim 1 to 3, in addition to:
Merchandise news processing unit, when the commodity candidate shown by the candidate display portion is selected one, execution has been selected Commodity merchandise news processing.
6. a kind of control method of image information processing device, comprises the following steps:
Acquisition step, the image for the commodity that collection image pickup part is imaged;
Candidate display step, when the identifying processing of the image of the commodity by being collected based on the acquisition step can not be automatically true When being set to specified commodity, the commodity candidate for extracting the candidate for the commodity out from the benchmark commodity stored is shown;And
Informing step, there are in by the commodity candidate shown by the candidate display step and is defined as being unable to oneself in advance During the non-determined commodity of the dynamic commodity determined, inform based on the uncertain specified commodity of the commodity candidate.
7. control method according to claim 6, wherein,
The informing step is judged to show by the candidate display step when the determination rate based on each commodity preordering of correspondence Commodity candidate in there are when not meeting regulation and determining the non-determined commodity of rate, inform not true based on the commodity candidate Surely commodity are specified.
8. control method according to claim 7, wherein,
The informing step, which is worked as, to be judged to there are what is be arbitrarily designated in the commodity candidate shown by the candidate display step During the non-determined commodity, inform based on the uncertain specified commodity of the commodity candidate.
9. the control method according to any one of claim 6 to 8, wherein,
Informing step display corresponding with the display location of the non-determined commodity represents the information of uncertain specified commodity.
10. the control method according to any one of claim 6 to 8, in addition to:
Merchandise news process step, when being selected one by the commodity candidate shown by the candidate display step, holds The merchandise news processing for the commodity that row has been selected.
CN201410799219.2A 2014-01-21 2014-12-19 Image information processing device and its control method Expired - Fee Related CN104794831B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710813377.2A CN107665556B (en) 2014-01-21 2014-12-19 Image information processing apparatus and control method thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-008953 2014-01-21
JP2014008953A JP6193136B2 (en) 2014-01-21 2014-01-21 Image information processing apparatus and program

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201710813377.2A Division CN107665556B (en) 2014-01-21 2014-12-19 Image information processing apparatus and control method thereof

Publications (2)

Publication Number Publication Date
CN104794831A CN104794831A (en) 2015-07-22
CN104794831B true CN104794831B (en) 2017-09-01

Family

ID=53559604

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201710813377.2A Expired - Fee Related CN107665556B (en) 2014-01-21 2014-12-19 Image information processing apparatus and control method thereof
CN201410799219.2A Expired - Fee Related CN104794831B (en) 2014-01-21 2014-12-19 Image information processing device and its control method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201710813377.2A Expired - Fee Related CN107665556B (en) 2014-01-21 2014-12-19 Image information processing apparatus and control method thereof

Country Status (2)

Country Link
JP (1) JP6193136B2 (en)
CN (2) CN107665556B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017018602A1 (en) * 2015-07-30 2017-02-02 엘지전자 주식회사 Mobile terminal and method for controlling same
JP6760780B2 (en) * 2016-07-04 2020-09-23 東芝テック株式会社 Information processing equipment and programs
JP6908491B2 (en) * 2017-10-10 2021-07-28 東芝テック株式会社 Product information reader and program
CN107967773A (en) * 2017-12-01 2018-04-27 旗瀚科技有限公司 A kind of supermarket self-help purchase method of view-based access control model identification
CN110992140A (en) * 2019-11-28 2020-04-10 浙江由由科技有限公司 Matching method and system for recognition model
US20210248889A1 (en) * 2020-02-06 2021-08-12 Toshiba Tec Kabushiki Kaisha Article display system
CN112466068B (en) * 2020-11-26 2021-07-09 融讯伟业(北京)科技有限公司 Intelligent weighing device and intelligent weighing method based on computer vision technology

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001011553A1 (en) * 1999-08-10 2001-02-15 Ajax Cooke Pty Ltd Item recognition method and apparatus
CN1791894A (en) * 2003-06-26 2006-06-21 国际商业机器公司 Apparatus, method, and system for positively identifying an item
CN102376136A (en) * 2010-08-23 2012-03-14 东芝泰格有限公司 Store system and a sales registration method
EP2533217A1 (en) * 2011-06-07 2012-12-12 Teraoka Seiko Co., Ltd. Commodity search device and commodity information processing device
CN103295346A (en) * 2012-02-29 2013-09-11 东芝泰格有限公司 Information processing apparatus, store system and information processing method

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5403657B2 (en) * 2009-02-23 2014-01-29 Necインフロンティア株式会社 Stationary scanner, POS terminal, and settlement product selection method
US9710491B2 (en) * 2009-11-02 2017-07-18 Microsoft Technology Licensing, Llc Content-based image search
JP5571633B2 (en) * 2011-08-31 2014-08-13 東芝テック株式会社 Health level notification device, program, and health level notification method
JP5483622B2 (en) * 2011-08-31 2014-05-07 東芝テック株式会社 Store system and program
JP5194160B1 (en) * 2011-10-19 2013-05-08 東芝テック株式会社 Information processing apparatus, information processing method, and program
JP2013210971A (en) * 2012-03-30 2013-10-10 Toshiba Tec Corp Information processing apparatus and program
JP5707375B2 (en) * 2012-11-05 2015-04-30 東芝テック株式会社 Product recognition apparatus and product recognition program
JP5529982B2 (en) * 2013-01-09 2014-06-25 東芝テック株式会社 Information processing device
JP5550126B2 (en) * 2013-06-18 2014-07-16 Necインフロンティア株式会社 Stationary scanner, POS terminal, and settlement product selection method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001011553A1 (en) * 1999-08-10 2001-02-15 Ajax Cooke Pty Ltd Item recognition method and apparatus
CN1791894A (en) * 2003-06-26 2006-06-21 国际商业机器公司 Apparatus, method, and system for positively identifying an item
CN102376136A (en) * 2010-08-23 2012-03-14 东芝泰格有限公司 Store system and a sales registration method
EP2533217A1 (en) * 2011-06-07 2012-12-12 Teraoka Seiko Co., Ltd. Commodity search device and commodity information processing device
CN103295346A (en) * 2012-02-29 2013-09-11 东芝泰格有限公司 Information processing apparatus, store system and information processing method

Also Published As

Publication number Publication date
CN107665556B (en) 2020-06-26
JP6193136B2 (en) 2017-09-06
CN104794831A (en) 2015-07-22
CN107665556A (en) 2018-02-06
JP2015138350A (en) 2015-07-30

Similar Documents

Publication Publication Date Title
CN104794831B (en) Image information processing device and its control method
CN105608808B (en) Information processing unit and its control method, store system
CN104766413B (en) Information processor and its control method
CN103295346B (en) Signal conditioning package, store system and information processing method
CN106373298B (en) Information processing unit and its control method
CN104766416A (en) Information processing device, control method thereof, store system
JP6747873B2 (en) Information processing device and program
JP2014052800A (en) Information processing apparatus and program
CN107437087A (en) Identifying system, information processor and control method
JP6208091B2 (en) Information processing apparatus and program
CN107437312A (en) Information processor and its control method, terminal device
JP5437404B2 (en) Information processing apparatus, store system, and program
JP6336351B2 (en) Information processing apparatus and program
CN104299131A (en) Information processing apparatus and controlling method thereof
CN104299337B (en) Information processor and its control method
JP5770899B2 (en) Information processing apparatus and program
JP6503670B2 (en) Item registration apparatus, item registration method, and item registration program
JP6517398B2 (en) Information processing apparatus and program
JP5797703B2 (en) Information processing apparatus, store system, and program
JP2013156940A (en) Information processor, store system and program
JP6177199B2 (en) Information processing apparatus and program
JP5802803B2 (en) Information processing apparatus and program
JP2013156933A (en) Information processor, store system and program
JP5885708B2 (en) Information processing apparatus, store system, and program
JP6306776B2 (en) Information processing apparatus and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170901

CF01 Termination of patent right due to non-payment of annual fee