JP2018128989A - Image processing device, pos terminal, forgetting-to-take-out prevention method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device, a POS terminal, a forgetting-to-take-out prevention method, and a program that can prevent forgetting to take out.SOLUTION: An image processing device of an embodiment includes image processing means, determination means, detection means, and transmission means. The image processing means performs image processing on the basis of an operation performed by an operator. The determination means determines that the operator has terminated the operation. In the case where it is determined by the determination means that the operator has terminated the operation, the detection means detects that there is an object having been forgotten to take out by the operator. In the case where the object having been forgotten to take out is detected by the detection means, the transmission means transmits data indicating that there is the object having been forgotten to take out to a predetermined transmission destination.SELECTED DRAWING: Figure 3

Description

  Embodiments described herein relate generally to an image processing apparatus, a POS terminal, a forgetting prevention method, and a program.

  A store such as a convenience store includes a store in which an image processing device such as an MFP (multifunction peripheral) is placed. In such a store, the user may forget to take a document or the like in the image processing apparatus or the like. In a conventional image processing apparatus, the user is urged to be alerted by performing a display not to forget to take it out or by sounding a buzzer sound. However, there are always traces of customers who forget to take care even if they are cautioned in this way. The forgotten manuscript may contain important documents such as a resident's card or insurance card, and there is a risk that it will be misused if it is picked up by a malicious person.

JP-A-60-26329

Due to the circumstances as described above, it is desired to reduce forgetting.
The problem to be solved by the embodiments of the present invention is to provide an image processing apparatus, a POS terminal, a forgetting prevention method, and a program capable of preventing forgetting to remove.

  The image processing apparatus according to the embodiment includes an image processing unit, a determination unit, a detection unit, and a transmission unit. The image processing means performs image processing based on the operation of the operator. The determination means determines that the operator has finished the operation. When the determination unit determines that the operator has finished the operation, the detection unit detects that there is an object forgotten by the operator. When the forgotten object is detected by the detecting means, the transmitting means transmits data indicating that there is an forgotten object to a predetermined transmission destination.

The block diagram which shows each principal part circuit structure of the in-store system which concerns on embodiment, and the apparatus contained in the said in-store system. The schematic diagram which shows an example of the external appearance of the image processing apparatus in FIG. 2 is a flowchart of control processing by a CPU of the image processing apparatus in FIG. The flowchart of the control processing by CPU of the POS terminal in FIG. The figure which shows an example of the image displayed on the screen of the display device of the POS terminal in FIG. 2 is a flowchart of control processing by a CPU of the image processing apparatus in FIG. The figure which shows an example of the image displayed on the screen of the display device of the POS terminal in FIG.

Hereinafter, an in-store system according to an embodiment will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a main circuit configuration of each of an in-store system 1 and an apparatus included in the in-store system 1 according to the embodiment. The in-store system 1 is installed in a store such as a convenience store, a supermarket, a store-type printing company, or another store. The in-store system 1 includes an image processing device 100, a POS (point of sales) terminal 200, an imaging device 300, a storage device 400, a coin vendor 500, and a handy terminal 600. The image processing device 100, the POS terminal 200, the imaging device 300, the storage device 400, and the handy terminal 600 are connected to a network NW. The network NW typically includes a local area network (LAN). The network NW may include a wide area network (WAN). The network NW may be a wireless line or a wired line. The network NW may include a mixture of wireless lines and wired lines. In FIG. 1, only one image processing apparatus 100, POS terminal 200, imaging apparatus 300, storage apparatus 400, coin vendor 500, and handy terminal 600 are shown. However, the number of the image processing device 100, the POS terminal 200, the imaging device 300, the storage device 400, the coin vendor 500, and the handy terminal 600 is not limited to one each. Each of the device 300, the storage device 400, the coin vendor 500, and the handy terminal 600 may be installed in any number of stores or the like.

  The image processing apparatus 100 performs image processing such as printing, scanning, and copying. When performing the image processing, the image processing apparatus 100 functions as an image processing unit. The image processing apparatus 100 is, for example, a multifunction peripheral (MFP) or a multi-copy machine. The image processing apparatus 100 is operated by a customer or the like. The image processing apparatus 100 includes a central processing unit (CPU) 101, a main memory 102, an auxiliary storage device 103, a communication interface 104, an input device 105, a display device 106, an image forming unit 107, and an image reading unit 108 as main circuit configurations. A reader / writer 109 and a bus 110.

  The CPU 101 corresponds to a central part of a computer that performs processing and control necessary for the operation of the image processing apparatus 100. The CPU 101 controls each unit to realize various functions of the image processing apparatus 100 based on a program such as an operating system or application software stored in the main memory 102 or the auxiliary storage device 103.

  The main memory 102 corresponds to the main storage portion of the computer. The main memory 102 may store a program such as an operating system or application software. The main memory 102 is used as a so-called work area that stores data temporarily used when the CPU 101 performs various processes.

  The auxiliary storage device 103 corresponds to the auxiliary storage portion of the computer. The auxiliary storage device 103 is, for example, an EEPROM (electrically erasable programmable read-only memory), an HDD (hard disk drive), or an SSD (solid state drive). The auxiliary storage device 103 may store a program such as the above operating system or application software. In addition, the auxiliary storage device 103 stores data used when the CPU 101 performs various processes, data generated by processes performed by the CPU 101, and the like.

  The program stored in the main memory 102 or the auxiliary storage device 103 includes a control program described regarding control processing of the image processing apparatus 100, which will be described later. As an example, the image processing apparatus 100 is transferred to an administrator of the image processing apparatus 100 with the control program stored in the main memory 102 or the auxiliary storage device 103. However, the image processing apparatus 100 may be transferred to an administrator or the like in a state where a control program described regarding control processing described later is not stored in the main memory 102 or the auxiliary storage device 103. The image processing apparatus 100 may be transferred to an administrator or the like with another control program stored in the main memory 102 or the auxiliary storage device 103. Then, a control program described regarding control processing to be described later may be separately transferred to an administrator or the like and written to the auxiliary storage device 103 under the operation of the administrator or a service person. The transfer of the control program at this time can be realized, for example, by recording on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, a semiconductor memory, or by downloading via a network.

  The communication interface 104 is an interface for the image processing apparatus 100 to communicate via the network NW.

The input device 105 receives an operation by an operator of the image processing apparatus 100. The input device 105 is, for example, a keyboard, a keypad, or a touch pad.
The display device 106 displays a screen for notifying the operator of the image processing apparatus 100 of various information. The display device 106 is a display such as a liquid crystal display or an organic EL (electro-luminescence) display. In addition, as the display device 106, a display panel arranged so as to overlap with a touch pad can be used. That is, the display panel included in the touch panel can be used as the display device 106, and the touch pad included in the touch panel can be used as the input device 105.

  The image forming unit 107 includes a printer that performs printing on a sheet such as paper. The printer is typically a laser printer. Alternatively, the printer may be another printer such as an ink jet printer.

  The image reading unit 108 includes a scanner that reads an image. The scanner is an optical reduction type equipped with an image sensor such as a CCD (charge-coupled device) image sensor. Alternatively, for example, the scanner is a contact image sensor (CIS) system including an image sensor such as a complementary metal-oxide-semiconductor (CMOS) image sensor. The scanner may be any other known method. The scanner reads an image from a sheet or the like by using these methods.

  The reader / writer 109 can insert a memory card such as a USB (Universal Serial Bus) memory or an SD memory card, an optical disc such as a CD (Compact Disc) or a DVD (Digital Versatile Disc), or other storage media. The reader / writer 109 reads data from a storage medium or writes data to the storage medium. The reader / writer 109 detects that a storage medium is inserted into the reader / writer 109.

  The bus 110 includes an address bus, a data bus, and the like, and transmits signals transmitted and received by each unit of the image processing apparatus 100.

  The image processing apparatus 100 will be further described with reference to FIG. FIG. 2 is a schematic diagram illustrating an example of the appearance of the image processing apparatus. For example, the image processing apparatus 100 includes a document table 121, a cover 122, a document feeding device 123, an ADF paper feed tray 124, an ADF paper discharge tray 125, an operation panel 126, a paper feed tray 127, a paper discharge tray 128, and a relay device 129. , Finisher 130 and finisher discharge tray 131.

  The document table 121 is a table for placing a document or the like to be read by the image reading unit 108.

  The cover 122 is provided so that it can be opened and closed. The operator of the image processing apparatus 100 generally opens the cover 122 when placing a document on the document table 121, closes the cover 122 after placing the document on the document table 121. The closed cover 122 presses a document placed on the document table 121.

  The document feeder 123 automatically feeds a sheet-like document placed on the ADF paper feed tray. An image is read by the image reading unit 108 from the document fed by the document feeder 123. The document feeder 123 further discharges the document whose image has been read to the ADF discharge tray 125. The document feeder 123 is also called DF (document feeder) or ADF (auto document feeder).

  The ADF paper feed tray 124 is a tray for placing a sheet-like document or the like on which the image reading unit 108 wants to read an image. The ADF paper feed tray 124 includes a sensor 1241. The sensor 1241 detects that a document or the like is placed on the ADF paper feed tray 124. The sensor 1241 is, for example, a weight sensor that performs detection based on the weight of the document. Alternatively, for example, the sensor 1241 is an optical sensor that performs detection using light. The sensor 1241 may be another known sensor.

  The ADF discharge tray 125 is a tray on which the document discharged from the document feeder 123 is placed. The ADF paper discharge tray 125 includes a sensor 1251. The sensor 1251 detects that a document or the like is placed on the ADF discharge tray 125. Similar to the sensor 1241, the sensor 1251 is a weight sensor, an optical sensor, or another known sensor.

  The operation panel 126 is provided for an operator of the image processing apparatus 100 to perform an operation. The operation panel 126 includes an input device 105 and a display device 106.

  The paper feed tray 127 is a tray for storing sheets such as paper. The sheets stored in the paper feed tray 127 are conveyed to the image forming unit 107.

  A paper discharge tray 128 is a tray from which a sheet printed by the image forming unit 107 is discharged. The paper discharge tray 128 includes a sensor 1281. The sensor 1281 detects that a sheet or the like is placed on the paper discharge tray 128. The sensor 1281 is a weight sensor, an optical sensor, or other known sensors, like the sensor 1241.

  The relay device 129 is a device for connecting the finisher 130. The relay device 129 is detachable. When the relay apparatus 129 is attached to the image processing apparatus 100, the sheet is not discharged to the discharge tray 128 and is conveyed into the relay apparatus 129. The relay device 129 transports the sheet transported into the relay device 129 into the finisher 130.

  The finisher 130 is connected to the relay device 129. The finisher 130 is detachable. The finisher 130 performs various types of processing on the sheet conveyed into the finisher 130. The processing performed by the finisher 130 is, for example, folding, drilling, stapling, cutting, or binding. The finisher 130 discharges the processed sheet to the finisher discharge tray 131. Alternatively, the finisher 130 discharges the sheet conveyed into the finisher 130 as it is to the finisher discharge tray 131 without processing.

  The finisher discharge tray 131 is a tray on which sheets discharged from the finisher 130 are placed. The finisher discharge tray 131 includes a sensor 1311. The sensor 1311 detects that a sheet or the like is placed on the finisher discharge tray 131. Similar to the sensor 1241, the sensor 1311 is a weight sensor, an optical sensor, or another known sensor.

Returning to FIG. 1, the description of the in-store system 1 will be continued.
The POS terminal 200 is installed for a cash register operation such as purchase registration of a product to be settled. The POS terminal 200 is typically a terminal on the POS system. The POS terminal 200 is operated by a store clerk or the like. The POS terminal 200 may be able to make a settlement for the registered product in addition to the purchase registration of the product. Alternatively, a payment device may be installed in the store separately from the POS terminal 200. That is, the POS terminal 200 may be a registration device in a semi-self checkout system. The POS terminal 200 is an example of a terminal device. The POS terminal 200 includes a CPU 201, a main memory 202, an auxiliary storage device 203, a communication interface 204, an input device 205, a display device 206, and a bus 207 as main circuit configurations.

  The CPU 201 corresponds to a central part of a computer that performs processing and control necessary for the operation of the POS terminal 200. The CPU 201 controls each unit to realize various functions of the POS terminal 200 based on a program such as an operating system or application software stored in the main memory 202 or the auxiliary storage device 203.

  The main memory 202 corresponds to the main storage portion of the computer. The main memory 202 may store a program such as an operating system or application software. The main memory 202 is used as a so-called work area that stores data temporarily used when the CPU 201 performs various processes.

  The auxiliary storage device 203 corresponds to the auxiliary storage portion of the computer. The auxiliary storage device 203 is, for example, an EEPROM, HDD, or SSD. The auxiliary storage device 203 may store programs such as the above operating system or application software. In addition, the auxiliary storage device 203 stores data used when the CPU 201 performs various processes, data generated by processes performed by the CPU 201, and the like. The auxiliary storage device 203 also stores a product list that is a list of products registered as purchased products. Alternatively, the main memory 202 may store the product list. Further, the auxiliary storage device 203 also stores a product database including various information such as a product code, a product name, and a price for a product sold in the store.

  The program stored in the main memory 202 or the auxiliary storage device 203 includes a control program described regarding control processing of the POS terminal 200, which will be described later. As an example, the POS terminal 200 is transferred to an administrator of the POS terminal 200 with the control program stored in the main memory 202 or the auxiliary storage device 203. However, the POS terminal 200 may be transferred to an administrator or the like in a state where a control program described regarding control processing described later is not stored in the main memory 202 or the auxiliary storage device 203. The POS terminal 200 may be transferred to an administrator or the like with another control program stored in the main memory 202 or the auxiliary storage device 203. Then, a control program described regarding control processing described later may be separately transferred to an administrator or the like and written to the auxiliary storage device 203 under the operation of the administrator or a serviceman. The transfer of the control program at this time can be realized, for example, by recording on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, a semiconductor memory, or by downloading via a network.

  The communication interface 204 is an interface for the POS terminal 200 to communicate via the network NW.

The input device 205 receives an operation by an operator of the POS terminal 200. The input device 205 is, for example, a keyboard, a keypad, or a touch pad.
The display device 206 displays a screen for notifying the operator of the POS terminal 200 of various information. The display device 206 is a display such as a liquid crystal display or an organic EL display, for example. In addition, as the display device 206, a display panel arranged so as to overlap the touch pad can be used. That is, the display panel included in the touch panel can be used as the display device 206, and the touch pad included in the touch panel can be used as the display device 206.

  The bus 207 includes an address bus, a data bus, and the like, and transmits signals transmitted and received by each unit of the POS terminal 200.

  The imaging device 300 images the inside of the store. The imaging device 300 may capture a range that does not include the image processing device 100, or may capture a range that includes part or all of the image processing device 100. In addition, when the imaging range of the imaging apparatus 300 includes a part or all of the image processing apparatus 100, the range includes the reader / writer 109, the document table 121, the ADF paper feed tray 124, the ADF paper ejection tray 125, and the paper ejection tray. It is preferable to include places where forgetting to take place such as 128 and finisher discharge tray 131. The imaging device 300 outputs the captured moving image. The imaging device 300 is, for example, a video camera that captures moving images. It is preferable that the imaging apparatus 300 also serves as a security camera or a surveillance camera.

The storage device 400 performs recording by storing a moving image or moving image data output from the imaging device 300. The storage device 400 is, for example, a video deep recorder, HDD, SSD, memory card reader / writer, or optical drive. Note that the storage device 400 may be connected to the imaging device 300 without going through the network NW. The storage device 400 may be integrated with the imaging device 300 or built in the imaging device 300. The storage device 400 may be integrated with the POS terminal 200 or built in the POS terminal 200. Alternatively, the storage device 400 may be integrated with the image processing apparatus 100 or built in the image processing apparatus 100.
The imaging device 300 and the storage device 400 cooperate to function as a recording unit that records the installation facility of the image processing device.

The storage device 400 can operate in at least two modes of the first mode and the second mode. The storage device 400 operates as one of the following (A) to (C), for example.
(A)
In the first mode, the storage device 400 (A) constantly records the moving image output from the imaging device 300. Then, the storage device 400 (A) continuously records, for example, by overwriting from the oldest when the storage capacity becomes full.
In the second mode, the storage device 400 (A) performs recording in the same manner as in the first mode. However, for example, the storage device 400 (A) prevents the moving image from being overwritten while operating in the second mode. Alternatively, for example, the storage device 400 (A) separately stores a moving image while operating in the second mode. Note that the storage device 400 (A) is not limited to the time when it is operating in the second mode, but overwrites the moving image starting from a time point that is a predetermined time after starting the operation in the second mode. It may be stored so that it cannot be done or separately. In addition, the storage device 400 (A) may raise at least one of the image quality and the frame rate of the moving image when recording in the second mode than when recording in the first mode.
(B)
The storage device 400 (B) does not record in the first mode.
The storage device 400 (B) performs recording in the second mode. Note that it is preferable that the storage device 400 (B) be unable to overwrite a moving image recorded in the second mode.
(C)
The storage device 400 (C) performs recording in the same manner in both the first mode and the second mode. However, in the second mode, the storage device 400 (C) makes it possible to know which part was recorded while operating in the second mode.

The coin vendor 500 is connected to the image processing apparatus 100. The coin vendor 500 is installed to charge for various processes performed by the image processing apparatus 100. An operator of the image processing apparatus 100 puts currency such as banknotes or coins into the coin vendor 500. The image processing apparatus 100 performs various processes based on the operation by the operator within the range of the amount of money put into the coin vendor 500.
The coin vendor 500 performs settlement. That is, based on an operation by a user or the like, an amount obtained by subtracting the sum of the amounts according to various processes performed by the image processing apparatus 100 from the input amount is discharged as change. Then, the coin vendor 500 issues a receipt or the like as necessary.
Note that the coin vendor 500 may be one that can use electronic money such as an IC card in place of banknotes and coins, or in addition to banknotes and coins.

  The handy terminal 600 is operated by a store clerk or the like. The handy terminal 600 is a terminal for a store clerk to carry and use. As an example, the handy terminal 600 is a terminal on a POS system. The handy terminal 600 is used for business such as inspection, stocking or inventorying, for example. Wireless communication is used for communication between the handy terminal 600 and the network NW. The handy terminal 600 includes a display device for notifying the operator of the handy terminal 600 of various information. The display device is, for example, a display such as a liquid crystal display or an organic EL display. The handy terminal 600 may be a dedicated terminal as the handy terminal 600, or may be one using an existing tablet PC (personal computer) or a smartphone. The handy terminal 600 is an example of a mobile terminal device.

  Hereinafter, operation | movement of the in-store system 1 which concerns on embodiment is demonstrated based on FIGS. Note that the content of the processing in the following description of the operation is an example, and various processing that can obtain the same result can be used as appropriate. FIG. 3 is a flowchart of control processing by the CPU 101 of the image processing apparatus 100. The CPU 101 executes this control process based on a control program stored in the main memory 102 or the auxiliary storage device 103. FIG. 4 is a flowchart of control processing by the CPU 201 of the POS terminal 200. The CPU 201 executes this control process based on a control program stored in the main memory 202 or the auxiliary storage device 203.

In Act 1 of FIG. 3, the CPU 101 of the image processing apparatus 100 waits for the use of the image processing apparatus 100 to start. Several examples are given below as methods for determining that use has started. The CPU 101 determines that the use has started, for example, when a fee is charged to the coin vendor 500. Alternatively, for example, the CPU 101 determines that the use has started when any operation is performed on the input device 105. Alternatively, for example, the CPU 101 determines that the use has started when the sensor 1221 detects that the cover 122 is opened or a document or the like is placed on the ADF paper feed tray 124. Alternatively, for example, the CPU 101 determines that the use has started when the user stands in front of the image processing apparatus 100. For example, a sensor such as a motion sensor (not shown) is used to detect that the user is standing in front of the image processing apparatus 100. Alternatively, for example, the CPU 101 detects that the user has stood in front of the image processing apparatus 100 by analyzing a moving image captured by the imaging apparatus 300. If the use of the image processing apparatus 100 is started, the CPU 101 determines Yes in Act1 and proceeds to Act2.
In the above, several methods for determining that the use has started have been exemplified, but the CPU 101 may perform a plurality of methods as exemplified above. Then, if it is determined that the use is started by at least one of the plurality of methods, it is determined Yes in Act1 and the process proceeds to Act2.

In Act 2, the CPU 101 waits for the use of the image processing apparatus 100 to end. Several examples are given below as a method for determining that the use has been terminated. The CPU 101 determines that the use has been completed, for example, when the coin vendor 500 starts payment. Alternatively, for example, the CPU 101 determines that the use is finished when the coin vendor 500 finishes the payment. Alternatively, for example, the CPU 101 determines that the use has been completed when the operator of the image processing apparatus 100 performs an operation for instructing the input device 105 to end. Alternatively, for example, the CPU 101 determines that the use is finished when the user leaves the front of the image processing apparatus 100. For example, a sensor such as a motion sensor (not shown) is used to detect that the user has left the front of the image processing apparatus 100. Alternatively, for example, the CPU 101 detects that the user has left the front of the image processing apparatus 100 by analyzing a moving image captured by the imaging apparatus 300. If the use of the image processing apparatus 100 is terminated, the CPU 101 determines Yes in Act2 and proceeds to Act3.
In the above, several methods for determining that the use has been completed have been exemplified. However, the CPU 101 may perform a plurality of methods as exemplified above. If it is determined that the use has been completed by at least one of the plurality of methods, the determination in Act2 is Yes and the process proceeds to Act3.
As described above, by performing the process of Act2, the computer having the CPU 101 as the center functions as a determination unit that determines that the operator has finished the operation.
Note that the CPU 101 performs processing for controlling various operations such as printing, scanning, and copying in parallel with the processing of Act2 by executing the processing in a thread different from the processing of Act2.

In Act 3, the CPU 101 determines whether a forgotten item is detected. The CPU 101 detects forgotten things as follows, for example.
For example, if the CPU 101 performs a process for scanning a document placed on the document table 121 in the process performed in parallel with Act 2, if the cover 122 cannot be opened after that, the document table It is determined that the document on 121 is forgotten.
Further, for example, when the sensor 1241, the sensor 1251, the sensor 1281, or the sensor 1311 is reacting, the CPU 101 determines that the tray in which the sensor is installed has been left behind. That is, if the sensor that reacts is the sensor 1241, the ADF paper feed tray, the sensor 1251 the ADF paper discharge tray, the sensor 1281 the paper discharge tray 128, and the sensor 1311 the paper finisher tray 131. Determine that there is something forgotten.
For example, if a storage medium is inserted into the reader / writer 109, the CPU 101 determines that the storage medium has been forgotten.
If the forgotten item is not detected, the CPU 101 determines No in Act3 and returns to Act1. If a forgotten item is detected, the CPU 101 determines Yes in Act3 and proceeds to Act4.
As described above, by performing the processing of Act3, the computer having the CPU 101 as the center functions as a detection unit that detects that there is an object that has been forgotten by the operator.

  In Act 4, the CPU 101 generates a notification command to notify the operator of the POS terminal 200, which is a predetermined transmission destination, that the forgotten thing has been detected. The notification command includes information indicating a location (for example, the document table 121) where a forgotten item is detected. Then, the CPU 101 instructs the communication interface 104 to transmit the generated notification command to the POS terminal 200. Upon receiving this instruction, the communication interface 104 transmits the notification command to the POS terminal 200. The transmitted notification command is received by the communication interface 204 of the POS terminal 200. As described above, by performing the processing of Act4, the computer having the CPU 101 as the center cooperates with the communication interface 104 to transmit data for informing that there is an object that has been forgotten to a predetermined transmission destination. It functions as a transmission means for transmitting.

  On the other hand, in Act 21 of FIG. 4, the CPU 201 of the POS terminal 200 confirms whether or not the notification command is received by the communication interface 204. If the notification command is not received, the CPU 201 determines No in Act 21 and proceeds to Act 22. Therefore, by performing the processing of Act 21, the computer having the CPU 201 as the center serves as a receiving unit that receives data for informing that the image processing apparatus has forgotten something in cooperation with the communication interface 204. Function. At this time, the computer having the CPU 201 as a center functions as reception control means for controlling the communication interface 204.

  In Act 22, the CPU 201 confirms whether or not a status command is received by the communication interface 204. If the status command is not received, the CPU 201 determines No in Act 22 and returns to Act 21. Thus, the CPU 201 repeats Act 21 and Act 22 until a notification command or a status command is received. The status command will be described later.

If an end command is received when the CPU 201 is in the standby state of Act 21 and Act 22, the CPU 201 determines Yes in Act 21 and proceeds to Act 23.
In Act 23, the CPU 201 generates an image corresponding to the notification screen SC1 as shown in FIG. 5 in order to notify that the forgotten thing is detected by the image processing apparatus 100. Then, the CPU 201 instructs the display device 206 to display the generated image. Upon receiving this instruction, the display device 206 displays the notification screen SC1.

FIG. 5 is a diagram illustrating an example of the notification screen SC1. Notification screen SC1 includes area A1. The area A1 is displayed to notify that the forgotten thing is detected by the image processing apparatus 100. The area A1 is displayed as a pop-up, for example. The area A1 includes a character string ST1 and a button B1. The character string ST1 indicates that the forgotten thing is detected by the image processing apparatus 100. The character string ST1 indicates a location where a forgotten item is detected. As an example, the character string ST1 is a character string such as “Forgotten things have occurred in the copier. Check (occurrence location: document table)”. The button B1 is a button for the operator of the POS terminal 200 to operate when instructing to end the display of the notification screen SC1. In addition, although area | region A2 is also shown in FIG. 5, area | region A2 is mentioned later.
As described above, by performing the processing of Act 23, the computer having the CPU 201 as a center functions as a notification unit that performs a notification operation for notifying the store clerk that there is an object that has been forgotten in the image processing apparatus.

The CPU 201 proceeds to Act 24 after the processing of Act 23.
In Act 24, the CPU 201 generates a portable command in order to notify the operator of the handy terminal 600 that a forgotten item has been detected. The portable command includes information indicating a location (for example, the document table 121) where a forgotten item is detected. Then, the CPU 201 instructs the communication interface 204 to transmit the generated portable command to the handy terminal 600. Upon receiving this instruction, the communication interface 204 transmits the portable command to the handy terminal 600. The transmitted portable command is received by the handy terminal 600.
The handy terminal 600 that has received the portable command displays on the display device a screen that includes content for notifying that the forgotten thing has been detected by the image processing apparatus 100.
As described above, by performing the processing of Act 24, the computer having the CPU 201 as a center functions as a notification unit that performs a notification operation for notifying the store clerk that there is an object that has been forgotten in the image processing apparatus.

On the other hand, the CPU 101 of the image processing apparatus 100 proceeds to Act5 after the process of Act4 in FIG.
In Act 5, the CPU 101 starts a notification operation for notifying the operator of the image processing apparatus 100 that a forgotten item has been detected. That is, for example, the CPU 101 displays on the display device 106 that a forgotten item has been detected. Further, for example, the CPU 101 causes a buzzer sound or a sound to be sounded by an unillustrated speaker or the like so that the operator of the image processing apparatus 100 is aware that the forgotten thing has been detected. After the processing of Act5, the CPU 101 proceeds to Act6.

  In Act 6, the CPU 101 determines whether a forgotten object is detected in the same manner as in Act 3. If a forgotten item is not detected, the CPU 101 determines Yes in Act 6 and proceeds to Act 7. For example, a forgotten item that is noticed as being left behind is removed from the image processing apparatus 100 by the owner of the lost item, so that the forgotten item is not detected. Alternatively, for example, a forgotten item is not detected by a person other than the owner of the forgotten item being removed from the image processing apparatus 100.

  In Act 7, the CPU 101 confirms whether or not the use of the image processing apparatus 100 is started in the same manner as Act 1. If the use of the image processing apparatus 100 is not started, the CPU 101 determines No in Act 7 and returns to Act 6. Thus, the CPU 101 repeats Act6 and Act7 until no forgotten thing is detected or the use of the image processing apparatus 100 is started.

  If the forgotten thing is no longer detected when the CPU 101 is in the standby state of Act6 and Act7, the CPU 101 determines No in Act6 and proceeds to Act8.

  In Act 8, the CPU 101 generates an end command to notify the POS terminal 200 that the forgotten thing is no longer detected. Then, the CPU 101 instructs the communication interface 104 to transmit the generated end command to the POS terminal 200. In response to this instruction, the communication interface 104 transmits the end command to the POS terminal 200. The transmitted end command is received by the communication interface 204 of the POS terminal 200.

On the other hand, the CPU 201 of the POS terminal 200 proceeds to Act 25 after the processing of Act 24 in FIG.
In Act 25, the CPU 201 confirms whether or not an end command has been received by the communication interface 204. If the end command is not received, the CPU 201 determines No in Act 25 and proceeds to Act 26.

  In Act 26, the CPU 201 confirms whether or not an operation for terminating the display of the notification screen SC1 has been performed. That is, the CPU 201 confirms whether a predetermined operation such as operating the button B1 has been performed. If the operation for terminating the display of the notification screen SC1 is not performed, the CPU 201 determines No in Act 26 and proceeds to Act 27.

  In Act 27, the CPU 201 confirms whether or not a status command is received as in Act 22. If the status command is not received, the CPU 201 determines No in Act 27 and returns to Act 25. Thus, the CPU 201 repeats Act25 to Act27 until a notification command or a status command is received or an operation for terminating the display of the notification screen SC1 is performed. The status command will be described later.

  If an end command is received when the CPU 201 is in the standby state of Act25 to Act27, the CPU 201 determines Yes in Act25 and proceeds to Act28. On the other hand, if an operation to end the display of the notification screen SC1 is performed when the CPU 201 is in the standby state of Act23 to Act27, the CPU 201 determines Yes in Act26 and proceeds to Act28.

  In Act 28, the CPU 201 ends the display of the notification screen SC1. That is, the CPU 201 generates an image corresponding to a screen that does not include the area A1. Then, the CPU 201 instructs the display device 206 to display the generated image. Upon receiving this instruction, the display device 206 displays a screen based on the image. After the processing of Act 28, the CPU 201 returns to Act 21.

On the other hand, the CPU 101 of the image processing apparatus 100 proceeds to Act 9 after the process of Act 8 in FIG.
In Act 9, the CPU 101 ends the notification operation started in Act 5. After the processing of Act9, the CPU 101 returns to Act1.

If the use of the image processing apparatus 100 is started when the CPU 101 is in the standby state for Act6 and Act7, the CPU 101 determines Yes in Act7 and proceeds to Act10.
In Act 10, the CPU 101 generates a recording command. Then, the CPU 101 instructs the communication interface 104 to transmit the generated recording command to the storage device 400 that is a predetermined transmission destination. Upon receiving this instruction, the communication interface 104 transmits the recording command to the storage device 400. The transmitted recording command is received by the storage device 400.
The storage device 400 that has received the recording command shifts from the operation in the first mode to the operation in the second mode.
As described above, by performing the processing of Act 10, the computer having the CPU 101 as the center functions as a recording control unit that changes the recording mode of the recording unit that captures and records the image processing apparatus to a mode that stores the recorded moving image. To do.

After the processing of Act10, the CPU 101 proceeds to Act11.
In Act 11, the CPU 101 waits for the use of the image processing apparatus 100 to end in the same manner as Act 2. If the use of the image processing apparatus 100 is terminated, the CPU 101 proceeds to Act 12. By performing the process of Act11, the computer having the CPU 101 as a center functions as a determination unit that determines that the operator has finished the operation.

In Act 12, the CPU 101 generates a stop command. Then, the CPU 101 instructs the communication interface 104 to transmit the generated stop command to the storage device 400. In response to this instruction, the communication interface 104 transmits the stop command to the storage device 400. The transmitted stop command is received by the storage device 400.
The storage device 400 that has received the stop command shifts from the operation in the second mode to the operation in the first mode.
After the processing of Act12, the CPU 101 returns to Act3.

  The CPU 101 of the image processing apparatus 100 performs the control process shown in FIG. 6 in parallel with the control process shown in FIG. 3 by executing it in a thread different from the control process shown in FIG. FIG. 6 is a flowchart of control processing by the CPU 101 of the image processing apparatus 100.

  In Act 31 of FIG. 6, the CPU 101 of the image processing apparatus 100 waits for the state of the image processing apparatus 100 to change. If the state of the image processing apparatus 100 changes, the CPU 101 determines Yes in Act 31 and proceeds to Act 32. The state of the image processing apparatus 100 will be described later.

In Act 32, the CPU 101 generates a state command including information indicating the state of the image processing apparatus 100 whose change has been confirmed in Act 31. Then, the CPU 101 instructs the communication interface 104 to transmit the generated status command to the POS terminal 200. Upon receiving this instruction, the communication interface 104 transmits the status command to the POS terminal 200. The transmitted status command is received by the communication interface 204 of the POS terminal 200. The CPU 101 returns to Act1 after the processing of Act32.
The state of the image processing apparatus 100 is as follows when exemplified by the itemized list.
The image processing apparatus 100 is in use (not empty).
The image processing apparatus 100 is not used (is empty).
-Waiting for copying, printing or scanning.
・ Copying, printing, or scanning.
・ Checkout is in progress.
-An error has occurred.
As described above, by performing the processing of Act32, the computer having the CPU 101 as a center functions as a transmission unit that cooperates with the communication interface 104 to transmit the state of the image processing apparatus to a predetermined transmission destination.

On the other hand, if the status command is received in the standby state of Act 21 and Act 22 in FIG. 4, the CPU 201 of the POS terminal 200 determines Yes in Act 22 and proceeds to Act 29.
In Act 29, the CPU 201 generates an image corresponding to the status screen SC2 as shown in FIG. 7 in order to notify the status of the image processing apparatus 100 included in the status command. Then, the CPU 201 instructs the display device 206 to display the generated image. Upon receiving this instruction, the display device 206 displays the status screen SC2. After the processing of Act 29, the CPU 201 returns to Act 21.

  FIG. 7 is a diagram illustrating an example of the status screen SC2. Status screen SC2 includes area A2. In the area A2, a character string indicating what state the image processing apparatus 100 is currently in is displayed. In the area A2, for example, “MFP1: In use (copying)” is displayed. Among these, “MFP 1” is a name for identifying the image processing apparatus 100. When a plurality of image processing apparatuses 100 are set in the store, for example, “MFP1”, “MFP2”,... The “in use (copying)” portion indicates the state of the image processing apparatus 100 identified by “MFP 1”.

If a status command is received in the standby state of Act25 to Ac26, the CPU 201 determines Yes in Act27 and proceeds to Act30.
In Act 30, the CPU 201 performs the same operation as in Act 29. The status screen displayed in Act 30 is, for example, a screen such as a notification screen SC1 shown in FIG. The notification screen SC1 displayed here includes a region A1 and a region A2. After the processing of Act30, the CPU 201 returns to Act25.

  According to the in-store system 1 of the embodiment, the image processing apparatus 100 detects an object that has been forgotten by the operator when the operator finishes using the image processing apparatus 100. When the image processing apparatus 100 detects an object that has been forgotten by the operator, the image processing apparatus 100 transmits a notification command indicating that there is an object that has been forgotten to the POS terminal 200 that is a predetermined transmission destination. The POS terminal 200 that has received the notification command can notify that there is an object that has been forgotten based on the notification command. Then, the store clerk who notices the notification can inform the operator that there is an object that has been forgotten. In this way, the image processing apparatus 100 can prevent forgetting to remove it. In addition, since the predetermined transmission destination is the POS terminal 200, the store clerk can easily notice the notification.

  Further, according to the in-store system 1 of the embodiment, the image processing apparatus 100 transmits a state command indicating the state of the image processing apparatus 100 to the POS terminal 200 that is a predetermined transmission destination. The POS terminal 200 that has received the status command notifies the status of the image processing apparatus 100 based on the status command. By this notification, the store clerk can know the state of the image processing apparatus 100. As a result, the store clerk knows that the operator is likely to end the use of the image processing apparatus 100. Therefore, in the case where the operator has forgotten to take the image, the store clerk can be quickly compared with the case where the state of the image processing apparatus 100 is not known. It is possible to respond.

Further, according to the in-store system 1 of the embodiment, the image processing apparatus 100 sets the recording mode of the storage device 400 to the first recording mode when use of the image processing apparatus 100 is started when forgetting to take it occurs. The mode is changed to the second mode. When the storage device 400 is operating in the second mode, the recorded moving image is prohibited from being overwritten, or the recorded moving image is stored separately. Thereby, the storage device 400 stores a moving image of a scene in which an important part, for example, a person who has taken away something left is shown. In addition, when the imaging device 300 is imaging the range including a part or all of the image processing device 100, there is a high possibility that an important scene such as a moment when the forgotten item is taken away is reflected. In particular, when the imaging range of the imaging apparatus 300 includes a place where the image processing apparatus 100 is forgotten to be taken, there is a high possibility that the forgotten thing itself is reflected.
Further, according to the in-store system 1 of the embodiment, the storage device 400 may improve at least one of the image quality and the frame rate when operating in the second mode than when operating in the first mode. When constantly recording with a security camera or the like, at least one of the image quality and the frame rate of the moving image may be lowered in order to save the recording capacity or extend the recording time. By increasing at least one of the image quality and the frame rate only in the second mode, the image quality and frame of a scene in which an important part, for example, a person who has taken away a forgotten object is reflected, while saving the recording capacity or extending the recording time are maintained. At least one of the rates can be increased.

  Further, according to the in-store system 1 of the embodiment, the POS terminal 200 controls the handy terminal 600 so as to notify that the forgotten thing is detected by the image processing apparatus 100. Therefore, even when the store clerk is in the backyard, warehouse, or sales floor, that is, when the cashier operation is not performed, if the handy terminal 600 is carried, the forgotten item is detected by the image processing apparatus 100. I can know that.

The embodiment described above can be modified as follows.
Part of the processing performed by the image processing apparatus 100 in the above embodiment may be performed by the POS terminal 200. Alternatively, part of the processing performed by the image processing apparatus 100 in the above embodiment may be performed by the cooperation of the image processing apparatus 100 and the POS terminal 200.
The processing performed by the POS terminal 200 in the above embodiment may be performed by a computer (not shown) such as a PC or a server. Alternatively, the processing performed by the POS terminal 200 in the above embodiment may be performed by cooperation between the POS terminal 200 and a computer (not shown).

  The recording command and the stop command may be transmitted by the POS terminal 200. By receiving the notification transmitted from the image processing apparatus 100, the POS terminal 200 can know that the use of the image processing apparatus 100 has been started and ended.

  In the above embodiment, the image processing apparatus 100 changes the recording mode of the storage device 400 from the first mode to the second mode when an operation by the operator is started after the forgotten object is detected. However, the image processing apparatus 100 may change the recording mode of the storage device 400 from the first mode to the second mode when a forgotten item is detected. That is, for example, the CPU 101 performs the process of Act10 before any of the processes of Act4 to Act7.

  When the coin vendor 500 can use an IC card or the like, the in-store system 1 may store an ID (identifier) or the like for identifying the IC card or the like used when a forgotten item is detected. . Then, the in-store system 1 may use the stored ID for identifying an individual. Thereby, when the IC card identified by the stored ID is used again, the in-store system 1 previously forgotten the image processing apparatus 100 or the user who used the IC card to use the store. It is determined that the person is the same person. If the in-store system 1 determines that the person is the same person, the in-store system 1 may notify the store clerk or the customer that the forgotten item has been detected when the IC card has been used before. The ID may be stored in either the image processing apparatus 100 or the POS terminal 200. Alternatively, the ID may be stored in a storage device (not shown). The above processing is controlled by, for example, the image processing apparatus 100, the POS terminal 200, or a computer (not shown). Alternatively, the above processing is controlled by, for example, any one of the image processing apparatus 100, the POS terminal 200, and a computer (not shown) cooperating.

  The in-store system 1 may store data indicating the feature of the face calculated based on the face image or moving image of the operator imaged by the imaging device 300 when the forgotten thing is detected. The in-store system 1 may use the stored data for identifying an individual. Thereby, the in-store system 1 images the face of the user who uses the store or the user who uses the image processing apparatus 100, and determines whether the face of the user matches the stored data. Then, if the user's face matches the stored data, the in-store system 1 determines that the user is the same person as the person who previously left the thing. Further, if the in-store system 1 determines that the person is the same person, the in-store system 1 may notify the store clerk or the operator that there has been a forgotten thing before. The above processing is controlled by, for example, the image processing apparatus 100, the POS terminal 200, or a computer (not shown). Alternatively, the above processing is controlled by, for example, any one of the image processing apparatus 100, the POS terminal 200, and a computer (not shown) cooperating.

  The in-store system 1 may include a device that can make a sound, such as a bell or a speaker. When the in-store system 1 detects that an operator who has operated the image processing apparatus 100 is about to go out of the store when a forgotten item is detected, a predetermined sound from a bell or a speaker, etc. You may sound. The detection is performed, for example, by analyzing a moving image captured by the imaging apparatus 300. By doing in this way, the store clerk who heard the sound can know that the forgotten thing has occurred and that the owner of the forgotten thing is going out of the store. Further, it is easy for the operator, that is, the owner of the lost item to notice that the lost item is being lost. The above processing is controlled by, for example, the image processing apparatus 100, the POS terminal 200, or a computer (not shown). Alternatively, the above processing is controlled by, for example, any one of the image processing apparatus 100, the POS terminal 200, and a computer (not shown) cooperating.

The in-store system may include a terminal device such as an electronic cash register that is not a terminal on the POS system, instead of the POS terminal 200.
The in-store system may be installed in a facility other than a store such as a library. In this case, the in-store system includes, in place of the POS terminal, a PC or a dedicated terminal for operation by the staff of the facility. The PC or dedicated terminal is an example of a terminal device.

  The image processing apparatus may not include an image forming unit. That is, the image processing apparatus may be an apparatus that reads an image, such as a scanner. Further, the image processing apparatus may not include an image reading unit. In other words, the image processing apparatus may be an apparatus that performs image formation, such as a printer.

  In the above embodiment, the storage device 400 operates in at least two modes of the first mode and the second mode. However, the imaging apparatus 300 may operate in at least two modes. That is, for example, the imaging apparatus 300 performs imaging in the second mode without performing imaging in the first mode. Alternatively, for example, the imaging apparatus 300 performs imaging so that the bit rate of moving image data output in the second mode is smaller than that in the first mode.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... In-store system, 100 ... Image processing apparatus, 101, 201 ... CPU, 102, 202 ... Main memory, 103, 203 ... Auxiliary storage device, 104, 204 ... Communication interface, 105, 205 ... Input device, 106, 206 ... Display device 107... Image forming unit 108... Image reading unit 109... Reader / writer 110 207 BUS 121 121 Document base 122 122 Cover 123 Document feeder 124 124 ADF paper tray 125 ADF paper discharge tray, 126 ... operation panel, 127 ... paper feed tray, 128 ... paper discharge tray, 129 ... relay device, 130 ... finisher, 131 ... finisher paper discharge tray, 200 ... POS terminal, 300 ... imaging device, 400 ... Storage device, 500 ... coin bender, 600 ... handy terminal, A , A2 ... area, SC1 ... notification screen, SC2 ... state screen

Claims (9)

Image processing means for performing image processing based on an operator's operation;
Determining means for determining that the operator has finished the operation;
When the determination unit determines that the operator has finished the operation, the detection unit detects that there is an object that has been forgotten by the operator;
An image processing apparatus comprising: a transmission unit configured to transmit data for informing that a forgotten item is present to a predetermined transmission destination when the forgotten item is detected by the detection unit; .   The image processing apparatus according to claim 1, wherein the predetermined transmission destination is a POS terminal.   The image processing apparatus according to claim 1, wherein the transmission unit transmits the state of the image processing apparatus to the predetermined transmission destination.   Recording control means for changing the recording mode of the recording means for imaging and recording the installation facility of the image processing device to a mode for saving the recorded video when the forgotten object is detected by the detection means. The image processing apparatus according to claim 1, further comprising: Receiving means for receiving data for informing that there is an object left in the image processing apparatus;
A POS terminal comprising: a notification unit configured to perform a notification operation for notifying that there is an object forgotten in the image processing device when the data is received by the reception unit.   The POS terminal according to claim 5, wherein the notification unit causes a predetermined mobile terminal device to notify that there is an object that has been forgotten in the image processing apparatus. Perform image processing by the image processing device based on the operation of the operator,
Determining that the operator has finished operating the image processing apparatus;
When it is determined that the operator has finished operating the image processing apparatus, it is detected that there is an object that has been forgotten by the operator regarding the image processing,
A method for preventing forgetting, wherein when the forgotten object is detected, the image processing apparatus is notified that there is an forgotten object. When the forgotten object is detected, information that can identify the operator is stored,
It is determined that the user is the same person as the operator,
The forgetting prevention method according to claim 7, wherein when the user is determined to be the same person as the operator, the user is notified that he / she has forgotten something before. A computer provided in a terminal device equipped with a communication interface,
Reception control means for controlling the communication interface so as to receive data indicating that there is an object left in the image processing apparatus;
When the data is received by the communication interface, a program for functioning as notification means for performing a notification operation for notifying that there is an object that has been forgotten in the image processing apparatus.