JP2015200839A - Image forming system, image forming apparatus, camera, control method of image forming apparatus, control method of camera, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To present, to a user, the stock status of consumables that are consumed in an image forming apparatus in association with a stock area by photographing the stock area storing the consumables.SOLUTION: An image forming system including an image forming apparatus that communicates with a camera determines whether or not a camera capable of photographing a stock area storing consumables has been registered on the basis of identification information specifying the detected consumables. When the camera is determined to have been registered, the image forming system notifies the camera of a request to acquire the total stock of the consumables together with the identification information specifying the consumables. The image forming system then acquires the current total stock of the consumables specified by the identification information from the camera and displays the acquired current total stock of the consumables on display means in association with the stock area.

Description

  The present invention relates to an image forming system, an image forming apparatus, a camera, an image forming apparatus control method, a camera control method, and a program.

  Conventionally, in an image forming system for managing an image forming apparatus connected to a network, a warning is normally given when the remaining amount of consumables and supplies held in the image forming apparatus decreases. I have been.

  At that time, the user or the manager will go to the place where the replacement parts for consumables and the replenishment items for supplies are stored, and the replacement parts and replenishment items will be transported to the image forming apparatus for replacement or replenishment It has generally been done.

  In such a case, the following is generally performed as a method for managing whether or not these replacement parts and supply items are stored at the place where the replacement parts and supply items are stored. That is, the manager in charge inputs the quantity to the image forming system by taking an inventory at an appropriate time, and the image forming system detects the occurrence of a warning due to the decrease in the remaining amount and the elimination thereof. In some cases, the quantity is subtracted.

  Alternatively, there is a management system that can automatically detect the stock quantity. As an example of such a system, there is a method realized by mounting a wireless transmission / reception device on the image forming apparatus, the replacement part, or the supply article (see, for example, Patent Document 1). In this method, when the image forming apparatus detects a decrease in the remaining amount of the image forming apparatus, the wireless communication apparatus communicates with the replacement parts and the replenishment articles placed around the image forming apparatus itself. By performing the above, automatic detection of the stock quantity is realized.

JP 2002-111943 A

  However, in the prior art as described above, the wireless transmission / reception apparatus attached to each of the replacement parts and the replenishment articles must use a power source and an antenna of a limited size. . Affixing the wireless transmitter / receiver one by one to a replacement part or a replenishment article increases costs.

  On the other hand, the range in which the stock quantity can be automatically detected is only the range in which the radio waves transmitted from the image forming apparatus by the wireless transmitting / receiving apparatus can reach. Depending on these conditions, the range in which inventory can be confirmed using this method must be narrow. In addition, even if it is known that there is stock in this method, it is impossible to determine where the stock is when the storage location is divided into a plurality of locations.

  As a result, even if the remaining amount of consumables and supplies decreases on the image forming apparatus, the user can know only whether there is inventory. As a result, in order to obtain replacement parts and replenishment articles, it was necessary to take time and effort to go around the stock storage locations.

The present invention has been made to solve the above-described problems, and an object of the present invention is to capture a stock area for storing consumables consumed by the image forming apparatus and to associate the stock area with the stock area. It is to provide a mechanism that can present the stock status of consumables to the user.

The image forming system of the present invention that achieves the above object has the following configuration.
An image forming system in which an image forming apparatus and a camera communicate with each other, wherein the image forming apparatus uses detection means for detecting a remaining amount of the consumables and identification information for identifying the consumables detected by the detecting means. Based on the determination means for determining whether or not a camera capable of photographing the stock area for storing the consumables is registered, and, if determined to be registered, the consumables together with identification information for identifying the consumables. A notification means for notifying the camera of a request for acquiring a stock quantity of the product, an acquisition means for obtaining a current stock quantity of the consumable product specified by the identification information from the camera, and a current stock of the acquired consumable product Display control means for displaying the quantity on the display means in association with the inventory area, and the camera is used for photographing an inventory area for storing a stock of consumables consumed by the image forming apparatus. And analyzing a stock image of a specific consumable item extracted from a photographed image of an inventory area associated with the identification information acquired from the image forming apparatus, and analyzing the consumable item associated with the identification information. It is characterized by comprising: a detecting means for detecting a current stock quantity; and a sending means for sending the current stock quantity of the detected consumables to the image forming apparatus.

  According to the present invention, it is possible to present a user with a stock status of consumables in a state corresponding to the stock area by photographing a stock area where consumables consumed by the image forming apparatus are stored.

1 is a block diagram illustrating a configuration of an image forming system. 2 is a block diagram illustrating an internal configuration of the image forming apparatus. FIG. It is a block diagram explaining the internal structure of an information processing apparatus. It is a block diagram explaining the internal structure of a network camera. It is a figure which shows the table managed with an image forming system. 3 is a flowchart illustrating a control method of the image forming system. 3 is a flowchart illustrating a control method of the image forming system. 3 is a flowchart illustrating a control method of the image forming system. 3 is a flowchart illustrating a control method of the image forming system. 6 is a diagram illustrating a UI screen displayed on the image forming apparatus. FIG. 4 is a flowchart illustrating a control method of the image forming system. It is a figure which shows the table managed with an image forming system. 4 is a flowchart illustrating a control method of the image forming system. 4 is a flowchart illustrating a control method of the image forming system. 4 is a flowchart illustrating a control method of the image forming system. It is a figure which shows the table managed with an image forming system. 4 is a flowchart illustrating a control method of the image forming system. It is a figure which shows the table managed with an image forming system. 4 is a flowchart illustrating a control method of the image forming system. 4 is a flowchart illustrating a control method of the image forming system. 4 is a flowchart illustrating a control method of the image forming system. It is a figure which shows the table managed with an image forming system. 4 is a flowchart illustrating a control method of the image forming system. 4 is a flowchart illustrating a control method of the image forming system.

Next, the best mode for carrying out the present invention will be described with reference to the drawings.
<Description of system configuration>
[First Embodiment]
FIG. 1 is a block diagram illustrating a configuration of an image forming system according to the present exemplary embodiment.
In FIG. 1, reference numeral 1001 denotes a network. Reference numeral 1002 denotes an image forming apparatus. Reference numeral 1003 denotes an image forming apparatus. Reference numeral 1004 denotes a network camera. Reference numeral 1005 denotes a network camera. Reference numeral 1006 denotes an information processing apparatus. Note that the network cameras 1004 and 1005 and the image forming apparatuses 1002 and 1003 are configured to be able to communicate with each other via the network 1001.

2 is a block diagram showing an internal configuration of the image forming apparatus shown in FIG. Hereinafter, the image forming apparatus shown in FIG. 1 will be described as an example. In the following description, the image forming apparatus 1002 will be taken up and described. However, the image forming apparatus 1003 is the same unless otherwise distinguished.
In FIG. 2, reference numeral 2100 denotes a controller unit. Reference numeral 2200 denotes an engine unit. Reference numeral 2101 denotes a main bus of the controller unit. Reference numeral 2102 denotes a central processing unit (hereinafter referred to as CPU). Reference numeral 2103 denotes a memory controller, 2104 denotes a read-only memory (hereinafter referred to as ROM), and 2105 denotes a readable / writable memory (hereinafter referred to as RAM).

Reference numeral 2106 denotes a storage controller, and 2107 denotes a storage device such as a solid state storage device (hereinafter referred to as SSD) or a hard disk device (hereinafter referred to as HDD). A plurality of 2107 storage devices may be connected.
A network interface 2108 connects the controller unit 2100 to the network 101.

  An HID controller 2109 controls an interactive input / output device (hereinafter referred to as HID). Reference numeral 2110 denotes an output device such as a display device for presenting information to the user, and reference numeral 2111 denotes an input device such as a keypad or a touch panel for the user to input instructions and data. A plurality of output devices 2110 and 2111 input devices may be connected. Reference numeral 2112 denotes an engine interface.

  Reference numeral 2201 denotes a scanner control unit. Reference numeral 2202 denotes a scanner. 2203 is a sensor installed in the scanner, and 2204 is a sensor installed in the 2202 scanner. These sensors 2203 and 2204 are used, for example, to detect whether or not an original is placed on the scanner 2202 or to detect the paper size and orientation of the original. If the scanner 2202 is equipped with a paper feed mechanism, it may be used to detect that a paper jam has occurred in the paper feed mechanism. Depending on the specific configuration of the scanner 2202, there may be one sensor or three or more sensors.

Reference numeral 2205 denotes a printer control unit. Reference numeral 2206 denotes a printer. 2207 is a sensor installed in the printer, and 2208 is a sensor installed in the 2206 printer. These sensors 2207 and 2208 are used, for example, to detect the remaining amount of toner or ink used for printing, or to detect the remaining amount of paper supplied to the paper feed mechanism. Alternatively, it may be used to detect that a paper jam has occurred in the paper feed mechanism during printing. There may be one of these sensors depending on the specific configuration of the printer 2206, or three or more sensors may be installed.
Reference numeral 2209 denotes a peripheral device control unit. Reference numeral 2300 denotes a peripheral device connected to the engine unit 2200. For example, the peripheral device 2300 includes an automatic document feeder (hereinafter referred to as ADF) connected to a scanner and a multi-stage paper discharge device connected to a printer.

FIG. 3 is a block diagram illustrating an internal configuration of the information processing apparatus 1006 illustrated in FIG.
In FIG. 3, reference numeral 3001 denotes a main bus. Reference numeral 3002 denotes a CPU.
Reference numeral 3003 denotes a memory controller. Reference numeral 3004 denotes a ROM. Reference numeral 3005 denotes a RAM. Reference numeral 3006 denotes a storage controller. Reference numeral 3007 denotes a storage device. A network interface 3008 connects the information processing apparatus 1006 and the network 1001. Reference numeral 3009 denotes an HID controller. Reference numeral 3010 denotes an output device, and reference numeral 3011 denotes an input device.

FIG. 4 is a block diagram illustrating the internal configuration of the network camera 1004 shown in FIG.
In FIG. 4, reference numeral 1004 denotes a network camera. Although the network camera 1004 will be described below for explanation, the network camera 1005 is the same except when it is necessary to distinguish between them.
Reference numeral 4001 denotes a main bus for connecting an internal device of the network camera 1004. Reference numeral 4002 denotes a CPU. Reference numeral 4003 denotes a memory controller. Reference numeral 4004 denotes a ROM. Reference numeral 4005 denotes a RAM. Reference numeral 4006 denotes a storage controller. Reference numeral 4007 denotes a storage apparatus.
A network interface 4008 connects the network camera 1004 and the network 1001. Reference numeral 4009 denotes a camera controller. Reference numeral 4010 denotes a video signal generation unit that generates a video signal from a signal output from the camera unit 4011. Reference numeral 4011 denotes a camera unit.

  Reference numeral 4012 denotes a lens driving unit that drives the lens unit 4013. Reference numeral 4013 denotes a lens unit. Reference numeral 4014 denotes a pan head control unit that controls the pan head unit 4015.

FIG. 5A illustrates data stored in the memories in the image forming apparatuses 1002 and 1003. This example is an example schematically illustrating the contents of network camera data stored in a memory storing a network camera list and a memory storing a storage location monitoring camera.
In FIG. 5A, reference numeral 8001 denotes a network camera ID which is a unique ID (identification information) assigned to the network camera. Reference numeral 8002 denotes a network address of the network camera. Reference numeral 8003 denotes an installation location that is information indicating a location where the network camera is installed. Reference numeral 8004 denotes a component ID which is a unique ID (identification information) assigned to a consumable item or the like (a replacement component or a supply item) that is in stock in a range covered by the network camera.

FIG. 5B is a diagram showing data stored in the memory in the network camera. This example is an example schematically illustrating the contents of package data stored in a memory for storing package data and a memory for storing a package data list.
In FIG. 5B, reference numeral 9001 denotes a package data ID that is a unique ID of stored package data. Reference numeral 9002 denotes package recognition target image data indicating image data including features that are easily recognized on the appearance of the package used in package recognition. Reference numeral 9003 denotes a package recognition target character that indicates a character string printed on a package that may be available at the time of package recognition. Reference numeral 9004 denotes a part type indicating a part type to which the replacement part or the replenishment article having the appearance of the package belongs. 9005 is a compatible model that can use replacement parts or supply items indicated by these packages. Reference numeral 9006 denotes a part ID which is a unique ID assigned to a replacement part or a supply article having a package indicated by these data.

FIG. 5C shows data stored in the memory in the network camera. This example is an example schematically illustrating the contents of the stock area data stored in the memory that stores the stock area.
In FIG. 5C, reference numeral 10001 denotes a stock area data ID that is a unique ID of a stored stock area. Reference numeral 10002 denotes a lens control parameter which is an example of a parameter necessary for capturing an image of the stock area. Here, an example in which the angle of view and the objective distance are held here is shown. Reference numeral 10003 denotes a pan head control parameter which is another example of a parameter necessary for capturing a video of the stock area. Here, an example is shown in which the longitude and latitude when capturing the target area is held here. Reference numeral 10004 denotes a part ID which is a unique ID assigned to a replacement part or a supply article stored in an inventory area photographed by this parameter.

FIG. 5D is a diagram illustrating data stored in the memory in the information processing apparatus. In this example, the contents of the image forming apparatus data stored in the memory for storing the image forming apparatus list data are schematically illustrated.
In FIG. 5D, 11001 is an image forming apparatus ID that is a unique ID assigned to the stored image forming apparatus. 11002 is the network address of the image forming apparatus. 11003 is the model name of the image forming apparatus.

  FIG. 6 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to a procedure in which the information processing apparatus 1006 sets network camera inventory area data for the network camera 1004 by the administrator. Note that each step of the information processing apparatus 1006 is realized by the CPU 3002 executing the stored module. Each step of the network camera 1004 is realized by executing a module in which the CPU 4002 is stored.

  In FIG. 6, when the process is started, the user who is an administrator selects the network camera 1004 for setting the stock area data by operating the input device 2111 in step S12001. In subsequent S 12002, the information processing apparatus 1006 transmits a setting operation start notification to the network camera 1004. In step S12003, the network camera 1004 receives the notification. In step S12004, the network camera 1004 transmits the acquired image to the information processing apparatus 1006.

  In step S12005, the information processing apparatus 1006 receives an image transmitted from the network camera 1004. In step S <b> 12006, the information processing apparatus 1006 displays the received image on the output device 3010.

In step S12007, the information processing apparatus 1006 acquires a user instruction input from the input device 3011. As the user's instruction input, a part type instruction, a camera control command, an inventory area designation command, package data selection, an end instruction, and the like are assumed.
In subsequent S12008, CPU 3002 of information processing apparatus 1006 determines the type of instruction input by the user.

  If the CPU 3002 determines that the instruction input is a component type instruction, the process advances to step S12009. In step S12009, the information processing apparatus 1006 transmits the input content of the component type instruction input by the user to the network camera. In subsequent S12010, the network camera 1004 acquires the input content of the component type instruction and stores it in the memory in the network camera 1004. When the storage of the input content of the component type instruction is completed, the process returns to S12004 and is continued.

  On the other hand, if the CPU 3002 determines in step S12008 that the instruction input is a camera control command, the process advances to step S12011. In step S <b> 12011, the information processing apparatus 1006 acquires the content of the input camera control command and transmits it to the network camera 1004. In subsequent S 12012, network camera 1004 receives the contents of the camera control command transmitted from information processing apparatus 1006. In subsequent S12013, the camera controller 4009 of the network camera 1004 controls each part of the network camera 1004 according to the contents of the command. If camera control is performed, the process returns to S12004 and is continued.

In step S12008, if the CPU 3002 determines that the instruction input is a stock area designation command for designating that the range designated by the current video is a stock area, the process advances to step S12014.
In step S12014, the information processing apparatus 1006 transmits an inventory area designation command to the network camera 1004. In step S12015, the network camera 1004 receives the command transmitted from the information processing apparatus 1006. In step S12016, the network camera 1004 instructs generation and storage of inventory area information. Then, the network camera 1004 generates inventory area information from the input contents of the received component type instruction and the current camera state. When the generation is completed, the network camera 1004 stores the generated information in a memory in the network camera 1004. When the storage is completed, the process returns to S12004 and continues.

  On the other hand, if the CPU 3002 of the information processing apparatus 1006 determines that the instruction input is selection of package data in S12008, the process proceeds to S12017. In step S12017, the information processing apparatus 1006 transmits package data to the network camera 1004. This package data is selected by the user from the package data stored in the memory in the information processing apparatus 1006. If transmission is performed, the process advances to step S12018, and the network camera 1004 receives package data from the information processing apparatus 1006. When the network camera 1004 receives the package data, the process advances to step S12019. The network camera 1004 stores the package data in a memory in the network camera 1004. When the storage is completed, the process returns to S12004 and continues.

  On the other hand, if the CPU 3002 determines in step S12008 that the instruction input is an end instruction, the process advances to step S12020. In step S12020, the information processing apparatus 1006 notifies the network camera 1004 of the end of the stock area data setting operation. In S12021, when the network camera 1004 receives a notification of the end of the stock area data setting operation, this process is completed. Then, all the stock area data setting operations are completed.

  FIG. 7 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to a procedure in which the administrator sets monitoring camera data for setting the network camera 1004 as a monitoring camera for the image forming apparatus 1002. Note that each step of the information processing apparatus 1006 is realized by the CPU 3002 executing the stored module. Each step of the network camera 1004 is realized by executing a module in which the CPU 4002 is stored. Each step of the image forming apparatus 1002 is realized by the CPU 2102 executing the stored module. In this embodiment and other embodiments, the term “memory” corresponds to a storage device provided as hardware in each of the image forming apparatus 1002, the network camera 1004, and the information processing apparatus 1006.

When the process starts, first, the user who is an administrator operates the input device 2111 to select one of the image forming apparatuses connected to the network 1001 in step S16001. Here, description will be made assuming that the image forming apparatus 1002 is selected as the image forming apparatus.
In step S 16002, the information processing apparatus 1006 transmits to the image forming apparatus 1002 a notification that the monitoring camera data setting operation is started. In step S 16003, the image forming apparatus 1002 receives the response and returns a response to that effect to the information processing apparatus 1006.

  In step S <b> 16004, the user operates the input device 3011 to select any network camera on the network 1001. Here, it is assumed that the network camera 1004 is selected as the network camera.

  In step S <b> 16005, the information processing apparatus 1006 acquires the camera address of the selected network camera 1004 from the memory storing the network camera list data, and transmits the acquired camera address to the image forming apparatus 1002. In subsequent S 16006, the image forming apparatus 1002 receives the camera address transmitted from the information processing apparatus 1006.

  In step S <b> 16007, the image forming apparatus 1002 tries to connect a camera to the camera address. In step S <b> 16008, the network camera 1004 accepts a camera connection attempt and returns a response to the image connection apparatus 1002.

  In step S <b> 16009, the image forming apparatus 1002 transmits a request for acquiring camera detailed information to the network camera 1004. In step S16010, the network camera 1004 receives the request from the image forming apparatus 1002. Then, the network camera 1004 returns detailed information of the operating network camera 1004 to the image forming apparatus 1002 as a response to the request.

  In step S16011, the image forming apparatus 1002 acquires the response from the network camera 1004. In subsequent S16012, the image forming apparatus 1002 stores the information in a memory that stores the information of the storage location monitoring camera.

When the storage is completed in this way, the image forming apparatus 1002 returns a response to the information processing apparatus 1006 in step S16013. In step S <b> 16014, the information processing apparatus 1006 receives the response from the image forming apparatus 1002. In subsequent S16015, the information processing apparatus 1006 acquires the user's next instruction input.
If there is a next instruction input by the user, the process proceeds to S16016, where the CPU 3002 of the information processing apparatus 1006 determines the type of instruction input. If the CPU 3002 determines that the type of instruction input is a camera selection instruction, the process returns to S16004 and continues. On the other hand, if the CPU 3002 determines that the type of instruction input is an end instruction, the process advances to step S16017.

  In step S16017, the information processing apparatus 1006 transmits a notification indicating the end of the setting operation to the image forming apparatus 1002. In S16018, when the image forming apparatus 1002 receives the notification from the information processing apparatus 1006, the entire process ends.

  FIG. 8 is a flowchart for explaining a control method in the image forming system shown in FIG. 8A corresponds to a procedure in which the administrator sets data in the image forming apparatus list in order to register the image forming apparatus 1002 as a selectable image forming apparatus on the information processing apparatus 1006. Note that each step of the information processing apparatus 1006 is realized by the CPU 3002 executing the stored module. Each step of the image forming apparatus 1002 is realized by the CPU 2102 executing the stored module.

In step S <b> 19001, the user who is an administrator inputs an address to the information processing apparatus 1006 to specify an image forming apparatus. Here, as an example, it is assumed that the user inputs an address indicating the image forming apparatus 1002.

In subsequent S19002, the information processing apparatus 1006 tries to connect to the designated image forming apparatus. In step S 19003, the image forming apparatus 1002 accepts a connection attempt and returns a response to the information processing apparatus 1006.

In step S19004, the information processing apparatus 1006 receives the response from the image forming apparatus 1002. The information processing apparatus 1006 that has received the response transmits an acquisition request for detailed image forming apparatus information to the image forming apparatus 1002.

  In step S19005, the image forming apparatus 1002 receives an acquisition request from the information processing apparatus 1006. Upon reception, the image forming apparatus 1002 responds to the information processing apparatus 1006 with necessary detailed information.

  In step S 19006, the information processing apparatus 1006 receives the response from the image forming apparatus 1002 and acquires detailed information. In step S 19007, the information processing apparatus 1006 stores the acquired detailed information in a memory that stores image forming apparatus list data in the information processing apparatus 1006.

  In step S19008, the information processing apparatus 1006 acquires an instruction input from the user, if any. Subsequently, in S19009, the CPU 3002 of the information processing apparatus 1006 determines the type of the instruction input. If the CPU 3002 determines that the type of instruction input is an instruction to designate the next image forming apparatus, the process returns to S19001 and continues. If the type of instruction input is an end instruction, the process ends here.

  FIG. 8B corresponds to a procedure in which the administrator sets data of the network camera list in order to register the network camera 1004 as a network camera on the information processing apparatus 1006. Note that each step of the information processing apparatus 1006 is realized by the CPU 3002 executing the stored module. Each step of the network camera 1004 is realized by executing a module in which the CPU 4002 is stored.

  In step S 21001, the user who is an administrator inputs an address to specify a network camera for the information processing apparatus 1006. Here, as an example, it is assumed that the user inputs an address indicating the network camera 1004.

  In subsequent S 21002, the information processing apparatus 1006 tries to connect to the network camera 1004. In step S 21003, the network camera 1004 accepts a connection attempt and returns a response to the information processing apparatus 1006.

  In subsequent S21004, the information processing apparatus 1006 confirms that there is a response from the network camera 1004. Then, the information processing apparatus 1006 transmits a request for acquiring detailed information of the network camera 1004 to the network camera 1004.

  In subsequent S21005, the network camera 1004 receives an acquisition request from the information processing apparatus 1006. In response to the request, the network camera 1004 transmits necessary detailed information to the information processing apparatus 1006.

  In step S <b> 21006, the information processing apparatus 1006 receives and acquires detailed information transmitted from the network camera 1004. In step S21007, the information processing apparatus 1006 stores the detailed information in a memory in the information processing apparatus 1006 that stores network camera list data.

  In step S21008, the information processing apparatus 1006 acquires an instruction input from the user if there is any more. In step S21009, the CPU 3002 of the information processing apparatus 1006 determines the type of instruction input. If the CPU 3002 determines that the type of the instruction input is an instruction for specifying the next image forming apparatus, the process returns to S21001 and is continued. On the other hand, if the CPU 3002 determines that the type of instruction input is an end instruction, the process ends here.

  FIG. 9 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to an operation example of the system when the life of a consumable item such as a drum is approaching on the image forming apparatus or when the remaining amount of a supply item such as toner and paper is low.

In these processes, the image forming apparatus 1002 is determined in advance through one of the sensors 2207 and 2208 and the life of the consumables approaches a predetermined line, or the remaining amount of the supplied product decreases. It starts by detecting and notifying that it is below the lower limit.
In step S <b> 24001, the CPU 2102 of the image forming apparatus 1002 grasps information on which type of consumable or supply has been notified.

In subsequent S24002, information of the camera that monitors the place where the replacement part or the supply article corresponding to the type of consumable or supply is stored is acquired from the storage device 2107. If there is only one such camera, the CPU 2102 selects that camera. If there are a plurality of cameras, the CPU 2102 selects one of them. If it does not exist, the CPU 2102 determines whether such a camera exists in S24003, and proceeds to S24019. If one or more such cameras are found in S24003, the process proceeds to S24004.

In step S24004, the CPU 2102 transmits the type of the replacement part or supply item to the currently selected camera via the network interface 2108. Here, the description will be made assuming that the network camera 1004 is selected in the first execution of S24004. In FIG. 9, the process proceeds along the solid arrow.

  In step S <b> 24005, the network camera 1004 receives the component type transmitted from the image forming apparatus 1002. In subsequent S24006, the CPU 4002 acquires information on the stock area in which the component type is stored from the memory storing the stock area. In step S24007, the CPU 4002 controls the network camera 1004 so as to capture the stock area. In subsequent S24008, the CPU 4002 extracts an image of the stock area.

  In subsequent S <b> 24009, the CPU 4004 transmits the extracted video to the image forming apparatus 1002. In step S24010, the video is received from the network camera 1004 via the network interface 2108. In subsequent S24011, CPU 2102 returns to network camera 1004 a response that the video has been received.

  In subsequent S24012, the CPU 4002 of the network camera 1004 executes package recognition using package data stored in a memory that stores package data based on the video and the component type.

In subsequent S24013, the CPU 4002 of the network camera 1004 determines the number of packages from the result of analyzing and recognizing the package image (stock image) in the video (captured image in the stock area). If the quantity is determined, the process advances to step S24014, and the CPU 4002 of the network camera 1004 transmits the quantity to the image forming apparatus 1002. In step S24015, the CPU 2102 of the image forming apparatus 1002 receives the quantity from the network camera 1004 via the network interface 2108.

  In subsequent S24016, the CPU 2102 of the image forming apparatus 1002 determines whether or not processing has been completed for all the cameras whose component types are being monitored. If the CPU 2102 determines that the inquiry has been completed for all cameras, the process advances to step S24018. Otherwise, the process proceeds to S24017.

  In step S24017, in step S24002, the CPU 2102 of the image forming apparatus 1002 selects the next camera that has not been inquired among the acquired cameras. Then, the process returns to S24004 and is executed. If it is assumed that the network camera 1005 is selected for the second time, for example, the process proceeds to S24020 along the one-dot chain line in FIG. The subsequent processing is the same as the processing performed from S24005 by the network camera 1004.

When the processing proceeds to step S24018, the CPU 2102 of the image forming apparatus 1002 displays the video and the stock quantity obtained from the cameras that have been inquired so far in a format so that the information from the same camera can be known. Is executed, and the entire process is completed.
If the CPU 2102 of the image forming apparatus 1002 determines that there is no camera corresponding to the component type in S24003, the process proceeds to S24019, the CPU 2102 of the image forming apparatus 1002 displays an error, and the entire process is performed. finish.

FIG. 10 is a diagram illustrating an example of a UI screen displayed on the output device 2110 illustrated in FIG. In particular, FIG. 10A is an example of a typical implementation of a screen in which the stock status inquiry execution unit 5301 displays the video and the stock quantity on the output device 2110 in S24018. This screen example represents a state in which A4 size paper has been exhausted. Reference numeral 25001 denotes an entire screen. Reference numeral 25002 denotes a screen title. Reference numeral 25003 denotes a status line. In a typical implementation, a message caption for reporting a problem currently occurring on the image forming apparatus is displayed in a telop format.
Reference numeral 25004 denotes an OK button for the user to end the display of this screen.

For example, reference numeral 25005 denotes an image of an A4 sheet stock area taken by the network camera 1004 of the present embodiment and information accompanying it. In addition to displaying where the place is, it is shown that the inventory quantity is “32”.
Similarly, 25006 is an image of an inventory area of A4 paper taken by the network camera 1005 of the present embodiment and information accompanying it.

  FIG. 10B is an example of a typical implementation of a screen on which an error is displayed on the output device 2110 by the CPU 2102 of the image forming apparatus 1002 in step S24019. 25007 is a message indicating that the camera monitoring the location where the A4 size paper is stored is not registered in the system.

In the present embodiment, a network camera is appropriately installed so that a stock area for managing consumables and supplies of the image forming apparatus can be photographed. When it is detected that the remaining amount of consumables and supplies in the image forming apparatus is decreasing, it is possible to acquire the stock status of replacement parts and supplies from the network camera and present it to the user. is there. In addition, by acquiring image information obtained by taking stock taken by the camera, it is possible to present where the stock is placed. As a result, the user can accurately grasp the place where the necessary stock is placed, and can easily obtain replacement parts or replenishment articles, thereby improving convenience.
[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to the drawings.
An example of the system configuration of the second embodiment of the present invention is the same as that shown in FIG. The internal configuration of the image forming apparatus according to the second embodiment of the present invention is the same as that shown in FIG. The internal configuration of the information processing apparatus according to the second embodiment of the present invention is the same as that shown in FIG. The internal configuration of the network camera according to the second embodiment of the present invention is the same as that shown in FIG.

  In this embodiment, the procedure for registering the image forming apparatus data in the memory for storing the image forming apparatus list data on the information processing apparatus 1006 by the user as the administrator is the same as that shown in FIG.

  FIG. 11 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to a procedure in which the administrator registers the information processing apparatus 1006 as an inventory status inquiry destination from the information processing apparatus 1006 to the image forming apparatus 1002.

  When the process is started, a user who is an administrator first selects one of the image forming apparatuses connected to the network via a UI screen provided by the CPU 3002 of the information processing apparatus 1006 in S29001. Here, description will be made assuming that the image forming apparatus 1002 is selected as the image forming apparatus.

  Then, the CPU 3002 of the information processing apparatus 1006 transmits a registration notification to the image forming apparatus 1002 in subsequent S29002. In step S 29003, the CPU 2102 of the image forming apparatus 1002 receives a registration notification from the information processing apparatus 1006.

  In subsequent S 29004, the CPU 2102 of the image forming apparatus 1002 transmits a detailed information acquisition request to the information processing apparatus 1006. In step S <b> 29005, the information processing apparatus 1006 receives the request from the image forming apparatus 1002, and the CPU 3002 of the information processing apparatus 1006 transmits detailed information to the image forming apparatus 1002.

  In step S <b> 29006, the image forming apparatus 1002 receives detailed information from the information processing apparatus 1006. In subsequent S29007, the image forming apparatus 1002 stores the network address of the information processing apparatus 1006 and the received detailed information together in the memory storing the inventory status inquiry destination.

FIG. 12A schematically illustrates data contents of the information processing apparatus stored in the memory storing the inventory status inquiry destination and the memory storing the inventory monitoring event notification target.
In FIG. 12A, 30001 is an information processing apparatus ID which is a unique ID assigned to the information processing apparatus. Reference numeral 30002 denotes a network address of the information processing apparatus. Reference numeral 30003 denotes data on the installation location of the information processing apparatus. Reference numeral 30004 denotes a version of a management service implemented by a software package constituting the system operating on the information processing apparatus.

FIG. 12B schematically illustrates the contents of the inventory monitoring event notification reception target network camera and the inventory status data stored in the memory for storing the inventory monitoring event notification reception target inventory status.
In FIG. 12B, 31001 is an inventory status record ID which is a unique ID assigned to the inventory status record. 31002 is the ID of the network camera corresponding to the inventory status record. 31003 is a network address of the network camera. Reference numeral 31004 denotes a monitoring target part ID which is a part ID of a replacement part or a supply item to be monitored linked to the inventory status record. 31005 is the current inventory quantity which is the current inventory quantity of the monitored replacement part or supply item.

  FIG. 13 is a flowchart for explaining a control method in the image forming system shown in FIG. In this example, the procedure for the administrator to register the information processing apparatus 1006 as the notification destination of the inventory monitoring event from the information processing apparatus 1006 to the network camera 1004 is schematically represented by a flowchart.

  In step S <b> 34001, the user who is an administrator selects any network camera connected to the network 1001 using the UI screen provided by the CPU 3002 of the information processing apparatus 1006. Here, the description will be made assuming that the user has selected the network camera 1004 as an example.

  In step S34002, the information processing apparatus 1006 transmits a registration notification to the selected network camera 1004. In step S34003, the network camera 1004 receives a registration notification from the information processing apparatus 1006. In subsequent S34004, the network camera 1004 transmits a request for acquiring detailed information to the information processing apparatus 1006.

  In S34005, the information processing apparatus 1006 receives an acquisition request from the network camera 1004, and transmits detailed information regarding the information processing apparatus 1006 to the network camera 1004 as a response thereto. In step S34006, the network camera 1004 receives the detailed information.

  In subsequent S340007, the network camera 1004 stores information related to the information processing apparatus 1006 such as detailed information received from the information processing apparatus 1006 in a memory that stores the inventory monitoring event notification target.

  When the storage is completed, the process advances to step S34008, and the network camera 1004 returns a response that the information processing apparatus detailed information is received to the information processing apparatus 1006. In step S34009, the information processing apparatus 1006 transmits an inquiry about the component type to be monitored to the network camera 1004. In step S34010, the network camera 1004 receives the inquiry from the information processing apparatus 1006, and extracts a component type therefrom.

Here, in the memory storing the stock area, one part ID 10004 is held corresponding to the stock area data ID 10001 as shown in FIG. Therefore, it is possible to extract all the part IDs of replacement parts or supply items that can be monitored by sequentially obtaining the stock area data held in the memory that stores the stock area of the network camera 1004.
In step S34011, the network camera 1004 transmits the extracted component ID as a response to the information processing apparatus 1006.

The information processing apparatus 1006 receives the component ID from the network camera 1004 in subsequent S34012. In subsequent S34013, the information processing apparatus 1006 creates an inventory status record corresponding to the network camera and their component IDs in a memory that stores the inventory monitoring event notification reception target inventory status.
In subsequent S34014, CPU 3002 of information processing apparatus 1006 selects the first one of the component types corresponding to these component IDs. In step S34015, the information processing apparatus 1006 inquires the network camera 1004 about the inventory quantity.

  In subsequent S34016, the network camera 1004 receives the inquiry from the information processing apparatus 1006. In S34017, the network camera acquires information on the stock area storing the part type from the memory storing the stock area in order to detect the stock of the designated part.

  In step S34018, the CPU 4002 of the network camera 1004 controls the camera so as to capture the stock area. In subsequent S34019, the CPU 4002 of the network camera 1004 extracts a video of the stock area.

  In step S34020, the network camera 1004 extracts package data stored in a memory that stores package data based on the video and the component type.

In subsequent S34021, the CPU 4002 of the network camera 1004 acquires the result of recognizing the package in the video, and determines the quantity of the package. When the quantity is determined in this way, the process proceeds to S34022, and the network camera 1004 transmits the inventory quantity (stock quantity) to the information processing apparatus 1006.

  In S34023, the information processing apparatus 1006 receives the inventory quantity from the network camera 1004. In subsequent S34024, information processing apparatus 1006 records the received inventory quantity in a memory that stores the inventory monitoring event notification reception target inventory status.

When the recording of the inventory quantity is completed in this way, the process proceeds to S34025. Here, the CPU 3003 of the information processing apparatus 1006 determines whether or not the inquiry about the inventory quantity has been completed for all of the component types corresponding to these component IDs.
On the other hand, if it is determined in S34025 that the inquiry has not ended, the process proceeds to S34026, and after selecting the next component type, the process returns to S34015 and is continued.

FIG. 14 is a flowchart for explaining a control method in the image forming system shown in FIG. In this example, the network camera 1004 and the information processing device 1006 communicate with each other, and the information processing device 1006 adapts to the inventory status photographed by the network camera 1004 and corresponds to a processing procedure in which the information processing device 1006 manages inventory information.
In step S37001, the CPU 4002 of the network camera 1004 acquires the first stock area stored in the memory that stores the stock area. In subsequent S37002, the CPU 4002 of the network camera 1004 acquires the component type from the component ID recorded in the record of the inventory area.
In subsequent S37003, the CPU 4002 of the network camera 1004 controls the camera so as to capture the stock area. In subsequent S37004, the CPU 4002 of the network camera 1004 extracts an image of the stock area.

In subsequent S 37005, the CPU 4002 of the network camera 1004 executes package recognition using the package data stored in the memory storing the package data from the video and the component type.

In subsequent S 37006, the CPU 4002 of the network camera 1004 acquires the result of recognizing the package in the video and determines the quantity of the package. When the package quantity is determined, the process advances to S37007. In S37007, the CPU 4002 of the network camera 1004 compares the determined package quantity with the recorded inventory quantity. If the CPU 4002 of the network camera 1004 determines that the comparison result has been determined and changed in S37008, the process advances to S37009. If the CPU 4002 of the network camera 1004 determines that there is no change, the process advances to S37015.

  In step S37009, the CPU 4002 of the network camera 1004 acquires the first one of the targets to which the recorded notification is transmitted. In subsequent S37010, the CPU 4002 of the network camera 1004 transmits the notification to the information processing apparatus 1006. Then at S37011. The information processing apparatus 1006 receives the notification from the network camera 1004. In subsequent S37012, the information processing apparatus 1006 records the changed inventory quantity in the memory storing the inventory monitoring event notification reception target inventory status. When the recording is completed, a response to the notification is returned, and the CPU 4002 of the network camera 1004 that has received the response determines whether or not the notification has been completed for all notification targets in subsequent S37013. If the CPU 4002 of the network camera 1004 determines that it is not over, the process advances to S37014 to select the next notification target. Thereafter, the processing returns to S37010 and continues.

On the other hand, if the CPU 4002 of the network camera 1004 determines that notifications for all notification targets have been completed in S37013, the process proceeds to S37015, and the CPU 4002 of the network camera 1004 checks whether all inventory areas have been checked. judge. If the CPU 4002 of the network camera 1004 determines that the process has not ended, the process advances to S37016 to select the next inventory area, and then returns to S37002 to continue.
On the other hand, if the CPU 4002 of the network camera 1004 determines that all inventory areas have been checked in S37015, the process returns to S37001 and is repeated from the beginning.

FIG. 15 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to the operation of the system when the life of a consumable item approaches the image forming apparatus 1002 or when the remaining amount of supply item is low.
These processes are performed in advance when the CPU 2102 of the image forming apparatus 1002 approaches the upper limit of a consumable item via one of the sensors and exceeds a predetermined upper limit, or the remaining amount of the supply item decreases. Start by being notified that you are below the set lower limit.
In step S40001, the CPU 2102 of the image forming apparatus 1002 detects the remaining amount, and acquires information about which type of consumable item or supply item has been notified.

In subsequent S40002, the CPU 2102 of the image forming apparatus 1002 determines whether there is a destination for inquiring about the stock status of replacement parts or supply articles corresponding to the type of consumables or supplies. Judgment is made by searching from the memory to be stored. If the CPU 2102 of the image forming apparatus 1002 determines that an inquiry destination exists, the process advances to step S40003. On the other hand, if it is determined that there is no inquiry destination, the process proceeds to S40026.

  In subsequent S40003, the CPU 2102 of the image forming apparatus 1002 selects the first inquiry destination as described above. In step S40004, the CPU 2102 of the image forming apparatus 1002 notifies the information processing apparatus 1006 of the component type. In step S40005, the information processing apparatus 1006 receives the component type from the image forming apparatus 1002.

In step S <b> 40006, the CPU 3002 of the information processing apparatus 1006 extracts an inventory status record corresponding to the component type from the memory that stores the inventory monitoring event notification reception target inventory status. In subsequent S40007, CPU 3002 of information processing apparatus 1006 determines whether there is a network camera monitoring such a component. If the CPU 3002 of the information processing apparatus 1006 determines that there is no such network camera, the process proceeds to S40022. If the CPU 3002 of the information processing apparatus 1006 determines that a network camera exists, the process advances to S40008.
In S40008, the CPU 3002 of the information processing apparatus 1006 selects the first of such cameras. In subsequent S40009, the CPU 3002 of the information processing apparatus 1006 transmits a video acquisition request to the network camera 1004 by designating a component type.

  In step S40010, the network camera 1004 receives a video acquisition request from the information processing apparatus 1006. In subsequent S40011, the CPU 4002 of the network camera 1004 extracts the stock area corresponding to the component type from the memory storing the stock area. In subsequent step S40012, the CPU 4002 of the network camera 1004 controls the camera so that an image of the inventory area can be extracted. In step S <b> 40013, the CPU 4002 of the network camera 1004 acquires an image of the stock area. In subsequent S40014, the CPU 4002 of the network camera 1004 transmits the acquired video to the information processing apparatus 1006.

  In step S <b> 40015, the information processing apparatus 1006 receives the video from the network camera 1004. Then, the information processing apparatus 1006 transmits the video to the image forming apparatus 1002. In step S <b> 40017, the image forming apparatus 1002 receives the video from the information processing apparatus 1006.

  In subsequent S40018, the information processing apparatus 1006 transmits the inventory quantity to the image forming apparatus 1002. In step S <b> 40019, the image forming apparatus 1002 receives the inventory quantity transmitted from the information processing apparatus 1006.

In subsequent S40020, the CPU 3002 of the information processing apparatus 1006 determines whether a series of processes including transmission of component types to network cameras corresponding to all the component types has been completed. If the CPU 3002 of the information processing apparatus 1006 determines that the processing has not ended, the process proceeds to S40021, and after the next network camera is selected, the process returns to S40009 and continues. If the CPU 3002 of the information processing apparatus 1006 determines that all have been completed, the process proceeds to S40023.
If the CPU 3002 of the information processing apparatus 1006 determines that there is no network camera in S40007, the process proceeds to S40022, and an error is transmitted to the image forming apparatus 1002 as a response to the transmission of the component type. Then, the process proceeds to S40023.

In step S <b> 40023, the CPU 2102 of the image forming apparatus 1002 determines whether or not the inquiry for all registered inventory status inquiries has been completed, regardless of whether an error response is received or a video and an inventory quantity are received. If the CPU 2102 determines that the process has not been completed, the process advances to step S40024 to select the next inventory status inquiry destination, and the process returns to step S40004 and is continued.
If the CPU 2102 of the image forming apparatus 1002 determines that all the inquiries have been completed, the process advances to step S40025, and the CPU 2102 of the image forming apparatus 1002 sets the error or video and inventory quantity in units of cameras and inventory areas. Display it so that it can be distinguished with and exit.

On the other hand, if the CPU 2102 of the image forming apparatus 1002 determines that no inventory status inquiry destination corresponding to the part type is found in S40002, the process advances to S40026, and the inventory status inquiry execution unit 26301 determines an error. Display and finish the process. An example of the screen displayed here is the same as that shown in FIG.
According to the present embodiment, as in the first embodiment, when the remaining amount of consumables and supplies of the image forming apparatus is decreasing, the user can check the location where the stock is available. is there. Furthermore, in the second embodiment, the image forming apparatus can acquire the inventory status of each inventory area from the information processing apparatus without individually accessing the network camera. This has the advantage that the objective can be achieved with less network traffic.

[Third Embodiment]
Next, a third embodiment of the present invention will be described. An example of the system configuration of the third embodiment of the present invention is the same as that shown in FIG. The internal configuration of the image forming apparatus according to the third embodiment of the present invention is the same as that shown in FIG. The internal configuration of the information processing apparatus according to the third embodiment of the present invention is the same as that shown in FIG.
The internal configuration of the network camera according to the third embodiment of the present invention is the same as that shown in FIG.
FIG. 16 is a diagram schematically illustrating the contents of the person specifying data stored in the memory for storing the person specifying data of the network camera 1104 and the memory for storing the person specifying data list of the information processing apparatus 1006.
In FIG. 16A, reference numeral 44001 denotes a person specifying data ID which is a unique ID assigned to each record of the person specifying data. Reference numeral 44002 denotes the gender of the person. Reference numeral 44003 denotes a feature quantity for face recognition which is a feature quantity used when the face of the person is recognized.
Reference numeral 44004 denotes a body shape recognition feature amount which is a feature amount used when the person is recognized by the body shape. 44005 is the name of the person.
Reference numeral 44006 denotes a person ID which is a unique ID assigned to the person.
FIG. 17 is a flowchart for explaining a control method in the image forming system shown in FIG. In this example, in particular, FIG. 17A corresponds to a procedure for setting person specifying data from the information processing apparatus 1006 to the network camera 1004.

When the processing is started, first, in step S45001, the user who is an administrator selects one of the network cameras connected to the network 1001 on the UI screen provided by the CPU 3002 of the information processing apparatus 1006. Here, description will be made assuming that the network camera 1004 is selected.
In subsequent S45002, the information processing apparatus 1006 transmits a start notification to the network camera 1004 selected by the user. In step S45003, the network camera 1004 receives the notification from the information processing apparatus 1006 and detects that the setting operation has been started.

  In step S45004, the information processing apparatus 1006 waits until an instruction from the user is input, and acquires the instruction input, if any. In S45005, CPU 3002 determines what the content of the instruction input from the user is. If the CPU 3002 determines that the instruction is person-specific data selection, the process proceeds to S45006. If the CPU 3002 determines that the instruction is an end instruction, the process advances to step S45010.

  In S45006, the CPU 3002 acquires the person specifying data selected by the user from the memory storing the person specifying data list. In step S45007, the information processing apparatus 1006 transmits the acquired person specifying data to the network camera 1004.

  In subsequent S45008, the network camera 1004 receives the person specifying data from the information processing apparatus 1006. In step S45009, the network camera 1004 stores the received person specifying data in a memory that stores the person specifying data. Then, the process returns to S45004 and continues.

  When the processing proceeds to S45010, the information processing apparatus 1006 transmits a notification of the end of the person specifying data setting operation to the network camera 1004. In subsequent S45011, the network camera 1004 receives the notification from the information processing apparatus 1006 and completes the entire process.

FIG. 16B schematically illustrates the contents of device monitoring area data recorded in the memory secured in the network camera 1004.
In FIG. 16B, reference numeral 48001 denotes a device monitoring area ID which is a unique ID assigned to the device monitoring area data. Reference numeral 48002 denotes lens control parameters necessary for appropriately capturing an image forming apparatus to be monitored. Similarly, 48003 is a necessary pan head control parameter. Reference numeral 48004 denotes an image forming apparatus ID of an image forming apparatus to be monitored. Reference numeral 48005 denotes an image forming apparatus model indicating the model of the image forming apparatus to be monitored. Reference numeral 48006 denotes an image forming apparatus network address indicating a network address of the image forming apparatus.

FIG. 16C schematically illustrates contents of device monitoring camera data recorded in a memory secured in the information processing apparatus 1006.
In FIG. 16C, reference numeral 49001 denotes a device monitoring camera ID which is a unique ID assigned to each record of device monitoring camera data. Reference numeral 49002 denotes an image forming apparatus ID that holds the ID of the image forming apparatus monitored in the device monitoring camera information. Reference numeral 49003 denotes a network camera ID of a network camera that monitors the image forming apparatus.

FIG. 17B corresponds to a procedure in which a user who is an administrator of the information processing apparatus 1006 sets device monitoring area data for the network camera 1004.
When the process is started, the user selects one of the network cameras connected to the network 1001 using a UI screen provided by the information processing apparatus 1006 in S50001. In subsequent S50002, the information processing apparatus 1006 notifies the network camera 1004 of the start of the device monitoring area data setting operation.

In step S50003, the network camera 1004 receives the notification from the information processing apparatus 1006 and detects the start of processing. The network camera 1004 acquires the current video of the network camera 1004 and transmits it to the information processing apparatus 1006 in subsequent S50004. In step S50005, the information processing apparatus 1006 receives the video from the network camera 1004.
In S50006, the information processing apparatus 1006 displays the video from the network camera 1004 and presents it to the user. In step S50007, the information processing apparatus 1006 waits for an instruction input from the user and performs acquisition. In subsequent S50008, CPU 3002 of information processing apparatus 1006 determines what the instruction input from the user was. If the CPU 3002 determines that the instruction input is selection of any image forming apparatus, the process advances to step S50009. In step S50009, the information processing apparatus 1006 transmits detailed data of the selected image forming apparatus to the network camera 1004. In step S50010, the network camera 1004 receives the detailed data of the image forming apparatus, and the process returns to step S50004 and continues.

  On the other hand, if the CPU 3002 determines in step S50008 that the content of the instruction input is a camera control command, the process advances to step S50011. In step S50011, the information processing apparatus 1006 transmits the camera control command to the network camera 1004. In step S50012, the network camera 1004 receives the camera control command from the information processing apparatus 1006. In subsequent S50013, the CPU 4002 of the network camera 1004 controls each unit of the network camera 1004 based on the command. When that is done, the process returns to S50004 and continues.

On the other hand, if the CPU 3002 determines in S50008 that the content of the instruction input is a device monitoring area designation command, the process proceeds to S50014. In step S50014, the information processing apparatus 1006 generates device monitoring camera data from the information of the network camera 1004 and the information of the selected image forming apparatus. Then, the information processing apparatus 1006 stores the device monitoring camera data in a memory that stores the device monitoring camera data.
In subsequent S50015, the information processing apparatus 1006 transmits the device monitoring area designation command to the network camera 1004.

  Thereafter, in subsequent S50016, the network camera 1004 receives the device monitoring area designation command from the information processing apparatus 1006. In subsequent S50017, the network camera 1004 acquires the received data of the image forming apparatus and the current camera control parameters. Then, the CPU 4002 of the network camera 1004 generates device monitoring area data from the received data of the image forming apparatus and the current camera control parameter, and stores it in a memory that stores the device monitoring area data. Thereafter, the process returns to S50004 and continues.

On the other hand, if the CPU 3002 determines in S50008 that the content of the instruction input is an end instruction, the process proceeds to S50018. In step S50018, the information processing apparatus 1006 notifies the network camera 1004 of the end of device monitoring area data setting. In step S50019, the network camera 1004 receives the notification from the information processing apparatus 1006 and completes the entire process.

FIG. 18A schematically shows the contents of accessor data recorded in the network camera 1004 and inventory area accessor data recorded in the information processing apparatus 1006.
In FIG. 18A, 51001 is an inventory area accessor record ID which is a unique ID assigned to the inventory area accessor record. 51002 is an inventory area ID of an inventory area accessed by the accessor. 51003 is the person ID of the accessor. 51004 is a part ID of a replacement part or a supply article accessed by the accessor. Reference numeral 51005 denotes an increase / decrease value that represents information indicating how many replacement parts or supply articles have been increased or decreased as a result of access by the accessor. Reference numeral 51006 denotes a contact time when the access person appears in the video. Reference numeral 51007 denotes a departure time when the access person disappears from the video.

FIG. 19 is a flowchart for explaining a control method in the image forming system shown in FIG. FIG. 19A is a flowchart illustrating an example of inventory area access person detection processing by the network camera 1004.
When the process is started, first, in S53001, the CPU 4002 obtains stock area information from a memory storing stock area data. Then, the CPU 4002 selects the first one among them. In subsequent S53002, the CPU 4002 controls each part of the network camera 1004 to photograph the stock area. In subsequent S53003, the CPU 4002 extracts a video of the inventory area.

  Next, in S53004, the CPU 4002 determines from the video information whether a person is detected for the stock area video. If the CPU 4002 determines that a person is reflected in the video in S53005, the processing proceeds to S53006. On the other hand, if the CPU 4002 determines that no person is included in the video, the process proceeds to S53011.

In this way, when it is determined that a person has been detected, the CPU 4002 identifies the person in S53006. Subsequently, in S53007, the CPU 4002 acquires what parts are in stock in the stock area from the memory storing the stock area data. Then, the CPU 4002 recognizes the package based on the package data acquired from the memory storing the package data and calculates the inventory quantity.
In step S53008, the CPU 4002 compares the quantity of each part stocked in the stock area with the quantity detected this time, and calculates a fluctuation value.

If the CPU 4002 determines that the inventory quantity has changed in S53009, the CPU 4002 generates inventory area accessor data. For the generation of this data, person data of a person specified using a person specifying function module (not shown), detected stock area, and data of a part whose quantity has been found to change are used.
Then, the CPU 4002 stores the generated data in a memory that stores the inventory area accessor. In step S53011, the CPU 4002 determines whether the currently selected stock area is the last one. If the CPU 4002 determines that the inventory area is the last one, the process returns to S53001 and repeats the process from the first inventory area.
On the other hand, if the CPU 4002 determines that the inventory area is not the last one, the process proceeds to S53012, and after selecting the next inventory area, the process returns to S53003 and is continued.

FIG. 18B schematically shows the contents of device operator information data recorded in the network camera 1004.
In FIG. 18B, 54001 is a device operator record ID which is a unique ID assigned to the device operator record. Reference numeral 54002 denotes a person ID of a person who has operated the device recorded in the device operator record. Reference numeral 54003 denotes an image forming apparatus ID of the image forming apparatus operated by the person. Reference numeral 54004 denotes a model of the image forming apparatus. Reference numeral 54005 denotes a network address of the image forming apparatus. Reference numeral 54006 denotes a contact time when the person appears in an image obtained by photographing a device monitoring area monitoring the image forming apparatus. 54007 is the departure time when the person disappeared from the video.

FIG. 19B is a flowchart illustrating an example of device operator detection processing by the network camera 1004.
When the process is started, in S56001, the CPU 4001 selects the first one of all the device monitoring areas stored in the memory for storing the device monitoring area data. In subsequent S56002, CPU 4001 controls each unit of the network camera so as to photograph the device monitoring area. In step S56003, the CPU 4001 extracts a device monitoring area video. In subsequent S560004, the CPU 4001 performs person detection processing on the video.

If the CPU 4001 determines in step S56005 that a person has been detected, the process advances to step S56006. In step S56006, the CPU 4001 executes a person specifying function process on the video to execute the person specifying process. In subsequent S56007, the CPU 4001 creates device operator data from the person data and information on the selected device monitoring area, and stores the device operator data in a memory that stores the device operator information. Then, the process proceeds to S56008.
On the other hand, if the CPU 4001 determines that no person has been detected in S56005, the process proceeds to S56008. In step S56008, the CPU 4001 determines whether or not the currently selected device monitoring area is the last selected device. If the CPU 4001 determines that the currently selected device monitoring area is currently selected, the process proceeds to step S56001. Return to and repeat from the beginning.
On the other hand, if the CPU 4001 determines in S56008 that the currently selected device monitoring area is not the last device monitoring area, the process proceeds to S56009, and after selecting the next device monitoring area, the process returns to S56003 and continues.

FIG. 20 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to a processing example by the information processing apparatus 1006 and the network camera 1004. In this process, a list of network cameras is set in the information processing apparatus 1006, and a list of information processing apparatuses to be notified when inventory change is detected is set in the network camera 1004. Only the difference from FIG. 8 will be described below.
In step S21006, the information processing apparatus 1006 acquires the detailed camera information, and the process advances to step S59001. In step S <b> 59001, the information processing apparatus 1006 transmits camera detailed information to the network camera 1004. In step S59002, the network camera 1004 receives the camera detailed information from the information processing apparatus 1006. Then, the CPU 4002 of the network camera 1004 generates inventory change detection notification target data using the camera detailed information, and stores it in a memory that stores the inventory change detection notification target. Thereafter, the process proceeds to S21007 and continues as it is.

FIG. 21 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to an inventory status management process example between the information processing apparatus 1006 and the network camera 1004.
In S61001, first, the CPU 4002 of the network camera 1004 determines whether or not access to a new inventory area is recorded in the memory storing the inventory area accessor. If the CPU 4002 determines that there is a new access record, the change in the inventory quantity recorded in the memory is acquired, and the process advances to step S61002. If the CPU 4002 determines that there is no new access record, the process returns to S61001 and waits until a new access record is generated.

  In step S61002, the CPU 4002 of the network camera 1004 selects the first notification target acquired from the memory storing the stock conversion detection notification target. In subsequent S61003, the CPU 4002 transmits the notification of the selected notification target to the information processing apparatus 1006. In step S61004, the information processing apparatus 1006 receives the notification.

  In step S61005, the CPU 3002 of the information processing apparatus 1006 stores the inventory accessor information and the increase / decrease in the inventory quantity, which are the contents of the notification, in a memory that stores the inventory monitoring event notification reception target inventory status.

FIG. 22A is a diagram showing the contents of the remaining amount reducing component data recorded in the memory of the image forming apparatus.
In FIG. 22A, 64001 is a remaining amount reducing component information ID representing a number temporarily assigned to the remaining amount reducing component information. Reference numeral 64002 denotes a component ID of a component whose remaining amount has decreased. Reference numeral 64003 denotes an occurrence time indicating a time when it is detected that the remaining amount has decreased. Reference numeral 64004 denotes an inquiry response destination information processing apparatus ID indicating an ID of an information processing apparatus that has responded when an inventory inquiry is performed when the remaining amount of parts is reduced.

FIG. 22B is a diagram showing the contents of inventory inquiry response history data recorded in a memory that stores the inventory inquiry response execution history of the information processing apparatus 1006.
In FIG. 22B, reference numeral 65001 denotes an inventory inquiry response history ID which is a unique ID assigned to the inventory inquiry response history. Reference numeral 65002 denotes an image forming apparatus ID of the inquired image forming apparatus. Reference numeral 65003 denotes a component ID representing the inquired component type. Reference numeral 65004 denotes an inquiry time for recording the inquired time. Reference numeral 65005 denotes a storage location monitoring camera list that holds a list of network camera IDs of storage location monitoring cameras that monitor the inventory area corresponding to the component type.

  FIG. 23 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to an example of inventory processing by the information processing apparatus 1006, the image forming apparatus 1002, and the network camera 1004. Here, only differences from FIG. 15 will be described.

  In step S40001, after the image forming apparatus 1002 acquires the information on the component type in which the decrease in the remaining amount is detected, the process advances to step S66001. In step S <b> 66001, the CPU 2102 stores data indicating that the remaining amount of the component type has decreased in the memory that stores the remaining amount reduced component information of the image forming apparatus 1002. Then, the process proceeds to S40002. S40003 and S4004 shown in FIG. 15 are executed.

  In step S40005, the information processing apparatus 1006 receives the component type from the image forming apparatus 1002, and then advances to step S66002. In step S66002, the CPU 3002 of the information processing apparatus 1006 generates inquiry source information data including information on the image forming apparatus 1002 that is the inquiry source, the notified component type, and the time when the notification is received. The CPU 3002 stores the generated data in a memory that stores an inventory inquiry response execution history. Thereafter, the processing proceeds to S40006.

If it is determined in S40007 that the CPU 3002 determines that there is a camera monitoring the component, the process advances to S66003.
In step S66003, the CPU 3002 of the information processing apparatus 1006 generates data of the network camera that is monitoring the component. Then, the data of the network camera 1004 is stored in a memory for storing an inventory inquiry response execution history. Thereafter, the processing proceeds to S40008.

  In step S40010, the network camera 1004 receives a request from the information processing apparatus 1006 and receives a video acquisition request. In step S40011, the CPU 4002 of the network camera 1004 acquires an inventory area corresponding to the component type from a memory that stores inventory area data. In subsequent S40012, the CPU 4002 controls each unit of the network camera 1004 so as to acquire the image of the stock area. In subsequent S40013, CPU 4002 extracts the video of the inventory area, and transmits the extracted video to information processing apparatus 1006 in subsequent S40014.

FIG. 24 is a flowchart for explaining a control method in the image forming system shown in FIG. This example corresponds to a series of processing examples when the remaining amount of consumables and supplies is recovered on the image forming apparatus 1002.
This processing is started when the image forming apparatus 1002 detects that the remaining amount of the component recorded in the memory storing the remaining amount reducing component is recovered (timing corresponding to the first time). Hereinafter, the second camera (network camera 1004) takes a picture at a second time before the first time (S71001 described later) when it is notified that the remaining amount of the predetermined consumables has recovered to the predetermined amount. Image information of an operator who operates the image forming apparatus is acquired. Further, the image information of the stock area photographed from the second time to the first time is acquired from the first camera (network camera 1005). If it is determined that the operator specified from the image information acquired from the first camera and the image information acquired from the second camera do not match, information specifying the operator specified in the stock area is A processing example of displaying a warning on the display unit of the information processing apparatus 1006 will be described.
In step S71001, the CPU 2102 of the image forming apparatus 1002 acquires the type of component whose remaining amount has been recovered. In subsequent S71002, the CPU 1202 obtains the ID of the information processing apparatus 1006 that responded when the remaining amount of the component is reduced from the inquiry response destination information processing apparatus ID 64004 shown in FIG. If such an information processing apparatus 1006 is recorded, the process proceeds to S71003. If not, the process ends.
In step S71003, the image forming apparatus 1002 acquires information on the information processing apparatus 1006 to which a remaining amount recovery notification should be sent from the memory storing the inventory status inquiry destination. In step S71004, a notification is transmitted to the information processing apparatus 1006 in order to transmit information indicating that the remaining amount has been restored to a predetermined amount and its component type. In addition, the time when the remaining amount is reduced is included in the notification.

  In step S <b> 71005, the information processing apparatus 1006 receives the inventory recovery notification from the image forming apparatus 1002. In subsequent S71006, it is determined whether information of network cameras 1004 and 1005 monitoring the image forming apparatus 1002 exists in the memory storing the device monitoring camera data.

If the CPU 3002 determines that network camera information exists, the process advances to step S71007. Here, description will be made assuming that such a network camera is the network camera 1004.
In step S71007, the CPU 3002 selects the first network camera. In subsequent S 71008, the CPU 3002 transmits a request for device operator information to the network camera 1004. At this time, the time when the remaining amount is reduced is included as information for specifying the device operator.
In subsequent S <b> 71009, the network camera 1004 receives a request for the device operator information from the information processing apparatus 1006. In addition, the CPU 4002 acquires from the memory storing the device operator information the most likely person who has operated the device before and after the time when the remaining amount decrease occurred as a key. If such a person is extracted, the process proceeds to S71010, and the network camera 1004 transmits information about the person who has operated the device to the information processing apparatus 1006. In step S71011, the information processing apparatus 1006 receives the image information of the person from the network camera 1004.

  In subsequent S71012, CPU 3002 determines whether or not the transmission of requests to all cameras has been completed. If it is determined that there is still a next camera, the process proceeds to S71013, the next network camera 1005 is selected, and the process returns to S71008 and is continued.

  On the other hand, if the CPU 3002 determines in S71012 that the transmission of requests to all cameras has been completed, the process proceeds to S71014. In step S <b> 71014, the CPU 3002 integrates information about the person who has operated the device sent from a plurality of network cameras 1004, 1005, etc., and determines the person who has operated the device when the remaining amount actually decreases. To do.

  In step S71015, the CPU 3002 determines whether there is information on the network camera that monitors the inventory area where the component type whose remaining amount has been recovered is placed. The network camera information is acquired from a memory that stores a stock inquiry response execution history.

If the CPU 3002 determines that network camera information exists, the process advances to step S71016 to select the first of such cameras. At this time, information on the inventory area of the component type monitored by the network camera is also acquired. Here, description will be made assuming that such a network camera is the network camera 1005.
The network camera 1005 has the same internal configuration as the network camera 1004. Alternatively, the network camera 1004 may specialize in device monitoring and the network camera 1005 may specialize in inventory area monitoring.

  In subsequent S71017, the information processing apparatus 1006 requests the network camera 1005 for information on the person who has accessed the stock area. At this time, the time when the remaining amount is reduced is included as information for identifying the person who has accessed the stock area.

In step S71018, the CPU 4002 of the network camera 1005 receives a request for device operator information from the information processing apparatus 1006. In addition, the CPU 4002 of the network camera 1005 acquires a person who has accessed the stock area after that from the memory in which the stock area access person is stored, using the time when the remaining amount is reduced as a key.
If such a person is extracted, the process advances to step S71019, and the network camera 1005 transmits information about the person who has accessed the stock area to the information processing apparatus 1006. In step S71020, the information processing apparatus 1006 receives information about the person from the network camera 1005.

  In step S71021, the CPU 3002 of the information processing apparatus 1006 determines whether transmission of requests to all network cameras has been completed. If the CPU 3002 determines that there is still a next camera, the process advances to step S71022 to select the next network camera. If the selection is completed, the process returns to S71017 and continues.

If the CPU 3002 determines in S71021 that the transmission of requests to all network cameras has been completed, the process proceeds to S71023. In S71023, the CPU 3002 determines whether or not the person who has accessed the stock area monitored by each of the network cameras 1004 and 1005 includes the person who is considered to have operated the device confirmed in S71014. . If it is determined that the person is accessing the inventory, the process ends there. If it is determined that the person is not accessing the inventory, the process advances to step S71024.
In step S <b> 71024, the CPU 3002 displays information that the inventory handler does not match the device operator.

  According to the present embodiment, it is possible to determine the person of the device operator and to determine the person who has accessed the inventory area in which the replacement part or the supply item is placed. Then, when the remaining amount of consumables and supplies in the image forming device recovers, the device operator correctly determines whether the same person as the device operator has accessed the inventory area, so that the device operator can correctly replace and supply parts. It is possible to determine whether or not

  Although details are not described here, when someone accesses the stock area, it is possible to determine whether or not a corresponding remaining amount reduction warning has occurred. If there is an access to the stock area even though the corresponding remaining amount reduction warning cannot be found, it is highly likely that this is an unauthorized access to the replacement parts or supply items in stock.

  According to the third embodiment, as in the first and second embodiments, when the remaining amount of consumables and supplies decreases, the stock status and location of replacement parts and supply items are presented to the user. Can be provided at low cost.

  In addition to the above, when this embodiment is used, when a decrease in the remaining amount of consumables or supplies occurs, the person who obtained the replacement part or the supply item supplies the device when the remaining amount decreases. It is possible to confirm whether or not it is the same as the person who was operating.

  As a result, the manager can confirm whether or not the person who has caused a decrease in the remaining amount of consumable supplies has neglected to replace parts or supply supplies. In addition, even if there is no decrease in the remaining amount of consumable supplies, if there is a person who has brought replacement parts or supplies, it will be possible to detect it, and it is also possible to obtain fraud prevention effects It is.

  Each process of the present invention can also be realized by executing software (program) acquired via a network or various storage media by a processing device (CPU, processor) such as a personal computer (computer).

  The present invention is not limited to the above embodiment, and various modifications (including organic combinations of the embodiments) are possible based on the spirit of the present invention, and these are excluded from the scope of the present invention. is not.

1001 Network 1002, 1003 Image forming apparatus 1004, 1005 Network camera

Claims (9)

An image forming system in which an image forming apparatus and a camera communicate with each other,
The image forming apparatus includes:
Detection means for detecting the remaining amount of consumables;
A determination unit that determines whether a camera capable of photographing an inventory area for storing the consumable is registered based on identification information that identifies the consumable detected by the detection unit;
A notification means for notifying the camera of a request for acquiring a stock quantity of the consumable, together with identification information for identifying the consumable, if determined to be registered;
An acquisition means for acquiring a current stock amount of consumables specified by the identification information from the camera;
Display control means for displaying the current inventory amount of the acquired consumables on the display means in association with the inventory area,
The camera
Photographing means for photographing an inventory area for storing a stock of consumables consumed by the image forming apparatus;
Analyzing a stock image of a specific consumable item extracted from a photographed image of a stock area associated with the identification information acquired from the image forming apparatus, and analyzing the current stock of the consumable item associated with the identification information Detecting means for detecting the amount;
An image forming system, comprising: a transmission unit configured to transmit a current stock amount of the detected consumables to the image forming apparatus. An image forming system including an information processing apparatus communicating with a camera or an image forming apparatus,
The image forming apparatus includes:
Detection means for detecting the remaining amount of consumables;
Transmitting means for transmitting identification information identifying the consumables detected by the detecting means to the information processing apparatus;
Obtaining means for obtaining a current stock quantity of the consumables specified by the identification information from the information processing apparatus;
Display control means for displaying the current inventory amount of the acquired consumables on the display means in association with the inventory area,
The information processing apparatus includes:
Determining means for determining whether a camera capable of photographing an inventory area for storing the consumables is registered based on identification information for identifying the consumables acquired from the image forming apparatus;
A notification means for notifying the camera of a request for acquiring a stock quantity of the consumable, together with identification information for identifying the consumable, if determined to be registered;
An acquisition means for acquiring a current stock amount of consumables specified by the identification information from the camera;
Notification means for notifying the image forming apparatus of the current stock amount of the acquired consumables,
The camera
Photographing means for photographing a stock area for storing stock of consumables consumed by the image forming apparatus;
Analyzing a stock image of a specific consumable item extracted from a photographed image of a stock area associated with the identification information acquired from the information processing device, and present stock of the consumable item associated with the identification information Detecting means for detecting the amount;
An image forming system, comprising: a transmission unit configured to transmit a current stock amount of the detected consumables to the information processing apparatus. An image forming system including an information processing apparatus communicating with a first camera or a second camera and an image forming apparatus,
The image forming apparatus includes:
Detection means for detecting a state in which the remaining amount of consumables has been reduced to a predetermined amount;
Notification means for notifying the information processing apparatus that the remaining amount of consumables has recovered to a predetermined amount,
The information processing apparatus includes:
Image information of an operator who operates the image forming apparatus photographed by the second camera at a second time prior to the first time when it is notified that the remaining amount of the consumables has recovered to a predetermined amount. First acquisition means for acquiring;
Second acquisition means for acquiring, from the first camera, image information of an inventory area photographed from the second time to the first time;
Determining means for determining whether the operator specified from the image information acquired from the first camera and the image information acquired from the second camera match;
If the operator determines that they do not match, warning means for displaying a warning on the display means information identifying the operator specified in the inventory area;
With
The first camera is
First imaging means for imaging an inventory area for storing inventory of consumables of the image forming apparatus;
In response to a request from the information processing apparatus, a first transmission for transmitting, to the information processing apparatus, image information of an inventory area photographed by the first photographing unit from the second time to the first time. With means,
The second camera is
Second imaging means for imaging an operator who operates the image forming apparatus;
In response to a request from the information processing apparatus, image information of an operator who operates the image forming apparatus photographed by the second photographing unit from the second time to the first time is sent to the information processing apparatus. A second transmitting means for transmitting;
An image forming system comprising: An image forming apparatus that communicates with a camera,
Detection means for detecting the remaining amount of consumables;
A determination unit that determines whether a camera capable of photographing an inventory area for storing the consumable is registered based on identification information that identifies the consumable detected by the detection unit;
A notification means for notifying the camera of a request for acquiring a stock quantity of the consumable, together with identification information for identifying the consumable, if determined to be registered;
An acquisition means for acquiring a current stock amount of consumables specified by the identification information from the camera;
An image forming apparatus comprising: display control means for displaying the acquired current stock amount of consumables on a display means in association with a stock area. A camera that communicates with an image forming apparatus,
Photographing means for photographing an inventory area for storing a stock of consumables consumed by the image forming apparatus;
Analyzing a stock image of a specific consumable extracted from a captured image of a stock area associated with identification information acquired from the image forming apparatus, and analyzing the current stock amount of the consumable associated with the identification information Detecting means for detecting
And a transmission unit configured to transmit a current stock amount of the detected consumables to the image forming apparatus. A method of controlling an image forming apparatus that communicates with a camera,
A detection process for detecting the remaining amount of consumables;
A determination step of determining whether a camera capable of photographing an inventory area for storing the consumables is registered based on identification information for identifying the consumables detected by the detection step;
A notification step of notifying the camera of a request for acquiring a stock quantity of the consumable, together with identification information for identifying the consumable, if determined to be registered;
An acquisition step of acquiring a current stock amount of the consumables specified by the identification information from the camera;
And a display control step of displaying the acquired current stock amount of the consumables on the display means in association with the stock area. A method of controlling a camera that communicates with an image forming apparatus,
A photographing step of photographing an inventory area for storing a stock of consumables consumed by the image forming apparatus, by photographing means;
Analyzing a stock image of a specific consumable extracted from a captured image of a stock area associated with identification information acquired from the image forming apparatus, and analyzing the current stock amount of the consumable associated with the identification information A detection step for detecting
And a transmission step of transmitting a current stock amount of the detected consumables to the image forming apparatus.   A program causing a computer to execute the control method of the image forming apparatus according to claim 6.   A program causing a computer to execute the camera control method according to claim 7.

Images