JP2024035350A - Printing device, information processing device, control method thereof, printing system, and program - Google Patents

Abstract

An object of the present invention is to appropriately manage the amount of ink remaining in a printing device. A printing device is configured to perform printing using recording materials stored in a storage section. The printing device includes a receiving unit that receives information regarding the remaining amount of recording material based on the image taken by the storage unit, and a system that the printing device manages based on the information regarding the remaining amount of recording material received by the receiving device. and updating means for updating information regarding the remaining amount of the recording material. [Selection diagram] Figure 7

Description

The present disclosure relates to a technique for managing the remaining amount of ink in a printing device.

There is a technique for managing the amount of ink remaining in a printing device. Patent Document 1 discloses that the ink consumption amount calculated from the ink consumption amount at the time of ink replacement and the ink consumption amount temporarily saved when the remaining ink amount is reset is managed by the printing device. A technique for correcting the remaining amount of ink is described. Furthermore, in recent years, printing devices have also been provided in which a user refills an ink tank of the printing device with ink from an ink bottle.

Japanese Patent Application Publication No. 2006-130812

When a user replenishes ink from an ink bottle to an ink tank, even if the above-mentioned ink consumption amount is used, it may not be possible to appropriately grasp the remaining amount of ink in the printing device.

The present disclosure aims to appropriately manage the remaining amount of ink in a printing device.

A printing device according to an aspect of the present disclosure is a printing device that performs printing using a recording material stored in a storage unit, and the storage unit stores information regarding the remaining amount of the recording material based on a captured image. and an updating means that updates information regarding the remaining amount of the recording material managed by the printing apparatus based on information regarding the remaining amount of the recording material received by the receiving means. It is characterized by

According to the present disclosure, the remaining amount of ink in a printing device can be appropriately managed.

FIG. 2 is a block diagram showing an example of a hardware configuration. FIG. 2 is a schematic diagram showing an example of a printer and a smartphone. FIG. 2 is a block diagram showing an example of a software configuration. FIG. 3 is a schematic diagram showing an example of replenishing ink to a printer. FIG. 3 is an enlarged view of an ink tank section. It is a flowchart which shows an example of the process performed by a smartphone. 3 is a flowchart illustrating an example of processing performed by a printer. FIG. 3 is a diagram showing an example of a display screen displayed on a display unit of a printer. FIG. 3 is a diagram showing an example of a display screen displayed on a display unit of a printer.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the subject matter of the present disclosure, and not all combinations of features described in the following embodiments are essential to the solution of the present disclosure. Note that the same configurations will be described using the same reference numerals.

<<First embodiment>>
In this embodiment, a printing system using a printing device (recording device) and an information processing device that is an external device of the printing device will be described as an example. An inkjet printer will be described as an example of a printing device. Note that the recording method of the printer may be an electrophotographic method. A smartphone will be described as an example of an information processing device. Although details will be described later, in this embodiment, an example will be described in which the remaining amount of ink (recording material) in a printing device is managed using an image captured using an imaging function of an information processing device. For this reason, although a smartphone will be described as an example of the information processing device, the information processing device may also be a notebook PC or a tablet terminal equipped with a camera. Note that the information processing apparatus may acquire an image captured by another camera device that is a device different from the information processing apparatus, and the processing described below may be performed. That is, the information processing device does not need to have a photographing function.

FIG. 1 is a block diagram showing an example of the hardware configuration of a printer 100 and a smartphone 150. FIG. 2 is a schematic diagram showing an example of the printer 100 and the smartphone 150. FIG. 3 is a block diagram showing an example of the software configuration of the printer 100 and the smartphone 150. The configurations of printer 100 and smartphone 150 will be described below.

<Printer configuration>
FIG. 1A is a block diagram showing an example of the hardware configuration of the printer 100. The printer 100 includes a CPU 101, a ROM 102, a RAM 103, a network communication section 104, a network connection section, a display section 106, an operation section 107, a scanner section 108, a printer section 109, and an ink tank section (accommodation section) 110.

CPU 101 is a central processing unit for controlling each section within printer 100. The ROM 102 stores various program codes. In the RAM 103, image data and the like are temporarily stored and buffered when each service is executed.

The network communication unit 104 connects to a router (not shown) via a network connection unit 105. That is, the network communication unit 104 is configured to be connected to a network such as the Internet via the network connection unit 105 and to be able to communicate with other devices. The RAM 103 also stores image data and the like received by the network communication unit 104.

The display unit 106 is composed of, for example, a liquid crystal display, and is capable of displaying characters, figures, indicators, and the like. The display unit 106 is not limited to a liquid crystal display, but can also be configured using an LED or other display. The information displayed by the display unit 106 includes, for example, setting information of the printer 100 or information regarding ink contained in each ink tank. Information regarding ink includes, for example, information on the remaining amount of ink contained in an ink tank, information on ink replenishment instructions, and the like. Note that driving of the display unit 106 is controlled by the CPU 101. The operation unit 107 includes switches, hard keys, etc. for the user to perform various input operations. Further, the display unit 106 may function as an operation unit for performing input operations and the like, such as a touch panel.

In the printer 100, the scanner function is realized by the scanner unit 108, and the print function is realized by the printer unit 109. Ink is stored in the ink tank section 110. As shown in FIG. 2, the ink tank section 110 has at least the front surface made of a transparent member such as plastic or glass, so that the ink inside can be viewed by the user. The front portion of the ink tank section 110 where the remaining amount of ink can be visually checked is also referred to as an ink remaining amount window. As will be described later, the ink tank section 110 includes an ink inlet 402 (FIG. 4) and is configured to be refilled with ink from an ink bottle 403 (FIG. 4) by the user. The printer unit 109 has an inkjet head, and ink is supplied to the inkjet head from an ink tank unit 110 via a tube. The printer unit 109 prints an image on a recording medium such as printing paper using an inkjet method based on image data received from the outside or image data read from the scanner unit 108 . Furthermore, the printer unit 109 also manages ink information of the ink tank, including information regarding the remaining amount of ink (for example, remaining ink amount value), and paper information, including information on the number of stacked sheets. Note that the remaining ink amount information may be stored and managed in the ROM 102 or the like. The scanner unit 108 optically reads the original set on the original platen 201 (FIG. 2), converts it into electronic data, and sends the image data converted into a specified file format to an external device via the network. or stored in a storage area such as an HDD. The copy function uses the scanner unit 108 to read a document placed on the document table 201 and transfers generated image data to the printer unit 109 . Then, the printer unit 109 stores the image in a storage medium based on the image data. The above-mentioned units are interconnected by a bus 111 and can mutually transmit and receive data.

FIG. 3A is a diagram showing the software configuration of the printer 100. The control program for the printer 100 is roughly divided into three blocks. The three blocks are an application layer 320 that manages applications, a middleware layer 330 that controls devices via various interfaces (I/F), and an operating system 340 that manages overall control.

The role of each of the three blocks will be explained. The operating system (OS) 340 provides basic functions for a control unit such as the CPU 101 to execute a control program. The middleware layer 330 is composed of a software group that controls I/F with each physical device in the printer 100. The middleware layer 330 includes a printer control module 331, a scanner control module 332, an operation unit control module 333, and an image processing module 334.

A printer control module 331 for controlling the printer I/F manages printing operations and general operations. The scanner control module 332 controls the scanner I/F. The operating unit control module 333 controls the operating unit I/F. Image processing module 334 controls image data. Printing is performed by the image processing module 334 passing the controlled image data to the printer control module 331. In addition, when using the copy function, the image processing module 334 reads image data from the scan image data memory in which the scanned image is saved, and similarly passes the image data to the printer control module 331, thereby realizing the copy function. .

The application layer 320 includes a job management application 321 and a sensor control application 322. The application layer 320 realizes functions such as printing provided by the printer 100 to the user by operating each device via each middleware. For example, when the operation unit control module 333 detects that the user has executed printing via the operation unit 107, the application layer 320 is notified of a print execution instruction. In the application layer 320, a print execution instruction is received, and a job management application 321 for printing executes printing.

The job management application 321 uses the printer control module 331 of the middleware layer 330 to execute a printing operation using the inkjet head. The job management application 321 controls the content displayed on the operation unit 107 via the operation unit control module 333 and controls the operation of the printer section via the printer control module 331, as necessary. The sensor control application 322 controls various sensors.

<Smartphone configuration>
FIG. 1(b) is a block diagram showing an example of the hardware configuration of the smartphone 150. The smartphone 150 includes a CPU 151, a ROM 152, a RAM 153, a network communication section 154, a network connection section 155, a display section 156, an operation section 157, an imaging section 158, a control section 159, and an image processing section 160.

CPU 151 is a central processing unit for controlling each part within smartphone 150. The ROM 152 stores various program codes. The RAM 153 stores image data captured by a smartphone camera and applications downloaded by the smartphone.

The network communication unit 154 connects to a router (not shown) via a network connection unit 155. That is, the network communication section 154 is configured to be connected to a network such as the Internet via the network connection section 155 and to be able to communicate with other devices. Furthermore, the smartphone 150 is capable of communicating with other mobile terminals via the network communication unit 154.

The display unit 156 is composed of a liquid crystal display or the like, and is capable of displaying characters, figures, indicators, and the like. The operation unit 157 is configured with a touch panel on which the user performs various input operations, and the display unit 156 functions as an operation unit for performing input operations and the like.

The imaging unit 158 captures an image. It is also possible for the display unit 156 to display a preview image of the imaging unit 158. The control unit 159 exchanges data with the image processing unit 160 and instructs the image processing unit 160 to perform processing. The image processing unit 160 performs various image processing. For example, the image processing unit 160 performs a process of converting a captured image obtained by the imaging unit 158 capturing an image of the ink remaining amount window of the ink tank unit 110 of the printer 100 into an ink remaining amount value. Although the CPU 151, the control section 159, and the image processing section 160 are shown as separate blocks in FIG. 1B, they may all be realized by the CPU 151.

In the present embodiment, the smartphone 150 performs a process of capturing an image of the ink remaining amount window of the ink tank section 110 of the printer 100. Then, the smartphone 150 estimates the remaining ink level value of the ink tank unit 110 from the captured image including the remaining ink level, performs a process of converting it into a remaining ink level value, and transfers the converted ink level value to the printer 100. Perform processing to send to. Details will be described later.

FIG. 3(b) is a diagram showing the software configuration of the smartphone 150. The control program for the smartphone 150 is roughly divided into three blocks. The three blocks are an application layer 350 that manages applications, a middleware layer 360 that controls devices via various I/Fs, and an operating system 370 that manages overall control.

Explain the role of each. The operating system 370 provides basic functions for a control unit such as the CPU 151 to execute a smartphone control program. The middleware layer 360 is composed of a software group that controls I/F with each physical device in the smartphone 150. The middleware layer 360 includes a smartphone control module 361 , a communication control module 362 , an operation unit control module 363 , an imaging unit control module 364 , and an image processing module 365 .

A smartphone control module 361 for controlling the smartphone controls the overall operation of the smartphone 150. The communication control module 362 controls the communication unit I/F. The operating unit control module 363 controls the operating unit I/F. An imaging unit control module 364 that controls the imaging unit 158 is used to image the ink remaining amount window of the printer body. The image processing module 365 that controls image data is used for processing such as analyzing captured image data of remaining ink amount and converting it into an ink remaining amount value.

The application layer 350 realizes the functions of the smartphone by operating each device via each middleware. The application layer 350 includes a smartphone application 351. The smartphone application 351 of the application layer 320 of the smartphone is activated and operated via the operation unit 157. In this embodiment, a printer control application is used as the smartphone application 351. The printer control application has a function of outputting to the printer 100 an instruction to print an image in the smartphone using the printer 100 . Further, the printer control application has a function of displaying remaining ink amount information of the printer 100 using a smartphone application. In this embodiment, the printer control application is configured to start the imaging unit 158 (camera). For example, a process of capturing an image of the ink remaining amount window of the printer 100 is performed in accordance with an instruction from a printer control application. Then, the printer control application performs a process of converting the ink remaining amount image, which is the captured image of the ink remaining amount window, into an ink remaining amount value via the image processing module 365. Details will be described later.

<How to refill ink in the printer body>
FIG. 4 is a schematic diagram showing an example of replenishing the printer 100, which is an example of a printing device, with ink (liquid), which is a consumable item. When the ink tank cover 401 of the printer 100 is opened, the user can access the ink tank section 110. In the example of FIG. 4, ink tanks 110 for four colors are arranged on the right side of the front of the printer 100 when viewed from the user operating the printer 100. Specifically, in the ink tank section 110, a cyan ink tank section 110C, a magenta ink tank section 110M, a yellow ink tank section 110Y, and a black ink tank section 110Bk are arranged in this order. Note that the basic configuration of each ink tank section in this embodiment is substantially the same. Furthermore, although the ink tank section 110 and the ink tank cover 401 are provided on the front surface of the casing of the printer 100, the installation configuration is not limited to this. Note that the ink tank cover 401 may be provided at another location of the printer 100 as long as the user can visually check the remaining amount of ink stored in the ink tank portion 110. In the following description, when each ink tank section is comprehensively described, a reference numeral 110 will be given.

Each ink tank section 110 is provided with an ink inlet 402 at the top. The user opens the cap blocking the ink injection port 402, inserts the tip of the ink bottle 403 into the ink injection port, and supplies ink from the ink bottle 403 to the ink tank section 110. Note that, as described above, the ink remaining amount window is provided on the front surface of the ink tank portion 110, but the ink remaining amount window may include a configuration including the ink tank cover 401. As will be described later, the remaining ink amount window of this embodiment has a scale that is an indicator of the remaining amount of ink, but the scale may be provided on the ink tank portion 110 or on the ink tank cover. 401 may be provided. Details of the scale will be described later. In this embodiment, the printer 100 will be described as a color printer that records a color image on a recording medium by ejecting multiple types of ink of different colors. However, the printer 100 is not limited to this example, and may be a monochrome printer that can print only black, or a printer that can print ink of five or more colors. Further, the ink tank section 110 is not limited to being arranged collectively on one side (right side) of the front surface, but may be arranged separately on both sides (both left and right) of the front surface.

FIG. 5 is an enlarged view of the ink tank section 110 of the printer 100. The example in FIG. 5 is a schematic diagram showing the appearance of the ink tank section 110 including the ink tank cover 401. In this embodiment, the ink tank cover 401 is provided with an ink remaining amount window 501 so as to overlap the transparent portion of the front surface of the ink tank section 110. The remaining ink amount window 501 is a part that displays the remaining amount of ink in each ink tank, and allows the user to visually check the remaining amount of each ink actually stored in the ink tank section 110 through the ink tank cover 401. Can be done. A scale 503 indicating the remaining amount of ink in stages is provided so as to be visible through the remaining ink amount window 501. In this embodiment, the scale 503 is provided on the ink tank section 110 side, and FIG. 5 shows an example in which the scale 503 provided on the ink tank section 110 is visually observed through the ink tank cover 401. However, it is not limited to this example. The scale 503 may be provided on the ink tank cover 401 on the printer 100 main body side. The remaining ink amount 502 is the remaining amount of ink actually stored in each ink tank. That is, the remaining amount of ink can be visually confirmed by the liquid level of the ink stored in each ink tank.

<Smartphone processing>
FIG. 6 is a flowchart illustrating an example of processing performed by the smartphone 150 in this embodiment. The processing of the smartphone 150 shown in FIG. 6 is performed by the CPU 151 loading a program, which is a printer control application, stored in the ROM 152 into the RAM 153 and executing it. Further, some or all of the functions of the processing steps of the smartphone 150 in FIG. 6 may be realized by hardware such as an ASIC or an electronic circuit. Note that the symbol "S" in the description of each process means a step in the flowchart (the same applies to the flowcharts in this specification hereinafter).

The process in FIG. 6 is one of the processes that is executed when the user starts the printer control application, which is the smartphone application 351. Each process shown in FIG. 6 is performed by an activated printer control application. In the following, to simplify the explanation, the printer control application that is the smartphone application 351 will be simply referred to as an application 351. Further, the printer control application may be any application that can exchange information with the printer 100, and may or may not be a dedicated application.

When the application 351 is activated by the user, the application 351 connects the smartphone 150 and the printer 100 in S601. For example, the smartphone 150 and the printer 100 are wirelessly connected via a router (not shown).

Next, in S602, the application 351 receives a selection of the remaining ink amount imaging function from the user. As described above, the application 351 has various functions such as a print function that sends a print instruction to the printer 100, but here, the description will be made assuming that the selection of the ink remaining amount imaging function is received from the user.

Next, in S603, the application 351 receives a selection of the remaining ink amount imaging mode from the user. In this embodiment, the ink remaining amount imaging mode includes a simple ink imaging mode and a detailed ink imaging mode. The simple ink imaging mode is a mode for simply imaging the remaining amount of ink with a small amount of work. For example, the simple ink imaging mode of this embodiment is a mode in which images of the ink remaining amount display windows of all colors are captured at one time. The detailed ink imaging mode is a mode in which the remaining amount of ink can be determined in more detail than in the simple ink imaging mode, although the amount of work (number of times of imaging) is greater than in the simple ink imaging mode. As described above, in this embodiment, the first mode is a mode in which the remaining ink amount is simply imaged with a small number of images, and the first mode is a mode in which the amount of ink is simply imaged with a small number of images. A second mode in which the remaining amount of ink can be determined can be set.

In S604, the application 351 determines which imaging mode the user has selected, and branches the process. If the simple ink imaging mode is selected, the process advances to S605, and if the detailed ink imaging mode is selected, the process advances to S607. Note that although an example in which the processing is switched based on the user's selection has been described here, a default mode may be set in advance, and in S603 and S604, processing may be performed according to the preset mode.

In S605, the application 351 performs processing according to the simple ink imaging mode. Specifically, the application 351 causes the imaging unit 158 of the smartphone 150 to recognize the appearance of the printer 100 and determines whether the remaining ink amount windows 501 of all colors have been detected by the imaging unit 158. The positional relationship of the ink tank sections 110 may change depending on the model of the printer 100. For example, as shown in FIG. 4, some printers have the ink tank section 110 concentrated on one side of the front surface of the printer 100, while others have the ink tank section 110 distributed on both sides of the front surface of the printer 100. Some printers have The application 351 obtains information such as the type of ink used in the printer 100, the position of the remaining ink level window 501 in the printer body, and the order of ink tanks from the model information of the printer 100 obtained when the printer 100 is connected. Already obtained. Therefore, the application 351 recognizes the position where the ink remaining amount window 501 is provided on the exterior of the printer 100. Therefore, in S605, the application 351 uses the imaging unit 158 to recognize the appearance of the printer 100 to determine whether the remaining ink amount windows 501 of all colors have been detected. That is, the application 351 determines whether the viewing angle of the imaging unit 158 includes the ink remaining amount windows 501 of all the ink tanks installed in the printer 100. If remaining ink amount windows 501 for all colors are detected, the process advances to S606. On the other hand, if the remaining amounts of ink for all colors are not detected, the process advances to step S607 because the processing is not suitable for the simple imaging mode in which the remaining ink amounts are determined in one image capture.

In S606, the application 351 captures images of the detected ink remaining amount windows 501 of all colors. At this time, for example, the application 351 may display a guide corresponding to the external appearance of the printer on the display unit 156. For example, the application 351 may display a guide corresponding to the window frame of the remaining ink amount window 501 superimposed on the preview screen of the imaging unit 158 displayed on the display unit 156. The preview screen is a screen that displays an image (video) obtained by the lens and image sensor of the imaging unit 158 on the display unit 156 in real time. When the user checks the preview screen and operates the image capture button at a desired timing, the image capture unit 158 captures an image. Note that the preview screen on which the guide is superimposed may be displayed at the timing of S605. By referring to the superimposed guide (mark), the user can easily determine the position and orientation of the smartphone 150 for capturing images of the ink remaining amount windows of all colors. In S606, it is expected that an imaging instruction from the user will be accepted at the timing when the window frame guide displayed on the preview screen and the appearance of the remaining ink amount window 501 overlap. Then, by receiving an imaging instruction from the user, the imaging unit 158 performs imaging. In this way, by displaying the guide, which serves as an auxiliary mark when performing image capture, on the preview screen, the smartphone 150 can maintain an appropriate posture (for example, facing directly) toward the printer 100. Imaging will be performed. An appropriate amount of remaining ink can be determined by capturing an image in an appropriate posture. A captured image obtained by capturing the remaining ink amount window 501 is referred to as an ink remaining amount image. After S606, the process advances to S609.

The process of S607 will be explained. S607 is a process performed when detailed ink imaging mode is selected or when ink remaining amount windows for all colors are not detected in simple ink imaging mode. In S607, the application 351 images the remaining ink amount window 501 of each color. For example, as shown in FIG. 5, when there are remaining ink amount windows 501 for four colors, processing is performed to image each remaining ink amount window 501 corresponding to each color. That is, when FIG. 5 is captured in the simple ink imaging mode, one remaining ink amount image is generated, and when FIG. 5 is captured in the detailed ink imaging mode, four remaining ink amount images are generated. Even in the detailed ink imaging mode, the information on the remaining ink amount window (for example, the position in the printer body, the order of arrangement, the size, the position of the scale, etc.) is known. Therefore, the application 351 may cause the display unit 156 to display an auxiliary guide when performing imaging based on known information. For example, in the detailed ink imaging mode, the application 351 may display a guide corresponding to the scale 503 of the remaining ink amount window 501 on the display unit 156 as a preview image. Further, the window frame of the remaining ink amount window 501 may be displayed as a guide. In this way, the application 351 can display the guide superimposed on the preview screen even in the detailed ink imaging mode. When the user checks the preview screen and operates the image capture button at a desired timing, the image capture unit 158 captures an image. That is, imaging is performed by accepting an imaging instruction from the user at a timing when the appearance of the guide superimposed on the preview screen and the scale 503 and the like overlap. In this way, by displaying the auxiliary guide when performing imaging, imaging is performed while the smartphone 150 maintains an appropriate attitude (for example, facing the printer 100). . In particular, in the detailed ink imaging mode, by using finer marks (for example, the scale 503) as a guide than in the simple ink imaging mode, it is possible to maintain the posture of the smartphone 150 in a more suitable posture.

When the processing in S607 is completed, the process advances to S608, and the application 351 determines whether the remaining ink amount windows 501 of all ink colors have been imaged. If there is an ink remaining amount window 501 that has not been imaged, the process returns to S607 and the process is repeated. When imaging of the remaining ink amount windows 501 of all ink colors is completed, the process advances to S609.

Note that in the image capturing process of the ink remaining amount window 501 in S606 and S607, the description has been made assuming that the image capturing unit 158 performs image capture by the user operating the image capture button of the operation unit 157; however, the process is not limited to this process. do not have. The application 351 may be configured to automatically perform imaging processing at the timing when the displayed guide and a known object overlap.

For example, in the case of a printer in which black ink tanks and color ink tanks are separated on both sides of the main body, the detailed ink imaging mode may be a mode in which images are taken on the left side and the right side, respectively. That is, the detailed ink imaging mode may be performed not for each color but for each arrangement, and is configured to take images of the ink remaining amount display windows on the left side (Bk side) and the right side (color side), respectively. Good too.

In S609, the application 351 performs processing to convert the captured ink remaining amount image into an ink remaining amount value. As described above, the application 351 knows the position of the landmark object from the model information of the printer 100. Further, the application 351 also knows the distance between the landmark object and the remaining ink amount window 501 from the model information of the printer 100. Therefore, the application 351 can easily specify the position of the ink remaining amount window 501 in the ink remaining amount image captured at the timing when the guide displayed as a landmark and the known object overlap. . In S609, the application 351 analyzes the ink remaining amount image and estimates the ink remaining amount from the position of the ink level in the ink remaining amount window 501 identified in this way.

For example, from the ink remaining amount image including the remaining ink amount window 501 in FIG. 5, the remaining amount of each ink color is converted into values of C: 62%, M: 50%, Y: 78%, and Bk: 69%. Ru. Note that although this embodiment shows an example in which the remaining amount of ink is directly estimated from the value of the scale 503 of the remaining ink amount window 501, the present invention is not limited to this. There is also ink stored outside the ink tank section 110, such as ink in the flow path from the ink tank section 110 to the inkjet head and ink inside the inkjet head. These amounts of ink can be specified from the model information of the printer 100. The application 351 may estimate the remaining amount of ink, taking into consideration the amount of ink stored in a portion other than the ink tank unit 110, from the remaining ink amount image.

Next, the process advances to S610, and the application 351 determines whether the remaining amount values of all ink colors have been converted. If there is an ink color that has not been converted, the process returns to S609 and the process is repeated. When the conversion of remaining amount values of all ink colors is completed, the process advances to S611.

In S611, the application 351 displays the converted remaining ink amount conversion result. For example, the application 351 displays the converted numerical value (percentage) of the remaining amount on the display unit 156, as described above. At this time, the remaining ink amount image may also be displayed.

Next, in S612, the application 351 receives an instruction from the user as to whether or not the displayed ink remaining amount conversion result is correct. If an instruction indicating that it is incorrect is received, the process returns to S603 and the process is repeated. If the instruction indicating that the information is correct is received, the process advances to S613.

In S613, the application 351 transmits the remaining ink amount conversion result to the printer 100. The application 351 then ends the processing of this flowchart. The above is the explanation of the process flow in the smartphone 150.

Note that in the process of FIG. 6, an example in which there are two remaining ink amount imaging modes and an example in which the process is switched has been described, but the present invention is not limited to this example. A mode may be provided in which only one of the modes is provided. Further, other modes than those described above may be included in the remaining ink amount imaging mode.

<Processing flow of printer 100>
FIG. 7 is a flowchart illustrating an example of processing performed by the printer 100. The process shown in FIG. 7 is performed by the CPU 101 loading a program stored in the ROM 102 into the RAM 103 and executing it. Furthermore, some or all of the functions of the processing steps in FIG. 7 may be realized by hardware such as an ASIC or an electronic circuit. The process shown in FIG. 7 is a process that is performed after the smartphone 150 and printer 100 are connected.

In step S<b>701 , the printer 100 receives the conversion result of the remaining ink amount sent from the smartphone 150 . That is, the printer 100 receives the remaining ink amount value estimated by the smartphone 150. Next, in step S702, the printer 100 displays the received conversion result of the remaining ink amount on the display unit 106 of the printer 100.

FIG. 8 is a diagram showing an example of a display screen 800 displayed on the display unit 106 of the printer 100. In S702, the printer 100 displays a display screen 800 including the remaining ink amount value on the display unit 106. The display screen 800 includes an ink remaining amount value 801 which is a result of ink remaining amount conversion, a message 802 asking the user whether to perform ink remaining amount correction, an OK button 803, and a cancel button 804. Although the remaining ink amount value 801 shows an example in which the remaining amount value is displayed in a rounded form at scale positions of 10%, the display mode is not limited to this example. The remaining amount bar may be displayed accurately in units of 1%, or a numerical value may be displayed together with the remaining amount bar. The OK button 803 and the cancel button 804 are reception units that accept selections from the user.

In step S703, the printer 100 determines whether the information indicating the instruction from the user is information indicating that the remaining ink amount value 801 may be reflected in the printer. Specifically, when the OK button 803 is selected on the display screen 800 in FIG. 8, it is determined that the information is allowed to be reflected on the printer, and when the cancel button 804 is selected, the information is not reflected on the printer. It is determined that the information indicates that

If it is determined that the value is to be reflected in the printer, the process advances to step S704, and the printer 100 updates the remaining ink amount stored in the printer body using the remaining ink amount value 801. For example, the printer 100 replaces the remaining ink amount stored in the printer body with the remaining ink amount value 801. Alternatively, the printer 100 may correct the remaining ink amount stored in the printer body using the remaining ink amount value 801. Subsequently, in step S705, the printer 100 displays a screen indicating that the amount of ink remaining in the printer body has been updated. Then, the process ends. On the other hand, if it is determined in step S703 that the update is not reflected in the printer, the process advances to step S706, and the printer 100 displays a screen showing that the amount of ink remaining in the printer main body has not been updated yet. Then, the printer 100 ends the process of this flowchart.

FIG. 9 is a diagram showing an example of a display screen displayed on the display unit 106 of the printer 100. FIG. 9A is an example of a screen 900 displayed in S705 when the update of the amount of ink remaining in the printer body is completed. FIG. 9B is an example of a screen 910 that is displayed in S706 and shows that the amount of ink remaining in the printer main body has not been updated yet.

Note that if the printer 100 does not have the display unit 106, the confirmation process shown in FIG. What is necessary is to perform an updating process using the quantity value. Alternatively, the screens shown in FIGS. 8 and 9 may be displayed on the smartphone 150 connected to the printer 100.

As described above, according to this embodiment, the remaining amount of ink in the printing device can be appropriately managed. That is, an error may occur between the remaining amount of ink managed by the printing device and the remaining amount of ink actually stored in the ink tank. Furthermore, in the case of a printing device in which a user refills ink into an ink tank with an ink bottle, the remaining amount of ink managed by the printing device may not be properly managed due to the user's replenishment. In this embodiment, the amount of ink remaining in the printing device is appropriately managed by updating the amount of ink remaining in the printing device using an image showing the remaining amount of ink captured by a smartphone, which is an external device of the printing device. Can be done.

Further, according to the present embodiment, in an ink bottle type printing apparatus, the remaining amount of ink stored in the ink tank can be appropriately managed. Therefore, for example, in a system that automatically orders ink bottles, which are consumable items, based on the remaining amount of the ink tank, ordering accuracy can be improved. Further, it becomes possible to accurately notify the user using the printer of an out-of-ink error.

<<Other embodiments>>
In the embodiments described above, an example in which the printing device is an inkjet printer has been mainly described, but as described above, the printing device may be an electrophotographic printer. Therefore, in the embodiments described above, ink was used as an example of the recording material, but toner may also be used. That is, although the remaining amount of ink has been described as an example of the remaining amount of recording material, it may also be the remaining amount of toner.

The present invention provides a system or device with a program that implements one or more functions of the embodiments described above via a network or a storage medium, and one or more processors in a computer of the system or device reads and executes the program. This can also be achieved by processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

The disclosure of this embodiment includes configurations typified by the following example of a printing device, example of an information processing device, example of a control method thereof, example of a printing system, and example of a program.

<Configuration 1>
A printing device that executes printing using a recording material stored in a storage section,
receiving means for receiving information regarding the remaining amount of the recording material based on an image taken of the storage unit;
an updating unit that updates information regarding the remaining amount of the recording material managed by the printing device based on information regarding the remaining amount of the recording material received by the receiving unit;
A printing device characterized by having:

<Configuration 2>
The printing device is configured to be able to communicate with an information processing device,
According to configuration 1, the receiving means receives information regarding the remaining amount of the recording material from the information processing device that estimates the remaining amount of the recording material using an image taken of the storage section. printing device.

<Configuration 3>
3. The printing apparatus according to configuration 1 or 2, wherein the storage unit is configured so that the recording material stored therein can be visually recognized.

<Configuration 4>
further comprising a management means for managing the remaining amount of the recording material stored in the storage section,
Any one of configurations 1 to 3, wherein the updating means updates the remaining amount of the recording material managed by the management means, based on the received information regarding the remaining amount of the recording material. The printing device described in .

<Configuration 5>
When the information regarding the remaining capacity is received by the receiving unit, the apparatus further includes a receiving unit that receives an instruction from the user as to whether or not to update the remaining capacity of the storage unit using the information regarding the remaining capacity;
According to any one of configurations 1 to 4, the updating unit updates the remaining capacity of the storage unit when the receiving unit receives an instruction to update the remaining capacity of the storage unit. Printing device.

<Configuration 6>
6. The printing device according to any one of configurations 1 to 5, wherein the storage section is marked with a mark.

<Configuration 7>
7. The printing device according to configuration 6, wherein the mark is a scale.

<Configuration 8>
having a plurality of the accommodating parts,
8. The printing apparatus according to any one of configurations 1 to 7, wherein the plurality of storage units are arranged together.

<Configuration 9>
having a plurality of the accommodating parts,
8. The printing apparatus according to any one of configurations 1 to 7, wherein the first storage part and the second storage part of the plurality of storage parts are arranged separately.

<Configuration 10>
Any one of configurations 1 to 9, wherein the storage unit has an injection port that is accessible by a user, and the recording material is replenished by injecting the recording material through the injection port. The printing device according to item 1.

<Configuration 11>
An information processing device configured to be able to communicate with a printing device having a storage unit,
acquisition means for acquiring a captured image of the storage section;
estimating means for estimating the remaining amount of recording material in the storage section from the captured image;
transmitting means for transmitting information regarding the estimated remaining amount of recording material to the printing device;
An information processing device comprising:

<Configuration 12>
an imaging unit;
a display unit that displays a preview screen of the imaging unit;
a control means for controlling the imaging section and the display section;
It further has
12. The information processing apparatus according to configuration 11, wherein the control means executes control to display a guide corresponding to a mark attached to the storage section on the preview screen.

<Configuration 13>
According to configuration 12, the control means executes control to capture the captured image at a timing when the guide displayed on the preview screen and the mark attached to the storage section overlap. Information processing device.

<Configuration 14>
The control means is configured to be able to switch between a first mode in which images are taken of a plurality of the accommodating parts and a second mode in which images are taken of some of the accommodating parts. The information processing device according to configuration 12 or 13.

<Configuration 15>
15. The information processing device according to configuration 14, wherein the guide used in the first mode and the guide used in the second mode are different.

<Configuration 16>
The guide used in the first mode corresponds to the frame of the remaining capacity window of the storage section,
16. The information processing device according to configuration 15, wherein the guide used in the second mode corresponds to a scale attached to the accommodating section.

<Configuration 17>
The acquisition means further acquires information indicating the type of equipment of the printing apparatus,
According to any one of configurations 12 to 16, the control means specifies the position, type, and arrangement order of the storage section based on information indicating the type of the device and displays the guide. The information processing device described.

<Configuration 18>
A printing system including an information processing device and a printing device that executes printing using recording materials stored in a storage section, the printing system comprising:
The printing device includes:
receiving means for receiving information regarding the remaining amount of the recording material based on an image taken of the storage unit;
an updating unit that updates information regarding the remaining amount of the recording material managed by the printing device based on information regarding the remaining amount of the recording material received by the receiving unit;
has
The information processing device includes:
acquisition means for acquiring a captured image of the storage section;
estimating means for estimating the remaining amount of recording material in the storage section from the captured image;
transmitting means for transmitting information regarding the estimated remaining amount of recording material to the printing device;
A printing system comprising:

<Configuration 19>
A method for controlling a printing device that performs printing using recording materials stored in a storage section, the method comprising:
receiving information regarding the remaining amount of the recording material based on the image taken of the storage unit;
updating information regarding the remaining amount of the recording material managed by the printing device based on the received information regarding the remaining amount of the recording material;
A method for controlling a printing device, comprising:

<Configuration 20>
A method for controlling an information processing device configured to be able to communicate with a printing device having a storage unit, the method comprising:
acquiring a captured image of the storage section;
estimating the remaining amount of recording material in the storage unit from the captured image;
transmitting information regarding the estimated remaining amount of recording material to the printing device;
A method for controlling an information processing device, comprising:

<Configuration 21>
A program for causing a computer to execute the method for controlling a printing apparatus according to configuration 19.

<Configuration 22>
A program for causing a computer to execute the method for controlling an information processing apparatus according to configuration 20.

100 Printer 101 Ink tank unit 150 Smartphone 501 Ink remaining amount window

Claims (22)

A printing device that executes printing using a recording material stored in a storage section,
receiving means for receiving information regarding the remaining amount of the recording material based on an image taken of the storage unit;
an updating unit that updates information regarding the remaining amount of the recording material managed by the printing device based on information regarding the remaining amount of the recording material received by the receiving unit;
A printing device characterized by having: The printing device is configured to be able to communicate with an information processing device,
2. The receiving unit receives information regarding the remaining amount of the recording material from the information processing device that estimates the remaining amount of the recording material using an image taken of the storage unit. Printing device as described. 2. The printing apparatus according to claim 1, wherein the storage unit is configured so that the recording material stored therein can be visually recognized. further comprising a management means for managing the remaining amount of the recording material stored in the storage section,
2. The printing apparatus according to claim 1, wherein the updating unit updates the remaining amount of the recording material managed by the management unit based on the received information regarding the remaining amount of the recording material. When the information regarding the remaining capacity is received by the receiving unit, the apparatus further includes a receiving unit that receives an instruction from the user as to whether or not to update the remaining capacity of the storage unit using the information regarding the remaining capacity;
2. The printing apparatus according to claim 1, wherein the updating unit updates the remaining capacity of the accommodating unit when the receiving unit receives an instruction to update the remaining capacity of the accommodating unit. The printing apparatus according to any one of claims 1 to 5, wherein a mark is attached to the storage section. 7. The printing apparatus according to claim 6, wherein the mark is a scale. having a plurality of the accommodating parts,
The printing apparatus according to any one of claims 1 to 5, wherein the plurality of storage units are arranged together. having a plurality of the accommodating parts,
The printing apparatus according to any one of claims 1 to 5, wherein a first storage part and a second storage part of the plurality of storage parts are arranged separately. . 6. The storage unit has an injection port that is accessible by a user, and the recording material is replenished by injecting the recording material through the injection port. 2. The printing device according to item 1. An information processing device configured to be able to communicate with a printing device having a storage unit,
acquisition means for acquiring a captured image of the storage section;
estimating means for estimating the remaining amount of recording material in the storage section from the captured image;
transmitting means for transmitting information regarding the estimated remaining amount of recording material to the printing device;
An information processing device comprising: an imaging unit;
a display unit that displays a preview screen of the imaging unit;
a control means for controlling the imaging section and the display section;
It further has
12. The information processing apparatus according to claim 11, wherein the control means executes control to display a guide corresponding to a mark attached to the storage section on the preview screen. 13. The control means executes control to capture the captured image at a timing when the guide displayed on the preview screen and the mark attached to the storage section overlap. information processing equipment. The control means is configured to be able to switch between a first mode in which images are taken of a plurality of the accommodating parts and a second mode in which images are taken of some of the accommodating parts. The information processing apparatus according to claim 12 or 13. The information processing apparatus according to claim 14, wherein a guide used in the first mode and a guide used in the second mode are different. The guide used in the first mode corresponds to the frame of the remaining capacity window of the storage section,
16. The information processing apparatus according to claim 15, wherein the guide used in the second mode corresponds to a scale attached to the accommodating section. The acquisition means further acquires information indicating the type of equipment of the printing apparatus,
The information processing according to claim 12 or 13, wherein the control means specifies the position, type, and arrangement order of the storage unit based on information indicating the type of the device and displays the guide. Device. A printing system including an information processing device and a printing device that executes printing using recording materials stored in a storage section, the printing system comprising:
The printing device includes:
receiving means for receiving information regarding the remaining amount of the recording material based on an image taken of the storage unit;
an updating unit that updates information regarding the remaining amount of the recording material managed by the printing device based on information regarding the remaining amount of the recording material received by the receiving unit;
has
The information processing device includes:
acquisition means for acquiring a captured image of the storage section;
estimating means for estimating the remaining amount of recording material in the storage section from the captured image;
transmitting means for transmitting information regarding the estimated remaining amount of recording material to the printing device;
A printing system comprising: A method for controlling a printing device that performs printing using recording materials stored in a storage section, the method comprising:
receiving information regarding the remaining amount of the recording material based on the image taken of the storage unit;
updating information regarding the remaining amount of the recording material managed by the printing device based on the received information regarding the remaining amount of the recording material;
A method for controlling a printing device, comprising: A method for controlling an information processing device configured to be able to communicate with a printing device having a storage unit, the method comprising:
acquiring a captured image of the storage section;
estimating the remaining amount of recording material in the storage unit from the captured image;
transmitting information regarding the estimated remaining amount of recording material to the printing device;
A method for controlling an information processing device, comprising: A program for causing a computer to execute the method for controlling a printing apparatus according to claim 19. A program for causing a computer to execute the method for controlling an information processing apparatus according to claim 20.

Images