JP2021081784A - Program and information processing device - Google Patents

Abstract

To provide a technology which is a program of an information processing device capable of setting a characteristic parameter used for printing in a printer, and which reduces the time and labor of a user at the time of the setting.SOLUTION: A PC1 acquires captured data indicating a photographed image, by executing a candidate parameter determination application 43; identifies the image of a reference part which a printer 2 comprises, and the image of a sheet equipped in the printer 2, from the acquired captured data; compares the identified image of the reference part with the image of the sheet; calculates a candidate parameter which serves as a candidate of a print parameter, based on the comparison result and a feature value of the reference part; and sets the calculated candidate parameter, as the candidate of the print parameter used for printing in the printer 2.SELECTED DRAWING: Figure 4

Description

The technical fields disclosed herein relate to programs and information processing devices that acquire characteristic parameters used for printing on a printer.

There is known a technique of storing a user-defined paper size in an information processing device such as a personal computer and setting the paper to be used for printing by a printer based on the paper size. For example, Patent Document 1 discloses a technique of selecting an appropriate printer paper by a management server when a user-defined paper size is specified in the print data output from the information processing apparatus.

Japanese Unexamined Patent Publication No. 2014-63386

For example, when the paper size is set by the user, it is necessary for the user to measure an appropriate size using a measuring instrument. However, the user does not always have the measuring instrument immediately because he / she does not have the measuring instrument. In that case, it is troublesome for the user to make the measuring instrument available, such as returning to pick up the measuring instrument. Further, when setting characteristic parameters used for printing regardless of the paper size, the user may not always be able to immediately obtain the information and means necessary for setting the characteristic parameters. Patent Document 1 does not disclose a technique relating to details when setting characteristic parameters used for printing.

This specification is a program of an information processing device capable of setting characteristic parameters used for printing with a printer, and discloses a technique for reducing the time and effort of a user at the time of setting the program.

A program made for the purpose of solving this problem is a program that can be executed by a computer of an information processing apparatus and sets characteristic parameters used for printing by a printer, and displays a captured image on the computer. The acquisition process for acquiring the imaging data, the identification process for specifying the image of the reference component included in the printer and the image of the paper mounted on the printer from the imaging data acquired in the acquisition process, and the identification. In the calculation process of comparing the image of the reference component specified in the process with the image of the paper, and calculating the characteristic parameter based on the comparison result and the feature value of the reference component, and the calculation process. It is characterized in that the setting process of setting the characteristic parameter calculated as described above as the characteristic parameter used for printing on the printer is executed.

By executing the program disclosed in the present specification, the information processing apparatus identifies the image of the reference component and the image of the paper from the imaging data, and based on the comparison result and the feature value of the reference component, Calculate characteristic parameters. For example, a user can easily calculate characteristic parameters and use them for printing simply by taking an image including a reference component and paper with a camera provided in the information processing device and having the information processing device acquire the imaged data. Can be done. That is, when setting the characteristic parameters used for printing, it is not necessary to prepare the measuring equipment or the like necessary for the setting, and the user's labor at the time of setting is small.

An information processing device that realizes the function of the program, a control method for realizing the function of the program, and a storage medium that can be read by a computer that stores the program are also new and useful.

According to the technique disclosed in the present specification, a program of an information processing device capable of setting characteristic parameters used for printing with a printer, and a technique for reducing the time and effort of the user at the time of setting are realized.

It is a schematic block diagram of the mobile device which concerns on embodiment. (A) is a view of the printer viewed from above, and (B) is a diagram showing an outline of the internal configuration of the XX cross section of the printer shown in (A). It is a flowchart which shows the procedure of the candidate parameter determination process. It is explanatory drawing which shows the example of the captured image. It is a flowchart which shows the procedure of the paper image identification processing. It is a flowchart which shows the procedure of the calculation setting process. It is explanatory drawing which shows the example of the captured image of the back surface. It is a flowchart which shows the procedure of the printer parameter determination process.

Hereinafter, an embodiment in which an application program (hereinafter referred to as an “application”) executed on a mobile device is embodied will be described in detail with reference to the attached drawings. The present embodiment discloses a mobile device including a camera.

As shown in FIG. 1, the mobile device 1 of the present embodiment includes a controller 10, a user interface (hereinafter referred to as "user IF") 20, a communication interface (hereinafter referred to as "communication IF") 30, and a camera. 40 and. The user IF 20 and the communication IF 30 are electrically connected to the controller 10. The mobile device 1 is, for example, a smartphone, a tablet computer, or a notebook personal computer. The mobile device 1 is an example of an information processing device. Note that the controller 10 in FIG. 1 is a general term for hardware and software used for controlling the mobile device 1, and does not necessarily represent a single hardware actually existing in the mobile device 1. ..

As shown in FIG. 1, the controller 10 of the mobile device 1 includes a CPU 11 and a memory 12. The CPU 11 executes various processes according to the program read from the memory 12 and based on the user's instruction. The CPU 11 is an example of a computer. The memory 12 includes a ROM, a RAM, and a non-volatile memory, and stores various programs, various data, and the like.

Any example of memory may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. In addition to the above examples, the non-transitory medium also includes a recording medium such as a CD-ROM or a DVD-ROM. The non-transitory medium is also a tangible medium. On the other hand, the electric signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium, which is a kind of computer-readable medium, but is a storage that can be read by a non-transitory computer. Not included in the medium.

The user IF 20 is, for example, a touch panel, and includes hardware having a function of accepting an input operation by the user and a function of displaying information. The user IF 20 is an example of a display device and an example of a user interface. The display device and the input device may be different devices, and the user IF 20 may be a combination of a display having a display function and a keyboard, a mouse, or the like having an input reception function.

The communication IF 30 includes hardware for communicating with various external devices. The communication IF 30 may include a plurality of interfaces having different communication methods. Communication methods include, for example, wired or wireless network communication, USB communication, and short-range communication such as Bluetooth (registered trademark). The mobile device 1 can communicate with the printer 2 via the communication IF 30.

The camera 40 includes at least hardware capable of capturing a still image. When the camera 40 is activated, the mobile device 1 acquires an image with an image sensor at predetermined time intervals, and causes the user IF 20 to display the acquired live view image and the shooting button. When the mobile device 1 receives an operation on the shooting button being displayed, the mobile device 1 executes shooting with the camera 40 and acquires imaging data. After acquiring the imaging data, the mobile device 1 may accept the option of storing or discarding the acquired imaging data. The live view image is an image that apparently changes continuously, and is an example of an image that changes continuously.

In the mobile device 1 of this embodiment, as shown in FIG. 1, an operating system (hereinafter referred to as “OS”) 41, a print application 42, and a candidate parameter determination application 43 are stored in the memory 12. .. OS41 is, for example, iOS®, Android®.

Next, the printer 2 connected to the mobile device 1 of the present embodiment will be described. FIG. 2A is a view of the printer 2 viewed from above, and FIG. 2B shows an outline of the internal configuration of the XX cross section of the printer shown in FIG. 2A. As shown in FIG. 2B, for example, the printer 2 of this embodiment is provided with a heat-sensitive printing head 21, and with the printing medium 22 attached, printing on the printing medium 22 and conveying the printing medium 22. In parallel. The print medium 22 used for printing in the printer 2 is replaceable, and is set in the printer 2 in a state in which continuous strip-shaped paper is rolled into a roll. In the following, with respect to the print medium 22, as shown in FIG. 2A, the direction conveyed by the printer 2 is defined as the transport direction, and the direction orthogonal to the transport direction is defined as the width direction.

The print head 21 includes a plurality of heat generating elements arranged in the width direction. The printer 2 selectively heats each heat generating element to print on the conveyed print medium 22 based on the print data, and prints the printed portion of the print medium 22 from the discharge port 23. Protrude to the outside. The printer 2 includes, for example, a manual cutter 24 in the vicinity of the discharge port 23. When the cutter 24 is operated by the user, the portion protruding outside the machine is cut out from the remaining print medium 22 and discharged.

The printing medium 22 used in the printer 2 is, for example, a continuous strip-shaped release paper 221 and a label paper attached to one side of the release paper 221 as shown in FIG. 2 (B) in a partially enlarged manner. It is a label roll including 222. The print medium 22 has a plurality of paper types depending on the shape of the label paper 222. Paper types are, for example, long tapes, die-cut labels, and marked media.

The long tape is obtained by sticking a continuous strip-shaped label paper 222 similar to the release paper 221 on one surface of the continuous release paper 221. For example, a label having a predetermined length is created from a long tape by cutting a printed portion with a cutter 24 or the like. The die-cut label is a label paper 222 that has been preformed into a predetermined shape and is attached to one surface of a continuous release paper 221 at a predetermined interval. The marked medium is a print medium 22 in which marks are provided in advance at predetermined intervals in the transport direction. The mark is provided in black on the back surface, which is the side surface of the light-colored release paper 221 on which the label paper 222 is not attached.

The printer 2 of this embodiment has a transmission sensor 25 for detecting the print medium 22 and a reflection sensor 26 in the vicinity of the print head 21. The transmission sensor 25 is a sensor in which a light emitting element and a light receiving element are arranged on opposite sides of the transport path of the print medium 22. The reflection sensor 26 is a sensor in which the light emitting element and the light receiving element are arranged on the same side with respect to the transport path of the print medium 22. The reflection sensor 26 is arranged so as to detect the back surface of the release paper 221 of the print medium 22.

The printer 2 cue the print medium 22 by detecting it with the transmission sensor 25 and the reflection sensor 26 while carrying the mounted print medium 22. The printer 2 can detect, for example, the presence or absence of the label paper 222 of the die-cut label based on the output result of the transmission sensor 25, and align the head position of the label paper 222 with the position of the print head 21. Further, the printer 2 can detect, for example, the presence or absence of a mark on the marked media based on the output result of the reflection sensor 26, and adjust the position of the mark to the position of the print head 21.

The print application 42 stored in the memory 12 of the mobile device 1 is an application that creates print instruction data instructing the printer 2 to print. The print instruction data includes print parameters determined by the print application 42 and image data. The print parameters include paper parameters that are information about the print medium 22 to be printed, and printer parameters that are parameters related to the operation of the printer 2. The print parameter is an example of a characteristic parameter.

Paper parameters include, for example, information about paper type, paper size in the transport direction and width direction. The paper type is information indicating whether the print medium 22 is a long tape, a die-cut label, or a marked medium. Of the paper parameters, the paper size in the transport direction is set based on the user's instructions if the paper type is long tape, and if it is a die-cut label or marked media, the size of the label paper 222 or the position of the mark. Determined based on. When the paper type is a long tape, the paper parameter may not include the paper size in the transport direction. The paper size in the width direction is the size in the width direction of the label paper 222 regardless of the paper type.

The printer parameters include, for example, information such as sensor sensitivity and energy rank. The sensor sensitivity is, for example, a parameter of the sensitivity of the transmission sensor 25 and the reflection sensor 26. The energy rank is a parameter of the calorific value of the print head 21.

In the print application 42, a plurality of candidate parameters that are candidates for print parameters to be included in the print instruction data can be registered. The candidate parameter determination application 43 stored in the memory 12 of the mobile device 1 is an application that determines candidate parameters and registers them in the print application 42. For example, a save file for saving the candidate parameters at a predetermined address is prepared, and the candidate parameter determination application 43 registers the candidate parameters in the save file. The candidate parameter determination application 43 of the present embodiment determines, for example, candidate parameters including paper parameters related to the print medium 22 mounted on the printer 2. The candidate parameter determination application 43 is an example of a program.

The save file for saving the candidate parameters may be saved in an area accessible to both the print application 42 and the candidate parameter determination application 43. The saved file may be stored in a predetermined area of the memory 12, or may be stored in a storage area prepared by the OS 41 of the mobile device 1, for example, in the registry of Windows (registered trademark). Further, the saved file may be stored in an external device such as a server that can be accessed from the mobile device 1.

The print application 42 can access the save file when generating the print instruction data and acquire the candidate parameters. The print application 42 accepts, for example, one selection of the candidate parameters stored in the save file, and determines the print parameters to be included in the print instruction data based on the selected candidate parameters. The print application 42 may use the selected candidate parameter as it is as a print parameter. Further, the print application 42 may accept editing for the selected candidate parameter and use the edited candidate parameter as a print parameter. The print application 42 may accept, for example, an instruction to change the numerical value of the paper parameter in the candidate parameters via the user IF20.

Instead of including the print parameter itself in the print instruction data, the print application 42 may store the determined print parameter in the memory 12 or the like, and include information indicating the storage location in the print instruction data. Further, the print application 42 may include information indicating a storage location where the image data is stored in the print instruction data instead of including the image data itself in the print instruction data. The storage location of the print parameters and image data may be the memory 12 of the mobile device 1, the memory of the printer 2, or an external device such as a server. The printer 2 reads print parameters and image data from the storage location based on the received print instruction data, and uses the printer 2 for printing.

The print application 42 may be an application that receives print instructions for image data from another application and generates print instruction data based on the received instructions. For example, the print application 42 may be a printer driver. Further, the print application 42 may be an application that accepts the creation or editing of image data and its print instruction by itself, or may be an application that acquires image data from the outside and generates the print instruction data. good. Further, the print application 42 may generate print instruction data jointly with another program such as OS 41, or may transmit the generated print instruction data to the printer 2 jointly with another program.

Subsequently, the processing by the candidate parameter determination application 43 will be described. The following processing and each processing step in the flowchart basically indicate the processing of the CPU 11 according to the instructions described in each program. That is, the processing of "judgment", "extraction", "selection", "calculation", "decision", "specification", "acquisition", "acceptance", "control", etc. in the following description is the processing of the CPU 11. Represents. The processing by the CPU 11 also includes hardware control using the API of the OS 41 of the PC1. In this specification, the operation of each program will be described by omitting the description of OS 41. That is, in the following description, the description to the effect that "program B controls hardware C" may refer to "program B controls hardware C using the API of OS41". In addition, the processing of the CPU 11 according to the instructions described in the program may be described in abbreviated terms. For example, it may be described as "performed by the CPU 11" or "performed by the program".

Note that "acquisition" is used in a concept that does not require a request. That is, the process of receiving data without the CPU 11 requesting is also included in the concept of "the CPU 11 acquires the data". Further, the "data" in the present specification is represented by a bit string that can be read by a computer. Then, data having the same substantial meaning and contents but different formats are treated as the same data. The same applies to "information" in the present specification. Further, "requesting" and "instructing" are concepts indicating that information indicating that a request is being made or information indicating that an instruction is being given is output to the other party. In addition, the information indicating that the request is made or the information indicating that the instruction is given is simply described as "request" or "instruction".

Further, the process of determining whether or not the information A indicates that the information A is the matter B by the CPU 11 is conceptually described as "determining whether or not the information A is the matter B from the information A". There is. The process of determining whether the information A indicates that the information A is the matter B or the matter C by the CPU 11 is "determined from the information A whether the information A is the matter B or the matter C." It may be described conceptually as.

The procedure of the candidate parameter determination process for determining the candidate parameters that are candidates for various print parameters in the mobile device 1 of the present embodiment will be described with reference to the flowchart of FIG. The candidate parameter determination process is executed by the CPU 11 of the controller 10 when the execution instruction of the candidate parameter determination application 43 is received.

In the candidate parameter determination process, the CPU 11 first generates a confirmation list (S101). The confirmation list is a list of candidate parameters, and is a list of candidates for allowing the user to select information on the paper loaded this time. As described above, the candidate parameters are stored in the save file, and in S101, the CPU 11 reads, for example, the candidate parameters from the save file and generates a confirmation list.

The CPU 11 may, for example, generate a confirmation list based on all the candidate parameters saved in the save file, or separately provide the candidate parameter determination application 43 with one or more candidate parameters for the confirmation list in addition to the candidate parameters. You may memorize and add the memorized candidate parameters to the confirmation list. Alternatively, the CPU 11 may generate a confirmation list using only the candidate parameters for the confirmation list stored in the candidate parameter determination application 43. Further, the CPU 11 may use the API of the print application 42 to request the print application 42 for the candidate parameter or its list, acquire the candidate parameter or its list, and generate a confirmation list based on the acquired information. ..

The CPU 11 determines whether or not the mode designation has been accepted (S102). The candidate parameter determination application 43 of the present embodiment receives, for example, an instruction to specify a paper type and acquire a paper parameter. Acceptable modes are, for example, long tape, die-cut labels, marked media, and automatic. Automatic is an instruction to acquire paper parameters without specifying a paper type, and long tape, die-cut label, and marked media are instructions to acquire paper parameters by specifying a paper type, respectively. In S102, the CPU 11 accepts a cancellation instruction in addition to the mode designation.

When it is determined that the mode other than the cancel is specified (S102: YES), the CPU 11 acquires the imaging data and causes the user IF 20 to display the acquired imaging data (S103). S103 is an example of the acquisition process. In the present embodiment, the CPU 11 may activate the camera 40 to perform shooting to acquire imaging data, or may acquire captured imaging data from the memory 12 or the like. For example, the CPU 11 causes the user IF 20 to display a message inquiring whether or not to shoot, and accepts the user's input.

When the instruction to shoot is received, the CPU 11 activates the camera 40 and causes the user IF 20 to display the live view image. In this case, S103 is also a shooting process, and the image data of the live view image is the imaging data. Further, when the CPU 11 receives a shooting instruction while displaying the live view image, the CPU 11 shoots with the camera 40 and acquires the captured data. In this case, the CPU 11 stops the display of the live view image and causes the user IF 20 to display the acquired imaging data. In this case as well, S103 is also an imaging process, and the imaging data acquired by the imaging is the imaging data. On the other hand, when the instruction to acquire the image pickup data is received from the memory 12 or the like without taking a picture, the CPU 11 reads the designated image pickup data and causes the user IF 20 to display the image. In this case, S103 is also a still image display process.

The candidate parameter determination application 43 requests the user to acquire imaging data in which a specific reference component and paper provided on the outer surface of the printer 2 are contained in the same image. For example, the CPU 11 acquires the model information of the target printer for which the candidate parameters are determined, specifies the specified reference component based on the model information, and causes the user IF 20 to display a message requesting shooting.

The reference parts are parts included in all printers of the same model, for example, a logo, a plate, and a sticker provided in the vicinity of the discharge port 23 of the printer 2, and are predetermined for each printer model. The printer 2 may have a dedicated component for comparison with paper as a reference component. The candidate parameter determination application 43 stores in advance feature information such as the color and outer shape of the reference component for each printer model in association with the printer model information. As the reference component, a component having a color different from the color of the exterior of the printer is selected.

As a message requesting shooting, the CPU 11 may, for example, specifically indicate the reference component of the printer 2 and cause the user IF 20 to display an instruction to shoot together with the paper as text or an illustration, or output it as a voice message. .. Further, when acquiring the die-cut label information, the CPU 11 may output a message requesting that an image including one image be acquired.

An example of the captured image is shown in FIG. 4 (A). The example of FIG. 4A is an image 50 obtained by photographing the printer 2 to which the die-cut label 52 is attached. The reference component of the printer 2 included in the image 50 of FIG. 4A is the logo mark 51 provided at the upper part of the discharge port 23 in the drawing. The exterior of the printer 2 of this embodiment is dark, and the logo mark 51 is light.

The CPU 11 binarizes the acquired imaging data (S104), and attempts to detect a candidate image presumed to be an image of the reference component based on the feature information of the reference component stored in advance (S105). S105 is an example of the candidate image identification process. If the imaging data includes the reference component, the CPU 11 can acquire the position of the reference component based on the information of the reference component stored in the memory 12 and the binarized image.

The CPU 11 determines whether or not the candidate image presumed to be the image of the reference component could be detected (S106). When it is determined that the detection could not be performed (S106: NO), the CPU 11 determines whether or not the number of trials is smaller than the predetermined value (S107). The predetermined value is, for example, 3, which is a predetermined number of times. When it is determined that the number of trials is smaller than the predetermined value (S107: YES), the CPU 11 adjusts the binarization parameter (S108), returns to S104, and tries binarization and detection of the image of the reference component again. To do.

When it is determined that the number of trials has reached a predetermined value (S107: NO), the CPU 11 sends a message indicating that the image of the reference component could not be detected, or a message requesting photography similar to that of S103, to the user IF20. Is displayed (S109). The binarization parameter in the first trial is a value predetermined by the candidate parameter determination application 43, and may be different for each printer model, for example.

On the other hand, when it is determined that the candidate image presumed to be the image of the reference component can be detected (S106: YES), the CPU 11 uses the component frame, which is an image showing the outline of the acquired image of the reference component, as the image of the captured data. Overlapping, it is displayed on the user IF20 (S110). S110 is an example of the guide display process. In the example of FIG. 4, as shown in FIG. 4B, the component frame 511 surrounding the image of the logo mark 51 is displayed superimposed on the image 50 in a fluorescent color or the like. In this example, the image of the logo mark 51 surrounded by the component frame 511 is an example of the first candidate image, and the component frame 511 is an example of the guide image. S106, which detects a candidate image presumed to be an image of a reference component, is an example of specific processing.

Next, the CPU 11 executes a paper image identification process, which is a process of detecting a paper image (S111). The procedure of the paper image identification process will be described with reference to the flowchart of FIG. In the example of FIG. 4A, the tip of the paper pulled out from the discharge port 23 is shown. The paper image of this example is an image of the die-cut label 52. A die-cut label is a paper in which a shaped label paper is attached on a release paper, but the difference in brightness between the release paper and the label paper is often not so large. The candidate parameter determination application 43 of this embodiment attempts to identify a paper image using a color density histogram.

In the paper image identification process, the CPU 11 first grayscales the captured data (S201). Then, the CPU 11 reads the correction value from the memory 12 (S202). The correction value is a value for correcting the threshold value for detecting the paper image. Using the threshold corrected by the read correction value, the CPU 11 determines the boundary between the background and the release paper and the boundary between the release paper and the label paper from the gray scale image, and the paper which is the image of the label paper. Attempts to detect a candidate image presumed to be an image (S203). S203 is an example of the candidate image identification process. The boundary between the background and the release paper may be acquired based on the binarized data.

For example, if the exterior of the image is a dark-colored printer 2, it is estimated that the highest density portion in the image is the exterior of the printer 2 and the minimum density portion is the label paper. Therefore, the CPU 11 acquires a color change vector from the maximum density to the minimum density, and determines a threshold value which is the density of the boundary between the release paper and the label paper. The CPU 11 defines, for example, the range of the label paper where the density change becomes flat at the minimum density, and the boundary between the release paper and the label paper where the density change peaks just before the density change becomes flat. Is determined, and the concentration at that location is used as the default threshold. In S203, the paper image is detected with the value obtained by adding the correction value read in S202 to the default threshold value as the threshold value. The boundary between the background and the release paper may or may not be detected in parallel with the detection of the image of the logo mark 51 based on the binarized data.

Then, the CPU 11 determines whether or not the paper image can be detected (S204). When it is determined that the paper image could not be detected (S204: NO), the CPU 11 determines whether or not the number of trials is smaller than the predetermined value (S205). The predetermined value is, for example, 3, which is a predetermined number of times. The predetermined value may be a number different from the predetermined value used in S107 of the candidate parameter determination process. When it is determined that the number of trials is smaller than the predetermined value (S205: YES), the CPU 11 adjusts the threshold value (S206), returns to S203, and tries to detect the paper image again.

When it is determined that the number of trials has reached a predetermined value (S205: NO), the CPU 11 displays a message indicating that the paper image could not be detected or a message requesting shooting similar to S103 to the user IF20. (S207), the paper image identification process is terminated, and the process returns to the candidate parameter determination process.

On the other hand, when it is determined that the paper image can be detected (S204: YES), the CPU 11 superimposes the paper frame, which is an image showing the outline of the detected paper image, on the image of the captured data and displays it on the user IF20 (S208). ). S208 is an example of the guide display process.

In the example of FIG. 4, as shown in FIG. 4B, the paper frame 521 surrounding the image of the die-cut label 52 is displayed superimposed on the image 50 in a fluorescent color or the like. The image of the die-cut label 52 surrounded by the paper frame 521 is an example of the second candidate image, and the paper frame 521 is an example of the guide image. Since the paper is presumed to be rectangular, the CPU 11 interpolates the portion of the label paper, for example, to form a rectangular paper frame 521. A frame showing the outer shell of the release paper may also be displayed.

If the camera 40 is activated and the live view image is displayed, the CPU 11 outputs a message requesting shooting similar to that of S103 until, for example, both the component frame and the paper frame can be displayed. When both the parts frame and the paper frame are displayed continuously, it is advisable to display a message or voice guidance indicating that appropriate imaging data has been acquired.

The CPU 11 displays asking the user whether or not the displayed paper frame 521 is appropriate, and receives a correction instruction for the paper frame 521 (S209). S209 is an example of the guide correction process. The CPU 11 receives, for example, a correction instruction by touching or dragging the displayed paper frame 521. When it is determined that the correction instruction of the paper frame 521 has been accepted (S209: YES), the CPU 11 returns to S208, corrects the paper frame 521, and displays the paper frame 521. When it is determined that the correction instruction is not accepted (S209: NO), the CPU 11 determines whether or not the confirmation instruction of the paper frame 521 has been accepted (S210). When it is determined that the confirmation instruction is not accepted (S210: NO), the CPU 11 waits until the correction instruction or the confirmation instruction is received.

When it is determined that the confirmation instruction of the paper frame 521 has been accepted (S210: YES), the CPU 11 determines the range surrounded by the paper frame 521 being displayed at that time as the paper image (S211). S204 and S211 are examples of specific processing.

Then, the CPU 11 acquires the correction amount of the paper frame 521 corrected by the user from the position of the paper frame 521 when the confirmation instruction is received, and stores the correction value based on the correction amount in the memory 12 (S212). , The paper image identification process is finished, and the process returns to the candidate parameter determination process. S212 is an example of storage processing. The correction value is, for example, the difference between the density value corresponding to the position of the fixed paper frame 521 and the density value of the default threshold value. The correction value stored in S212 is read out in S202 of the next paper image identification process.

Returning to the description of FIG. The CPU 11 determines whether or not the paper image is specified by the paper image specifying process of S111 (S112). When the number of trials reaches a predetermined value in S205 of the paper image specifying process, the paper image is not specified. Further, the cancellation instruction may be accepted in addition to the confirmation instruction in S210 of the paper image identification process. In that case, when the cancellation instruction is accepted, the paper image is not specified.

When it is determined that the paper image has not been specified (S112: NO), or after S109, the CPU 11 displays a message inquiring whether or not to retake the captured data, and accepts the user's instruction (S113). .. When it is determined to perform re-shooting (S113: YES), the CPU 11 returns to S103 and acquires new imaging data. The imaging data acquired in S103 includes those that do not include the image of the reference component or the image of the paper. In that case, since it is determined as NO in S107 or S112, the CPU 11 takes a picture in S113. Decide whether to fix it.

When the image acquired in S103 is a live view image, the mobile device 1 acquires the live view image at predetermined time intervals, so that the re-imaging is performed even if the re-imaging instruction is not received. In that case, if the position of the image of the reference component or the paper image moves due to the re-photographing, the CPU 11 causes the component frame 511 and the paper frame 521 to follow and display according to the position of each image after the movement.

On the other hand, when it is determined that the paper image has been specified (S112: YES), the CPU 11 executes the calculation setting process (S114). The calculation setting process is a process of acquiring a paper type and a paper size and setting them as paper parameters of candidate parameters. The procedure of the calculation setting process will be described with reference to the flowchart of FIG.

In the calculation setting process, the CPU 11 acquires the actual size of the reference component included in the printer 2 (S301). The size of the reference component of the printer 2 is an example of the feature value of the reference component. The size of the reference component of the printer 2 may be stored in the memory 12 in advance, or may be acquired from an external device such as a server. Then, the CPU 11 compares the size of the component frame 511 showing the image of the reference component with the size of the paper frame 521 showing the paper image, and based on the comparison result and the actual size acquired in S301, the paper size. (S302). S302 is an example of the calculation process.

For example, in the example of FIG. 4, as shown in FIG. 4C, the actual width of the reference component of the printer 2 is multiplied by the ratio of the width wb of the paper frame 521 to the width wa of the component frame 511. The paper width of the paper to be compared is calculated. Similarly, the paper length wc and the release paper width wd can be calculated. In addition, keystone correction may be performed at the time of calculation.

Further, the CPU 11 acquires the paper type from the paper image (S303). For example, when the image of the release paper is included in all four sides of the paper image as in the example of FIG. 4, the CPU 11 determines that the paper type is a die-cut label. On the other hand, when the image of the release paper is included only in two directions such as the left and right of the paper image, the CPU 11 determines that the paper type is a long tape.

Then, the CPU 11 determines whether or not the acquired paper type matches the mode received in S102 of the candidate parameter determination process (S304). When automatic is selected as the mode, the CPU 11 determines that they match. If it is determined that they match (S304: YES), the CPU 11 determines the paper type of this paper to the paper type acquired in S303 (S305). In S305, the paper type is determined to be a die-cut label or a long tape. S305 is an example of the determination process.

On the other hand, when it is determined that the paper type acquired in S303 does not match the mode specified by the user (S304: NO), the CPU 11 determines whether or not to determine the back surface (S306). For example, in the marked media in which the mark is provided on the back surface of the paper, the CPU 11 determines in S303 that the tape is a long tape based on the image on the front surface of the paper. If the mode specified by the user is the marked media, the CPU 11 determines in S306 that the back surface is determined. Specifying the mode in which the marked media is specified is an example of the paper type input process.

When it is determined that the back surface is determined (S306: YES), the CPU 11 acquires the imaging data obtained by photographing the back surface of the paper (S307). S307 is an example of the back surface acquisition process. For example, the CPU 11 displays a message instructing to shoot the back surface, activates the camera 40, and acquires a live view image. Alternatively, the CPU 11 acquires the imaging data obtained by photographing the back surface by taking a picture with the camera 40 or reading it from the memory 12 or the like based on the instruction of the user.

An example of a captured image obtained by photographing the back surface of the marked media is shown in FIG. 7 (A). The user causes the mobile device 1 to acquire the imaging data on the back surface by pointing the back surface of the front end portion of the paper drawn from the ejection port 23 of the printer 2 toward the camera 40. In the example of FIG. 7A, the captured image 60 obtained by photographing the back surface 53 of the paper includes four mark images 531. In this embodiment, the mark of the marked media is provided in a dark color on a light-colored release paper.

Then, the CPU 11 tries to detect the mark included in the image of the paper from the imaged data on the back surface (S308). S308 is an example of the back surface specifying process. The CPU 11 binarizes the imaged data on the back surface, for example, and detects the position of the mark from the binarized data. Alternatively, the CPU 11 may make a determination based on the color density histogram.

The CPU 11 determines whether or not the mark has been successfully detected (S309). If it is determined to be successful (S309: YES), the CPU 11 determines that the paper type is the marked media (S310). Further, the CPU 11 calculates the distance between the marks based on the distance between the marks in the imaging data on the back surface and the width of the release paper calculated from the imaging data on the front surface (S311). For example, as shown in FIG. 7B, the CPU 11 acquires the positions of two marks arranged in the length direction of the paper, and based on the width wd of the release paper acquired from the captured image on the surface, between the marks. To get the distance we.

On the other hand, when it is determined that the mark cannot be detected (S309: NO), the CPU 11 determines that the tape is a long tape (S312). If the mark detection is not successful, the binarization parameter may be adjusted within a predetermined number of times as performed in S106 to S108 of the candidate parameter determination process, or based on the user's instruction. The captured data may be retaken.

After any of S305, S311 and S312, the CPU 11 extracts from the confirmation list the paper parameters of the determined paper type and the size close to the calculated paper size (S313). The close size is, for example, a range of ± 1 mm centered on the calculated paper size. Further, the CPU 11 causes the user IF 20 to display a list of the extracted paper parameters (S314).

Then, the CPU 11 accepts the user's selection from the paper parameters displayed in the list, and determines whether or not the selection or new setting instruction is accepted (S315). When it is determined from the list-displayed paper parameters that the user's selection has been accepted (S315: YES), the CPU 11 determines to use the selected paper parameters as the paper parameters of the candidate parameters (S316). The paper parameter determined in S316 is an example of a characteristic parameter. The CPU 11 may accept fine adjustments to the selected paper parameters before the determination, and the paper parameters after the fine adjustment may be used as candidate parameters.

Further, when the confirmation list does not include the paper parameters close to the paper information acquired this time, the CPU 11 displays the information of the paper this time on the user IF20 in S315, and also accepts an instruction to set as a new setting. When it is determined that the new setting instruction has been accepted (S315: YES), the CPU 11 determines to generate a paper parameter based on the information of the current paper and use it as the paper parameter of the candidate parameter (S316). The CPU 11 may accept an instruction for fine adjustment with respect to the information on the paper this time.

When the paper parameters are determined, the CPU 11 executes the printer parameter determination process (S317). The printer parameter determination process is a process of determining various printer parameters to be included in the print instruction data when printing on paper with the paper parameters determined as candidate parameters this time.

The procedure of the printer parameter determination process will be described with reference to the flowchart of FIG. In the printer parameter determination process, the CPU 11 acquires the color information of the image of the reference component included in the surface imaging data acquired in S103 of the candidate parameter determination process (S401). Further, the CPU 11 acquires the color information of the paper image from the same imaging data (S402). In S402, the CPU 11 acquires the color of the release paper and the color of the label paper from the paper image included in the image capture data on the surface.

The CPU 11 determines the energy rank based on the color of the label paper (S403). For example, when the color of the label paper is darker than the color of the standard paper, the label paper is likely to be a material having a large roughness, so that the CPU 11 raises the energy rank. Further, the CPU 11 determines the sensor sensitivity of the transmission sensor 25 based on the difference between the color of the release paper and the color of the label paper (S404). For example, when the color of the release paper and the color of the label paper are close to each other, the CPU 11 increases the sensor sensitivity of the transmission sensor 25.

Then, the CPU 11 determines whether or not the paper type is determined to be the marked media (S405). When it is determined that the media is marked (S405: YES), the CPU 11 acquires the color information of the marked image based on the imaged data on the back surface (S406). Then, the CPU 11 determines the sensor sensitivity of the reflection sensor 26 based on the difference between the color of the release paper and the color of the mark image (S407). For example, when the color of the release paper and the color of the mark image are close to each other, the CPU 11 increases the sensor sensitivity of the reflection sensor 26.

After S407 or when it is determined that there is no image pickup data on the back surface (S405: NO), the CPU 11 corrects each determined printer parameter based on the color information of the image of the reference component (S408), and after the correction. Determine the value as a printer parameter. Each printer parameter determined in S408 is an example of a characteristic parameter.

For example, the CPU 11 compares the original color of the reference component based on the information of the reference component stored in the memory with the color of the image of the reference component included in the imaging data, and acquires the correction value of the color correction. The original color of the reference component is an example of the feature value of the reference component. For example, when the color of the image is darker than the original color, the CPU 11 acquires a correction value for brightness correction that changes the color of the image to the original color. Then, the CPU 11 corrects the sensor sensitivity and the energy rank based on the acquired correction value. Before determining each printer parameter, a correction value based on the image of the reference component may be acquired to correct the imaging data, and each printer parameter may be determined using the corrected imaging data.

After S408, the CPU 11 ends the printer parameter determination process and returns to the calculation setting process. In the calculation setting process, after the printer parameter determination process of S317, when it is determined that the back side is not determined (S306: NO), or when it is determined that the printer is canceled without selection or new setting (S315). : NO), the CPU 11 ends the calculation setting process and returns to the candidate parameter determination process.

Returning to the description of the candidate parameter determination process of FIG. In the candidate parameter determination process, after the calculation setting process of S114, the determined candidate parameter is registered in a predetermined save file (S115). Since the candidate parameters saved in the save file are used as print parameters in the print application 42, S115 is an example of the setting process. After S115, when it is determined that the mode is canceled without accepting the designation (S102: NO), or when it is determined that the re-shooting instruction is not accepted (S113: NO), the CPU 11 determines the candidate parameters. End the process.

As described in detail above, by executing the candidate parameter determination application 43 described in the present specification, the mobile device 1 is the printer 2 based on the comparison result between the image of the reference component and the image of the paper. Determine the candidate parameters of the print parameters used for printing. The user can easily determine each information as a candidate parameter by inputting the imaging data captured by the camera 40, for example. That is, when setting the print parameters, it is not necessary to prepare the measuring equipment or the like necessary for the setting, which saves the user time and effort.

Further, in the present embodiment, since the paper size is calculated based on the size of the reference component, the paper parameters can be easily set even in the printer 2 which does not have the function of detecting the paper size. Moreover, since the paper parameters are acquired without feeding the paper, waste of the paper can be reduced. Further, in the present embodiment, when the marked media is specified, the image of the mark is acquired based on the imaged data on the back surface, so that the distance between the marks can also be calculated.

Further, in the present embodiment, since the component frame 511 and the paper frame 521 are displayed on the image of the captured data, the user can confirm whether or not the reference component or the paper is correctly recognized by the program. Further, since the correction of the paper frame 521 is accepted, the program can recognize the reference component and the paper more accurately. It should be noted that the parts frame may be modified. In addition, a guide display indicating the position of the acquired mark image may be displayed on the imaged data on the back surface.

Further, in the present embodiment, when the paper frame 521 is modified, the difference between the modified threshold value and the default threshold value is stored as a correction value and used for the next detection of the paper image. The default threshold is the boundary position detected by a standard algorithm, and correction by a correction value corrected by the user is likely to result in more accurate detection in the next detection. In this embodiment, the correction value stored last time is used as it is next time, but the correction value may be stored a plurality of times and the average value or the median value may be used, or the correction value may be used as teacher data by the machine. You may build a model to be trained. Further, the correction value may be used when detecting the image of the reference component.

Further, in this embodiment, in addition to the paper parameters, the values of the printer parameters such as the sensor sensitivity and the energy rank are acquired based on the imaging data, and the acquired values are determined as the candidate parameters. Therefore, the determined candidate parameters are used as the print parameters. If printing is performed using the above, there is a high possibility that the printing will be more appropriate. Further, since various printer parameters are corrected based on the color information of the image of the reference component, it is possible to suppress the variation of the printer parameters depending on the imaging environment.

It should be noted that the present embodiment is merely an example and does not limit the present invention in any way. Therefore, as a matter of course, the present invention can be improved and modified in various ways without departing from the gist thereof. For example, the number of PCs and printers is not limited to the illustrated example. The printing method of the printer 2 is not limited to the thermal method, and may be, for example, a thermal transfer method, an inkjet method, or an electrophotographic method. Further, the print medium is not limited to the label paper, and may be, for example, a simple roll paper.

Further, in the present embodiment, the mobile device 1 includes the print application 42 and the candidate parameter determination application 43, but the present invention is not limited to this. For example, the print application 42 and the candidate parameter determination application 43 may be installed in different devices. For example, the mobile device 1 may include the candidate parameter determination application 43, and a device other than the mobile device 1 such as a personal computer may include the printing application 42. In that case, the mobile device 1 stores the determined candidate parameter in an area that can be used by the print application 42 of another device.

Further, the printer 2 may have the same function as the print application 42. The mobile device 1 may register the determined candidate parameter in the printer 2. Further, the printer 2 may have the same function as the candidate parameter determination application 43. The printer 2 may execute the candidate parameter determination process to determine the candidate parameter and register it in its own device. In these cases, the printer 2 can select the candidate parameters registered in the printer 2 and use them as print parameters when printing the image data. The printer 2 can use candidate parameters when printing image data stored in a memory such as a built-in flash memory or an external SD card.

Further, in the present embodiment, the mobile device 1 registers the determined candidate parameters in a storage file stored in a predetermined area, but the present invention is not limited to this. For example, the mobile device 1 may create and export a save file in which candidate parameters are described. The print application 42 may import the exported saved file and use it as a candidate for print parameters. Alternatively, the candidate parameters may be registered in the print application 42 by writing the contents of the exported save file to the save file or the like of the print application 42 by another means.

Further, for example, in the present embodiment, the mobile device 1 is set to set all the paper parameters and the printer parameters, but only a part of these may be set. For example, only the paper parameters may be used, only the printer parameters may be used, or only the paper size or the paper width among the paper parameters may be used.

Further, in the present embodiment, the image of the reference component is detected based on the binarized data, and the paper image is detected based on the grayscale data, but the present invention is not limited to this. For example, the reverse may be performed, both may be performed based on binarized data, or both may be performed based on grayscale data.

Also, the mode specification does not have to be accepted. For example, when the candidate parameter determination application is started, detection may be performed in the automatic mode. Alternatively, there may be no automatic mode, and the paper type may be determined by specifying the mode. Further, for example, the confirmation list may be generated before the list is displayed. Further, in the present embodiment, the detection trial is repeated a number of times within a predetermined value, but the retry may not be performed. Further, the order of detecting the image of the reference component and detecting the paper image may be reversed or may be performed in parallel.

Further, in the present embodiment, various printer parameters are corrected based on the color information of the image of the reference component, but it is not necessary to correct them. That is, various printer parameters may be set only from the paper image.

Further, in the present embodiment, the candidate parameter determination application 43 registers the candidate parameters in the save file, and the print application 42 selects from the candidate parameters registered in the save file and sets them as print parameters, but the present invention is not limited to this. .. For example, the print application 42 may start the candidate parameter determination application 43 when creating the print instruction data. In that case, the candidate parameter determination application 43 determines the candidate parameter and outputs it, and the print application 42 sets the output candidate parameter as it is as a print parameter, or edits the output candidate parameter and uses it as a print parameter. You can set it.

Further, the mobile device 1 may include an application having both functions of the print application 42 and the candidate parameter determination application 43. In that case, the mobile device 1 determines the candidate parameters in the same manner as the candidate parameter determination application 43 of the present embodiment by the function of the application, and prints using the determined candidate parameters in the same manner as the printing application 42 of the present embodiment. May be executed. Further, the mobile device 1 may save a plurality of candidate parameters determined by the application, select one of the saved candidate parameters and use it for printing, or edit the selected candidate parameters. May be used for printing.

Further, in any flowchart disclosed in the embodiment, the plurality of processes in the arbitrary plurality of steps can be arbitrarily changed in the execution order or executed in parallel as long as the processing contents do not conflict with each other.

Further, the process disclosed in the embodiment may be executed by a single CPU, a plurality of CPUs, hardware such as an ASIC, or a combination thereof. In addition, the process disclosed in the embodiment can be realized in various aspects such as a recording medium or a method in which a program for executing the process is recorded.

1 Mobile device 2 Printer 11 CPU
12 memory 20 user IF
40 camera 43 candidate parameter determination app

Claims (13)

A program that can be executed by the computer of the information processing device and sets characteristic parameters used for printing with a printer.
On the computer
The acquisition process to acquire the imaging data indicating the captured image, and
Specific processing for identifying an image of a reference component included in the printer and an image of paper mounted on the printer from the imaging data acquired in the acquisition process.
A calculation process in which the image of the reference component specified in the specific process is compared with the image of the paper, and the characteristic parameter is calculated based on the comparison result and the feature value of the reference component.
A setting process for setting the characteristic parameter calculated in the calculation process as the characteristic parameter used for printing with the printer, and a setting process.
To execute,
A program characterized by that. In the program according to claim 1,
In the calculation process,
The size of the image of the reference component is compared with the size of the image of the paper, and the width of the paper is calculated as the characteristic parameter based on the comparison result and the size of the reference component as a feature value of the reference component. To do,
A program characterized by that. In the program described in claim 2,
On the computer
A determination process for determining the paper type based on the image of the paper is executed.
In the calculation process,
When the paper type has width and length as the parameters of the paper size in the determination process, the width and length of the paper are calculated as the characteristic parameters based on the image of the paper.
A program characterized by that. In the program according to claim 1,
In the calculation process,
The color of the image of the reference component is compared with the color of the image of the paper, and based on the comparison result and the color of the reference component as a feature value of the reference component, the paper in the printer is used as the characteristic parameter. Calculate the correction value of the sensitivity of the sensor used for the detection of
A program characterized by that. In the program according to claim 1,
In the calculation process,
The color of the image of the reference component is compared with the color of the image of the paper, and based on the comparison result and the color of the reference component as a feature value of the reference component, printing with the printer is performed as the characteristic parameter. Calculate and obtain the correction value of the energy rank of the print head used for
A program characterized by that. In the program according to any one of claims 1 to 5.
On the computer
A paper type input process that accepts an input as to whether or not the paper type of the paper to be compared is a specific paper type in which the image used for acquiring the characteristic parameter is included on the back surface of the paper.
When it is input that the specific paper type is used in the paper type input process, the back side acquisition process of requesting and acquiring the imaging data obtained by photographing the back side of the paper mounted on the printer, and the back side acquisition process.
From the imaging data acquired in the back surface acquisition process, a back surface identification process for specifying an image on the back surface of the paper is executed.
In the calculation process,
The image of the reference component and the image of the paper specified in the specific process are compared with the image of the back surface of the paper specified in the back surface identification process, and the comparison result and the feature value of the reference component are obtained. Based on, the characteristic parameter is acquired.
A program characterized by that. In the program according to any one of claims 1 to 6.
On the computer
From the imaging data acquired in the acquisition process before executing the specific process, a first candidate image which is a candidate image of the reference component and a second candidate image which is a candidate image of the paper. Candidate image identification processing to identify and
When at least one candidate image is specified by the candidate image identification process, a guide display indicating the outline of the specified candidate image is superimposed on the image of the captured data and displayed on the display device of the information processing apparatus. Process and execute,
In the specific process,
The first candidate image shown by the guide image is specified as an image of the reference component, and the second candidate image shown by the guide image is specified as an image of the paper.
A program characterized by that. In the program according to claim 7.
On the computer
The camera of the information processing device is activated, and a shooting process of displaying an image shot by the camera and continuously changing is displayed on the display device is executed.
In the guide display process,
The guide image is made to follow the continuously changing image displayed in the shooting process.
A program characterized by that. In the program according to claim 7.
On the computer
A still image display process for displaying the still image shown in the captured image data acquired in the acquisition process on the display device is executed.
In the guide display process,
The guide image is superimposed on the still image displayed by the still image display process.
A program characterized by that. In the program according to any one of claims 7 to 9.
On the computer
With the guide image displayed, a guide correction process for receiving the correction of the position of the guide image via the user interface of the information processing device is executed.
In the candidate image identification process,
When the position of the guide image is corrected by the guide correction process, the image indicated by the corrected guide image is used as the candidate image.
A program characterized by that. In the program according to claim 10.
On the computer
When the position of the guide image is corrected by the guide correction process, a storage process for storing the correction value based on the correction amount in the memory is executed.
In the guide display process,
When displaying the guide image, the position where the guide image is displayed is determined based on the correction value stored in the storage process.
A program characterized by that. A program that can be executed by the computer of the information processing device and sets characteristic parameters used for printing with a printer.
On the computer
Acquisition process to acquire image data showing the image taken by the camera,
Specific processing for specifying an image of paper used for printing by the printer from the imaging data acquired in the acquisition process, and
A calculation process for calculating the characteristic parameters based on the image of the paper specified in the specific process, and a calculation process for calculating the characteristic parameters.
A setting process for setting the characteristic parameter calculated in the calculation process as the characteristic parameter used for printing with the printer, and a setting process.
To execute,
A program characterized by that. An information processing device equipped with a computer
The computer
Acquisition process to acquire image data showing the image taken by the camera,
Specific processing for identifying an image of a reference component included in a printer connected to the information processing apparatus and an image of paper mounted on the printer from the imaging data acquired in the acquisition process.
Calculation that compares the image of the reference component specified in the specific process with the image of the paper, and calculates the characteristic parameter used for printing with the printer based on the comparison result and the feature value of the reference component. Processing and
A setting process for setting the characteristic parameter calculated in the calculation process as the characteristic parameter used for printing with the printer, and a setting process.
To execute,
An information processing device characterized by this.

Images