JP2014071759A - Image display control apparatus and information display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display control apparatus which displays information on a label so as not to impair the appearance of the label to be attached to an object, and to provide an information display program.SOLUTION: A printer prepares a label on the basis of print information input to a mobile terminal. A user attaches the prepared label to an article, and images the attached label by use of a camera of the mobile terminal. The user image-processes the captured image. A flash memory of the mobile terminal stores print information of the label, processed image information, and position information showing a shooting position. When a label replacement time is reached, the mobile terminal displays a label print image, the processed image, and the shooting position, on the basis of information stored in the flash memory (S117, S133). The user can easily determine and find a label to be replaced before the appearance thereof is impaired.

Description

  The present invention relates to an information display control device and an information display program for displaying information related to a label printed by a printing device.

  A label produced by a conventional printing apparatus includes a printing portion that can be printed by the printing device on the front surface, and a pasting portion coated with an adhesive on the back surface (see, for example, Patent Document 1). In the label disclosed in Patent Document 1, the pasting portion on the back surface is covered with a first mount piece, a second mount piece, and a third mount piece. The first mount piece covers only the upper part and the lower part of the sticking part. The second mount piece covers only the upper side, the lower side, and the left side of the pasting portion that is not covered by the first mount piece. The third mount piece covers only the remaining sticking part.

  The user first peels off the first mount piece, exposes a part of the sticking part, and sticks the label to the object. When time passes and the adhesive strength of the label decreases, the second backing sheet piece is peeled off to expose a new pasting portion, and the label is stuck on the object again. When the adhesive strength of the label decreases again, the third mount piece is peeled off, the new pasting portion is further exposed, and the label is pasted on the object again. Thereby, the user can stick a label to an object over a long period of time.

JP 2001-255825 A

  However, with the label described in Patent Document 1, even if the adhesive force decreases and the label begins to peel off, the user may not notice it. In addition, even if the user remembers a label pasted on the object in the past and tries to re-apply it, the user may forget the place where the object to which the label is pasted and cannot find it immediately. Therefore, the label that is about to peel off may remain attached to the object in a poor-looking state.

  The objective of this invention is providing the information display control apparatus and information display program which display the information regarding a label so that the appearance of the label affixed on a target object may not deteriorate.

  The information display control device according to the first aspect of the present invention includes: a print information acquisition unit that acquires print information that is information of a print image that the printing device prints on a print medium; and the print medium that is imaged by the imaging unit. Image acquisition means for acquiring image information that is information of an image including an object to be pasted, position acquisition means for acquiring position information that is information of a position at which the image is captured by the imaging means, and the printing medium Renewal time acquisition means for obtaining renewal time information which is information on renewal time of the print, the print information acquired by the print information acquisition means, the image information acquired by the image acquisition means, and the position acquisition The position information acquired by the means and the replacement time information acquired by the replacement time acquisition means are associated with each print information, and the first storage means A storage control means for storing; a first determination means for referring to the replacement time information stored in the first storage means; and determining whether or not print information that has reached the replacement time is included; When the first determination means determines that the print information that has reached the replacement time is included, the print image based on the print information, the image based on the image information corresponding to the print information, Display control means for causing the display means to display the position based on the position information corresponding to the print information.

  According to the information display control device of the present invention, when the first determination unit determines that the information stored in the first storage unit includes the print information that has reached the renewal time, the display control unit includes: In addition to the print image based on the print information, an image based on the image information corresponding to the print information and a position based on the position information are displayed on the display means. Therefore, the user can easily grasp the print medium at the time of replacement before the appearance of the print medium deteriorates. Further, since the information display control device displays the position based on the position information, the user can easily find the print medium.

  Further, in the information display control device, the replacement time acquisition unit refers to a second storage unit that stores in advance the replacement time information corresponding to the type of the print medium selected by the selection unit, and The replacement time information stored in the second storage unit may be acquired according to the type of the print medium set by the setting unit. The information display device acquires rewriting time information corresponding to the type of print medium. Therefore, the user can stick the print medium to the target object until the appropriate replacement time according to the type of the print medium.

  Further, the information display control device prints the print image in an area corresponding to a pasting surface of the print medium in the object included in the image based on the image information acquired by the image information acquisition unit. Image processing means for performing image processing for arranging an image of the print medium to be performed, and the storage control means stores image information of the image processed by the image processing means in the first storage means, The display control means may display the image processed image on the display means. As an image to be displayed on the display means by the information display device, an image of a print medium on which a print image is printed is arranged on the pasting surface of the object. Therefore, even when the image displayed by the information display device includes a plurality of subjects, the user can easily specify the target object to which the print medium is to be attached.

  In addition, the information display control device determines whether or not pasting time obtaining means for obtaining pasting time information, which is information on pasting time when the print medium is pasted on the object, and whether or not the print medium has been pasted. A second determination means, and the replacement time acquisition means, when the second determination means determines that the print medium has been replaced, from the application time to the determination time determined by the second determination means. The time when the period until the determination time is added is used as the new renewal time, and the new renewal time information is acquired, and the storage control unit acquires the new renewal acquired by the renewal time acquisition unit. Time information may be stored in the first storage unit in association with each print information. Even if the rewriting time of the print medium varies depending on the use mode, a new renewal time based on the use mode is acquired for the print medium that has been rewritten once. Thus, the user can apply individual labels to the object until the appropriate time of each label.

  Further, in the information display control device, the display control means displays the print image based on each of the plurality of print information in a list format or a thumbnail format when there are a plurality of the print information reaching the rewriting time. And when a specific print image is selected by the selection means from among the print images displayed in a list format or a thumbnail format, the selected print image and the selected print image An image based on image information corresponding to print information and a position based on position information corresponding to print information of the selected print image may be displayed on the display means. When there are a plurality of pieces of print information that reach the replacement time, the information display device causes the display unit to display a print image corresponding to each of the plurality of pieces of print information in a list format or a thumbnail format. In addition, when a specific print image is selected by the selection unit, the information display device causes the display unit to display the selected print image and the image and position corresponding to the print information of the selected print image. Therefore, even when there are a plurality of print media that have reached the renewal time, the user can easily grasp the print media.

  The information display control device includes a direction acquisition unit that acquires imaging direction information that is information of an imaging direction in which the imaging unit has captured the image, and the storage control unit is configured to acquire the direction acquired by the direction acquisition unit. Imaging direction information is further stored in the first storage unit in association with each print information, and the display control unit further displays the imaging direction based on the imaging direction information corresponding to the print information in the display unit. It may be displayed. In addition to the position based on the position information, the information display device displays the imaging direction based on the imaging direction information on the display means. Therefore, the user can more easily find the print medium attached to the object based on the position and the imaging direction.

  An information display program according to the second aspect of the present invention is an information display program executed by an information display control device that displays print information that is information of a print image printed by a printing device on a print medium, A print information acquisition step for acquiring the print information in the controller of the information display control device, and an image acquisition for acquiring image information that is an image of the image including the target object to which the print medium is pasted, which has been imaged by the imaging means. A position acquisition step of acquiring position information that is information of a position at which the image is captured by the imaging step, and a replacement time acquisition that acquires replacement time information that is information of a replacement time of the print medium Step, the print information acquired by the print information acquisition step, and the image acquired by the image acquisition step. A storage control step of storing the information, the position information acquired by the position acquisition step, and the replacement time information acquired by the replacement time acquisition step in a storage unit in association with each print information; A judgment step for judging whether or not the printing information that has reached the pasting time is included with reference to the pasting time information stored in the storage means, and the judgment step has reached the pasting time. When determining that the print information is included, the print image based on the print information, the image based on the image information corresponding to the print information, and the position based on the position information corresponding to the print information; And a display control step of displaying on the display means.

  The user can easily grasp the print medium at the time of replacement before the appearance of the print medium deteriorates. Further, since the information display control device displays the position based on the position information, the user can easily find the print medium.

It is a figure which shows the label 5 affixed on the whole block diagram of the information display control system 1, and the articles | goods 6. FIG. FIG. 3 is a block diagram showing an electrical configuration of the mobile terminal 2 and the printer 3. It is a figure which shows the replacement period data table. 4 is a flowchart of input processing of the mobile terminal 2. 4 is a flowchart of a subroutine for image processing of the mobile terminal 2. It is a figure which shows the label data table. It is a flowchart of the change date notification process of the portable terminal. 6 is a flowchart of a subroutine of display processing of the mobile terminal 2. FIG. 6 is a diagram in which an image of a print image that has reached the date and time of replacement is displayed on the display unit 20. FIG. 10 is a diagram in which a print image that has reached a renewal date and an image of related information are displayed on the display unit 20. FIG. 6 is a diagram in which an image at an imaging position and an imaging direction is displayed on the display unit 20. It is a flowchart of the new replacement date update process of the portable terminal. It is the label data table 50 which updated pasting date information, pasting date information, and pasting period information.

  Embodiments of the present invention will be described below with reference to the drawings. First, the information display control system 1 will be described with reference to FIG. The information display control system 1 includes a mobile terminal 2 and a printer 3. The portable terminal 2 can communicate with the printer 3 that is a printing apparatus by wireless communication. The printer 3 is a small-sized label printer that prints a print image (characters, symbols, figures, etc.) on a long tape as a printing medium and creates a label 5 that can be attached. The created label 5 can be attached to the article 6.

  With reference to FIG. 2, the electrical configuration of the portable terminal 2 and the printer 3 will be described. The mobile terminal 2 includes a CPU 16 that controls the mobile terminal 2. The CPU 16 is electrically connected to the ROM 17, RAM 18, flash memory 19, audio circuit 8, A / D converter 10, display unit 20, touch panel 21, camera 22, GPS receiving unit 23, electronic compass 24, timer 25, and communication unit 26. It is connected to the. The ROM 17 stores a boot program, a BIOS, a program executed by the CPU 16, and map information that is map information. The RAM 18 temporarily stores various types of information processed by the program. The flash memory 19 stores print information that is information of a print image, image information that is information of an image captured by a camera 22 described later, and the like. The audio circuit 8 is connected to the speaker 7. The speaker 7 outputs a voice uttered by the other party when using the mobile terminal 2. The A / D converter 10 is connected to the microphone 9. The microphone 9 acquires analog voice such as a user's voice when the mobile terminal 2 is used. The A / D converter digitally converts the analog sound acquired by the microphone 9.

  The display unit 20 is a liquid crystal display provided on the front surface of the mobile terminal 2 (see FIG. 10). The display unit 20 displays, for example, keys for inputting various information to the mobile terminal 2 and various information regarding the label 5 (see FIG. 1). The touch panel 21 is disposed on the surface of the display unit 20. Therefore, the user can press the touch panel 21 corresponding to various keys displayed on the surface of the display unit 20 with a finger. Accordingly, the user can input various information such as various print images and various instructions (hereinafter, this operation is referred to as “panel operation”. The camera 22 is a CCD camera capable of imaging a subject. The GPS receiving unit 23 can receive a signal from a GPS satellite and detect the latitude and longitude indicating the position of the mobile terminal 2. The electronic compass 24 includes a geomagnetic sensor and can specify an imaging direction in which the camera 22 faces. The timer 25 measures the current date and time, and the communication unit 26 can transmit print information to the printer 3 by wireless communication.

  As shown in FIG. 3, the ROM 17 stores a renewal period data table 45. The renewal period data table 45 is a data table that the CPU 16 refers to in input processing (see FIG. 4) described later. In the replacement period data table 45, the type of the label 5 (see FIG. 1) and the pasting period information that is information on the pasting period are stored in association with each other. In the replacement period data table 45, when the label 5 is a laminate type, the replacement period information is stored as 24 months, and when the label 5 is a non-laminate type, it is stored as 12 months.

  As shown in FIG. 2, the printer 3 includes a CPU 31 that controls the printer 3. The CPU 31 is electrically connected to the ROM 32, flash memory 33, RAM 34, CGROM 35, input unit 36, display unit 37, drive circuits 38 to 40, and communication unit 41.

  Various programs executed by the CPU 31 are stored in the ROM 32. The flash memory 33 stores print information of a print image transmitted from the mobile terminal 2. The RAM 34 stores various temporary data. The CGROM 35 stores dot pattern data for printing for printing various print images on labels. The communication unit 41 can receive print information transmitted by the communication unit 26 of the mobile terminal 2.

  The input unit 36 receives an instruction from the user. The display unit 37 displays a print image to be printed on the label 5. The drive circuit 38 drives a thermal head 42 that prints on the tape. The drive circuit 39 drives a tape feed motor 43 that operates a platen roller (not shown) that transports the tape. The drive circuit 40 drives a cutter motor 44 that operates a cutter (not shown) that cuts the printed tape. The CPU 31 controls these drive circuits 38 to 40 to print on the conveyed tape, and then cuts the printed tape to create the label 5 (see FIG. 1).

  With reference to FIGS. 3-6, the method of the input process which CPU16 of the portable terminal 2 performs is demonstrated. The input process is executed when the portable terminal 2 starts an application that causes the printer 3 to execute a printing operation. When the input process is executed, a label data table 50 shown in FIG. 6 is created in the flash memory 19. In the label data table 50, image information, image information subjected to image processing, position information, imaging direction information, pasting date / time information, pasting date / time information, and pasting period information are stored in correspondence with the print information ( (S49 in FIG. 4). The image processing in the present embodiment is processing for arranging the image of the label 5 (see FIG. 1) in a predetermined area of the image captured by the camera 22. Details of the information stored corresponding to the print information will be described later.

  As shown in FIG. 4, in the input process of the portable terminal 2, first, the CPU 16 determines whether or not a print image is input by a panel operation by the user. (S11). When the CPU 16 determines that a print image has been input (S11: YES), the print image corresponding to the input operation by the user is stored in the RAM 18 (S13). Next, the CPU 16 displays the input print image on the display unit 20 (S15), and the process returns to S11. When the CPU 16 determines that no print image has been input (S11: NO), the CPU 16 determines whether or not a panel operation for ending the input of the print image has been performed (S17).

  When the CPU 16 determines that the panel operation for terminating the input of the print image is not performed (S17: NO), the process returns to S11. When the CPU 16 determines that the panel operation for finishing the input has been performed (S17: YES), print information of the input print image is created and the print information is acquired (S19). The CPU 16 controls the communication unit 26 to transmit the acquired print information to the CPU 31 of the printer 3 (S21). For example, when the user inputs a print image “Salt” and performs a panel operation to end the input (S17: YES), print information for printing the label 5 (see FIG. 1) is acquired (S19). ).

  The CPU 31 of the printer 3 receives the print information transmitted in S21. The CPU 31 prints a print image based on the received print information on a tape. As a result, the label 5 (see FIG. 1) on which the print image is printed is created, and the printer 3 finishes printing.

  After the print information is transmitted in S21, the CPU 16 determines whether or not an imaging start panel operation for starting imaging using the camera 22 has been performed (S23). When the CPU 16 determines that the panel operation for starting imaging has not been performed (S23: NO), the process returns to S23.

  When the CPU 16 determines that the panel operation for starting imaging has been performed (S23: YES), the camera 22 is activated (S25). Thereby, the user uses the mobile terminal 2 to capture an image including the article 6 to which the label 5 is attached. At this time, the article 5 may or may not be attached with the label 5 created based on the print information transmitted in S21. For example, as illustrated in FIG. 6, an image 509 including the article 6 to which the label 5 is not attached is captured by the camera. Next, the CPU 16 determines whether or not a panel operation for ending imaging using the camera 22 has been performed (S27). When the CPU 16 determines that the panel operation for ending imaging has not been performed (S27: NO). The process returns to S27.

  When the CPU 16 determines that the panel operation for finishing the imaging has been performed (S27: YES), the image information of the captured image is acquired (S29). Thereby, for example, image information of the image 509 (see FIG. 6) is acquired. Next, the CPU 16 acquires position information that is information on the position where the image is captured by the camera 22 (S31). The acquisition of the position information is performed by the CPU 16 controlling the GPS receiving unit 23 and specifying the position of the mobile terminal 2. For example, when the longitude of the position of the mobile terminal 2 is “aaa” and the latitude is “bbb”, (aaa, bbb) is acquired as position information (S31).

  Next, the CPU 16 acquires imaging direction information that is information on the imaging direction in which the camera 22 has captured an image (S33). The imaging direction information is acquired by the CPU 16 controlling the electronic compass 24 and specifying the direction in which the camera 22 is facing at the time of imaging. For example, when the imaging direction in which the camera 22 captures an image is “northeast”, “northeast” is acquired as the imaging direction information (S33).

  Next, the CPU 16 specifies the current date and time by the output of the timer 25. Considering this date and time as the date and time when the label 5 was affixed to the article 6, the CPU 16 obtains the affixing date and time information as information on the affixing date and time (S35). For example, when the current date is September 28, 2011, “2011/9/28” is acquired as the pasting date information (S35).

  Next, the CPU 16 determines whether or not a panel operation for selecting whether the type of the label 5 is a laminate type or a non-laminate type has been performed (S37). When the CPU 16 determines that the panel operation for selecting the type of the label 5 has not been performed (S37: NO), the process returns to S37. When the CPU 16 determines that the panel operation for selecting the type of the label 5 has been performed (S37: YES), the rewriting period data table 45 stored in the ROM 17 is referred to, and the rewriting corresponding to the selected type of the label 5 is performed. Period information is acquired (S39). The CPU 16 adds the renewal period based on this renewal period information to the pasting date based on the pasting date information acquired in S35, thereby specifying the pasting date and time of the label 5 and pasting that is information on the pasting date and time. Replacement date information is acquired (S41). For example, when the user selects the type of the label 5 as a non-laminate type (S37: YES), the acquired renewal period information is “12 months” (see FIG. 3) (S39). When the pasting date / time information acquired in S35 is “2011/9/28”, the pasting date / time information of the non-laminate type label 5 is “2012/9/28” (S41). The CPU 16 stores in the RAM 18 the image information, position information, imaging direction information, pasting date / time information, pasting period information, and pasting date / time information acquired in S29 to S41.

  Next, the CPU 16 determines whether or not an instruction to start image processing for processing an image captured by the camera 22 has been given by a panel operation (S43). When the CPU 16 determines that the instruction to start is not operated from the panel (S43: NO), the process returns to S43. When it is determined that the instruction to start the CPU 16 has been operated on the panel (S43: YES), the CPU 16 determines whether or not the instruction operated on the panel in S43 is an instruction to start image processing (S45). When the CPU 16 determines that the instruction operated on the panel in S43 is an instruction not to start image processing (S45: NO), the process proceeds to S49 described later.

  When the CPU 16 determines that the instruction operated on the panel in S43 is an instruction to start image processing (S45: YES), image processing is executed (S47). The image processing subroutine will be described with reference to FIG. In the image processing, the image of the label 5 on which the print image is printed is arranged in an area corresponding to the attachment surface of the article 6 in the image captured by the camera 22.

  In the image processing, first, the CPU 16 specifies a print image of the print information acquired in S19, and a predetermined frame is added to the specified print image. As a result, an image of the label 5 is created, and the CPU 16 acquires image image information that is information on the image (S51). Next, the CPU 16 acquires an image based on the image information acquired in S29 from the RAM 18 (S53). Next, the CPU 16 displays an image image based on the image image information and a captured image based on the image information on the display unit 20 (S55). For example, the display unit 20 displays a “Salt” print image 510 (see FIG. 9) and an image 509 (see FIG. 6).

  Next, the CPU 16 determines whether or not the pasting area for identifying the pasting area of the article 6 of the captured image displayed on the display unit 20 is specified by the panel operation (S57). When the CPU 16 determines that the pasting area has not been specified (S57: NO), the process returns to S57. When the CPU 16 determines that the pasting area has been specified (S57: YES), the image of the label 5 is arranged in the pasting area. Thereby, the CPU 16 performs image processing on the image based on the image information acquired in S29, and acquires the image information subjected to the image processing (S59). Next, the CPU 16 ends the image processing, and the processing returns to the input processing (see FIG. 4). For example, when the pasting area of the article 6 in the image 509 is specified by the panel operation (S57: YES), an image 590 including the article 6 on which the image image 555 of the label 5 is arranged is acquired as shown in FIG. (S59).

  Next, the CPU 16 associates with the print information acquired in S19, image information, image information which is information on the image processed, position information, imaging direction information, pasting date information, pasting date information, and pasting. The period information is stored in the flash memory 19 (S49), and the input process ends. The information stored in the flash memory 19 is stored in the label data table 50 in association with the print information as shown in FIG. For example, when information regarding the label 5 whose print image is “Salt” is stored, “Salt” is stored as the print information. In the image information, the image information of the image 509 acquired in S29 is stored. In the image information subjected to image processing, image information of the image processed image 590 acquired in S59 is stored. In the position information, the latitude and longitude of the position information acquired in S31 is stored as one set. The imaging direction information acquired in S33 is stored in the imaging direction information. Further, the pasting date / time information acquired in S35 (for example, 2011/9/28) is stored in the pasting date / time information, and the pasting date / time information (for example, 2012/9/28) acquired in S41 is stored in the pasting date / time information. 28) is stored, and the replacement period (for example, 12 months) acquired in S39 is stored in the replacement period. When the user does not perform a panel operation for starting image processing (S45: NO), the image information subjected to image processing is not stored.

  Next, with reference to FIG. 7, a method of the renewal date notification process executed by the CPU 16 of the mobile terminal 2 will be described. The replacement date / time notification process is a process performed at predetermined time intervals when the mobile terminal 2 is activated. The replacement date / time notification process is a process of notifying the user when the replacement date / time based on the replacement date / time information set in the input process has reached the date / time at which this process is performed. In the following description, it is assumed that the date for performing the renewal date notification process is September 28, 2012. Further, in the following processing, information regarding “Salt” stored in the print information (see FIG. 6) of the label data table 50 will be described as an example.

  In the pasting date and time notification process, first, the CPU 16 refers to the printing information in the label data table 50 stored in S49 and acquires one piece of printing information (S71). Here, the CPU 16 acquires the print information at the head of the label data table 50. For example, “Salt” is acquired from the print information of the label data table 50. Next, the CPU 16 refers to the replacement date information stored in the label data table 50 in association with the print information acquired in S71, and acquires the replacement date based on the replacement date information (S73). For example, in the label data table 50, “2012/9/28”, which is the rewriting date / time based on the rewriting date / time information corresponding to “Salt”, is acquired.

  Next, the CPU 16 acquires the current date and time specified by the output of the timer 25 (S75). The CPU 16 compares the date and time of replacement with the current date and time to determine whether or not the date and time of replacement has arrived at the present time (S77). If the CPU 16 determines that the date and time of replacement has not arrived (S77: NO), the process proceeds to S81 to be described later. If the CPU 16 determines that the date and time of replacement has arrived (S77: YES), the print information acquired in S71 is stored in the RAM 18 (S79). For example, when the current date and time “2012/9/28” is acquired (S75), the rewriting date and time “2012/9/28” of the print information “Salt” has reached the current date and time (S77: YES). The RAM 18 stores “Salt” print information (S79).

  Next, the CPU 16 determines whether other print information is stored in the label data table 50 (S81). If the CPU 16 determines that there is other print information (S81: YES), the process returns to S71. For example, when “Happy New Year” print information is stored in the label data table 50, it is determined that there is print information in addition to “Salt” in the label data table 50 (S81: YES), and S71. Processing up to S81 is executed. Furthermore, when the print information “EXIT” is stored in the label data table 50 (S81: YES), the processing from S71 to S81 is further executed in the same manner. When the CPU 16 determines that no other print information is stored in the label data table 50 (S81: NO), a display process is executed (S83).

  Next, the display processing method executed by the CPU 16 of the mobile terminal 2 will be described with reference to FIGS. As shown in FIG. 8, the CPU 16 displays a print image on the display unit 20 based on the print information stored in the RAM 18 in S79 (S111). When there are a plurality of print information stored in S79, the CPU 16 displays print images based on the print information in a list format. For example, when the print information stored in S79 is “Salt”, “Happy New Year”, and “Exit”, print images 510 to 512 based on these print information are displayed as shown in FIG. It is displayed in a list format on the display unit 20. When there is only one print information that has reached the date and time of replacement, only the print image based on the print information is displayed on the display unit 20.

  Next, the CPU 16 determines whether or not a panel operation for selecting a specific print image has been performed (S113). When the CPU 16 determines that the panel operation for selecting a specific print image has not been performed (S113: NO), the process returns to S113. When the CPU 16 determines that a panel operation for selecting a specific print image has been performed (S113: YES), the label data table 50 (see FIG. 6) is referred to, and the image stored in S49 in association with the print information of the print image. Information, position information, imaging direction information, and replacement date information are acquired (S115). When there is image information of the image 590 (see FIG. 6) subjected to image processing in the label data table 50, the CPU 16 acquires the image information subjected to the image processing. When the label data table 50 has only the image information image 509 (see FIG. 6), the CPU 16 acquires an image based on the image information. For example, when the print image 510 based on the print information “Salt” is selected from the print images 510 to 512 illustrated in FIG. 9, the position stored in the label data table 50 in association with the print information “Salt”. Information “(aaa, bbb)”, image-processed image information (image 590), imaging direction information “northeast”, pasting date information “2011/9/28”, pasting date information “2012/9/28” To be acquired.

  Next, in addition to the print image, the CPU 16 displays an image based on the image information subjected to the image processing, a pasting date based on the pasting date information, and a pasting date based on the pasting date information on the display unit 20 (S117). For example, when the “Salt” print image 510 (see FIG. 9) is selected in S113, the print image 510 is displayed in the upper part of the display unit 20, as shown in FIG. In the middle of the display unit 20, an image 555 of the label 5 (see FIG. 1) on which “Salt” is printed and an image 520 including the article 6 are displayed. In addition, based on information stored in the label data table 50 (see FIG. 6), a pasting date image 530 and a pasting date image 540 are displayed in the lower part of the display unit 20. In this case, the pasting date is “2011/9/28” and the pasting date is “2012/9/28”. Furthermore, keys 521 to 523 indicating “return to the previous screen”, “position / imaging direction”, and “display end” are displayed below the images 530 and 540.

  Next, the CPU 16 determines whether or not a panel operation has been performed on a key 521 (see FIG. 10) for returning the screen displayed on the display unit 20 to the previous screen (S119). If the CPU 16 determines that the panel operation of the key 521 is performed (S119: YES), the process returns to S111, and the print images 510 to 512 are displayed again in the list format (see FIG. 9). If the CPU 16 determines that the panel operation of the key 521 has not been performed (S119: NO), whether or not the key 522 (see FIG. 10) for displaying the imaging position and imaging direction on the display unit 20 has been panel-operated. Is determined (S121).

  When the CPU 16 determines that the panel of the key 522 is not operated (S121: NO), the CPU 16 determines whether or not the key 523 (see FIG. 10) for ending the display of the display unit 20 is operated (S123). . When the CPU 16 determines that the key 523 is not operated on the panel (S123: NO), the process returns to S119. When the CPU 16 determines that the key 523 has been operated on the panel (S123: YES), the display process is terminated, and the process returns to the pasting date and time notification process (see FIG. 7).

  When the CPU 16 determines that the key 522 has been panel-operated (S121: YES), the ROM 17 is referred to and map information is acquired (S131). Next, the screen of the display unit 20 is switched from the state shown in FIG. 10, and the imaging position based on the positional information acquired in S115 and the imaging direction based on the imaging direction information are displayed (S133). In this case, as shown in FIG. 11, a map image 550 based on the map information is displayed in the middle of the display unit 20. Here, the image 550 is displayed by the CPU 16 specifying an area in a predetermined range centered on the imaging position based on the position information based on the map information acquired in S131 and the position information acquired in S115. Further, the image pickup position 560 and the image pickup direction 570 are displayed on the image 550 based on the position information and the image pickup direction information acquired in S115. Here, the imaging direction 570 is displayed with an arrow by specifying an angle from a predetermined start line based on the imaging direction information acquired in S115. For example, when the “Salt” print image 510 is selected in S113, the imaging direction 570 is displayed as an arrow pointing northeast.

  Further, the print image 510 displayed in S117 is continuously displayed on the upper portion of the display unit 20. Further, the image 530 and the image 540 displayed in S117 are continuously displayed in the lower part of the display unit 20. Further, keys 521 and 523 indicating the keys “return to the previous screen” and “display end” are displayed below the images 530 and 540.

  Next, the CPU 16 determines whether or not a panel operation has been performed on the key 521 (see FIG. 11) for returning the screen displayed on the display unit 20 to the previous screen (S135). When the CPU 16 determines that the key 521 has been panel-operated (S135: YES), the process returns to S117, and the print image 510, the image 520, etc. are displayed (see FIG. 10). When the CPU 16 determines that the key 521 has not been panel-operated (S135: NO), the CPU 16 determines whether or not the key 523 (see FIG. 11) for ending the display of the display unit 20 has been panel-operated (see FIG. 11). S137). When the CPU 16 determines that the key 523 is not operated on the panel (S137: NO), the process returns to S133. When the CPU 16 determines that the key 523 has been panel-operated (S137: YES), the display process ends, and the process returns to the pasting date / time notification process (see FIG. 7).

  By executing the display process in this way, the user can refer to the images shown in FIGS. Therefore, the label 5 that has reached the date and time of replacement is notified to the user together with the print image 510 of the label 5, the image processed image, the captured position, and the imaging direction. Therefore, the user can easily grasp the label 5 that has reached the pasting date.

  As shown in FIG. 7, after the display process is completed, the CPU 16 determines whether the panel operation performed by the user is an instruction as to whether or not to update the replacement date and time acquired in S73 (S85). When the CPU 16 determines that an instruction not to update the renewal date / time has been given (S85: NO), the renewal date / time notification process ends. For example, if the label 5 (see FIG. 1) that is actually affixed is affixed to the article 6 in a good-looking state even when the date and time of reappearance has been reached, the user can reapply The process ends without updating the date and time. In this case, the label 5 is replaced according to the time when the appearance of the label 5 is deteriorated, and the update date information is updated by a new update date update process (FIG. 12) described later. On the other hand, if the label 5 that has arrived at the date and time of replacement is becoming less attractive, the user instructs the update of the date and time of replacement through a panel operation (S85: YES), and the label 5 is replaced.

  When the CPU 16 determines that an instruction to update the replacement date / time has been given (S85: YES), the print image that has reached the replacement date / time is displayed on the display unit 20 (S87). When there are a plurality of print images that have reached the date and time of replacement, the print images are displayed in a list format on the display unit 20 (see FIG. 9). Next, the CPU 16 determines whether or not a panel operation for selecting a specific print image whose update date and time is updated has been performed (S89).

  When the CPU 16 determines that the panel operation for selecting a specific print image is not performed (S89: NO), the process returns to S89. When the CPU 16 determines that the panel operation for selecting a specific print image has been performed (S89: YES), the RAM 18 is referred to, and the print information of the selected print image stored in S79 is acquired (S91). Next, the CPU 16 refers to the label data table 50, and acquires the replacement date information corresponding to the print information acquired in S91 (S93). Next, the CPU 16 refers to the label data table 50, and acquires the replacement period information corresponding to the print information acquired in S91 (S95). For example, when the print image “Salt” is selected in S89, the print information “Salt” is acquired (S91) and stored in the label data table 50 (see FIG. 6) corresponding to the print information “Salt”. Replacement date information “2012/9/28” is acquired (S93). Next, the renewal period information “12 months” is acquired (S95).

  Next, the CPU 16 updates the replacement date and time by adding the replacement period based on the replacement period information acquired in S95 to the replacement date and time based on the replacement date and time information acquired in S93 (S97). For example, the replacement date is updated to “2013/9/28” by adding the replacement period “12 months” to the replacement date “2012/9/28” (S97). The CPU 16 stores the replacement date information based on the updated replacement date information in the label data table 50 in association with the print information (S99).

  Next, the CPU 16 determines whether there is other print information based on the print image displayed in S87 (S101). If the CPU 16 determines that there is other print information (S101: YES), the process returns to S85. If the CPU 16 determines that there is no other print information (S101: NO), the process ends.

  Next, with reference to FIG. 12, the method of the new renewal date update process which CPU16 of the portable terminal 2 performs is demonstrated. The label 5 (see FIG. 1) attached to the article 6 does not look good at the time when it deviates from the renewal period based on the renewal period information in the renewal period data table 45 (see FIG. 3) in actual use. There are times when it is becoming. In such a case, the replacement date / time information update process can update the replacement period information stored in S49 to the replacement period information in accordance with actual use. Thereby, once label 5 is replaced, it replaces with the replacement period information memorize | stored in the replacement period data table 45 (refer FIG. 3), and changes date notification based on the replacement period information according to actual use. Processing (see FIG. 7) is executed. In the following processing, information regarding “Salt” stored in the print information (see FIG. 6) of the label data table 50 will be described as an example. Assume that the label data table 50 is in the state shown in FIG.

  First, the CPU 16 determines whether or not an instruction to start a new renewal date update process has been performed on the panel (141). When the CPU 16 determines that the panel operation for instructing the start is not performed (141: NO), the process returns to 141.

  If the CPU 16 determines that the panel operation for instructing the start has been performed (S141: YES), the print image based on all the print information stored in the label data table 50 in S49 is displayed on the display unit 20 (S143). . When there are a plurality of print images, the print images are displayed on the display unit 20 in a list format. The CPU 16 determines whether or not a panel operation for selecting a specific print image has been performed (S145). If the CPU 16 determines that a specific print image has not been selected (S145: NO), the process returns to S145. For example, when the user pastes the label 5 on which “Salt” is printed, the print image “Salt” displayed on the display unit 20 is selected.

  When the CPU 16 determines that a specific print image has been selected (S145: YES), print information corresponding to the specific print image selected in the label data table 50 is acquired (S147). The CPU 16 acquires the pasting date / time information stored in S49 in association with the acquired print information (S149). Furthermore, the CPU 16 acquires the replacement date / time information stored in S49 (S151). Next, the CPU 16 acquires replacement period information (S153). For example, when the printing information “Salt” is acquired (S147), “2011/9/28” is acquired from the pasting date and time information stored in the label data table 50 (see FIG. 6) (S149). “2012/9/28” is acquired from the replacement date and time information (S151), and “12 months” is acquired from the replacement period information (S153).

  Next, the CPU 16 specifies the current date and time based on the output of the timer 25 (S155). The CPU 16 adds a period from the pasting date / time based on the pasting date / time information acquired in S149 to the current date / time specified in S155 to the current date / time, thereby specifying a new pasting date / time, and information on the new pasting date / time. New replacement date information is acquired (S157). Next, the CPU 16 updates the replacement date information acquired in S151 to new replacement date information (S159). For example, when the current date and time is specified as “2012/6/28” (S155), the period from the pasting date and time “2011/9/28” acquired in S149 to the current date and time “2012/6/28”. “2013/3/28” obtained by adding 9 months to the current date and time is acquired as new renewal date and time information (S157). The replacement date / time information “2011/9/28” acquired in S151 is updated to new replacement date / time information “2013/3/28” (S159). As shown in FIG. 13, the date and time information of the label data table 50 stored in S49 is updated.

  Next, as illustrated in FIG. 12, the CPU 16 regards a period from the pasting date / time based on the pasting date / time information acquired in S <b> 149 to the current date / time as a new pasting period, so that a new pasting period information is obtained. Replacement period information is acquired (S161). The CPU 16 updates the renewal period information acquired in S153 to new renewal period information (S163). For example, if the current date and time is specified as “2012/6/28” (S155), the period from the pasting date and time “2011/9/28” acquired in S149 to the current date and time “2012/6/28”. Nine months is acquired as new renewal period information (S161). The renewal period information “12 months” acquired in S153 is updated to new renewal period information “9 months” (S163). As shown in FIG. 13, the replacement period information in the label data table 50 stored in S49 is updated.

  Next, as shown in FIG. 12, the CPU 16 regards the current date and time acquired in S155 as a new pasting date and time, thereby obtaining new pasting date and time information that is information on the new pasting date and time (S165). The CPU 16 updates the pasting date information acquired in S149 to new pasting date information (S167). For example, when the current date / time is specified as “2012/6/28” (S155), the new pasting date / time information is acquired as “2012/6/28” (S165). The pasting date / time information “2011/9/28” acquired in S149 is updated to new pasting date / time information “2012/6/28” (S167).

  Next, the CPU 16 stores the renewal date information updated in S159, the renewal period information updated in S163, and the past date information updated in S167 in the label data table 50 in association with the print information acquired in S147. (S169). For example, in association with the print information “Salt” acquired in S147, the renewal date information “2013/3/28” updated in S159, the renewal period information “9 months” updated in S163, and S167 The date and time information “2012/6/28” updated in the above is stored in the label data table 50 (S169).

  For example, when March 28, 2013 is reached, S91 to S99 of the renewal date and time notification process (see FIG. 7) are executed, so that the renewal period (9 months) corresponding to actual use is pasted. The replacement date is updated. Thereby, once label 5 is replaced, the replacement period (9 months) in actual use is stored, not the replacement period (12 months) stored in the replacement period data table 45 (see FIG. 3). Is done.

  As described above, after the label 5 printed by the printer 3 is attached to the article 6, the CPU 16 stores the print information of the label 5 and the image processed in association with the print information in the label data table 50. Information, position information, and imaging direction information are stored (S49 in FIG. 4 and FIG. 6). When the CPU 16 determines that the date and time for renewal of the label 5 has arrived, based on the information stored in the label data table 50, the print image, image, and imaging position of the label 5 are displayed on the display unit 20. Is displayed (S117 and S133 in FIG. 8). Therefore, the user can easily grasp the label 5 that has reached the replacement date and time before the label 5 looks bad. Further, since the position is displayed on the display unit 20 based on the position information (FIG. 11), the CPU 16 easily displays the label 5 even when a long time has elapsed since the label 5 was pasted. You can find out.

  In addition, the ROM 17 stores in advance a replacement period according to the type of label selected by the user, and when input processing is performed, the CPU 16 selects an appropriate period according to the type of label selected by the user. Replacement date information is acquired (S41 in FIG. 4). Therefore, the user can affix the label 5 to the article 6 until an appropriate renewal date and time according to the type of the label 5.

  Further, the CPU 16 arranges the image image of the label 5 in an area corresponding to the label 5 attachment surface in the article 6 included in the image captured by the camera 22 and performs image processing (S59 in FIG. 5). The image processed in this way is displayed on the display unit 20 when the print information reaches the renewal date (S117 in FIG. 8, FIG. 10). Therefore, even if the image captured by the camera 22 includes a plurality of subjects, the user can easily specify the article 6 to which the label 5 is attached.

  In addition, when the label 5 that has reached the pasting date / time is pasted, the CPU 16 adds the pasting date / time to the new past date / time during the period from the pasting date / time to the pasting date / time. Is acquired (S147 to S157 in FIG. 12). Then, the replacement date and time recorded in the label data table 50 is updated and stored again (S159 and S169 in FIG. 12). Therefore, for example, even if the renewal period of the label 5 varies depending on the usage mode, the label 5 that has been renewed once acquires a new renewal period based on the usage mode. And CPU16 performs a replacement date alerting | reporting process based on a new replacement period, and alert | reports to a user. Therefore, the user can affix the individual labels 5 to the article 6 until the appropriate time of each label 5.

  When there are a plurality of pieces of print information reaching the date and time of replacement, the CPU 16 displays print images based on each of the print information in a list format on the display unit 20 (S111 in FIGS. 9 and 8). Further, if a specific print image is selected, the image processed image and the imaging position are displayed (S113, S117, and S133 in FIG. 8). Therefore, even if there are a plurality of labels that have reached the renewal date and time, the user can easily grasp those labels.

  When the image is captured by the camera 22, the CPU 16 also stores the image capturing direction information in the label data table 50 (S49 in FIG. 4), and when it is determined that the label 5 has reached the pasting date and time, the display unit 20 The imaging direction is also displayed together with the position information (S133 in FIGS. 11 and 8). Therefore, the user can more easily find the label 5 attached to the article 6 based on the position displayed on the display unit 20 and the imaging direction.

  The present invention is not limited to the above-described embodiment, and modifications can be made without changing the gist of the invention. In the above embodiment, the portable terminal 2 is connected to the printer 3 via wireless communication. However, the portable terminal 2 may be an information terminal device such as a mobile personal computer (hereinafter referred to as a PC). Good. In this case, the PC is connected to the printer 3 via the network, and displays the print image of the label 5 that has reached the date and time of replacement.

  In the above embodiment, in the input process, the print information is acquired based on the print image input via the touch panel 21 (S19), but is not limited thereto. For example, the print information of the print image directly input to the input unit 36 of the printer 3 may be acquired by the CPU 16 of the mobile terminal 2 receiving the print information.

  In the above embodiment, in the input process, these pieces of information are acquired in the order of print information, image information, and rewriting date / time information (S19, S29, S41 in FIG. 4). It can be changed. For example, these pieces of information may be acquired in the order of replacement date information, image information, and print information.

  In the above embodiment, in the display process, when there are a plurality of pieces of print information that have reached the replacement date and time, the print information is displayed in a list format on the display unit 20 (S111 in FIGS. 9 and 8). Information may be displayed in a thumbnail format.

  In the above embodiment, the image 509 including the article 6 is imaged by the camera 22 before applying the label 5 (S23 to S27 in FIG. 4), but the article 6 to which the label 5 is applied may be imaged. . In this case, in the input process, if an input of an instruction not to start image processing is operated by the panel (S45: NO), an image captured by the camera 22 is displayed (S117 in FIG. 8).

  In the above embodiment, the mobile terminal 2 corresponds to the “information display control device” of the present invention. The printer 3 corresponds to the “printing apparatus” of the present invention. The label 5 corresponds to the “print medium” of the present invention. The article 6 corresponds to the “object” of the present invention. The CPU 16 corresponds to the “controller” of the present invention. The flash memory 19 corresponds to the “first storage unit” and the “second storage unit” of the present invention. The display unit 20 corresponds to the “display unit” of the present invention. The camera 22 corresponds to the “imaging means” of the present invention. The touch panel 21 corresponds to “selecting means” of the present invention.

  The CPU 16 that executes S19 corresponds to the “print information acquisition unit” of the invention. The CPU 16 that executes S29 corresponds to the “image acquisition means” of the present invention. The CPU 16 that executes S31 corresponds to the “position acquisition means” of the present invention. The CPU 16 that executes S33 corresponds to the “direction acquisition means” of the present invention. CPU16 which performs S41 and S157 is equivalent to the "replacement time acquisition means" of this invention. The CPU 16 that executes S49 and S169 corresponds to the “storage control means” of the present invention. The CPU 16 that executes S71 to S77 corresponds to the “first determination means” of the present invention. The CPU 16 that executes S83 corresponds to the “display control means” of the present invention. The CPU 16 that executes S47 corresponds to the “image processing means” of the present invention. The CPU 16 that executes S35 corresponds to the “pasting time acquisition means” of the present invention. The CPU 16 that executes S145 corresponds to the “second determination means” of the present invention.

  S19 corresponds to the “print information acquisition step” of the present invention. S29 corresponds to the “image acquisition step” of the present invention. S31 corresponds to the “position acquisition step” of the present invention. S33 corresponds to the “direction acquisition step” of the present invention. S41 corresponds to the “replacement time acquisition step” of the present invention. S49 corresponds to the “storage control step” of the present invention. S71 to S77 correspond to the “determination step” of the present invention. S83 corresponds to the “display control step” of the present invention.

2 Mobile terminal 3 Printer 5 Label 6 Article 16 CPU
19 HDD
20 Display unit 21 Touch panel 22 Camera 24 Electronic compass

Claims (7)

Print information acquisition means for acquiring print information that is information of a print image that the printing apparatus prints on a print medium;
Image acquisition means for acquiring image information, which is image information including an object to which the print medium is attached, imaged by an imaging means;
Position acquisition means for acquiring position information which is information of a position at which the image is picked up by the image pickup means;
A renewal time acquisition means for acquiring renewal time information which is information of a renewal time of the print medium;
The print information acquired by the print information acquisition unit, the image information acquired by the image acquisition unit, the position information acquired by the position acquisition unit, and the pasting time acquired by the replacement time acquisition unit. Storage control means for storing replacement time information in the first storage means in association with each print information;
A first determination unit that refers to the renewal time information stored in the first storage unit and determines whether or not the print information that has reached the renewal time is included;
When the first determination means determines that the print information that has reached the renewal time is included, the print image based on the print information, and the image based on the image information corresponding to the print information, An information display control device comprising: display control means for displaying on the display means the position based on the position information corresponding to the print information.   The replacement time acquisition unit refers to a second storage unit that stores in advance the replacement time information corresponding to the type of the print medium selected by the selection unit, and the print medium set by the setting unit The information display control apparatus according to claim 1, wherein the replacement time information stored in the second storage unit is acquired according to the type of the information. An image of the print medium on which the print image is printed is arranged in an area corresponding to the pasting surface of the print medium, among the objects included in the image based on the image information acquired by the image information acquisition means. Image processing means for performing image processing to be performed,
The storage control means stores image information of the image processed by the image processing means in the first storage means,
The information display control apparatus according to claim 1, wherein the display control unit displays the image processed image on the display unit. Affixing time acquisition means for acquiring affixing time information that is information of affixing time when the print medium is affixed to the object;
Second judging means for judging whether or not the printing medium has been replaced,
When the second determination unit determines that the printing medium has been replaced, the replacement time acquisition unit adds a period from the pasting time to the determination time to the determination time determined by the second determination unit. The new time of renewal is obtained as the new time of renewal,
The storage control means stores the new renewal time information acquired by the renewal time acquisition means in the first storage means in association with each print information. An information display control device according to any one of the above. The display control means includes
When there are a plurality of the print information reaching the replacement time, a print image based on each of the plurality of print information is displayed on the display unit in a list format or a thumbnail format,
When a specific print image is selected from the print images displayed in the list format or the thumbnail format by the selection unit, the selected print image and the print information of the selected print image correspond to the selected print image. 5. The information display according to claim 1, wherein an image based on image information and a position based on position information corresponding to print information of the selected print image are displayed on the display means. Control device. Direction acquisition means for acquiring imaging direction information which is information of an imaging direction in which the imaging means images the image;
The storage control unit further stores the imaging direction information acquired by the direction acquisition unit in the first storage unit in association with each print information,
The information display control apparatus according to claim 1, wherein the display control unit further causes the display unit to display the imaging direction based on the imaging direction information corresponding to the print information. An information display program executed by an information display control device for displaying print information which is information of a print image printed by a printing device on a print medium,
In the controller of the information display control device,
A print information acquisition step for acquiring the print information;
An image acquisition step of acquiring image information, which is information of an image including an object to which the print medium is attached, imaged by an imaging unit;
A position acquisition step of acquiring position information which is information of a position where the image is captured by the imaging step;
A renewal time acquisition step of obtaining renewal time information, which is information on the renewal time of the print medium;
The print information acquired by the print information acquisition step, the image information acquired by the image acquisition step, the position information acquired by the position acquisition step, and the paste acquired by the replacement time acquisition step. A storage control step of storing replacement time information in association with each print information in a storage unit;
A judgment step of referring to the renewal time information stored in the storage means and judging whether or not the print information reaching the renewal time is included;
When the determination step determines that the print information that has reached the replacement time is included, the print image based on the print information, the image based on the image information corresponding to the print information, and the print And a display control step of causing the display means to display the position based on the position information corresponding to the information.

Images