JP6206283B2 - Image processing method, image processing program, and electronic device - Google Patents

Description

  The present invention relates to an image processing method, an image processing program, and an electronic apparatus for forming an image on a recording medium by printing.

  An image forming apparatus called a label writer (label printer) is known as a device that prints on a recording medium such as a label or a card. Since this type of image forming apparatus can print on a sticky label, for example, it can be used to attach a printed label to a relatively small article.

  For example, in order to correct the content recorded on the business card, the corrected content can be printed on a label and attached to the business card. In this case, it is necessary to adjust the size of the character printed on the label in accordance with the size of the character printed on the business card. A conventional label writer can perform label printing of characters according to the set size by setting the character size of characters to be printed manually by the user.

  However, since it is difficult for the user to accurately grasp the size of the characters printed on the business card and to set the character size appropriately according to this size, the size adjustment fails and wasteful printing is performed. There was a case.

  Conventionally, an image processing method for reducing the burden on the user and shortening the time until printing when adjusting the size of an image to be printed has been considered (for example, Patent Document 1).

JP 2009-135578 A

  The prior art described in Patent Document 1 can print a photographed subject image in an actual size. However, in the technique described in the cited document 1, processing is performed on the entire captured image. For example, an image for correcting a part of the content recorded on a business card is adjusted in size and printed. Can not.

  The present invention has been made in consideration of the above-described problems, and an image processing method capable of easily adjusting the size of a part of an image according to the size of an image to be pasted and causing printing to be performed. An object of the present invention is to provide an image processing program and an electronic device.

  In order to solve the above-described problem, the image processing method of the present invention includes a detection step of detecting a reference image representing the reference length from a photographed image obtained by photographing the pasting area of the correction tape together with a member representing the reference length. And a first adjustment step of adjusting the orientation and resolution of the captured image based on the reference image, and detecting one or more correction candidate portions from the normalized image normalized by the first step A correction candidate location detection step to perform, a selection step to select a correction required location requiring correction from one or more correction candidate locations detected in the correction candidate location detection step, and the selection A size calculating step of calculating an image size of the correction-necessary portion selected in the step, an input step in which a user inputs data for replacing the image of the correction-necessary portion, and the input step A replacement image is generated from the input data, the second adjustment step of adjusting the size of the replacement image according to the image size of the correction required portion, the image adjusted in size by the second adjustment step, and the normal And an image composition step for compositing the image of the print background area obtained by removing the image of the necessary correction portion from the digitized image.

  According to the present invention, it is possible to easily adjust the size of a part of an image according to the size of an image to be pasted and to perform printing.

FIG. 2 is a block diagram illustrating a configuration of a label writer as an image forming apparatus according to the present embodiment. FIG. 3 is a block diagram illustrating a configuration of an electronic apparatus that controls image formation (printing) by a label writer according to the embodiment. The perspective view which shows the external appearance structure of the label writer in this embodiment. The figure which looked at the label writer in this embodiment from the upper part. 6 is a flowchart illustrating image processing executed by an image processing program of the electronic device according to the present embodiment. The flowchart which shows the sticking destination taking-in process in the flowchart of the image process shown in FIG. 5 in this embodiment. The flowchart which shows the character & background adjustment process in the flowchart which shows the sticking destination taking-in process shown in FIG. 6 in this embodiment. The flowchart which shows the object line position selection process in the flowchart which shows the sticking destination taking-in process shown in FIG. 6 in this embodiment. 6 is a flowchart showing print transmission processing in the flowchart of image processing shown in FIG. 5 in the present embodiment. FIG. 6 is a diagram illustrating a state in which an image is captured by the electronic apparatus according to the embodiment. FIG. 4 is a diagram illustrating an example of a captured image. Furthermore, the figure which shows an example of the image stored in the whole image area | region, and the figure which shows each line area detected from the image. The figure which shows an example of the row area data in which the data about the row area detected from FIG.10 (d) were recorded. The figure which shows the example of a setting of the background area in this embodiment. The figure which shows a mode that the label printed by the label writer in this embodiment is discharged | emitted. FIG. 6 is a diagram illustrating a transmission timing of a command and print data transmitted and received between the label writer and the electronic device in the embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration of a label writer 10 as an image forming apparatus according to the present embodiment. FIG. 2 is a block diagram illustrating a configuration of an electronic device 20 that controls image formation (printing) by the label writer 10. The electronic device 20 of the present embodiment can be realized by, for example, a device having an image capturing function and a communication function, and for example, a smartphone, a mobile phone, a digital camera, or the like can be used.

  In the present embodiment, the electronic device 20 captures an image including a recording medium on which an image has been formed and a measure portion representing a reference length used for image processing in the electronic device 20, and the reference length is determined from the image. The reference image to be expressed can be detected, and image processing for adjusting the orientation and actual size of the image to be printed by the label writer 10 based on the image of the major part can be performed.

  For example, when the recording medium is a business card, an image including a company name, name, address, telephone number, logo mark, and the like printed on the business card is taken together with the major part. The electronic device 20 allows the user to select an area to be corrected (partial image to be replaced) in the recording medium image from the photographed image, and input a corrected character or the like. It is possible to adjust the size of the replacement image, which is an image of a corrected character or the like, according to the size of the region to be corrected, that is, the actual size of the character or the like printed on the business card. If the label writer 10 prints the image adjusted to the actual size on the label, the description of the business card can be partially corrected by pasting the printed label on the business card.

  As shown in FIG. 1, a label writer 10 in this embodiment includes a central processing unit (CPU (Central Processing Unit)) 11, a memory unit (RAM (Random Access Memory)) 12, and a memory unit (ROM (Read Only Memory)). ) 13, a thermal head 14, a wireless communication control unit 15, an input control unit 16, a power supply controller 17, and a label transport unit (motor control unit) 18.

  The central processing unit 11 controls the entire label writer 10. The central processing unit 11 activates a program stored in the memory unit 13 in accordance with an instruction from the user input through the input control unit 16, and uses the memory unit 12 as a work (working) memory. Control of the operation. The central processing unit 11 performs print control for printing on a label based on a print control program under the control of the electronic device 20 connected via wireless communication.

  The memory unit 12 is used as a work memory for recording programs and data executed by the central processing unit 11. The memory unit 12 temporarily stores print data transmitted from the electronic device 20.

  The memory unit 13 records programs and data executed by the central processing unit 11. The program recorded in the memory unit 13 includes a print control program that controls printing according to a command received from the electronic device 20 under the control of the electronic device 20 connected via wireless communication. Including.

  The thermal head 14 is driven based on the print data recorded in the memory unit 12 under the control of the central processing unit 11, and performs printing (image formation) on the label according to the print data. It is assumed that the thermal head 14 is mounted with a device capable of printing a 128 dot width with a resolution of 200 dpi (dots per inch), for example.

  The wireless communication control unit 15 controls wireless communication using, for example, Bluetooth (registered trademark) or Wi-Fi (registered trademark). The wireless communication control unit 15 receives print data or the like to be printed from the electronic device 20 by wireless communication.

  The input control unit 16 controls input according to a user operation or the like. For example, the input control unit 16 controls input according to an operation on a button provided on the label writer 10.

  The power supply controller 17 performs control for supplying driving power to each unit constituting the label writer 10.

  The label transport unit 18 controls transport of a label that is a recording medium, and includes a motor control unit, a motor, a roller, and the like. The label transport unit 18 rotates a roller disposed in the label transport path by rotating the motor by the motor control unit. The label is conveyed on the conveyance path by a roller that is rotated in accordance with the printing timing, and is printed while passing through the conveyance path on which the thermal head 14 is disposed.

  Although not shown, a display such as an LCD (Liquid Crystal Display) may be provided to display a message for the user, an operation screen, and the like.

  As shown in FIG. 2, the electronic device 20 in the present embodiment includes a central processing unit (CPU (Central Processing Unit)) 21, a memory unit (RAM (Random Access Memory)) 22, and a memory unit (ROM (Read Only Memory)). ) 23, a CCD (Charge Coupled Device) unit 24, a wireless communication control unit 25, an input control unit 26, a power supply controller 27, and a display unit 28.

  The central processing unit 21 controls the entire electronic device 20. The central processing unit 21 activates a program stored in the memory unit 23 in accordance with an instruction from the user input through the input control unit 26, and uses the memory unit 22 as a work (work) memory. Control of the operation. The central processing unit 21 can print an image generated by image processing by using the label writer 10 connected through wireless communication by executing the image processing program.

  The memory unit 22 is used as a work memory for recording programs and data executed by the central processing unit 21. The memory unit 22 temporarily stores image data of an image photographed by the CCD unit 24, data during image processing, print data to be transmitted to the label writer 10, and the like.

  The memory unit 23 records programs and data executed by the central processing unit 21. The program recorded in the memory unit 23 includes various application programs in addition to a basic program such as an OS (Operating System). The application program includes an image processing program that can cause the label writer 10 connected via wireless communication to execute printing.

  The CCD unit 24 is for taking an image, and executes a photographing operation in accordance with an instruction from the user input from the input control unit 26. Image data of an image formed on the CCD unit 24 by a lens (not shown) is stored in the memory unit 22 by executing the photographing operation.

  The wireless communication control unit 25 controls wireless communication using, for example, Bluetooth (registered trademark) or Wi-Fi (registered trademark). When the label writer 10 executes printing according to the operation of the image processing program, the wireless communication control unit 25 transmits and receives control commands to and from the label writer 10 and transmits print data.

  The input control unit 26 controls input in accordance with user operations and the like, and controls input in accordance with operations on a touch panel, a keyboard, buttons, and the like provided in the electronic device 20, for example. By integrating the touch panel with the display surface of the display unit 28, a key input operation using a software keyboard can be performed.

  The power controller 27 performs control for supplying driving power to each unit constituting the electronic device 20.

  The display unit 28 displays a message for the user, an operation screen, and the like on a display such as an LCD under the control of the central processing unit 21.

FIG. 3 is a perspective view showing an external configuration of the label writer 10 in the present embodiment.
The label writer 10 discharges the printed label 19 from an opening provided at the upper end. A measure portion 30 is formed at the bottom of the label writer 10 along the side portion in the longitudinal direction.
The major part 30 represents a reference length used in image processing, and scales are formed at predetermined constant intervals. For example, the interval of one scale is 5.0 mm and corresponds to the length of 39 dots of the image printed by the thermal head 14 provided in the label writer 10.

FIG. 4 is a view of the label writer 10 in this embodiment as viewed from above.
By executing the image processing program, the electronic device 20 can change a part of the image input by the CCD unit 24 and print it by the label writer 10. When the image to be printed is adjusted according to the recording medium (the size of recorded characters, etc.) to which the label is to be attached, as shown in FIG. ) May be taken (details are shown in FIG. 10A).

  Next, an image processing method in the electronic device 20 according to the present embodiment will be described with reference to the flowcharts shown in FIGS. 5, 6, 7, 8, and 9.

  FIG. 5 is a flowchart showing image processing executed by the image processing program of the electronic device 20 in the present embodiment, FIG. 6 is a flowchart showing paste destination taking processing in the flowchart of image processing shown in FIG. 5, and FIG. The flowchart which shows the character & background adjustment process in the flowchart which shows the paste destination taking process shown in FIG. 6, FIG. 8 is the flowchart which shows the object line position selection process in the flowchart which shows the paste destination taking process shown in FIG. 9 is a flowchart showing a print transmission process in the flowchart of the image processing shown in FIG.

  First, when the image processing program is activated in response to a user instruction input from the input control unit 26, the central processing unit 21 causes the display unit 28 to display a main image for image processing. In the main image, for example, a software keyboard capable of inputting characters and the like, buttons for receiving various operations, and the like can be displayed in addition to a guide message for the user. Examples of the button include an “end button”, a “print execution button”, and a “paste destination take-in button”. Further, buttons necessary for each process are displayed as appropriate. The input operation for the software keyboard and buttons is performed by the user touching the touch panel, for example.

  When a key input is detected by the input control unit 26, the central processing unit 21 determines a key input operation. If it is determined that the operation is for the “pasting destination take-in button” (step A8, Yes), the central processing unit 21 starts the pasting destination taking process shown in FIG. 6 (step A9).

  When the pasting destination capturing process is started, the central processing unit 21 prints the entire background area for storing the image data corresponding to the recording medium detected from the photographed image and the label to be printed on the label in the entire background area. A printing range area for storing image data to be stored in the memory unit 22 is provided and initialized (FIG. 6, step B1).

  The central processing unit 21 activates the CCD unit 24 so that an image can be taken (step B2). Here, when an instruction to capture an image is issued by operating the “shutter button” (step B5, No), the central processing unit 21 causes the CCD unit 24 to capture an image. Image data of an image photographed by the CCD unit 24 is stored in the memory unit 22 (step B6). The central processing unit 21 executes character & background processing after image capture (step B7).

  FIG. 10A is a diagram illustrating a state where an image is captured by the electronic device 20 in the present embodiment, and FIG. 10B is a diagram illustrating an example of an image captured by the electronic device 20 in the present embodiment. .

  When printing an image for correcting a part of the business card 40 as a recording medium on a label, as shown in FIG. 10A, the business card 40 and a measure unit 30 provided on the label writer 10 are included. So that the image is taken. Preferably, the label writer 10 (major unit 30) and the business card 40 are taken from the electronic device 20 in the vertical direction. In addition, the business card 40 is placed in a state in which any side is in close contact with the measure unit 30. In other words, the image is photographed such that the arrangement of the character strings recorded on the business card 40 is vertical or parallel to the length direction of the major unit 30. Thereby, it is possible to reduce an image processing load and generate an image to be printed with high quality.

  In the character & background processing, first, the central processing unit 21 detects an image corresponding to the major unit 30 from the captured image (step C1). As shown in FIG. 10B, the reference image corresponding to the major portion 30 (major portion image) has a known shape in which graduations are formed at regular intervals. The central processing unit 21 detects the measure portion image based on this shape.

  When the reference image (major portion image) can be detected (step C2, Yes), the central processing unit 21 rotates the image of the recording medium in the captured image so that the major portion image is vertical. Thus, the direction is corrected (step C3).

  Next, the central processing unit 21 adjusts the resolution of the image on the recording medium so that the scale interval of the major portion image is 39 pixels (step C4). For example, when the scale interval of the major part image in the photographed image is 170 pixels, the resolution is lowered to (39/170 =) about 0.23 times. The central processing unit 21 stores the normalized image whose orientation and resolution are adjusted in the entire background area (step C5).

  Next, the central processing unit 21 targets the normalized image of the entire background area in which the orientation and resolution are adjusted, and the line area (character string area) corresponding to the image (character string or the like) printed on the business card 40. Is detected (step C6). The detected row area is a candidate for a region for correcting an image, and is also referred to as a correction candidate portion.

  FIG. 10 (c) shows an example of a normalized image in the present embodiment. In the image shown in FIG. 10C, the upper left corner is the coordinate origin (0.0), the horizontal direction is the X coordinate system, and the vertical direction is the Y coordinate system.

  The central processing unit 21 uses existing image processing technology to detect pixels corresponding to characters and the like, discriminates a group of pixels corresponding to a row based on the positional relationship of each pixel, and determines a row area (correction candidate). ). The central processing unit 21 sets a circumscribed rectangular frame (or a rectangular frame obtained by adding a predetermined width to the circumscribed rectangle) for pixels corresponding to a set of character strings, and sets the upper left vertex coordinates of the rectangular frame as the rectangle. The coordinates indicate the position of the frame.

  FIG. 10D shows each row area detected from the image shown in FIG. The example shown in FIG. 10 (d) shows that five row areas have been detected. FIG. 10D shows that not only a line area corresponding to a character string but also an image portion such as a logo mark printed on the business card 40 is detected as a line area.

  Further, the central processing unit 21 detects the character size for each row area for each row area (step C7). For example, if the row direction is aligned in the X coordinate direction, it is determined that a character string is recorded in horizontal writing on the business card 40. In this case, the character height is the height of the line area (Y coordinate direction). The character width is scanned in the X coordinate direction for each line area, and a group (that is, a character) of each pixel is detected and set as the group width (X coordinate direction). In addition, when a plurality of pixels (a plurality of characters) have different widths, the average value may be calculated as the character width.

  In the example described above, an example of a line area corresponding to a horizontally written character string is shown. However, in the case of a line area corresponding to a vertically written character string, the line width in the X coordinate direction is set as the character width. The character height is detected by scanning in the Y coordinate direction.

  The central processing unit 21 records data indicating the position of each line area (correction candidate portion) detected from the normalized image and the width and height of the character in the memory unit 22 as line area data. FIG. 11 shows an example of row area data in which data about the row area detected from FIG. 10 (d) is recorded. The data No. 1 shown in FIG. 11 is data in the row area corresponding to the character string of the department name shown in FIG. Similarly, no. The data of No. 2 is a row area corresponding to the character string of the name, “No. No. 3 data is data in the row area corresponding to the character string of the company name, No. 3 The data of No. 4 is data corresponding to the character string of the telephone number. Reference numeral 5 denotes data in the row area corresponding to the logo mark.

  If the line area is not detected as a result of the character & background processing (step B8, Yes), the central processing unit 21 displays an error on the display unit 28 (step B10). In this case, for example, the processing is instructed to be canceled by the user (step B4, No), so the central processing unit 21 stops the processing.

  On the other hand, when a line area is detected as a result of the character & background process (No at Step B8), the central processing unit 21 executes a target line position selection process (Step B9).

  In the target row position selection process, first, the central processing unit 21 generates a row area rectangle corresponding to each row area based on the row area data, and synthesizes the normalized image (step D1 in FIG. 8). The central processing unit 21 displays an image obtained by combining the row area rectangles of each row on the display unit 28 (step D2).

  The user can select an arbitrary row area by touching the row area rectangle displayed on the display unit 28 with respect to the image obtained by combining the row area rectangles (step D3). The user selects a line area including the character to be corrected from the character string recorded on the business card 40. A location selected from one or more row areas (correction candidate locations) is referred to as a location requiring correction. Here, not only one row area but also a plurality of row areas can be selected.

  When a touch operation is detected by the input control unit 26 (step D4), the central processing unit 21 is an operation for selecting any rectangular area within a rectangular area (step D6, No), and the corresponding line. “No.” of the row area corresponding to the area rectangle is recorded in the memory unit 22 as “replacement row No.” (step D7). Further, the central processing unit 21 changes the display form of the row area rectangle selected by the user to clearly indicate that it is in a state selected as a replacement target (step D8). When an operation for designating a rectangular frame of a plurality of line area rectangles is performed, the central processing unit 21 records “No.” of each line area as “replacement line No.” in the memory unit 22, Each time the row area rectangle is selected, the display form is changed sequentially.

  If an instruction to cancel selection of a replacement row is input (step D9, Yes), the central processing unit 21 deletes “replacement row No.” recorded in the memory unit 22 and selects a row area rectangle. Returns to the initial screen before being executed.

  On the other hand, when it is not cancellation but an instruction to confirm selection of a replacement line (No at Step D9), the central processing unit 21 selects a background area corresponding to the line area of the selected replacement line (Step D10). The image data corresponding to the background area is copied to the print background area of the memory unit 22 (step D11). The background area is an area to be printed on a label in the label writer 10, and includes a line area of a replacement line, and when the line area of the replacement line printed on the label is pasted according to the corresponding line of the recording medium. In addition, a range in which the entire label can be attached to the recording medium is set.

  FIG. 12 is a diagram illustrating a setting example of the background area in the present embodiment. In FIG. 12, an area AR1 is an image of the entire normalized image recorded in the entire background area, and an area AR3 shows a line area selected by the user as a replacement line. That is, the telephone number (replacement number No. 4) portion of the business card 40 is selected as a correction target (required correction portion).

  As shown in FIG. 12, the line area of the telephone number selected as the replacement line is arranged near the lower end of the business card 40. For this reason, the background area is set like the area AR2 shown in FIG. 12 so that the line area of the telephone number is printed near the lower end of the label. As a result, when the line area of the telephone number printed on the label is attached to the line on which the telephone number of the business card 40 is printed, the entire label can be attached to the business card 40.

  In the above description, the line area of the replacement line to be corrected is selected. However, an unnecessary line area that is unnecessary to be deleted from the business card 40 may be selected. For example, when it is desired to delete the “No. 3” row area (company name) shown in FIG. 10D from the business card 40, it is selected as a row area for unnecessary rows in the same manner as the replacement row selection described above. When the line area of the unnecessary line is selected, the central processing unit 21 deletes the image in the range indicated by the line area data of the line area of the unnecessary line (that is, the character string image of “company name”) from the image of the background area. . Thereby, the line area selected as an unnecessary line from the image printed on the label in the label writer 10 can be deleted.

  When the target line position selection process (pasting destination capture process) is completed, the central processing unit 21 displays, for example, an image of the background area and an image in which the line area of the replacement line is clearly shown in the image, and the line of the replacement line Data is input by user operation for characters to be printed instead of areas. The user can input a character input or a character control instruction by a key input operation on, for example, a software keyboard displayed on the main screen.

  When a character (printing character code) or a character control instruction is input by a key input operation (step A2) (step A3, Yes), the central processing unit 21 buffers the input printing character code in the memory unit 22. The characters are displayed as a replacement image in the line area of the replacement line using the character font corresponding to the print character code (step A6). For example, when correcting the telephone number printed on the business card 40, each character (numerical string) of the telephone number is repeatedly input in the same manner as described above, and each time it is input, a character is displayed in the row area of the replacement line. Is displayed as a replacement image.

  Thus, when the input of the characters necessary for correction is completed, the “print execution button” is selected by the user (step A7, Yes). When the “print execution button” is selected, the central processing unit 21 starts a print transmission process (step A10).

  In the print transmission process, first, the central processing unit 21 determines the presence or absence of print data. If there is no print data (FIG. 9, step E1, Yes), an error is displayed on the display unit 28 and the process is terminated (step E3).

  On the other hand, when there is print data (No at Step E1), the central processing unit 21 generates a socket for transmitting the print data to the label writer 10 (Step E2). If the socket generation fails, the transmission to the label writer 10 is impossible, so the central processing unit 21 displays an error on the display unit 28 and ends the process (step E3).

  When the socket is successfully generated (step E4, Yes), the central processing unit 21 generates a character string image to be printed on the label by the label writer 10 based on the character font indicated by the buffered print character code. (Step E5). Here, the central processing unit 21 refers to the character width and character height data stored in the row area of the replacement line of the line area data, and sets the character font indicated by the print character code to the character width and character height. Adjust the size accordingly. When a plurality of row areas are selected by the user as replacement rows, the same processing as described above is executed for each replacement row.

  The central processing unit 21 synthesizes the character string image as a replacement image in accordance with the position of the line area (correction designated portion) of the replacement line with the image of the print background area (step E6). Here, it is assumed that a binary bitmap image is generated as an image to be printed by the label writer 10. The central processing unit 21 calculates the print data length based on the image data to be printed.

  Thereafter, the central processing unit 21 controls printing while transmitting and receiving commands to and from the label writer 10 by wireless communication. FIG. 14 shows a transmission timing of a command and print data transmitted / received between the label writer 10 and the electronic device 20.

  The central processing unit 21 sends a status inquiry command to the label writer 10 through the wireless communication control unit 25 (S1 in FIG. 14) to inquire about the printer status (step E8). The central processing unit 11 of the label writer 10 transmits a status response notifying that printing is not permitted to the electronic device 20 through the wireless communication control unit 15 when printing is not possible, for example, when a label is not set. .

  When the print permission response is not received (No at Step E9), the central processing unit 21 of the electronic device 20 displays an error on the display unit 28, discards the socket, and ends the process (Step E15).

  On the other hand, if the central processing unit 11 of the label writer 10 is in a printable state, the central processing unit 11 transmits a state response (S2 in FIG. 14, S2) for notifying the print permission through the wireless communication control unit 15. When the central processing unit 21 of the electronic device 20 receives the print permission response (step E9, Yes), it transmits a print start command to the label writer 10 (S3, step E10). The label writer 10 transmits a permission response to the print start command (S4).

  Thereafter, the central processing unit 21 sequentially transmits the image data to be printed to the label writer 10 as print data 1, 2,..., N for each data packet having a predetermined data length (S5, S7,. S8 ...) (step E11). Each time the print data 1, 2,..., N is received, the label writer 10 returns data 1ACK,..., Data nACK in order to notify that the data has been normally received (S6, S9).

  When the transmission of all data is completed (No at Step E12), the central processing unit 21 transmits a print end command to the label writer 10 (S10, Step E13), discards the socket, and ends the process (Step E15). ). In this way, transmission of print data (image data to be printed) from the electronic device 20 to the label writer 10 is completed.

  When the label writer 10 completes reception of image data (print data) from the electronic device 20, it starts printing on the label 19. FIG. 13 shows how the label printed by the label writer 10 is discharged.

  As shown in FIG. 13, the image printed on the label 19 by the label writer 10 is recorded on the character string of the telephone number modified by the character string input by the user by the electronic device 20 and the other business card 40. The image of the background area is printed. Since the image printed on the label 19 is adjusted in size according to the actual size of characters and the like printed on the business card 40, the name portion printed on the business card 40 and the name printed on the label 19 By aligning and pasting the parts so that they match, the character string of the telephone number corrected in the electronic device 20 also matches the part of the telephone number printed on the business card 40. Therefore, it is possible to correct a part printed on the business card 40 by applying the label 19.

  In the above description, the case where the character string (telephone number) printed on the business card 40 is corrected by the character string input in the electronic device 20 is exemplified. However, for example, the image portion recorded on the business card 40 (Logo portion, etc.) is selected and corrected to characters, or an image or character portion recorded on the business card 40 is selected and corrected by an image such as a picture, figure or logo selected on the electronic device 20. May be. In this case as well, the size may be adjusted based on the major portion image by image processing in the same manner as described above.

  In this way, in the electronic device 20 according to the present embodiment, an image is taken so as to include the measure unit 30 provided in the label writer 10 and the recording medium (business card 40) to which the label is attached. Thus, the actual size of the image recorded on the recording medium can be calculated based on the major portion image, and the actual size of the image printed on the label can be adjusted by the label writer 10. In this image processing, image processing for adjusting the resolution of the image in accordance with the resolution of the thermal head 14 of the label writer 10 is possible. The actual size of the printed image can be prevented from being affected. Further, in the image processing according to the present embodiment, each partial area (row area) in the photographed image can be changed with a replacement image such as a character string input from the electronic device 20 by a user operation. At this time, since the size of the partially changed image is also adjusted based on the major portion image, the actual size can be matched with the image recorded on the original recording medium.

  In the above description, the resolution of the image to be printed that is transmitted from the electronic device 20 to the label writer 10 in accordance with the actual size of the print (such as a character string) recorded on the recording medium photographed by the electronic device 20. However, based on the image of the major unit 30, image processing may be performed so that the image is adjusted for printing to another size. For example, the image size of the image captured by the electronic device 20 and the size of characters (printing characters) input by the user in the electronic device 20 are adjusted to the label width usable in the label writer 10. You can also. For example, image processing can be performed to adjust the actual size of an image printed on each label so that the entire business card 40 can be printed by combining two labels.

  Further, the method described in the embodiment, that is, each method such as the processing shown in the flowcharts of FIGS. 5, 6, 7, 8, and 9 can be executed by a computer (for example, the electronic device 20). As a memory card (ROM card, RAM card, etc.), magnetic disk (flexible disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, and other recording media. Then, the computer reads the program recorded on the external recording medium, and the operation is controlled by this program, thereby realizing processing similar to the function described in the embodiment.

  Further, program data for realizing each method can be transmitted on a network (Internet) as a form of program code, and program data can be transmitted from a computer (server device or the like) connected to the network (Internet). It is also possible to implement the same function as the above-described embodiment.

  Note that the present invention is not limited to the embodiments, and can be variously modified without departing from the scope of the invention in the implementation stage. Further, the embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment or some constituent features are combined, the problem described in the column of the problem to be solved by the invention can be solved. When the effect described in the column of effect is obtained, a configuration in which this constituent requirement is deleted or combined can be extracted as an invention.

  Hereinafter, the invention described in the scope of claims of the present application will be appended.

[Appendix 1]
A detection step of detecting a reference image representing the reference length from a photographed image obtained by photographing a correction tape pasting area together with a member representing the reference length;
A first adjustment step of adjusting the orientation and resolution of the captured image based on the reference image;
A correction candidate location detection step for detecting one or more correction candidate locations from the normalized image normalized by the first adjustment step; and one or more correction candidate locations detected in the correction candidate location detection step A selection process for selecting a correction-necessary portion requiring correction from among the instructions according to the user's instruction;
A size calculating step of calculating an image size of the correction-necessary portion selected by the selecting step;
And an input process in which a user inputs data for replacing the image of the correction required portion.

[Appendix 2]
The image processing method according to appendix 1, further comprising: a second adjustment step of generating a replacement image from the data input in the input step and adjusting the size of the replacement image in accordance with the image size of the correction required portion.

[Appendix 3]
The image processing according to claim 1 or 2, further comprising: an image synthesis step of synthesizing the image whose size has been adjusted in the second adjustment step and the image of the print background area obtained by removing the image of the correction required portion from the normalized image. Method.

[Appendix 4]
A detection step of detecting a reference image representing the reference length from a photographed image obtained by photographing a correction tape pasting area together with a member representing the reference length;
A first adjustment step of adjusting the orientation and resolution of the captured image based on the reference image;
A correction candidate location detection step for detecting one or more partial correction candidate locations from the normalized image normalized by the first adjustment step;
A selection step of selecting a correction-necessary portion requiring correction from one or more correction candidate portions detected in the correction candidate portion detection step according to a user instruction;
A size calculating step of calculating an image size of the correction-necessary portion selected by the selecting step;
An input step in which a user inputs data for replacing the image of the correction required portion;
An image processing program in which a computer executes a second adjustment step of generating a replacement image from the data input in the input step and adjusting the size of the replacement image in accordance with the image size of the correction-needed portion.

[Appendix 5]
Detecting means for detecting a reference image representing the reference length from a photographed image obtained by photographing a correction tape pasting area together with a member representing the reference length;
First adjusting means for adjusting the orientation and resolution of the captured image based on the reference image;
Correction candidate location detection means for detecting one or more partial correction candidate locations from the normalized image normalized by the first adjustment means;
A selection unit that selects a correction-necessary portion that needs correction from one or more correction candidate portions detected by the correction candidate portion detection unit according to a user instruction;
Size calculation means for calculating the image size of the correction-necessary portion selected by the selection means;
An input means for a user to input data for replacing the image of the correction required portion;
An electronic apparatus comprising: a second adjustment unit that generates a replacement image from data input by the input unit and adjusts the size of the replacement image in accordance with the image size of the correction-necessary portion.

  DESCRIPTION OF SYMBOLS 10 ... Label writer, 11 ... Central processing unit, 14 ... Thermal head, 18 ... Label conveyance unit, 19 ... Label, 20 ... Electronic device, 21 ... Central processing unit, 22 ... Memory part.

Claims (5)

A detection step of detecting a reference image representing the reference length from a photographed image obtained by photographing a correction tape pasting area together with a member representing the reference length;
A first adjustment step of adjusting the orientation and resolution of the captured image based on the reference image;
A correction candidate location detection step for detecting one or more partial correction candidate locations from the normalized image normalized by the first adjustment step;
A selection step of selecting a correction-necessary portion requiring correction from one or more correction candidate portions detected in the correction candidate portion detection step according to a user instruction;
A size calculating step of calculating an image size of the correction-necessary portion selected by the selecting step;
And an input process in which a user inputs data for replacing the image of the correction required portion.   The image processing method according to claim 1, further comprising: a second adjustment step of generating a replacement image from the data input in the input step and adjusting the size of the replacement image according to the image size of the correction-needed portion.   The image processing method according to claim 2, further comprising an image composition step of combining the image whose size has been adjusted in the second adjustment step and an image of a print background area obtained by removing the image of the correction required portion from the normalized image. . A detection step of detecting a reference image representing the reference length from a photographed image obtained by photographing a correction tape pasting area together with a member representing the reference length;
A first adjustment step of adjusting the orientation and resolution of the captured image based on the reference image;
A correction candidate location detection step for detecting one or more partial correction candidate locations from the normalized image normalized by the first adjustment step;
A selection step of selecting a correction-necessary portion requiring correction from one or more correction candidate portions detected in the correction candidate portion detection step according to a user instruction;
A size calculating step of calculating an image size of the correction-necessary portion selected by the selecting step;
An input step in which a user inputs data for replacing the image of the correction required portion;
An image processing program in which a computer executes a second adjustment step of generating a replacement image from the data input in the input step and adjusting the size of the replacement image in accordance with the image size of the correction-needed portion. Detecting means for detecting a reference image representing the reference length from a photographed image obtained by photographing a correction tape pasting area together with a member representing the reference length;
First adjusting means for adjusting the orientation and resolution of the captured image based on the reference image;
Correction candidate location detection means for detecting one or more partial correction candidate locations from the normalized image normalized by the first adjustment means;
A selection unit that selects a correction-necessary portion that needs correction from one or more correction candidate portions detected by the correction candidate portion detection unit according to a user instruction;
Size calculation means for calculating the image size of the correction-necessary portion selected by the selection means;
An input means for a user to input data for replacing the image of the correction required portion;
An electronic apparatus comprising: a second adjustment unit that generates a replacement image from data input by the input unit and adjusts the size of the replacement image in accordance with the image size of the correction-necessary portion.

Images