JP2022034330A - Printing terminal and printing system - Google Patents

Abstract

To provide a technique capable of properly displaying a printable image.SOLUTION: A printing terminal includes: an image reading part for reading an image from a storage device; a grouping condition generation part for generating grouping conditions for dividing the image into a plurality of groups based on the designation of a user; a screen generation part for generating a screen including the image of each group grouped by a server based on the grouping conditions; and a printing part which prints the selected image out of the images of the screen.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a print terminal and a print system.

A technique has been proposed in which not only the image read from the card media is printed by the print terminal but also the images uploaded and downloaded from the print terminal to the server are displayed side by side using Exif information (for example, Patent Document 1). ..

Japanese Unexamined Patent Publication No. 2018-176601

The print terminal described in Patent Document 1 displays images to be printed according to the user's choice in the order in which the images are read, or displays the images in alphabetical order or numerical order of the file names of the images. Display by folder.

However, the storage capacity of storage devices such as SD cards, CF cards, and mobile phones has been increasing, and the number of images that can be stored in the storage devices has dramatically increased. For this reason, there is a problem that the user needs to browse many images when selecting an image to be printed, which is troublesome. Further, when the number of images to be displayed is large, there is a problem that a relatively large load is applied to the arithmetic unit and it takes time to display.

Therefore, the present disclosure has been made in view of the above-mentioned problems, and an object of the present disclosure is to provide a technique capable of appropriately displaying a printable image.

The print terminal according to the present disclosure is a print terminal capable of communicating with a server, and is a condition for dividing the image into a plurality of groups based on an image reading unit that reads an image from a storage device and a user's specification. The server includes a grouping condition generation unit that generates a grouping condition, divides the image into a plurality of groups based on the grouping condition, and groups based on the result of dividing the image into the plurality of groups. A screen generation unit that generates a list of the images for each and generates a screen including the images for each group based on the list, and a print unit that prints a selected image among the images on the screen. Further prepare.

According to the present disclosure, a screen including images for each group is generated based on the grouping conditions. With such a configuration, a printable image can be appropriately displayed.

It is a block diagram which shows the structure of the print system which concerns on Embodiment 1. It is a flowchart which shows the operation of the print system which concerns on Embodiment 1. It is a figure for demonstrating the operation example of the print system which concerns on Embodiment 1. It is a figure for demonstrating the operation example of the print system which concerns on Embodiment 1. It is a figure for demonstrating the operation example of the print system which concerns on Embodiment 1. It is a figure for demonstrating the operation example of the print system which concerns on Embodiment 1. It is a figure for demonstrating the operation example of the print system which concerns on Embodiment 1.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of a print system according to the first embodiment. As shown in FIG. 1, the print system includes a print terminal 1 and a group list generation server 20 which is a server, and the print terminal 1 and the group list generation server 20 are mutually connected via, for example, the Internet 50. It is possible to communicate with.

<Print terminal 1>
The print terminal 1 includes a control unit 2, an input unit 3, a display audio output unit 4, an image reading unit 5, an image buffer 6, a charge settlement device 7, an image printer 8, and a grouping condition generation unit 9. A group list decoding unit 10, an image selection screen generation unit 11, and a network I / F (interface) 12 are provided.

The input unit 3 receives from the user operations on the print terminal 1, such as selecting a menu and specifying (setting) the number of prints and an image. For example, a touch panel, a keyboard, and a mouse are applied to the input unit 3.

The display audio output unit 4 outputs a display and audio for instructing the user to operate. For example, a display unit such as a liquid crystal monitor and a CRT (Cathode Ray Tube) and an audio output unit such as a speaker are applied to the display audio output unit 4.

The image reading unit 5 reads an image from a storage device in which the image is stored. The storage device includes, for example, a media card such as an SD card and a CF card, a disc media such as a CD (Compact Disc) / DVD (Digital Versatile Disc), and a wireless and data communication device such as Wi-Fi (registered trademark). A mobile phone with a camera connected to the print terminal 1 via a wire such as a USB (Universal Serial Bus) cable of the above is applied. For example, a media card reader that reads data from a media card, a disk drive that reads data from disk media, and a communication device that receives data from a camera-equipped mobile phone are applied to the image reading unit 5.

In the first embodiment, the image reading unit 5 reads the image data and the Exif information of the image data as the image reading. The Exif information includes at least one metadata, and the metadata includes, for example, the shooting date of the image, the manufacturer of the camera that shot the image, the shutter speed, the ISO sensitivity, and the like.

The image buffer 6 temporarily stores the image read by the image reading unit 5. Since the image read by the image reading unit 5 and the image stored in the image buffer 6 are substantially the same, these images will be described below without distinction.

The charge settling device 7 setstles the charges related to the print service used by the user on the print terminal 1.

The image printer 8 which is a printing unit prints an image selected by the user among the images included in the screen generated by the image selection screen generation unit 11 described later. In the first embodiment, the image printer 8 prints an image selected by the user when the fee settled by the fee settling device 7 is paid.

The grouping condition generation unit 9 is a condition for dividing the image of the image buffer 6, that is, the image read by the image reading unit 5, into a plurality of groups based on the designation from the user to the input unit 3. To generate. In the following, the grouping condition will be described as a condition for dividing the image of the image buffer 6 into a plurality of groups according to at least one of the metadata included in the Exif information of the image and the image analysis result of the image. However, it is not limited to this.

As will be described later, the group list generation server 20 divides the images in the image buffer 6 into a plurality of groups based on the grouping conditions generated by the grouping condition generation unit 9. Then, the group list generation server 20 generates a group list, which is a list of images for each group, based on the result of dividing into a plurality of groups. The group list generation server 20 will be described in detail later.

The group list decoding unit 10 decodes the group list transmitted from the group list generation server 20, and selects the images in the image buffer 6 for each group based on the decoding result. That is, substantially, the group list decoding unit 10 selects the images in the image buffer 6 for each group based on the grouping condition generated by the designation from the user.

The image selection screen generation unit 11 reads out the images selected by the group list decoding unit 10 based on the group list from the image buffer 6 and generates a screen including images for each group.

The display audio output unit 4 displays the screen generated by the image selection screen generation unit 11. When the charge settled by the charge settlement device 7 is paid, the image printer 8 is generated by the image selection screen generation unit 11, and among the images included in the screen displayed by the display audio output unit 4, the user is notified of the image. Print the selected image. In the display audio output unit 4, a plurality of images may be rearranged and displayed so that the user can easily select them, displayed as pages, or automatically switched and displayed in the order of groups. , The image selection screen generation unit 11 may generate the above screen.

The network I / F 12 connects to the Internet 50 when transmitting the image of the image buffer 6 and the grouping condition generated by the grouping condition generation unit 9 to the group list generation server 20. Further, the network I / F 12 receives the group list generated by the group list generation server 20 from the group list generation server 20 via the Internet 50.

The control unit 2 is connected to the component of the print terminal 1 so as to be able to exchange data with each other, manage the state of each component, and give an instruction to each component. The control unit 2 may be realized by the cooperation of hardware such as a CPU (Central Processing Unit) and a memory, and software such as a control program for controlling the operation of the print terminal 1, or may be realized. It may be realized by dedicated hardware such as a circuit. This also applies to the grouping condition generation unit 9, the group list decoding unit 10, and the image selection screen generation unit 11.

<Group list generation server 20>
The group list generation server 20 includes a network I / F 21, an image buffer 22, a grouping condition indicating unit 23, an Exif information grouping processing unit 24, an Exif information group list generation unit 25, and an image analysis grouping processing unit. 26, an image analysis group list generation unit 27, and a composite group list generation unit 28 are provided.

The network I / F 21 receives the image and the grouping condition from the print terminal 1 by communicating with the print terminal 1 via the Internet 50, and also prints the group list generated by the group list generation server 20. Send to 1.

The image buffer 22 which is an image storage unit temporarily stores an image received from the print terminal 1.

The grouping condition instruction unit 23 has the Exif information grouping processing unit 24 and the image analysis grouping processing unit 26 based on the grouping condition from the print terminal 1, that is, the grouping condition generated by the grouping condition generation unit 9. Instruct the grouping process to.

When the Exif information grouping processing unit 24 receives an instruction from the grouping condition indicating unit 23, the Exif information grouping processing unit 24 divides the image of the image buffer 22 into a plurality of groups according to at least one metadata included in the Exif information of the image. .. Since the image stored in the image buffer 6 and the image stored in the image buffer 22 are substantially the same, the images in the image buffer 22 are divided into a plurality of groups, so that the images in the image buffer 6 are divided into a plurality of groups. As a result, the images read by the image reading unit 5 are divided into a plurality of groups.

The Exif information group list generation unit 25 generates an Exif information group list by converting the result of grouping by the Exif information grouping processing unit 24 into list data.

When the image analysis grouping processing unit 26 receives an instruction from the grouping condition indicating unit 23, the image analysis grouping processing unit 26 divides the image of the image buffer 22 into a plurality of groups according to the image analysis result of the image. Since the image stored in the image buffer 6 and the image stored in the image buffer 22 are substantially the same, the images in the image buffer 22 are divided into a plurality of groups, so that the images in the image buffer 6 are divided into a plurality of groups. As a result, the images read by the image reading unit 5 are divided into a plurality of groups.

The image analysis group list generation unit 27 generates an image analysis group list by converting the results of grouping by the image analysis grouping processing unit 26 into list data.

The composite group list generation unit 28 integrates the Exif information group list generated by the Exif information group list generation unit 25 and the image analysis group list generated by the image analysis group list generation unit 27 to form a composite group list. Generate.

Grouping condition instruction unit 23, Exif information grouping processing unit 24, Exif information group list generation unit 25, image analysis grouping processing unit 26, image analysis group list generation unit 27, and composite group list generation unit described above. 28 is included in the group list generation unit. As can be seen from the above description, the group list generation unit divides the images read by the image reading unit 5 into a plurality of groups based on the grouping conditions and the images in the image buffer 22, and divides the images into a plurality of groups. Generate a group list based on the separated results.

The grouping condition indicating unit 23 of the group list generation unit is realized by the cooperation of hardware such as a CPU and memory, and software such as a control program for controlling the operation of the print terminal 1. It may be realized by dedicated hardware such as a processing circuit. This means that the Exif information grouping processing unit 24, the Exif information group list generation unit 25, the image analysis grouping processing unit 26, the image analysis group list generation unit 27, and the composite group list generation unit 28 of the group list generation unit The same applies to.

<Operation>
FIG. 2 is a flowchart showing the operation of the print system according to the first embodiment. Hereinafter, using FIG. 2, a process for the user to read the image stored in the storage device into the print terminal 1, pay the fee, and acquire the printed matter on which the desired image is printed will be described. In the following example, the print terminal 1 (display voice output unit 4) is configured to display and give a voice instruction to the user what the user should instruct (set) in the flowchart. I will explain it as if it were.

First, in step S1, the user follows the instructions of the print terminal 1 to connect the mobile phone in which the image to be printed is stored to the print terminal 1 by wire or wirelessly, or the CD, DVD in which the image to be printed is stored. Insert a storage medium such as a media card into the print terminal 1. Then, the user performs an operation instructing the input unit 3 to "start image reading".

In step S2, the image reading unit 5 reads an image from a storage device such as a portable terminal and a storage medium, and stores the read image in the image buffer 6.

In step S3, the print terminal 1 receives from the user the designation of the grouping condition as an instruction for displaying an appropriate image from the plurality of images read and stored in the image buffer 6. The grouping condition generation unit 9 generates a grouping condition which is a condition for dividing the image of the image buffer 6 into a plurality of groups based on the user's designation. After that, the process proceeds to step S7.

Here, the specification of the "grouping condition" performed by the user in step S3 will be described.

FIG. 3 is a diagram showing an instruction example (guidance example) of the print terminal 1 until the user specifies a grouping condition using the shooting date (metadata) included in the Exif information as the “grouping condition”. be.

In the first instruction, the print terminal 1 instructs the user to select either grouping using the shooting date included in the Exif information or grouping using face recognition by the image analysis software. In the example of FIG. 3, the user selects grouping by shooting date.

In the second instruction, the print terminal 1 instructs the user to set the number of groups. In the example of FIG. 3, the user sets the number of groups to 5.

In the third instruction, the print terminal 1 instructs the user to set a range of shooting dates for each of the five groups. In the example of FIG. 3, the user sets a range of shooting dates for each of the five groups.

FIG. 4 is a diagram showing an instruction example (guidance example) of the print terminal 1 until the user specifies a grouping condition using face authentication by image analysis as a “grouping condition”.

In the first instruction, the print terminal 1 instructs the user to select either grouping using the shooting date included in the Exif information or grouping using face recognition by the image analysis software. In the example of FIG. 4, the user selects grouping by face recognition.

In the second instruction, the print terminal 1 instructs the user to select an image to be face-recognized. In the example of FIG. 4, the user selects eight images as the images to be face recognition.

In the third instruction, the print terminal 1 notifies the user that the number of people detected by face recognition for the eight images is five. Further, the print terminal 1 instructs the user to select whether or not to divide the image in the group of five people. In the example of FIG. 4, the user chooses to divide the image into groups of five.

The designation of the grouping conditions for face recognition is not limited to the above. For example, the print terminal 1 instructs the user to select the number of people, and extracts the persons appearing in the plurality of images stored in the image buffer 6 in descending order of the number of images by the selected number of people. You may. Then, the print terminal 1 may specify the grouping condition by instructing the user whether or not to divide the image by the group of the extracted persons.

As for the face recognition software, it is preferable to use face recognition software having a relatively high authentication accuracy that can detect an incomprehensible face such as a small face or a dark face.

As shown in FIG. 2, steps S4 to S6 are performed between step S2 and step S7 in parallel with step S3.

In step S4, the network I / F 12 transmits the image of the image buffer 6 to the group list generation server 20 via the Internet 50. The image buffer 22 stores an image received from the print terminal 1.

In step S5, the network I / F 12 transmits the grouping condition to the group list generation server 20 via the Internet 50. The grouping condition instruction unit 23 instructs the grouping process based on the grouping condition received from the print terminal 1. The Exif information grouping processing unit 24 divides the images in the image buffer 22 into a plurality of groups according to at least one metadata included in the Exif information of the images. The image analysis grouping processing unit 26 divides the image of the image buffer 22 into a plurality of groups according to the image analysis result of the image.

In step S6, the Exif information group list generation unit 25 generates an Exif information group list by converting the result of grouping by the Exif information grouping processing unit 24 into list data. The image analysis group list generation unit 27 generates an image analysis group list by converting the results of grouping by the image analysis grouping processing unit 26 into list data. The composite group list generation unit 28 integrates the Exif information group list and the image analysis group list to generate a composite group list.

FIG. 5 is a diagram showing a processing example of the Exif information grouping processing unit 24 in step S5 and a processing example of the Exif information group list generation unit 25 in step S6. Here, when the images stored in the image buffer 22 are eight images, the eight images are grouped into five groups (groups A1, A2, A3, A4, A5) designated in the example of FIG. An example of dividing into is described.

The eight images are assumed to be eight images (image1 to image8) in JPEG (registered trademark) format having "image1.jpg" to "image8.jpg" as image file names. The shooting dates for groups A1, A2, A3, A4, and A5 are "January 2019-February 2019", "March 2019-April 2019", and "May 2019-2019", respectively. It shall be "June 2019", "July 2019-August 2019", and "September 2019-". Further, it is assumed that the Exif information of each of the eight images includes the shooting date.

The Exif information grouping processing unit 24 divides each of the eight images in the image buffer 22 into a group having the same shooting date of the image among the five groups. For example, since the shooting date range of group A1 is "January 2019 to February 2019", only image7 having the same shooting date among the eight images is classified into group A1.

The Exif information group list generation unit 25 divides eight images (image1 to image8) into five groups (groups A1, A2, A3, A4, A5) by the Exif information grouping processing unit 24, and then the Exif information group. Generate Listing 41.

It should be noted that grouping may be performed according to each of the camera maker, shutter speed, and ISO sensitivity included in the Exif information, or grouping is performed according to two or more of the shooting date, the camera maker, the shutter speed, and the ISO sensitivity. You may be broken.

FIG. 6 is a diagram showing a processing example of the image analysis grouping processing unit 26 in step S5 and a processing example of the image analysis group list generation unit 27 in step S6. Here, when the images stored in the image buffer 22 are eight images, the eight images are grouped into five groups (groups B1, B2, B3, B4, B5) designated in the example of FIG. An example of dividing into is described.

It is assumed that the eight images are the same eight images (image1 to image8) as in FIG. Further, it is assumed that the persons shown in each of the eight images are different, and that the croups B1 to B5 are groups of Mr. A to Mr. E, respectively. In FIG. 6, the person detected by the face recognition software is shown as a "person in the picture".

The image analysis grouping processing unit 26 divides each of the eight images in the image buffer 22 into a group of people appearing in the image among the five groups. For example, there are five images (images 1, 2, 3, 6, 7) in which Mr. A appears, which is the largest number among Mr. A to Mr. E, and the five images are in Mr. A's group B1. Divided. Similarly, one or more images are divided into groups B2 to B5 of Mr. B to Mr. E.

The image analysis group list generation unit 27 is based on the result of dividing eight images (image1 to image8) into five groups (groups B1, B2, B3, B4, B5) by the image analysis grouping processing unit 26. Generate Listing 42.

In addition to face recognition, image analysis may detect the brightness (darkness) of the entire image, the background, and the like. Then, grouping may be performed according to each of brightness and background, or grouping may be performed according to two or more of face recognition, brightness and background.

FIG. 7 is a diagram showing a processing example of the composite group list generation unit 28 in step S6. Here, the composite group list generation unit 28 integrates the Exif information group list 41 of FIG. 5 and the image analysis group list 42 of FIG. 6, and lists the groups by image (image file name). An example of generating the group list 43 is shown. In FIG. 7, a composite group list 43 listing only the group names (A1 to A5, B1 to B5) to which each image belongs is generated.

After step S3 and step S6, in step S7, the network I / F21 transmits the composite group list to the network I / F12 via the Internet 50. The group list decoding unit 10 decodes the composite group list received by the network I / F12, and selects images for each group according to the grouping conditions based on the decoding result.

The image selection screen generation unit 11 acquires the identification information (for example, the file name of the image) of the image selected from the group list decoding unit 10, reads the image indicated by the identification information from the image buffer 6, and displays the screen including the image. Generate. As a result, the image selection screen generation unit 11 generates an image selection screen that is the result of the grouping condition specified by the user in step S3.

If the processing capacity of the group list generation server 20 is high, the generation speed of the composite group list is increased, and the time required to display the image corresponding to the group specified by the user on the print terminal 1 can be shortened, but the processing capacity is high. There is a cost to increase. Therefore, the group list generation server 20 creates the composite group list halfway, and the print terminal 1 receives the data of the composite group list being created at regular intervals or every time the composite group list is updated, and the image selection screen is displayed. May be displayed. According to such a configuration, the processing capacity and cost of the group list generation server 20 can be suppressed, and the stress of the user who has to wait until the composite group list is completed can be reduced.

The display audio output unit 4 displays the screen generated by the image selection screen generation unit 11. For example, the image selection screen generation unit 11 generates a screen including only an image (image 7) when the group A1 is designated by the user, and the display audio output unit 4 displays the screen. For example, the image selection screen generation unit 11 generates a screen including an image (images 1 to 3, 6, 7) when the group B1 is designated by the user, and the display audio output unit 4 displays the screen. For example, the image selection screen generation unit 11 generates a screen including images (images 4, 7, 8) when both groups A1 and B4 are specified by the user, and the display audio output unit 4 displays the screen. .. With such a configuration, the user can appropriately narrow down the displayed images.

In step S8, the user selects an image to be printed, a type of print medium on which the image is printed, and the number of prints from the displayed screen according to the instruction of the print terminal 1. Types of print media include, for example, printer types (sublimation printers, inkjet printers, etc.), paper types (plain paper, plain paper with protective layer, sticker paper, etc.), paper sizes, and the like. The size of the paper includes, for example, a general L size, a leaflet size (post size), a 2L size, and the like.

In step S9, the user pays the fee according to the instruction of the print terminal 1. The charge input here is a charge for printing by the print terminal 1. The required charge is calculated by the control unit 2 or the charge settlement device 7, and the user pays the calculated charge to the charge settlement device 7. The charge settlement device 7 may be, for example, a cash input type settlement device such as a coin mech or a bill burr, or an electronic money compatible settlement device.

When the fee is charged in step S10, the image printer 8 of the print terminal 1 prints the image selected by the user on paper to generate a printed matter.

In step S11, the user receives the printed matter, and the operation of FIG. 2 ends.

<Summary of Embodiment 1>
According to the print terminal 1 according to the first embodiment as described above, the user can divide the image into a plurality of groups by designating the grouping condition. According to such a configuration, even if there are many images stored in the storage device, the number of printed images viewed by the user when selecting the image to be printed is reduced, so that the user's labor can be suppressed. Further, since the image selection screen generation unit 11 can reduce the number of images read from the image buffer 6, the load on the image selection screen generation unit 11 can be reduced.

Further, in the first embodiment, the grouping process is performed on the dedicated group list generation server 20. According to such a configuration, since the processing capacity of the print terminal 1 can be reduced, the cost required for the CPU of the print terminal 1 and the like can be reduced.

Further, in the first embodiment, since the grouping is performed by using the Exif information and the image analysis, it is possible to perform an appropriate grouping of images. The print system of the first embodiment is configured to perform grouping using both Exif information and image analysis, but the present invention is not limited to this. For example, the print system may be configured to perform grouping using either Exif information or image analysis. According to this configuration, the composite group list generation unit 28 and the like can be omitted.

In the above configuration, if the processing capacity of the group list generation server 20 is increased, grouping processing under complicated conditions can be realized. Further, the group list generation server 20 may be connected to a plurality of print terminals 1 and shared by a plurality of print terminals 1. In this case, if the group list generation server 20 uses a CPU capable of high-speed processing, the group list generation server 20 performs grouping processing of the plurality of print terminals 1 in parallel even if the group list generation server 20 is accessed simultaneously from the plurality of print terminals 1. It becomes possible to do it.

The embodiments can be appropriately modified or omitted.

1 Print terminal, 5 Image reader, 8 Image printer, 9 Grouping condition generator, 11 Image selection screen generator, 20 Group list generation server, 22 Image buffer, 23 Grouping condition indicator, 24 Exif information grouping process Unit, 25 Exif information group list generation unit, 26 image analysis grouping processing unit, 27 image analysis group list generation unit, 28 composite group list generation unit.

Claims (5)

A print terminal that can communicate with the server.
An image reader that reads images from a storage device,
It is provided with a grouping condition generation unit that generates a grouping condition, which is a condition for dividing the image into a plurality of groups based on a user's specification.
The server divides the images into the plurality of groups based on the grouping conditions, and generates a list of the images for each group based on the result of dividing the images into the plurality of groups.
A screen generation unit that generates a screen including the image for each group based on the list, and a screen generation unit.
A print terminal further comprising a print unit for printing a selected image among the images on the screen. The print terminal according to claim 1 and
Equipped with the above server
The server
An image storage unit that stores the image read by the image reading unit, and an image storage unit.
Based on the grouping condition and the image of the image storage unit, the image read by the image reading unit is divided into the plurality of groups, and the list is created based on the result of dividing into the plurality of groups. A print system with a group list generator to generate. The printing system according to claim 2.
The grouping conditions are
A print system, which is a condition for dividing an image into a plurality of groups according to at least one metadata contained in the Exif information of the image. The printing system according to claim 2.
The grouping conditions are
A print system, which is a condition for dividing an image into a plurality of groups according to an image analysis result of the image. The printing system according to claim 2.
The grouping conditions are
A print system, which is a condition for dividing an image into a plurality of groups according to at least one metadata included in the Exif information of the image and an image analysis result of the image.

Images