JP2016133967A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To arrange the same image at a plurality of places in a photo book by selecting the same image from an image list multiple times.SOLUTION: An image processing apparatus for sequencing images selected among a plurality of images by a user includes: display means for displaying a list of the plurality of images on a display part; reception means for receiving an operation for selection of images by the user from the list of the plurality of images displayed on the display part; and recording means for recording orders of the selected images in a selecting order when the user selects the images. In the case that the user selects again a selected image whose order has already been recorded, the recording means records an order with respect to the selected image, when the image is selected again, in addition to the order that has already been recorded.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

In recent years, some images are arranged on a photobook page and displayed on a screen. Among them, there is one that selects an image to be used for a photobook from an image list that can be acquired by an application and automatically assigns each page in the selected order (see Patent Document 1).
Further, as a method for selecting an image to be used for a photo book from an image list, there is a method of displaying a list of image thumbnails and selecting an image from the list by tapping a touch panel. As a method for canceling the selection in this case, there is a method in which the selected image thumbnail is tapped again (see Patent Document 2).

JP 2011-186927 A JP 2014-106595 A

By the way, there is a demand not only to select images one by one in order, but also to select the same image in multiple (multiple times) and place the same image at a plurality of locations in the photo book.
In the prior art, when the user performs an operation of selecting the same image again, the selected state of the image is canceled, and the user cannot select the same image multiple times.
The present invention has been made in view of the circumstances as described above, and an object of the present invention is to select the same image from the image list a plurality of times and arrange the same image at a plurality of locations in the photo book.

The first aspect of the present invention is:
In an image processing apparatus that performs ordering on an image selected by a user from among a plurality of images,
Display means for displaying a list of a plurality of images on the display unit;
Accepting means for accepting an operation for a user to select an image from a list of a plurality of images displayed on the display unit;
A recording means for recording the order of the selected images in the order of selection when an image is selected by the user;
With
When the selected image whose order has already been recorded is selected again by the user, the recording means adds the selected image to the already recorded order and selects the selected image again. An image processing apparatus is characterized in that the order is recorded.

The second aspect of the present invention is:
In an image processing method for ordering images selected by a user from among a plurality of images,
A computer displaying a list of a plurality of images on a display unit;
A step of accepting an operation for a user to select an image from a list of a plurality of images displayed on the display unit;
A recording step in which when the computer selects an image, the computer records the order of the selected image in the order of selection;
Including
In the recording step, when a selected image whose order has already been recorded is selected again by the user, the selected image is added to the already recorded order and selected again. An image processing method is characterized in that the order is recorded.

  According to the present invention, it is possible to select the same image from the image list a plurality of times and arrange the same image at a plurality of locations in the photo book.

A block diagram for explaining a configuration of an image processing apparatus according to an embodiment Diagram showing the flow from selecting an image to placing it on the page when creating a book The figure which shows the screen of the image list of embodiment A flowchart showing a flow of single selection or deselection of an image by the user The figure which shows the image management information of embodiment The figure which shows the screen for demonstrating the image layout application of embodiment The flowchart which shows the flow which carries out multiple selection of the image of embodiment. The figure which shows the screen which has arrange | positioned the selected image of embodiment on each page of a book

DETAILED DESCRIPTION Exemplary embodiments for carrying out the present invention will be described in detail below with reference to the drawings.
The image processing apparatus (information processing apparatus) of the present embodiment is selected to display a list of a plurality of images on the display unit and arrange images selected by the user from the displayed list of the plurality of images in the order of selection. The image is ordered.
The configuration of the computer apparatus that constitutes the image processing apparatus 100 of the present embodiment will be described with reference to the block diagram of FIG. FIG. 1 is a block diagram for explaining a device configuration of a device that processes a program code for realizing the functions of the present embodiment. Here, the image processing apparatus according to the present embodiment may be realized by a single computer apparatus, or may be realized by distributing functions to a plurality of computer apparatuses as necessary. When configured by a plurality of computer devices, they may be connected by a communication line such as a LAN (Local Area Network) so that they can communicate with each other.

  In FIG. 1, the control unit 101 controls the entire image processing apparatus 100, and may be a CPU (Central Processing Unit), for example. A ROM (Read Only Memory) 102 records (stores) programs and parameters that do not need to be changed. A RAM (Random Access Memory) 103 temporarily stores programs and data supplied from an external device or the like. The external storage device 104 is a hard disk, a memory card, or the like that is fixedly installed in the image processing apparatus 100, and stores a program such as an OS (Operating System). The input interface 105 is connected to an input device such as a pointing device or a keyboard that receives user operations and inputs data. The BMU (Bit Move Unit) 106 transfers data between, for example, memories (for example, between a VRAM (Video RAM) 107 and another memory) or between the memory and each I / O device (for example, the network interface 109). Control. The VRAM 107 draws an image to be displayed on the display unit 111.

The image generated in the VRAM 107 is transmitted to the display unit 111 according to a predetermined rule, whereby the display unit 111 displays the image. The network interface 109 is connected to a network line 110 such as the Internet. The system bus 112 is 101 to 1
09 units are communicably connected.

Here, the external storage device 104 stores image layout application program software (hereinafter referred to as an image layout application) of the present embodiment, and stores an image file generated by the imaging device. Here, the image layout application is for assigning an electronic image to each page of a photo book.
In addition, the input interface 105 is not limited to the above configuration, and when the display unit 111 is a touch panel having a touch sensor, the input interface 105 may accept a user operation according to the output of the sensor.
The touch panel is an input device that is configured to be planar and overlapped with the display unit 111 so that coordinate information corresponding to the touched position is output.

  When the operation input unit includes a touch panel, the CPU 101 can detect the following operation state of the touch panel. (1) Touching the touch panel with a finger or a pen (hereinafter touch-down (this down operation corresponds to a press in the case of a pointing device)). (2) The touch panel is touched with a finger or a pen (hereinafter, touch-on). (3) The touch panel is moved while being touched with a finger or a pen (hereinafter referred to as a move). (4) The finger or pen that has been touching the touch panel is released (up operation, hereinafter touch up). (5) A state where nothing is touched on the touch panel (hereinafter, touch-off).

  In this embodiment, in particular, the touch-on is detected immediately after the touch-down is detected, the time when the touch-on is continuously detected is shorter than the predetermined time, and another touch is performed within a predetermined time before and after the touch-down is detected. The operation when no operation is detected is called “tap”. In addition, the time when the touch-on is continuously detected is longer than a predetermined time (a predetermined time elapses after the down operation), and other touch operations are detected within a predetermined time before and after the touch-down is detected. The operation when there is not is called “long tap”. The tap and long tap operations correspond to click and long click in the case of a pointing device.

  The CPU 101 is notified of these operations and the position coordinates where the finger or pen touches the touch panel, and the CPU 101 determines what operation has been performed on the touch panel based on the notified information. Regarding the move, the moving direction of the finger or pen moving on the touch panel can also be determined for each vertical component / horizontal component on the touch panel based on the change in position coordinates. Further, it is assumed that when a touch-up is performed on the touch panel through a move of a predetermined distance or more from the touchdown, a drop is performed via a drag (drag operation) (drag and drop). The touch panel may be any of various types of touch panels such as a resistive film type, a capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. .

  Here, in this embodiment, although the case where this invention is applied to a smart phone is demonstrated to an example, it is not limited to this. That is, the present invention may be applied to an imaging apparatus such as a digital camera. That is, the present invention can also be applied when a captured image recorded on a recording medium readable by a digital camera such as a memory card is reproduced and displayed on a display such as a rear liquid crystal device of the digital camera. Furthermore, the present invention can also be applied to devices such as PDAs, mobile phone terminals, portable image viewers, printer devices having a display, digital photo frames, music players, game machines, and electronic book readers. That is, the present invention can be applied to any device that can display content such as images, texts, and illustrations.

In the following, in this embodiment, when an image layout application is activated and a photo book is created in response to a user operation, a flow from selecting an image from a list of images to placing it on a page is shown in FIG. This will be described with reference to the flowchart of FIG. FIG. 2 is a flowchart for explaining a flow from selection of an image from a list of a plurality of images to arrangement on a page when creating a photo book in the image layout application of the present embodiment.
In the present embodiment, an example in which one image is arranged for one page including a cover will be described, but the present invention is not limited to this.

In response to a user operation, the image processing apparatus 100 according to the present embodiment activates an image layout application and performs photobook editing processing.
Hereinafter, the CPU 101 of the image processing apparatus 100 executes the following processing according to instructions of a program read from the ROM 102 and started. That is, the table (FIG. 5) in which the application-use book information of the RAM 103 is recorded and the image data of the image file are read, and the photobook editing process is executed. Here, FIG. 5 shows an example of a table for managing each piece of information related to image data in the present embodiment.

  In the flowchart of FIG. 2, in step S201, the CPU 101 reads the image information recorded in the image acquisition destination, creates the image management information table 500 shown in FIG. 5, and displays the image list screen 320 shown in FIG. To do. The image acquisition destination may be an image recording folder in the device or a storage on the Internet, and is not particularly limited in the present embodiment.

Here, the image management information table 500 shown in FIG. 5 and the image list screen 320 shown in FIG. 3 will be described.
In the image management information table 500 of FIG. 5, the image file path 502, the number of used images 503, the arrangement order 504, and the book ID 505 are recorded using the image ID 501 as a key.
The image file path 502 manages a file path in the device in the case of an in-device image, and a URL in the case of an image on the Internet.

The number of used images 503 indicates the number of selected images, and is “0” before selection by default, and is counted up to 1 or more according to the number of image selections.
The arrangement order 504 records the arrangement order when images are arranged in a photo book in steps to be described later.
A book ID 505 is an ID given when creating a photo book.

FIG. 3 shows an example of a screen for displaying an image list in an image folder and selecting an image to be used for a photo book in the image layout application of the present embodiment.
In this screen 320, a thumbnail image (hereinafter referred to as a thumbnail) 321, a field 322 for indicating the number of selected images, a button 325 for finishing the image selection and proceeding to the photobook editing screen, and returning to the previous screen. Button 326 is displayed.
In the case of a small screen such as a smartphone, the thumbnail 321 is displayed in a square shape in accordance with the short side regardless of the portrait or landscape orientation in order to increase the number of images that can be displayed on one screen.

When the thumbnail 321 is tapped, the image selection described in step S202 described later is performed.
A field 322 is a field for displaying the number of selected images, and a character string of the selected number is displayed.
When the button 325 is tapped, an image is arranged on the photo book described in step S207 described later.
When button 326 is tapped, the screen transitions to the screen before transitioning to this screen.

  FIG. 6A is a diagram illustrating an example of a screen and an image for performing image selection in the image layout application of the present embodiment. FIG. 6B is a diagram illustrating an example of a screen and an image for determining image selection and copying the image to the work area in the image layout application of the present embodiment.

Returning to the flowchart of FIG.
In step S202, the CPU 101 accepts image selection / cancellation on the screen shown in FIG. The user can select / cancel an image used for the photo book from the displayed image list. At this time, in this embodiment, “single selection”, “deselection”, and “multiple selection” of images used in the photobook can be performed. Each operation will be described below with reference to flowcharts. Here, “multiple selection”, which is a feature of the present embodiment, means that an operation of selecting a plurality of times for one image is performed.

[Single selection]
The user taps an unselected thumbnail (unselected image) and performs a selection operation for instructing selection of an image. The CPU 101 receives a screen tap event and selects an image. This flow will be described with reference to the flowchart of FIG. FIG. 4 is a flowchart for explaining a flow in which the user selects an image or cancels the selection described later in the present embodiment.

In step S401, the CPU 101 determines whether the image has already been selected. Whether or not it has been selected can be determined by looking at the value of the number of used images 503 in the image management information table 500 of FIG. If the value of the image usage number 503 is 0, the image has not been selected. In this case, the process proceeds to the next step S402.
In step S <b> 402, the CPU 101 refers to all the arrangement orders 504 in the image management information table 500 and acquires the maximum arrangement order max.
In step S <b> 403, the CPU 101 determines a value obtained by adding 1 to max (max + 1) as the arrangement order X of the selected images, and records the determination result in the record arrangement order 504 of the target image in the image management information table 500. Also, the image usage count 503 is counted up to 1.
In step S <b> 404, the CPU 101 displays an image list screen by superimposing a badge 601, which is a number (image) indicating the arrangement order of the arrangement order X, on the thumbnail.

[deselection]
The user taps the selected thumbnail 603 (second operation), and deselects the image. The CPU 101 receives the screen tap event and cancels the selection of the image. This flow will be described with reference to the flowchart of FIG.
Here, in this embodiment, a description will be given of an embodiment in which selection of all images is deselected when a plurality of images are selected. However, in the case of multiple selection, which order of images is to be deselected. A message or UI to be selected may be displayed, and an image in the order to be deselected may be selected.

In step S401, the CPU 101 determines whether the image has already been selected. Whether or not it has been selected can be determined by looking at the value of the image usage count 503 of the record of the target image in the image management information table 500 of FIG. If the value of the image usage number 503 is 1 or more, the image has been selected. In this case, the process proceeds to the next step S411.
When deselecting the target image, it is necessary to change the selection order of other images together with deselection, so that processing is performed.

In step S411, the CPU 101 assigns the number of images displayed in the image list to the variable Y. The number of images is acquired from the number of records in the image management information table 500. Further, the image usage number 503 of the target image is substituted into the variable Z. Further, Z is substituted into a variable (count variable) M.
In step S <b> 412, the CPU 101 assigns the order of the Mth image in the arrangement order 504 of the corresponding image to the variable X. When multiple orders are recorded on the corresponding image, it is necessary to adjust the order of other images each time one order is released, and the previous order of image release will not be affected. It is necessary to carry out the processing from the rear order. In the arrangement order 504, the order of images selected in ascending order is recorded.

In step S413, the CPU 101 assigns 1 to a variable (count variable) N.
In step S414, the CPU 101 acquires the arrangement order 504 of the Nth record in the image management information table 500 one by one from the back. If the order is not set, 0 is acquired. Then, it is determined whether or not the arrangement order 504 of the Nth record is larger than the value of the target arrangement order X. That is, it is determined whether the image is arranged behind the image to be canceled. At this time, if it is determined to be large (when arranged behind), the process proceeds to the subsequent step S415 to adjust the order, and if it is determined to be small (when arranged before), the order is adjusted. Skip to step S416.
When multiple images of the Nth record are selected, it is necessary to acquire the values of the respective arrangement orders 504 and determine one by one.

In step S415, the CPU 101 subtracts 1 from the value of the arrangement order 504 of the Nth image data. As a result, the arrangement order of the image data behind the image data to be canceled becomes one earlier (earlier), respectively.
In step S416, the CPU 101 adds 1 to the value of the variable N.
In step S417, the CPU 101 compares the values of the variable N and the variable Y. When the variable N is smaller than the variable Y (including the case where it is equal), the above steps S414 to S416 are repeated. When the variable N is larger than the variable Y, the process proceeds to the subsequent step S418, and the order adjustment to another image with respect to the variable X (deleted arrangement order) is ended.

In step S418, the CPU 101 subtracts 1 from the value of the variable M and sets the next arrangement order as a processing target.
In step S419, the CPU 101 determines whether the value of the variable M is greater than zero. When the value of the variable M is larger than 0, the above steps S412 to S418 are repeated for the next arrangement order. When the value of the variable M is 0 or less, the process proceeds to the subsequent step S420, and the order adjustment to other images with respect to the entire arrangement order of the target images is ended.
In step S420, since the order adjustment to the other images has been completed, the CPU 101 deletes the information of the arrangement order 504 for all the deletion target images and sets the image usage count 503 for all the deletion target images to zero.
In step S <b> 421, the CPU 101 updates the badge value of the image displayed on the screen by redrawing the image list screen because the arrangement order of the images behind the image to be released has been updated in the above processing. . In addition, the badge of the image to be canceled is not displayed.

[Multiple selection]
The user long taps the selected thumbnail (first operation), and performs multiple selection of images. The CPU 101 receives a long tap event on the screen and performs multiple selection of images. This flow will be described with reference to the flowchart of FIG. FIG. 7 is a flowchart for explaining the flow of multiple selection of images by tapping a thumbnail that has been selected by the user in the present embodiment.
The present embodiment is characterized in that means for utilizing a long tap event is provided as means for distinguishing user operations of multiple selection and selection cancellation. However, the means for distinguishing the user operation of multiple selection and selection cancellation is not limited to this. For example, a means for displaying a message when a selected thumbnail is tapped and selecting which one is desired, or a means for distinguishing by simultaneously pressing buttons provided by the terminal can be considered. Here, as a means of using a long tap event, when a selected thumbnail is long-tapped, the image is deselected, and when a selected thumbnail is tapped, multiple images are selected. There may be. In the single selection described above, the selection operation for the user to select an image may be any operation that uses at least one of a tap event and a long tap event.

  In step S701, the CPU 101 determines whether the image has already been selected. Whether or not it has been selected can be determined by looking at the value of the number of used images 503 in the image management information table 500 of FIG. If the value of the image usage number 503 is 1 or more, the image has been selected. In this case, the process proceeds to the next step S702. If the image has not been selected, it is regarded as a single selection, and the single selection process after step S402 in FIG.

In step S <b> 702, the CPU 101 refers to all the arrangement orders 504 in the image management information table 500 and acquires the maximum arrangement order max.
In step S <b> 703, the CPU 101 determines a value obtained by adding 1 to max as the arrangement order X when the corresponding image (selected image) is selected again.
In step S <b> 704, the CPU 101 copies the thumbnail of the corresponding image in the arrangement order X as indicated by 602 in FIG. 6A, and superimposes the badge indicating the next arrangement order X on the copied thumbnail (copy image). At this time, the copied thumbnail is further displayed with a slight shift from the display position of the original thumbnail (selected image). Thereby, it can be clearly shown to the user that the multiple selection process has been started.

In step S705, the CPU 101 determines whether the touch-up position of the long tap is a position overlapping the original thumbnail. If the position is the overlapping position, the CPU 101 proceeds to step S706. When the touch-up position of the long tap is a position that does not overlap the original thumbnail, the process proceeds to step S708.
In step S <b> 706, the CPU 101 confirms the user operation as multiple selection, and adds the arrangement order X to the rear of the arrangement of the arrangement order 504 of the corresponding image and records it. Also, the image usage count 503 is counted up.

In step S <b> 707, the CPU 101 hides the thumbnail 602 displayed in an overlapping manner, creates an arrangement order badge with the number recorded in the arrangement order 504, and displays the thumbnail in an overlapping manner. A plurality of orders are recorded in the arrangement order 504, and a plurality of arrangement order badges are created and displayed side by side. Further, a shadow indicating that multiple selections have been made is displayed over the thumbnail (see thumbnail 611 in FIG. 6B).
In step S <b> 708, the CPU 101 cancels the multiple selection as a user operation, hides the thumbnail 602 displayed in an overlapping manner, and returns to the original display state.
The above is the specific operation content of “select”, “cancel”, and “multiple selection” in step S202.

The remaining flowchart in FIG. 2 will be described. In step S203, the CPU 101 determines image selection, copies the image to the work area, and places the image in the photobook.
When the user taps a button 613 for creating a photo book using the image selected in step S202 on the screen of FIG. 6B, the CPU 101 uses the selected image in the image management information table 500 as the image file path. Copy from 502 to the work environment in order. At this time, the number of used images 503 is 1 or more.
For example, as in the thumbnail 611 shown in FIG. 6B, an image in which one image is multiple-selected in the fifth and seventh on the image selection screen is for the fifth page and the seventh page. It will be copied twice.
During image copying, an indicator 612 may be displayed indicating the copy work status.

In step S204, the CPU 101 displays an editing screen for editing the photobook as shown in FIG. 8 in order to assign the image selected by the user in step S202 to each page of the photobook in the designated order. To do. FIG. 8 shows an example of a screen in which images selected by the image layout application are arranged on each page of a photobook in the present embodiment.
On the photobook editing screen, continuous pages are arranged over a plurality of screens. For example, when one image is multiple-selected on the image selection screen fifth and seventh like the thumbnail 611 shown in FIG. 6B, the image is displayed on the photobook editing screen a plurality of times. Be placed. That is, the fifth and seventh multiple-selected images are arranged on the fifth page 801 and the seventh page 802, respectively, in the photobook editing screen of FIG.

As described above, according to the present embodiment, it is possible to select the same image from the image list a plurality of times and arrange the same image at a plurality of locations in the photo book.
Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. Moreover, you may combine suitably a part of above-mentioned embodiment.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  DESCRIPTION OF SYMBOLS 100 ... Image processing apparatus, 101 ... CPU, 103 ... RAM, 105 ... Input interface, 111 ... Display part

Claims (11)

In an image processing apparatus that performs ordering on an image selected by a user from among a plurality of images,
Display means for displaying a list of a plurality of images on the display unit;
Accepting means for accepting an operation for a user to select an image from a list of a plurality of images displayed on the display unit;
A recording means for recording the order of the selected images in the order of selection when an image is selected by the user;
With
When the selected image whose order has already been recorded is selected again by the user, the recording means adds the selected image to the already recorded order and selects the selected image again. An image processing apparatus that records an order. The accepting means is
When the first operation is performed on the selected image, the first operation is accepted as an operation for selecting the selected image again,
2. The second operation is received as an operation for canceling selection of the selected image when a second operation different from the first operation is performed on the selected image. An image processing apparatus according to 1. The image processing apparatus according to claim 2, wherein the first operation or the second operation is the same as an operation for selecting an unselected image whose order is not recorded. The first operation is an operation of performing an up operation to finish touching or pressing the image after a predetermined time has elapsed after the down operation of touching or pressing the image,
The image processing apparatus according to claim 2, wherein the second operation is an operation for performing the up operation before the predetermined time has elapsed after the down operation. The first operation is a long tap or a long click,
The image processing apparatus according to claim 4, wherein the second operation is a tap or a click.   When the predetermined time has elapsed after the down operation is performed on the selected image, the accepting unit is configured to indicate that the operation of selecting the selected image again can be accepted. The image processing apparatus according to claim 4, wherein a copy image of the selected image is displayed on the display unit. The accepting means is
A drag operation for moving the display position of the copy image can be accepted,
When an operation for performing the up operation is performed in a state where the copy image is dragged to a position that does not overlap the selected image, the operation is accepted as an operation for canceling the operation for selecting the selected image again. The image processing apparatus according to claim 6. The image processing apparatus according to claim 1, wherein the display unit displays, together with the selected image, a number indicating an order recorded for the selected image. It further has an arrangement means for arranging a plurality of selected images in the order in which they are recorded,
9. The apparatus according to claim 1, wherein the arrangement unit arranges the same selected images a plurality of times in the number of the recorded orders for the selected images in which a plurality of orders are recorded. 10. The image processing apparatus described. In an image processing method for ordering images selected by a user from among a plurality of images,
A computer displaying a list of a plurality of images on a display unit;
A step of accepting an operation for a user to select an image from a list of a plurality of images displayed on the display unit;
A recording step in which when the computer selects an image, the computer records the order of the selected image in the order of selection;
Including
In the recording step, when a selected image whose order has already been recorded is selected again by the user, the selected image is added to the already recorded order and selected again. An image processing method characterized by recording an order.   A program for causing a computer to execute each step of the image processing method according to claim 10.

Images