JP2019117318A - Operation display device and program - Google Patents

Abstract

To facilitate the process of changing layout for placing an image and background to be merged with the image.SOLUTION: An operation display device 1 comprises a storage unit configured to store data pertaining to a plurality of layouts and image data, and a display unit configured to display a preview screen with an image placed according to one of the plurality of layouts. The operation display device 1 also comprises a sensor for detecting operations performed on the operation display device 1 and a modification unit for changing the layout when predetermined operations are detected by the sensor. The display unit then displays a preview screen with the image placed according to a new layout.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an operation display device and a program.

  There is provided a service for uploading an image captured by a portable device such as a smartphone or a tablet terminal onto a network and ordering a photo book. When ordering a photo book, the user performs layout selection and background selection. In the layout selection, the number of images per page and the arrangement position of the images are determined. In background selection, the color, pattern, etc. of the background are selected.

  After selecting the layout and background, the user selects a favorite image from among the many images stored on the portable device. When an image is selected, the image is automatically arranged and a preview screen is displayed.

  Conventionally, when the user who confirmed the preview screen changes the layout or background, for example, the menu screen is called, the edit key is pressed, the layout change (or background change) is selected from the edit screen, and another layout is selected from the layout candidate screen. Choose When changing to another layout after confirmation on the preview screen, the display returns to the layout candidate screen, selects a layout, and confirms again on the preview screen.

  As described above, conventionally, in order to change the layout, it is necessary to switch between the layout candidate screen and the preview screen many times, which takes time and effort. Similarly, in background change, the background candidate screen and the preview screen are repeatedly switched.

Japanese Patent Application Publication No. 2006-511471 Patent No. 4762827 specification

  An object of the present invention is to provide an operation display device and a program capable of easily changing the layout and the background.

  The operation display apparatus according to the present invention includes a storage unit storing data relating to a plurality of layouts and image data, and a display unit displaying a preview screen on which an image is arranged according to any of the plurality of layouts. The operation display device includes: a sensor that detects an operation of the operation display device; and a change unit that changes a layout when the sensor detects a predetermined operation, and the display unit is changed The preview screen on which the image is arranged according to the later layout is displayed.

  In one aspect of the present invention, the layout is a layout of a photo book having a plurality of pages, and when the swing width of the operation display device detected by the sensor is equal to or less than a predetermined value, the change unit displays the display unit. When the layout of the displayed page is changed and the swing width of the operation display detected by the sensor is larger than a predetermined value, the change unit changes the layout of all pages.

  The operation display apparatus according to the present invention includes an operation unit including a storage unit for storing data on a plurality of backgrounds and image data, and a display unit for displaying a preview screen in which an image is synthesized on any of the plurality of backgrounds A display device, comprising: a sensor that detects an operation of the operation display device; and a change unit that changes a background when the sensor detects a predetermined operation, and the display unit is configured to It displays a preview screen in which an image is synthesized on the background.

  In one aspect of the present invention, tag information is added to each background, and the change unit calculates a degree of association between the shooting location of the image, shooting date or color information, and tag information of each background, Every time the sensor detects the predetermined motion, the background is selected and changed in descending order of relevance.

  In one aspect of the present invention, the changing unit causes the display unit to display a list screen of selected backgrounds when the number of background changes has reached a predetermined value.

  A program according to the present invention is a program for controlling a computer including a display unit and a sensor for detecting an operation, and displaying on the display unit a preview screen on which an image is arranged according to a first layout; When detecting a predetermined operation, arranging an image according to a second layout different from the first layout, and displaying on the display unit a preview screen on which an image is arranged according to the second layout And the computer.

  The program according to the present invention is a program for controlling a computer provided with a display unit and a sensor for detecting an operation, wherein the step of displaying on the display unit a preview screen obtained by combining an image on a first background; In the case where motion is detected, the step of combining an image on a second background different from the first background, and displaying on the display unit a preview screen in which the image is combined on the second background are displayed on the computer It is made to run.

  According to the present invention, the layout and background can be easily changed.

(A) (c) (d) is a figure showing an example of change of a preview screen, (b) is a figure showing signs that an operation display device is shaken. (A)-(c) is a figure showing an example of change of a preview screen. It is a block diagram which shows schematic structure of the operation display apparatus which concerns on embodiment. It is a functional block diagram realized by running a photobook creation program. It is a flowchart explaining the layout change method which concerns on embodiment. It is a functional block diagram realized by running a photobook creation program. It is a flow chart explaining the background change method concerning an embodiment. (A)-(c) is a figure which shows the example of a layout / background change screen.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1A shows a preview screen when ordering a photo book with the operation display device 1 according to the embodiment of the present invention. The operation display device 1 is, for example, a smart phone or a tablet terminal, and displays various screens by the touch panel T, and receives various operations from the user.

  In order to order a photo book, the user first selects the size, number of pages, layout, background, etc. of the photo book. In the layout selection, the number of images to be arranged per page, the assigned position of the images, etc. are designated. Background selection designates the color, pattern, etc. of the background. Thereafter, the user selects a favorite image from among the images stored in the operation display device 1. The operation display device 1 arranges the selected image according to the layout.

  After arranging the image, a preview screen is displayed. For example, a preview screen in page units as shown in FIG. 1A is displayed. FIG. 1A shows an example of a layout L1 in which one image is arranged on one page and the image area R is located at the center of the page.

  When changing the layout, as shown in FIG. 1B, the user shakes the operation display device 1. For example, the user holds the operation display device 1 and shakes (shakes) the operation display device 1 up and down so that the touch panel T faces sideways. For example, when the operation display device 1 is squeezed little by little and the number of sway reaches a predetermined value, the layout changes as shown in FIG. 1 (c). FIG. 1C shows an example of a layout L2 in which the image area R is positioned closer to the left side of the page.

  When the user shakes the operation display device 1 again, as shown in FIG. 1 (d), the layout is further changed. FIG. 1D shows an example of a layout L3 in which the image area R is positioned closer to the lower side of the page.

  FIGS. 2A to 2C show examples of layout change in the case where six images are arranged on one page. When the user shakes the operation display device 1, the layout L11 shown in FIG. 2A is changed to the layout L12 shown in FIG. 2B. When the user further swings the operation display device 1, the layout L12 shown in FIG. 2B is changed to the layout L13 shown in FIG. 2C.

  The user shakes the operation display device 1 and confirms the layout displayed on the touch panel T. When the back button B is pressed, the layout before the change is returned. The layout change process is ended by pressing the confirmation button 7 when the layout becomes the preferred one.

  When changing the layout, as in the conventional method, repeating the operation of calling the layout candidate screen, selecting the layout, and confirming on the preview screen takes time and effort. On the other hand, in the present embodiment, the layout is sequentially changed only by swinging the operation display device 1. Therefore, the layout can be easily changed.

  After the layout is determined, the operation display device 1 images all the pages of the photo book and transmits the image data to the order reception server (not shown). The order receiving server transfers the image data to the factory. Print processing is performed at the factory to produce a photo book.

  The operation display 1 may change the layout of only the currently displayed page when the swing width (moving distance) is small, and may change the layout of all pages collectively when the swing width is large.

  In the example shown in FIG. 1 and FIG. 2, the number of images per page is the same in the layout change, but after multiple layout changes, the number of images per page may be changed to a different layout. Further, when the swing width is large, the number of images per page may be changed to a different layout.

  FIG. 3 is a block diagram showing a schematic configuration of the operation display device 1. The operation display device 1 has a CPU (Central Processing Unit) 10 as a control unit that comprehensively controls the operation of the operation display device 1. The CPU 10 includes a read only memory (ROM) 11, a random access memory (RAM) 12, a non-volatile memory 13, an operation unit 14, a display unit 15, an imaging unit 16, a communication unit 17, a sensor 18, etc. It is connected.

  The CPU 10 is based on an OS (Operating System) program, and executes middleware, application programs and the like on the OS. Various programs are stored in the ROM 11 and each function of the operation display device 1 is realized by the CPU 10 executing various processes in accordance with these programs.

  The RAM 12 is used as a work memory for temporarily storing data when the CPU 10 executes a process based on a program.

  The non-volatile memory 13 is used for storing image data, layout data of a plurality of types, background data, and the like. Priorities are defined for multiple types of layouts. The nonvolatile memory 13 is, for example, a flash memory.

  The operation unit 14 receives various operations from the user. The display unit 15 displays various operation screens. In this embodiment, the touch panel T has the functions of the operation unit 14 and the display unit 15.

  The photographing unit 16 is, for example, a digital camera. Image data captured by the imaging unit 16 is stored in the non-volatile memory 13.

  The communication unit 17 communicates with the order receiving server via the Internet or the like.

  The sensor 18 includes a motion sensor that detects an operation (vibration, acceleration, rotation, etc.) of the operation display device 1. The sensor 18 may further include another sensor such as a gravity sensor that detects the direction of action of gravity.

  A photobook preparation program is stored in the ROM 11 (or the non-volatile memory 13), and the CPU 10 executes the photobook preparation program to select the selection unit 20, the image placement unit 21, and the display processing as shown in FIG. The unit 22, the motion determination unit 23, the layout change unit 24, and the photobook data transmission unit 25 are realized.

  The selection unit 20 receives the selection of the product size, the number of pages, the layout, the background, etc. of the photo book.

  The image arrangement unit 21 displays the thumbnails of the image data stored in the non-volatile memory 13 on the touch panel T, and receives the selection of the image to be used for the photo book. The image arrangement unit 21 automatically arranges the selected image according to the layout.

  The display processing unit 22 arranges the images according to the layout, creates a preview screen combined with the background, and displays the preview screen on the touch panel T.

  The motion determination unit 23 uses the sensor 18 to determine whether the operation display device 1 has performed a predetermined operation. For example, the motion determination unit 23 determines whether the operation display device 1 is shaken a predetermined number of times. In addition, the motion determination unit 23 determines whether the swing width (moving distance) of the operation display device 1 is equal to or less than a predetermined value.

  The layout changing unit 24 changes the layout when the operation display device 1 is swung a predetermined number of times. The layout changing unit 24 changes the layout in order based on the layout priority. The image arrangement unit 21 rearranges the images in the changed layout. The display processing unit 22 displays a preview screen after image rearrangement.

  When the swing width of the operation display device 1 is equal to or less than the predetermined value, the layout changing unit 24 changes the layout of only the target page being displayed on the touch panel T. If the swing width of the operation display 1 is larger than the predetermined value, the layout changing unit 24 changes the layout of all pages.

  After the layout is determined, the photobook data transmission unit 25 images all pages of the photobook, and transmits the image data to the order reception server using the communication unit 17.

  Next, a method of changing the layout upon ordering a photo book will be described with reference to the flowchart shown in FIG.

  The user selects a photo book product and determines the size, the number of pages, and the like. In addition, the user selects a layout, a background, and the like (step S1).

  The user selects an image to be used for the photo book from the image folder in the operation display device 1 (step S2). The image placement unit 21 places the selected image according to the layout (step S3). An image is arranged, and a preview screen combined with the background is displayed on the touch panel T.

  The user who has confirmed the preview screen shakes the operation display 1 when he desires to change the layout. If the motion determination unit 23 detects that the operation display device 1 is swung a predetermined number of times (step S4_Yes) and the swing width is equal to or less than a predetermined value (step S5_Yes), the layout changing unit 24 displays the current on the touch panel T The layout of the middle page is changed (step S6).

  If the swing width is larger than the predetermined value (step S5_No), the layout changing unit 24 changes the layout of all pages (step S7).

  The preview screen after layout change is displayed on the touch panel T. When the user approves the changed layout, the user presses the confirmation button 7 (step S8_Yes).

  If another layout is desired, the user shakes the operation display 1 again. The layout changing unit 24 changes to another layout. The layout changing unit 24 changes the layout in order based on the layout priority.

  According to the present embodiment, the layout is changed simply by swinging the operation display device 1. The layout can be easily changed as compared with the conventional method in which the calling of the layout candidate screen and the confirmation of the preview screen are alternately repeated.

  In the above embodiment, an example of changing the layout has been described, but the background may be changed. In this case, as shown in FIG. 6, the selection unit 20, the image arrangement unit 21, the display processing unit 22, the motion determination unit 23, the background change unit 26, and the photobook data transmission unit are executed by executing the photobook preparation program. 25 is realized.

  Further, tag information is attached to each of the plurality of types of background data stored in the non-volatile memory 13. Tag information is a season, a color, a place, etc.

  The background changing method will be described along the flowchart shown in FIG. Steps S11 to S13 are the same as steps S1 to S3 in FIG.

  The user who has confirmed the preview screen shakes the operation display 1 when he / she desires to change the background. If the motion determination unit 23 detects that the operation display 1 has been shaken a predetermined number of times (step S14_Yes), and the background change frequency is less than or equal to a predetermined value (step S15_Yes), the background change unit 26 is suitable for the image. Choose a background.

  For example, when the image conforms to Exif (Exchangeable image file format (registered trademark)), the background changing unit 26 matches the GPS position information and the shooting date and time included in the image with the tag information of the background data, Extract highly relevant background data. For example, when the GPS position information of the image indicates Okinawa, background data having tag information such as "Okinawa", "sea", "resort" and the like is extracted. When the photographing time of the image is summer, background data having tag information of "summer" is extracted. Conversely, background data having tag information "winter" is not extracted.

  The background data may be selected by comparing the photo book title input by the user with the tag information. For example, when the title "New Year Trip" is input, background data having tag information such as "Winter" and "New Year" is extracted.

  Color information of an image or face information of a person appearing in the image may be used. For example, when a woman is shown in an image, background data of a cute design is extracted.

  As described above, the background changing unit 26 compares the information extracted from the image and title used in the photo book with the tag information of the background data, extracts the background data having a high degree of association, and changes the background. (Step S16).

  The preview screen with the background changed is displayed on the touch panel T (step S17). When the user approves the changed background, the user presses the confirmation button (step S20_Yes). The background can be easily changed simply by swinging the operation display device 1.

  When changing to another background, the user shakes the operation display 1 again. The background changing unit 26 changes to another background. The background changing unit 24 compares the information extracted from the image or title used in the photo book with the tag information of the background data, and changes the background in descending order of the degree of association.

  Repeated background changes can result in a thin background (not relevant to the image) associated with the image. Therefore, when the number of background changes exceeds the predetermined value (step S15_No), a list of the backgrounds extracted by the background changing unit 26 is displayed (step S18). The user selects a background from the background candidate list (step S19).

  As shown in FIG. 8B, the layout may be changed or the background may be changed from the drop-down list (pull-down menu) 5. In the screen shown in FIG. 8A, the layout is changed when the operation display device 1 is shaken. In the screen shown in FIG. 8C, when the operation display device 1 is shaken, the background is changed.

  The motion of the operation display device 1 detected in the above embodiment may not be shaking, but may be another movement such as rotation.

  Instead of a photo book, it may be possible to order other prints such as calendars, posters and postcards.

  The method according to the present embodiment is not limited to the image editing process at the time of ordering a printed material, and also in the case where the background is combined with the image stored in the operation display device 1 or the image is arranged according to the layout. Is applicable.

  The present invention is not limited to the above embodiment as it is, and at the implementation stage, the constituent elements can be modified and embodied without departing from the scope of the invention. In addition, various inventions can be formed by appropriate combinations of a plurality of constituent elements disclosed in the above embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components in different embodiments may be combined as appropriate.

1 Operation display unit 10 CPU
11 ROM
12 RAM
13 Non-volatile memory 14 Operation unit 15 Display unit 16 Imaging unit 17 Communication unit 18 Sensor

Claims (7)

A storage unit for storing data relating to a plurality of layouts and image data;
A display unit that displays a preview screen in which an image is arranged according to any of the plurality of layouts;
An operation display device comprising
A sensor that detects the operation of the operation display device;
A change unit that changes a layout when the sensor detects a predetermined operation;
Have
The said display part displays the preview screen by which the image was arrange | positioned according to the layout after a change, The operation display apparatus characterized by the above-mentioned. The layout is a layout of a photo book having a plurality of pages,
When the swing width of the operation display device detected by the sensor is equal to or less than a predetermined value, the change unit changes the layout of the page displayed on the display unit,
The operation display device according to claim 1, wherein the change unit changes the layout of all pages when the swing width of the operation display device detected by the sensor is larger than a predetermined value. A storage unit that stores data related to a plurality of backgrounds and image data;
A display unit for displaying a preview screen in which an image is synthesized on any of the plurality of backgrounds;
An operation display device comprising
A sensor that detects the operation of the operation display device;
A change unit that changes the background when the sensor detects a predetermined operation;
Have
The operation display apparatus, wherein the display unit displays a preview screen in which an image is synthesized on a background after change. Tag information is given to each background,
The changing unit calculates the degree of association between the photographing location of the image, the photographing date or time, or color information, and the tag information of each background, and every time the sensor detects the predetermined operation, the background in descending order of the degree of association. The operation display device according to claim 3, wherein the operation display device is selected and changed.   5. The operation display apparatus according to claim 4, wherein the change unit causes the display unit to display a list screen of selected backgrounds when the number of background changes reaches a predetermined value. A program for controlling a computer comprising a display unit and a sensor for detecting an operation, comprising:
Displaying on the display unit a preview screen on which images are arranged according to the first layout;
Placing an image according to a second layout different from the first layout if the sensor detects a predetermined motion;
Displaying on the display unit a preview screen on which an image is arranged according to the second layout;
A program that causes the computer to execute the program. A program for controlling a computer comprising a display unit and a sensor for detecting an operation, comprising:
Displaying on the display unit a preview screen in which an image is combined with a first background;
Combining the image on a second background different from the first background when the sensor detects a predetermined motion;
Displaying on the display unit a preview screen in which an image is combined with the second background;
A program that causes the computer to execute the program.

Images