JP6153990B2 - Image display control program, image display control device, and image display control method - Google Patents

Description

  The present invention relates to an image display control program, an image display control device, and an image display control method, and more particularly, to an image display control program, an image display control device, and an image display control method that accept operation instructions for displayed images.

  In recent years, with the development of mobile phone terminal devices, multifunctional mobile phone terminal devices called smartphones having a display larger in size than conventional mobile phone terminal devices have been developed. Many smartphones do not employ a hardware keyboard that is used in conventional mobile phone terminal devices in order to keep the size of the display as large as possible while keeping the size of the housing small. In this type of smartphone, only a small number of operation buttons such as an on / off button are used as hardware operation units, and the display is also used as a touch panel so that the display can be used as a main operation unit. ing.

  However, in this configuration, when an operation instruction is input, it is not possible to perform a two-stage operation of moving and clicking the cursor as in an apparatus using a pointing device such as a mouse. Therefore, there is a problem that a process for determining which operation is performed when the operation is performed on the display in the smartphone is required. This problem is not limited to smartphones, but may be a problem that can occur in any device having a display unit that displays an image.

  As a technique that can be applied to solve this problem, Patent Document 1 discloses a terminal device that realizes a favorable predetermined operation (link selection operation) with a simple touch operation while eliminating the conflict of the touch operation. Has been. The terminal device includes a touch panel that detects the coordinates of the touch position, and a display unit in which the touch areas of the touch panel overlap at least in some display areas. Further, the terminal device generates display information to be displayed on the display unit from the document data to which the link is set, sets a predetermined range including the touched position as the link effective region, and links only within the link effective region. Allow selection. Furthermore, this terminal device moves to the link destination of the link that was in the touch state when the touch is released in the link effective area, and the link is moved when the touch moves from the link effective area to the outside while maintaining the touch state. Predetermined processing other than selection is executed.

WO2009 / 044770

  By the way, in the conventional image display apparatus, generally, an operation for selecting any one of the menu items is performed by the user following the operation for displaying the menu items indicating the various processes in order to execute the various processes on the displayed image. Done. In the conventional image display apparatus, the user also performs a drag operation on the displayed image.

  Therefore, there is a demand for a technique that allows the image display device to identify whether a drag operation or an operation for selecting a menu item is performed with a simple operation when a displayed image is selected. ing.

  However, in the technique disclosed in Patent Document 1, when the touch position moves from the link effective area to the outside thereof, an operation other than link selection (corresponding to selection of a menu item) is executed. Therefore, in order to determine that a drag operation is about to be performed, the move operation needs to be continued until the touch position on the touch panel exceeds the link effective area. Therefore, depending on the shape of the link effective area, the movement operation may take time and effort, and it is not always easy to identify whether a drag operation or an operation to select a menu item is performed. I couldn't.

  The present invention has been made in view of the above problems, and image display control that can identify whether a drag operation or a menu item selection operation is to be performed with a simple operation. It is an object to provide a program, an image display control device, and an image display control method.

In order to achieve the above object, an image display control program according to the present invention includes a plurality of predetermined menu item selection units when an image displayed in a display area for displaying an image on a computer is designated. A menu screen is provided in a specified display area in a state where an empty area is provided in a part of a peripheral area adjacent to a specified image, and both the empty area and the menu item selection unit are adjacent to the image. When the menu item selection unit is specified while the menu screen is displayed and the display control unit that performs control for displaying each displayed image , the process corresponding to the specified menu item selection unit is specified. If the position where the image is designated moves in the direction in which the empty area is located while the execution means for executing the image and the menu screen are displayed, the designated image is moved. Moving means for, to function as a.

  According to the image display device of the present invention, it is possible to identify whether a drag operation or an operation for selecting a menu item is performed with a simple operation.

  In the image display control program according to the present invention, the display control unit may perform control to display the menu item selection units apart from each other. Thereby, it is possible to prevent the display content from being hidden by the display of the menu screen.

  Further, in the image display control program according to the present invention, the display control means may perform control to display the menu item selection units arranged via an empty area. Thereby, it is possible to prevent the display content from being hidden by the display of the menu screen.

In the image display control program according to the present invention, the display control means arranges the images in a matrix and displays them in the display area, and the menu item selection unit is positioned in the row direction and the column direction of the image. Control may be performed to display an empty area in a part of the peripheral area. This makes it possible to identify whether a drag operation or a menu item selection operation is to be performed with a simple operation.

  In the image display control program according to the present invention, the display control means may perform control to display the menu item selection unit in a size smaller than the image. Thereby, it is possible to prevent the display content from being hidden by the display of the menu screen.

In the image display control program according to the present invention, the display control means may perform control to display the menu item selection unit at any one of the four corners of the image. Thereby, it is possible to prevent the display content from being hidden by the display of the menu screen.
Further, in the image display control program according to the present invention, when the moving unit moves in the direction in which the empty area is located in a state where the menu screen is displayed, The display of the menu item selection unit may be stopped.

On the other hand, in order to achieve the above object, the image display control device according to the present invention includes a plurality of predetermined menu item selection units when an image displayed in a display area for displaying an image is designated. A display area specified in a state where an empty area is provided in a part of the peripheral area adjacent to the specified image, and both the empty area and the menu item selection unit are adjacent to the image. If the menu item selection part is specified while the menu screen is displayed and the display control means for controlling each image displayed on the screen, the process corresponding to the specified menu item selection part is specified. When the position where the image is designated moves in the direction in which the empty area is located with the execution means to be executed on the designated image and the menu screen displayed, the move to move the designated image is performed. And means, the.

  Therefore, the image display control device according to the present invention can operate in the same manner as the image display control program according to the present invention. Therefore, as with the image display control program according to the present invention, an attempt is made to perform a drag operation. It is possible to identify whether the user is going to perform an operation of selecting a menu item or a menu item.

In order to achieve the above object, an image display control method according to the present invention includes a menu including a plurality of predetermined menu item selection sections when an image displayed in a display area for displaying an image is designated. the screen is provided with a free space in a part of the peripheral area adjacent to the designated image; while being adjacent both the free area and the menu item selection section in the image, which is designated, the display region A display control step for performing display control for each displayed image; and when the menu item selection unit is specified in a state where the menu screen is displayed, processing corresponding to the specified menu item selection unit When the position where the image is designated moves in the direction in which the empty area is located while the menu screen is displayed and the execution step for executing the designated image, the designated step is executed. A moving step of moving images, is carried out.

  Therefore, the image display control method according to the present invention can operate in the same manner as the image display control program according to the present invention. Therefore, as with the image display control program according to the present invention, an attempt is made to perform a drag operation. It is possible to identify whether the user is going to perform an operation of selecting a menu item or a menu item.

  According to the present invention, it is possible to identify whether a drag operation or a menu item selection operation can be performed with a simple operation.

It is a perspective view which shows the external appearance of the smart phone which concerns on embodiment. It is a block diagram which shows the structure of the smart phone which concerns on embodiment. It is a flowchart which shows the flow of a process of the display control processing program which concerns on embodiment. It is a block diagram which shows the structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is a block diagram which shows the structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is a block diagram which shows the structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is explanatory drawing with which it uses for description of the process according to drag operation which concerns on embodiment. It is a block diagram which shows the other structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is a block diagram which shows the other structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is a block diagram which shows an example of the menu screen which concerns on embodiment. It is a block diagram which shows the other structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is a block diagram which shows the other structural example of the screen displayed by execution of the display control processing program which concerns on embodiment. It is a block diagram which shows the other structural example of the screen displayed by execution of the display control processing program which concerns on embodiment.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings. In the present embodiment, the case where the present invention is applied to a smartphone will be described as an example. However, the present invention is not limited to this, and the present invention is not limited to this, but may be a mobile phone, a PDA (Personal Digital Assistants), a portable game machine, or the like. Needless to say, the present invention is applicable to other apparatuses having a display screen.

  FIG. 1 is a perspective view showing an appearance of the smartphone 10 according to the present embodiment. A smartphone 10 shown in FIG. 1 has a flat housing 12, and a display input in which a display panel 14 </ b> A as a display unit and an operation panel 14 </ b> B as an input unit are integrated on one surface of the housing 12. Part 14 is provided. The housing 12 includes a speaker 16, a microphone 18, an operation unit 20, and a camera unit 22. In addition, the structure of the housing | casing 12 is not limited to this, For example, the structure which has a folding structure and a slide mechanism can also be employ | adopted.

  FIG. 2 is a block diagram illustrating a configuration of the smartphone 10 according to the present embodiment. As shown in FIG. 2, the main components of the smartphone 10 include a wireless communication unit 24, a display input unit 14, a call unit 26, an operation unit 20, a camera unit 22, a storage unit 28, and an external input / output. Part 30. In addition, the smartphone 10 includes a GPS (Global Positioning System) receiving unit 32, a motion sensor unit 34, a power supply unit 36, and a main control unit 38 as main components. Further, as a main function of the smartphone 10, a wireless communication function for performing mobile wireless communication via the base station device and the mobile communication network is provided.

  The wireless communication unit 24 performs wireless communication with a base station device accommodated in the mobile communication network in accordance with an instruction from the main control unit 38. Using such wireless communication, transmission / reception of various file data such as audio data and image data, e-mail data, and reception of Web data, streaming data, and the like are performed.

  Under the control of the main control unit 38, the display input unit 14 displays images (still images and moving images), character information, etc., visually transmits information to the user, and detects user operations on the displayed information. This is a so-called touch panel display. The display input unit 14 includes a display panel 14A and an operation panel 14B.

  The display panel 14A uses an LCD (Liquid Crystal Display), an OELD (Organic Electro-Luminescence Display), or the like as a display device. The operation panel 14B is a device that is placed so that an image displayed on the display surface of the display panel 14A is visible, and detects one or a plurality of coordinates operated by a user's fingertip or a stylus. When such a device is operated by a user's fingertip or a stylus, a detection signal generated due to the operation is output to the main control unit 38. Next, the main control unit 38 detects an operation position (coordinates) on the display panel 14A based on the received detection signal.

  Although the size of the display area and the size of the display panel 14A may be completely matched, it is not always necessary to match the two. Further, examples of the position detection method employed in the operation panel 14B include a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method, and any method is adopted. You can also.

  The call unit 26 includes a speaker 16 and a microphone 18, converts user's voice input through the microphone 18 into voice data that can be processed by the main control unit 38, and outputs the voice data to the main control unit 38. 24 or the audio data received by the external input / output unit 30 is decoded and output from the speaker 16. Further, as shown in FIG. 1, for example, the speaker 16 can be mounted on the same surface as the surface on which the display input unit 14 is provided, and the microphone 18 can be mounted on the side surface of the housing 12.

  The operation unit 20 is a hardware key using a key switch or the like, and receives an instruction from the user. For example, as illustrated in FIG. 1, the operation unit 20 is mounted on the side surface of the housing 12 of the smartphone 10 and is turned on when pressed with a finger or the like, and turned off when the finger is released with a restoring force such as a spring. It is a push button type switch.

  The storage unit 28 includes a control program and control data of the main control unit 38, application software, address data that associates the name and telephone number of the communication partner, transmitted and received e-mail data, Web data downloaded by Web browsing, The downloaded content data is stored, and streaming data and the like are temporarily stored. The storage unit 28 includes an internal storage unit 28A built in the smartphone and an external storage unit 28B having a removable external memory slot. Each of the internal storage unit 28A and the external storage unit 28B constituting the storage unit 28 includes a flash memory type, a hard disk type, a multimedia card micro type, a multimedia card micro type, This is realized using a storage medium such as a card type memory (for example, MicroSD (registered trademark) memory), a RAM (Random Access Memory), a ROM (Read Only Memory), or the like.

  The external input / output unit 30 serves as an interface with all external devices connected to the smartphone 10, and communicates with other external devices (for example, universal serial bus (USB), IEEE 1394, etc.) or a network. (For example, the Internet, wireless LAN, Bluetooth (registered trademark), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association: IrDA) (registered trademark), UWB (Ultra Wideband) (registered trademark), ZigBee ( ZigBee) (registered trademark, etc.) for direct or indirect connection.

  As an external device connected to the smartphone 10, for example, a wired / wireless headset, a wired / wireless external charger, a wired / wireless data port, a memory card connected via a card socket, a SIM (Subscriber) Identity Module Card (UIM) / User Identity Module Card (UIM) card, external audio / video equipment connected via audio / video I / O (Input / Output) terminal, external audio / video equipment connected wirelessly, There are a wirelessly connected smartphone, a wired / wireless personal computer, a wired / wireless PDA, a wired / wireless personal computer, an earphone, and the like. The external input / output unit 30 transmits data received from such an external device to each component inside the smartphone 10, or allows the data inside the smartphone 10 to be transmitted to the external device. Can do.

  The GPS receiving unit 32 receives GPS signals transmitted from the GPS satellites ST1 to STn according to instructions from the main control unit 38, executes positioning calculation processing based on the received GPS signals, and calculates the latitude of the smartphone 10 Detect the position consisting of longitude and altitude. When the GPS receiving unit 32 can acquire position information from the wireless communication unit 24 or the external input / output unit 30 (for example, a wireless LAN), the GPS receiving unit 32 can also detect the position using the position information.

  The motion sensor unit 34 includes, for example, a three-axis acceleration sensor and detects the physical movement of the smartphone 10 according to an instruction from the main control unit 38. By detecting the physical movement of the smartphone 10, the moving direction and acceleration of the smartphone 10 are detected. The detection result is output to the main control unit 38.

  The power supply unit 36 supplies power stored in a battery (not shown) to each unit of the smartphone 10 in accordance with an instruction from the main control unit 38.

  The main control unit 38 includes a microprocessor, operates according to a control program and control data stored in the storage unit 28, and controls each unit of the smartphone 10 in an integrated manner. The main control unit 38 includes a mobile communication control function for controlling each unit of the communication system and an application processing function in order to perform voice communication and data communication through the wireless communication unit 24.

  The application processing function is realized by the main control unit 38 operating in accordance with application software stored in the storage unit 28. Application processing functions include, for example, an infrared communication function for controlling the external input / output unit 30 to perform data communication with the opposite device, an e-mail function for sending and receiving e-mails, and a web browsing function for browsing web pages. .

  The main control unit 38 also has an image processing function such as displaying video on the display input unit 14 based on image data (still image or moving image data) such as received data or downloaded streaming data. The image processing function is a function in which the main control unit 38 decodes the image data, performs image processing on the decoding result, and displays an image on the display input unit 14.

  Further, the main control unit 38 executes display control for the display panel 14A and operation detection control for detecting a user operation through the operation unit 20 and the operation panel 14B.

  By executing the display control, the main control unit 38 displays an icon for starting application software, a software key such as a scroll bar, or displays a window for creating an e-mail. Note that the scroll bar refers to a software key for receiving an instruction to move the display portion of a large image that does not fit in the display area of the display panel 14A.

  Further, by executing the operation detection control, the main control unit 38 detects a user operation through the operation unit 20 or accepts an operation on the icon or an input of a character string in the input field of the window through the operation panel 14B. Or a display image scroll request through a scroll bar.

  Further, by executing the operation detection control, the main control unit 38 causes the operation position with respect to the operation panel 14B to overlap with the display panel 14A (display area) or other outer edge part (non-display area) that does not overlap with the display panel 14A. And a touch panel control function for controlling the sensitive area of the operation panel 14B and the display position of the software key.

  The main control unit 38 can also detect a gesture operation on the operation panel 14B and execute a preset function in accordance with the detected gesture operation. Gesture operation is not a conventional simple touch operation, but an operation that draws a trajectory with a finger or the like, designates a plurality of positions at the same time, or combines these to draw a trajectory for at least one of a plurality of positions. means.

  The camera unit 22 is a digital camera that performs electronic photography using an imaging element such as a complementary metal oxide semiconductor (CMOS) or a charge-coupled device (CCD). Further, the camera unit 22 converts image data obtained by imaging into compressed image data such as JPEG (Joint Photographic coding Experts Group) under the control of the main control unit 38, and records the data in the storage unit 28 or externally. The data can be output through the input / output unit 30 or the wireless communication unit 24. In the smartphone 10 shown in FIG. 1, the camera unit 22 is mounted on the same surface as the display input unit 14, but the mounting position of the camera unit 22 is not limited to this, and the camera unit 22 may be mounted on the back surface of the display input unit 14. Alternatively, a plurality of camera units 22 may be mounted. When a plurality of camera units 22 are mounted, the camera unit 22 used for shooting can be switched to shoot alone, or a plurality of camera units 22 can be used for shooting simultaneously. it can.

  The camera unit 22 can be used for various functions of the smartphone 10. For example, the image acquired by the camera unit 22 can be displayed on the display panel 14A, or the image of the camera unit 22 can be used as one of the operation inputs of the operation panel 14B. Further, when the GPS receiving unit 32 detects the position, the position can also be detected with reference to an image from the camera unit 22. Furthermore, referring to the image from the camera unit 22, the optical axis direction of the camera unit 22 of the smartphone 10 is determined without using the triaxial acceleration sensor or in combination with the triaxial acceleration sensor. It is also possible to determine the current usage environment. Of course, the image from the camera unit 22 can also be used in the application software.

  In addition, the position information acquired by the GPS receiver 32 to the image data of the still image or the moving image, and the voice information acquired by the microphone 18 (the text information may be converted into voice information by the main control unit 38 or the like) Further, posture information acquired by the motion sensor unit 34 and the like can be added and recorded in the storage unit 28, or output through the external input / output unit 30 and the wireless communication unit 24.

  By the way, in the smartphone 10 according to the present embodiment, when image information is stored in at least one of the internal storage unit 28A or the external storage unit 28B and a list display of the image information is instructed by a user operation, the display panel 14A is displayed. Control to display the list. At this time, the smartphone 10 performs various processes on the displayed image or performs a process of performing a drag operation on the displayed image in accordance with a user operation.

  Next, with reference to FIG. 3, the effect | action of the smart phone 10 which concerns on this embodiment is demonstrated. FIG. 3 is a flowchart showing a flow of processing of a display control processing program executed by the main control unit 38 of the smartphone 10 when an execution instruction is input via the operation panel 14B or the operation unit 20. The program is stored in advance in a predetermined area of the internal storage unit 28A.

  Here, a case where a plurality of pieces of image information are stored in the storage unit 28 will be described in order to avoid complications.

  First, in step S100, the display panel 14A is controlled to display the top screen 42 that is the starting point of screen transition.

  FIG. 4A shows an example of the top screen 42 according to the present embodiment. As shown in FIG. 4A, the top screen 42 instructs, for example, a mail button 44a for instructing activation of the mail function, a web button 44b for instructing activation of the web browsing function, and activation of the camera function. The camera button 44c is provided. The top screen 42 includes an image list button 44d for instructing activation of the image list function, a call button 44e for instructing activation of the call function, a setting button 44f for instructing activation of various setting functions, and the like. Has a select button.

  The user selects a function to be activated by touching a desired selection button on the top screen 42, while the main control unit 38 activates various functions according to the selection button selected by the user operation.

  Therefore, in the next step S101, the user waits for selection of any menu button. In the next step S102, it is determined whether or not the menu button selected by the user is the image list button 44d. If the determination is negative, the process proceeds to step S103, and the function corresponding to the selected menu button is performed. After executing, this program is terminated. On the other hand, when it becomes affirmation determination, it transfers to step S104.

  In step S104, control is performed so that a list display screen for displaying a list of a plurality of images stored in the storage unit 28 is displayed on the display panel 14A.

  FIG. 4B shows an example of the image list screen 46 according to the present embodiment. As shown in FIG. 4B, the image list screen 46 displays a plurality of images 48 in a matrix and also displays an end button 50 designated when the display control processing program is ended. The plurality of images 48 are images indicated by each piece of image information stored in the storage unit 28.

  In step S105, it is determined whether or not an input operation has been performed via the operation panel 14B.

  If it is determined in step S105 that an input operation has been performed, the process proceeds to step S106, where the input operation is an instruction input operation for ending the display control processing program depending on whether or not the button designated for contact is the end button 50. It is determined whether or not there is.

  If it is determined in step S106 that the input operation is not an instruction to end the display control processing program, the process proceeds to step S107, and it is determined whether or not the input operation is an input operation for selecting an image. If it is determined in step S107 that the input operation is not for image selection, the process returns to step S105.

  On the other hand, if it is determined in step S107 that an input operation for selecting an image has been performed, the process proceeds to step S108, and control is performed to display the menu screen 52 including a plurality of predetermined menu items on the display panel 14A. To do. Note that the menu items in this embodiment are a process for copying image information, a process for deleting image information, a process for setting image information, and an image process for image information using an image processing program (not shown). The processing to be performed.

  5A and 5B show an example of the image list screen 46 according to the present embodiment. As shown in FIG. 5A, when any one of the plurality of images 48 displayed on the image list screen 46 is selected, it is superimposed on the image list screen 46 and is displayed on the menu screen 52. Is displayed. Further, as shown in FIG. 5B, in this embodiment, the menu screen 52 is an area for selecting any one of the four menu items from the menu item A to the menu item D. 52a to 52d are displayed. Here, each menu item selection part 52a thru | or 52d is displayed in the state which has an empty area | region in a part of peripheral area adjacent to the selected image. A part of the empty area adjacent to the selected image is set as drag instruction areas 54a to 54d for instructing a drag operation.

  In the present embodiment, the regions on both sides adjacent to the selected image in the column direction (vertical direction in front view of the display panel 14A) and the row direction (horizontal direction in front view of the display panel 14A) of the plurality of images 48 are displayed. Each is a free area. That is, in the state where the menu item selection units 52a to 52d are displayed on the image list screen 46, drag instruction areas 54a to 54d are respectively provided on the upper side, the lower side, the left side, and the right side of the selected image. Each is provided.

  When the user wants to perform a drag operation on any of the images displayed on the image list screen 46, a process for changing the display position of the image is assumed. In the present embodiment, as described above, since the drag instruction areas 54a to 54d are provided in the column direction or the row direction of the selected image, the drag operation can be smoothly performed following the operation for instructing the drag operation. Can continue.

  In the next step S109, it is determined whether or not the position designated by the fingertip on the operation panel 14B by the user has subsequently moved. At this time, the main control unit 38 determines that the designated position has moved, for example, when the designated position has moved by a predetermined distance (number of pixels) or more.

  When it is determined in step S109 that the designated position has not moved, the process proceeds to step S111, and it is determined whether or not the image selection by the user is released. At this time, the main control unit 38 determines that the image selection is canceled when the operation panel 14B stops outputting a detection signal generated due to the user operation, for example, due to the user's fingertip moving away from the operation panel 14B. judge.

  If it is determined in step S111 that the image selection has been canceled, the process proceeds to step S113, the display of the menu item selection units 52a to 52d displayed in step S107 is terminated, and the process returns to step S103.

  On the other hand, if it is determined in step S111 that the selection of the image has not been released, the process proceeds to step S115, and the designated position by the user's fingertip is in any of the areas where the menu item selection units 52a to 52d are displayed. It is determined whether it has been reached. At this time, the main control unit 38 displays the menu item selection units 52a to 52d as the specified positions when the specified position is located inside any one display area of the menu item selection units 52a to 52d. It is determined that any one of the areas has been reached.

  If it is determined in step S115 that one of the menu item selection units 52a to 52d has been reached, the process proceeds to step S117, and the display of the menu item selection units 52a to 52d displayed in step S107 is terminated. In the next step S119, processing corresponding to any one of the menu item selection units 52a to 52d corresponding to the area where the designated position by the fingertip of the user has reached is executed.

  In this way, the user designates the image by touching the display area of the image on which desired processing is to be performed via the operation panel 14B. Then, the user moves the display area of the menu item selection units 52a to 52d displayed adjacent to the image to an area corresponding to the desired process. As a result, the user can easily execute a desired process on a desired image.

  As shown in FIG. 5 (A), the designated position moves with the movement of the user's fingertip, and as shown in FIG. 5 (B), the designated position is displayed in the display area of the menu item selection unit 52b of “Menu B”. When is positioned, processing corresponding to the selection of “Menu B” is performed.

  On the other hand, if it is determined in step S115 that it has not reached, the process proceeds to step S121, and it is determined whether or not the position designated by the user's fingertip has reached any one of the drag instruction areas 54a to 54d.

  If it is determined in step S121 that the process has been reached, the process proceeds to step S123, and the display of the menu item selection units 52a to 52d displayed in step S107 is terminated. In the next step S125, a drag operation corresponding to the movement of the selected image is performed.

  As shown in FIG. 6A, the designated position on the operation panel 14B moves with the movement of the user's fingertip, and as shown in FIG. 6B, the designated position appears in the drag instruction area 54d on the right side of the front view. When is positioned, the display of the menu item selection sections 52a to 52d is terminated. Then, processing corresponding to this drag operation is executed.

  7A to 7F are schematic diagrams illustrating an example of processing according to the drag operation according to the present embodiment. For example, as shown in FIGS. 7A and 7B, when the first to fifth images are displayed in one column, the first image is designated as the processing target of the drag operation by the user operation. It is assumed that the second to fifth images are moved in the direction in which the second to fifth images exist (right direction in front view). In this case, as shown in FIG. 7C, when the designation of the first image is continued (long press) with the first image and the second image overlapped, the main control unit 38 Assume that an instruction to combine the first image and the second image is given, and the first image and the second image are combined. At this time, for example, as shown in FIG. 7D, a new folder is created at the position where the first image exists, and the first image and the second image are stored in the created folder. .

  Thereafter, as shown in FIGS. 7E and 7F, when the designation of the first image is continued (long press), the third image and the fourth image are sequentially collected. Then, as shown in FIG. 7G, when the designation (long press) of the first image is canceled at the stage where the fourth image is collected, the first to fourth images are collected in the created folder. In this state, aggregation (save in the same folder) is completed.

  As described above, the user designates an image by touching a display area of a desired image via the operation panel 14B, and moves the finger to the drag instruction areas 54a to 54d adjacent to the designated image. Thereby, the user can easily execute processing corresponding to the drag operation on the designated image.

  In step S127, it is determined whether or not an input operation of an instruction to end the display control processing program has been performed based on whether or not the touch-designated button is the end button 50.

  If it is determined in the next step S127 that the input operation for ending the display control processing program has not been performed, the process returns to step S105.

  On the other hand, if it is determined in step S103 or S127 that an operation for inputting an instruction to end the display control processing program has been performed, the process proceeds to step S129, and control is performed to end the display of the image list screen 46. The control processing program is terminated.

  As described above, the smartphone 10 has a display area for displaying an image, and an image displayed on the display panel 14 </ b> A that is a display unit in which the operation panel 14 </ b> B that is a touch panel is provided on the surface of the display area. Is specified. In this case, a menu screen showing each of a plurality of predetermined menu items is displayed for each menu item in a state where an empty area is provided in a part of the peripheral area adjacent to the displayed image in the display area. In addition, if the specified position is moved on the menu screen after the image is specified via the touch panel with the menu screen displayed in the display area, the menu item on the destination menu screen is specified. Judge that it was done. On the other hand, when the designated position moves to an empty area, it is determined that a drag operation corresponding to the movement of the designated position of the designated image is designated. And the process according to a judgment result is performed.

  Also, by setting a part of the peripheral area adjacent to the image as an empty area, the finger operated during the moving operation is separated from the touch panel against the user's intention, and is executed at a position where the finger is separated from the mobile terminal device. It is prevented that the instruction is regarded as being input. That is, it is possible to prevent a menu operation that is against the user's intention from being executed.

  In the present embodiment, a menu screen is displayed around the selected image, but the present invention is not limited to this. In the display area of the display panel 14A, a menu screen indicating the moving direction for instructing each menu item may be displayed at a position that does not overlap the selected image.

  FIGS. 8A and 8B and FIGS. 9A and 9B show other examples of the image list screen 46 according to the present embodiment. In this case, when an image is selected by a user operation on the image list screen 46, the smartphone 10 displays the menu screen 60 on the upper side of the selected image as shown in FIG. 8A as an example. . In the menu screen 60, a reference image position 60a indicating the position of the selected image is displayed in the center, and indicates which process is executed when the designated position is moved in which direction with reference to the reference image position 60a. .

  It is assumed that the user moves the designated position in the direction in which the menu B is located on the menu screen 60 (in the upper right direction when viewed from the front) while referring to the menu screen 60 as shown in FIG. In this case, the main control unit 38 executes processing corresponding to the menu B.

  On the other hand, referring to the menu screen 60 shown in FIG. 9A, the user moves the designated position in the direction in which the drag operation is located on the menu screen 60 (right direction in front view) as shown in FIG. 9B. Suppose that it is moved more than a predetermined distance. In this case, the main control unit 38 executes processing corresponding to the drag operation.

  When the user moves the designated position on the operation panel 14B with reference to the menu screen 60, the reference position information 60b indicating the designated position is displayed on the menu screen 60 according to the movement of the designated position, as shown in FIG. May be displayed while moving. Thus, the user can instruct execution of the process corresponding to the menu item or the process corresponding to the drag operation while confirming the position of the reference position information 60b on the menu screen 60.

  In the present embodiment, each menu item is displayed as a jet around the selected image. However, the present invention is not limited to this. In the display area of the display panel 14A, a menu screen indicating a moving direction for instructing each menu item may be displayed in an arc around the selected image.

  FIG. 11 shows another example of the image list screen 46 according to the present embodiment. When an image is selected by a user operation on the image list screen 46, the smartphone 10 displays a menu screen in an annular area centered on the designated position or the center of the selected image as shown in FIG. It may be displayed. In this case, the menu item selection units 62a to 62d may be displayed in a region corresponding to a partial angle in the annular region. At this time, an area corresponding to the angle of the other part in the annular area is set as an empty area, and the empty area is set as an area 62e for instructing a drag operation.

  In the present embodiment, each menu item is displayed as a jet around the selected image, but the present invention is not limited to this. When there are less than four menu items in the display area of the display panel 14A, the menu items may be displayed in areas adjacent to each other in the row direction or the column direction of the image selected in the arrangement of the plurality of images. . In this case, an area adjacent to the row direction or the column direction of the image selected in the arrangement of the plurality of images and an area where the menu item is not displayed is an empty area, and the empty area is an area for instructing a drag operation. And good.

  12A and 12B show another example of the image list screen 46 according to the present embodiment. For example, when there are two menu items, as shown in FIG. 12A, menu item selection units 64a and 64b are displayed in the upper front area and the lower front area of the selected image. . In this case, the area on the left side of the front view and the area on the right side of the front view are preferably empty areas, and the empty area may be the area 64c for instructing the drag operation.

  In the present embodiment, various processes are executed when the designated position moves to a menu item or an area for instructing a drag operation. However, the present invention is not limited to this. That is, when an image is selected by a user operation, it is assumed that a drag operation has been instructed, and processing corresponding to the drag operation such as moving the display position of the selected image according to the movement of the designated position is performed. Various processes may be executed when the display position of the selected image moves to a menu item or an area for instructing a drag operation.

  13A and 13B show another example of the image list screen 46 according to the present embodiment. When an image is selected by a user operation on the image list screen 46, the smartphone 10 displays the menu item selection units 66a to 66d in the peripheral area of the selected image. At this time, for example, as illustrated in FIG. 13A, the smartphone 10 displays menu item selection units 66a to 66d in an area corresponding to a partial angle in an annular area centered on the selected image. . At this time, an area corresponding to the angle of the other part in the annular area is set as an empty area, and the empty area is set as an area 66e for instructing a drag operation.

  When the display position of the selected image reaches the menu item selection units 66a to 66d by the user operation, the smartphone 10 stops the display of the menu item selection units 66a to 66d and performs processing corresponding to the menu item. Run. On the other hand, when reaching the area for instructing the drag operation, the smartphone 10 stops the display of the menu item selection units 66a to 66d and executes a process corresponding to the drag operation.

  As shown in FIG. 13B, for example, when the display position of the selected image reaches the menu item selection unit 66a of “Menu A”, the process corresponding to the drag operation is stopped and the menu A is displayed. Corresponding processing is executed. On the other hand, when the display position of the selected image reaches the area for instructing the drag operation, the display of the menu item selection units 66a to 66d is stopped and the drag operation is continued.

  At this time, whether or not the display position of the selected image has reached each area may be determined to have been reached when a part of the selected image is located in each area. Note that the determination method is not limited to this, and it may be determined that a region having a predetermined area or more in the selected image is reached in each region.

  Further, although cases have been described with the above embodiment where the present invention is implemented by software by execution of a computer program, the present invention is not limited to this, and the present invention may be implemented by hardware alone. Of course, it may be realized by a combination of hardware and software.

10 Smartphone 14A Display Panel 14B Operation Panel 28 Storage Unit 38 Main Control Unit 46 Image List Screen

Claims (9)

Computer
When an image displayed in a display area for displaying an image is designated, a menu screen including a plurality of predetermined menu item selection portions is displayed, and an empty area is provided in a part of the peripheral area adjacent to the designated image. A display control means for performing control to display for each image displayed in the designated display area in a state where both the empty area and the menu item selection unit are adjacent to the image ;
When the menu item selection unit is designated in a state where the menu screen is displayed, execution means for executing processing corresponding to the designated menu item selection unit on the designated image;
In a state where the menu screen is displayed, when the position where the image is designated moves in the direction in which the empty area is located, moving means for moving the designated image;
An image display control program for functioning as The image display control program according to claim 1, wherein the display control unit performs control to display the menu item selection units apart from each other. The image display control program according to claim 1, wherein the display control unit performs control to display the menu item selection units by arranging them through an empty area. The display control means arranges the images in a matrix and displays them in the display area, and the menu item selection unit is located in a part of the peripheral area of the image located in the row direction and the column direction of the image. The image display control program according to any one of claims 1 to 3, wherein the display is performed by providing the empty area. The image display control program according to any one of claims 1 to 4, wherein the display control unit performs control to display the menu item selection unit in a size smaller than the image. The image display control program according to any one of claims 1 to 5, wherein the display control unit performs control to display the menu item selection unit at any one of four corners of the image. 2. The moving means stops display of the menu item selection unit when the position where the image is designated moves in a direction in which the empty area is located in a state where the menu screen is displayed. The image display control apparatus according to any one of? 6. When an image displayed in a display area for displaying an image is designated, a menu screen including a plurality of predetermined menu item selection portions is displayed, and an empty area is provided in a part of the peripheral area adjacent to the designated image. A display control means for performing control to display for each image displayed in the designated display area in a state where both the empty area and the menu item selection unit are adjacent to the image ;
When the menu item selection unit is designated in a state where the menu screen is displayed, execution means for executing processing corresponding to the designated menu item selection unit on the designated image;
In a state where the menu screen is displayed, when the position where the image is designated moves in the direction in which the empty area is located, moving means for moving the designated image;
An image display control device. When an image displayed in a display area for displaying an image is designated, a menu screen including a plurality of predetermined menu item selection portions is displayed, and an empty area is provided in a part of the peripheral area adjacent to the designated image. A display control step for performing control for displaying each image displayed in the designated display area in a state where both the empty area and the menu item selection unit are adjacent to the image ;
When the menu item selection unit is specified in a state where the menu screen is displayed, an execution step of executing processing corresponding to the specified menu item selection unit on the specified image;
In a state where the menu screen is displayed, when the position where the image is designated moves in the direction in which the empty area is located, a movement step of moving the designated image;
An image display control method.

Images