EP3252588B1 - Electronic device and method for controlling the same - Google Patents
Electronic device and method for controlling the same Download PDFInfo
- Publication number
- EP3252588B1 EP3252588B1 EP17173946.9A EP17173946A EP3252588B1 EP 3252588 B1 EP3252588 B1 EP 3252588B1 EP 17173946 A EP17173946 A EP 17173946A EP 3252588 B1 EP3252588 B1 EP 3252588B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- touch
- display
- image
- pressure
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04105—Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
Definitions
- the present invention particularly relates to an electronic device suitable for use in an operation in a device including a touch panel, a method for controlling an electronic device, and a storage medium.
- a touch panel is a device obtained by integrating a display unit and an operation unit with which a user performs an operation. The user touches the touch panel according to information displayed on the touch panel to operate an electronic product.
- the touch panel is an input and output interface enabling a highly intuitive operation.
- the user performs a desired operation by moving their finger to a button displayed on the touch panel and touching the button to select the button. At this time, the user may touch the touch panel for a plurality of times until the desired operation is completed. If the user performs a plurality of touches, particularly in a case where the procedure of the operation becomes long, the operation is difficult to understand. In addition, if the procedure of the operation is long, the distance at which the user moves the finger on the touch panel may become long. Consequently, the user may feel weary of the operation of performing a touch.
- Japanese Patent Application Laid-Open No. 2009-245037 discusses an image display apparatus configured to display a desired image to be displayed in a multi-reproduction display manner with a touch panel operation, which facilitates access to the desired image.
- This image processing apparatus transitions to a first mode with a weak touch. In the first mode, the image processing apparatus can change the number of displayed images with a touch operation in a Y-direction.
- the image processing apparatus transitions to a second mode with a strong touch. In the second mode, the image processing apparatus brings an option into a focused state and allows a user to select from a list screen.
- EP2 458 487 discloses an operation control device which includes a contact detection unit for detecting contact of an operation body with a display surface of a display unit on which information is displayed, a pressure detection unit, provided on the display unit, for detecting a pressure at which the operation body presses the display surface of the display unit, and an operation control unit for changing a display state of the information displayed on the display unit in a forward or reverse direction on the basis of an amount of pressure detected by the pressure detection unit until the operation body makes contact with and is separated from the display surface of the display unit.
- the present invention is directed to a technique for enabling a user to intuitively and easily switch to list display with a small number of touch operations to easily search for another item.
- an electronic device as specified in claims 1 to 13.
- a method for controlling an electronic device as specified in claim 14 there is provided a program for causing a computer to function as the units of the electronic device, as specified in claim 15.
- a non-transitory computer-readable storage medium having stored therein a program for causing a computer to function as the units of the electronic device, as specified in claim 16.
- Fig. 1 is a block diagram illustrating an example of the internal configuration of an electronic device 100 according to the present embodiment.
- the electronic device 100 includes a central processing unit (CPU) 101, a memory 102, a non-volatile memory 103, an image processing unit 104, a display 105, an operation unit 106, a recording medium interface (I/F) 107, an external I/F 109, a communication I/F 110, a touch panel 112, and a pressure detection unit 113.
- CPU central processing unit
- the memory 102 includes, for example, a random-access memory (RAM) (e.g., a volatile memory with semiconductor devices).
- RAM random-access memory
- the CPU 101 controls the components of the electronic device 100 using the memory 102 as a work memory.
- the non-volatile memory 103 stores image data, sound data, other types of data, and various programs for the operation of the CPU 101.
- the non-volatile memory 103 includes, for example, a hard disk (HD) and a read-only memory (ROM).
- the image processing unit 104 Under the control of the CPU 101, the image processing unit 104 performs various types of image processing on, for example, image data stored in the non-volatile memory 103 or a recording medium 108, an image signal acquired via the external I/F 109, and image data acquired via the communication I/F 110.
- the image processing performed by the image processing unit 104 includes an analog-to-digital (A/D) conversion process, a digital-to-analog (D/A) conversion process, a compression process, a decoding process, an enlargement and reduction process (resizing), a noise reduction process, and a color conversion process.
- the image processing unit 104 may be configured with a dedicated circuit block for performing particular image processing. Alternatively, depending on the type of image processing, the CPU 101 can also perform the image processing according to a program without using the image processing unit 104.
- the display 105 displays an image or a graphical user interface (GUI) screen, which forms a GUI.
- GUI graphical user interface
- the CPU 101 generates a display control signal and controls the components of the electronic device 100 so as to generate an image signal to be used for displaying an image on the display 105 and output the image signal to the display 105.
- the display 105 displays an image based on the output image signal.
- the electronic device 100 itself may include only an interface for outputting an image signal with which an image is to be displayed on the display 105, and the display 105 may be configured with an external monitor (e.g., television).
- the operation unit 106 is an input device for receiving an operation of a user.
- the input device includes a text information input device such as a keyboard, a pointing device such as a mouse, a button, a dial, and a joystick.
- the recording medium 108 such as a memory card, a compact disc (CD), and a digital versatile disc (DVD), is attachable to the storage medium I/F 107. Under the control of the CPU 101, the storage medium I/F 107 reads and writes data from and to the attached recording medium 108.
- the storage medium I/F 107 Under the control of the CPU 101, the storage medium I/F 107 reads and writes data from and to the attached recording medium 108.
- the external I/F 109 is an interface for connecting to an external device via a cable for wired connection or wirelessly, and inputting and outputting an image signal or a sound signal.
- the communication I/F 110 is an interface for communicating with an external device or the Internet 111, and transmitting and receiving various types of data such as a file and a command.
- the electronic device 100 includes the touch panel 112 capable of detecting a contact with the display 105.
- the touch panel 112 and the display 105 can be formed in an integrated manner.
- the touch panel 112 is configured so that the transmittance of light does not hinder the display of the display 105.
- the touch panel 112 is attached to an upper layer of a display surface of the display 105.
- input coordinates on the touch panel 112 are associated with display coordinates on the display 105. Consequently, it is possible to configure a GUI as if a user can directly operate a screen displayed on the display 105.
- the CPU 101 can detect the following operations on the touch panel 112 (the following operations on an operation surface of the display 105) or the following states based on a touch.
- a touch-on is also detected.
- the touch-on continues to be detected unless a touch-up is detected.
- a touch-on is detected also in the state where a touch move is detected. Even if a touch-on is detected, but if the touch position does not move, a touch move is not detected. After a touch-up of all the fingers or the pen having touched the touch panel 112 is detected, a touch-off is detected.
- the CPU 101 is notified via the internal bus 150 of these operations or states and the position coordinates where the finger or the pen touches the touch panel 112.
- the CPU 101 determines, based on the information of which the CPU 101 is notified, what operation is performed on the touch panel 112. In the case of a touch move, the CPU 101 can also determine, based on changes in the position coordinates, the moving direction of the finger or the pen moving on the touch panel 112 with respect to each of the vertical and horizontal components on the touch panel 112.
- a flick is the operation of quickly moving the finger by a certain distance while the finger keeps touching the touch panel 112, and then releasing the finger from the touch panel 112 immediately after the quick movement.
- a flick is the operation of quickly tracing the touch panel 112 with the finger in a flipping manner. If a touch move performed by a predetermined distance or more at a predetermined speed or more is detected, and a touch-up is detected immediately after the touch move, the CPU 101 can determine that a flick is performed.
- the CPU 101 determines that a drag is performed. If a touch move is performed by less than a predetermined distance, and an operation from a touch-down to a touch-up is detected within a predetermined time, the CPU 101 determines that a tap is performed. In addition, if an operation from a touch-down to a touch-up is performed with a touch move not being performed by a predetermined distance or more, regardless of time, the CPU 101 may determine that a tap is performed.
- a touch operation for simultaneously touching a plurality of points (e.g., two points) and bringing the touch positions close to each other is referred to as a "pinch-in", and a touch operation for releasing the touch positions from each other is referred to as a "pinch-out”.
- a pinch-out and a pinch-in are collectively referred to as a “pinch operation” (or simply as a "pinch”).
- the touch panel 112 may be a touch panel of any of various types such as a resistive type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and a photo-sensor type.
- a method for detecting the presence of a touch according to the presence of the contact of the finger or the pen with the touch panel 112, or a method for detecting the presence of a touch according to the presence of the approach of the finger or the pen to the touch panel 112 is included depending on the type of the touch panel can be applicable.
- the pressure detection unit 113 detects the pressing force on the operation surface of the display 105.
- the pressure detection unit 113 can continuously detect the strength of the pressing force in a case where the display 105 is pressed with a touch operation on the display 105.
- the pressure detection unit 113 can be configured to detect the pressing force on the operation surface of the display 105 based on an output value from a strain gauge sensor installed in a portion that is distorted by the pressing force on the operation surface of the display 105.
- the pressure detection unit 113 calculates, from the capacitance value, the distance between the finger on the operation surface of the display 105 and the capacitance sensor resulting from the distortion of the operation surface by the pressing force on the operation surface.
- the pressure detection unit 113 may calculate a pressure based on the calculated distance or equate the calculated distance with a pressure. Yet alternatively, the pressure detection unit 113 may employ any other methods capable of detecting the pressing force on the operation surface of the display 105.
- the pressure detection unit 113 and the touch panel 112 may be formed in an integrated manner. Hereinafter, the operation of pressing the operation surface of the display 105 will be referred to as a "touch push".
- the recording medium 108 a plurality of image files is saved with file numbers.
- an image to be displayed can be switched by a touch operation on the touch panel 112.
- the electronic device 100 according to the present embodiment can be switched to "one-image reproduction" for displaying a single image full-screen, "four-image reproduction” for simultaneously displaying four different images, or "nine-image reproduction” for simultaneously displaying nine different images.
- Figs. 2 to 5 illustrate examples of a series of processing procedures according to a touch operation and a touch push operation in the present embodiment. These processes are implemented by a program recorded in the non-volatile memory 103 being loaded into the memory 102, and by the CPU 101 executing the program.
- Fig. 2 is a flowchart illustrating an example of the detailed processing procedure of a single-reproduction process for performing one-image reproduction to display on the display 105 an image of an image file saved in the recording medium 108.
- This process starts in a case where the user operates the touch panel 112 to give an instruction to reproduce an image, or processing described below proceeds to the single-reproduction process.
- the CPU 101 reads an image file from the recording medium 108 and displays an image of the image file on the display 105.
- Fig. 6A illustrates an example of the image subjected to one-image display in step S201 in Fig. 2 .
- the one-image display in a display area of the display 105 for displaying an image, a single image is displayed in the maximum size that allows the entirety of the image to fall within the display area. That is, in the one-image display, an image is displayed at the smaller of a display magnification at which the vertical length of the image matches the vertical length of the display area, and a display magnification at which the horizontal length of the image matches the horizontal length of the display area.
- the one-image display also corresponds to a detailed display screen for displaying each image with more details than multi-reproduction (list display) described below.
- list display multi-reproduction
- step S202 the CPU 101 determines whether a one-point touch-down (a touch-down on a single point) on the touch panel 112 is detected. If, as a result of this determination, the CPU 101 detects a one-point touch-down (YES in step S202), the processing proceeds to step S203. If not (NO in step S202), the processing proceeds to step S211.
- step S203 the pressure detection unit 113 detects a pressure P of a touch push in the state where a touch-on is being performed. Then, the CPU 101 determines whether the detected pressure P of the touch push exceeds a predetermined threshold SH1. If, as a result of this determination, the pressure P exceeds the threshold SH1 (YES in step S203), the processing proceeds to step S209. If not (NO in step S203), the processing proceeds to step S204.
- a "during-detection-of-pressure four-image multi-reproduction process" in step S209 will be described below with reference to the flowchart in Fig. 3 .
- step S204 the CPU 101 determines whether a touch move being performed in a right or left direction on the touch panel 112 is detected. If, as a result of this determination, the CPU 101 detects that a touch move in the right or left direction is being performed (YES in step S204), the processing proceeds to step S208. If not (NO in step S204), the processing proceeds to step S205.
- step S208 according to the direction of the touch move, the CPU 101 scrolls (moves the display position of) an image to be displayed on the display 105.
- the CPU 101 reads from the recording medium 108 an image file of an image to be displayed next with scrolling and displays the image on the display 105. In this manner, it is possible to switch from the current image to the next image or the previous image in a predetermined order (e.g., the order of file names) with scrolling. If the image is scrolled in the left direction by a touch move, the CPU 101 reads from the recording medium 108 an image file having a file number after that of the currently displayed image.
- the CPU 101 reads from the recording medium 108 an image file having a file number before that of the currently displayed image. For example, if a touch move is performed in the left direction in the state of Fig. 6A , and the image is scrolled to the left and switched to the next image, the next image is displayed as illustrated in Fig. 6B .
- step S205 the CPU 101 determines whether the CPU 101 detects that a multi-touch is performed on the touch panel 112. At this time, a "multi-touch" refers to the state where a touch-on is performed at two or more points. If, as a result of this determination, the CPU 101 detects that a multi-touch is performed (YES in step S205), the processing proceeds to step S206. If not (NO in step S205), the processing proceeds to step S207.
- step S206 the CPU 101 determines whether the CPU 101 detects that a pinch-in is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a pinch-in is performed (YES in step S206), the processing proceeds to step S210. If not (NO in step S206), the processing proceeds to step S207.
- a "multi-reproduction process" in step S210 will be described below with reference to a flowchart in Fig. 5 .
- step S207 the CPU 101 determines whether the CPU 101 detects that a touch-up is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a touch-up is performed (YES in step S207), the processing proceeds to step S211. If not (NO in step S207), the processing returns to step S203.
- step S211 the CPU 101 determines whether an event for ending the image reproduction process occurs. Examples of the event for ending the image reproduction process include turning off the electronic device 100, switching to an operation mode different from that for reproducing an image, and terminating application software that is reproducing an image. If, as a result of this determination, an event for ending the image reproduction process occurs (YES in step S211), the single-reproduction process ends. If not (NO in step S211), the processing returns to step S202.
- Fig. 3 is a flowchart illustrating an example of the detailed processing procedure of the during-detection-of-pressure four-image multi-reproduction process in step S209 in Fig. 2 .
- step S301 the CPU 101 reproduces four image files saved in the recording medium 108 and displays four images on the display 105.
- the CPU 101 newly reads, from the recording medium 108, three image files with file numbers following that of the image file subjected to the one-image reproduction immediately before the displaying of the four images, and causes the image processing unit 104 to resize images of the image files to be displayed to sizes that allow the placement of four images. Then, the CPU 101 displays the four images.
- Fig. 6C illustrates examples of the images subjected to four-image display in step S301 in Fig. 3 .
- Four images are displayed in sizes smaller than in the one-image reproduction on the display 105.
- the image displayed in one-image reproduction immediately before the touch push is included in the four images to be displayed.
- four images with file numbers "1" to "4" are displayed as illustrated in Fig. 6C .
- step S302 the CPU 101 determines whether the CPU 101 detects that a touch move is performed in an up or down direction with a touch operation continuous from the touch-down determined in step S202 (a touch operation performed without releasing the touch from the touch panel 112). If, as a result of this determination, the CPU 101 detects that a touch move is performed in the up or down direction (YES in step S302), the processing proceeds to step S307. If not (NO in step S302), the processing proceeds to step S303.
- step S303 the pressure detection unit 113 detects the pressure P of the touch push in the state where the touch-on is performed. Then, the CPU 101 determines whether the detected pressure P of the touch push exceeds a predetermined threshold SH1'.
- the relationship between the thresholds SH1 and SH1' is threshold SH1 > threshold SH1'.
- the threshold SH1' is set to a value with hysteresis with respect to the threshold SH1 so that an operation unintended by the user is not performed based on a change in pressure in the state where the touch push state is maintained. That is, the processing does not return to the single-reproduction process with a slight decrease in the pressure of the touch push.
- step S303 If, as a result of this determination, the pressure P exceeds the threshold SH1' (YES in step S303), the processing proceeds to step S304. If not (NO in step S303), the processing returns to the "single-reproduction process" in Fig. 2 , which is step S311.
- step S304 the CPU 101 further determines whether the pressure P of the touch push exceeds a predetermined threshold SH2.
- the threshold SH2 is a pressure greater than the thresholds SH1 and SH1'. If, as a result of this determination, the pressure P exceeds the threshold SH2 (YES in step S304), the processing proceeds to step S306. If not (NO in step S304), the processing proceeds to step S305.
- a "during-detection-of-pressure nine-image multi-reproduction process" in step S306 will be described below with reference to a flowchart in Fig. 4 .
- step S305 the CPU 101 determines whether the CPU 101 detects that a touch-up is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a touch-up is performed (YES in step S305), the processing proceeds to the "single-reproduction process" in step S311. If not (NO in step S305), the processing returns to step S302.
- step S307 the processing proceeds to step S307, and the processes of steps S303 to S305 are not performed. That is, once a touch move in the up or down direction (the operation of scrolling the images) is performed, the number and the sizes of images to be displayed are not changed even if the pressure changes by a touch push.
- the four-image reproduction can return to the previous one-image reproduction. In this case, an image to be displayed in the one-image reproduction is the same image as that before the touch push.
- step S201 If the pressure P of the touch push is made less than or equal to the threshold SH1' without a touch move, and even if the processing returns to the single-reproduction process in Fig. 2 , the touch-on continues to be performed. In such a case, after the process of step S201, the process of step S202 is skipped, and the processing proceeds to step S203. That is, various touch operations and a touch push operation in the single-reproduction process may be enabled in the state where the touch-on continues to be performed. With such a configuration, even if the processing proceeds to the processing in Fig. 3 by the user inadvertently performing a strong touch without intending to perform a touch push in the state of the one-image reproduction, the user can return to the one-image reproduction by weakening the pressure of the touch push, and perform an intended operation.
- the determination may be NO in step S202 after the process of step S201 so long as the touch continues to be performed. In this manner, various touch operations and a touch push operation in the single-reproduction process may not be allowed unless the touch is released once and a touch-down is performed again.
- step S307 according to whether the direction of the touch move is the up direction or the down direction, the CPU 101 scrolls images to be displayed on the display 105.
- the CPU 101 newly reads, from the recording medium 108, images to be newly displayed with scrolling. If the images are scrolled in the down direction, the CPU 101 reads four image files with file numbers before those of the currently displayed images. If the images are scrolled in the up direction, the CPU 101 reads four image files with file numbers after those of the currently displayed images.
- the image processing unit 104 resizes images of the newly read four image files to sizes that allow the placement of four images. Then, the CPU 101 displays the four images.
- step S308 the pressure detection unit 113 detects the pressure P of a touch push in the state where the touch-on is performed. Then, the CPU 101 determines whether the detected pressure P exceeds the threshold SH2. If, as a result of this determination, the pressure P exceeds the threshold SH2 (YES in step S308), the processing proceeds to the "during-detection-of-pressure nine-image multi-reproduction process" in step S306. If not (NO in step S308), the processing proceeds to step S309.
- step S309 the CPU 101 determines again whether the CPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, the CPU 101 detects that a touch move is performed in the up or down direction (YES in step S309), the processing returns to step S307. If not (NO in step S309), the processing proceeds to step S310.
- step S310 the CPU 101 determines whether the CPU 101 detects that a touch-up is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a touch-up is performed (YES in step S310), the "during-detection-of-pressure four-image multi-reproduction process" ends, and the processing proceeds to step S210 in Fig. 2 . If not (NO in step S310), the processing returns to step S308.
- Fig. 4 is a flowchart illustrating an example of the detailed processing procedure of the during-detection-of-pressure nine-image multi-reproduction process in step S306 in Fig. 3 .
- step S401 the CPU 101 reproduces nine image files saved in the recording medium 108 and displays nine images on the display 105.
- the CPU 101 newly reads, from the recording medium 108, five image files with file numbers following those of the image files displayed with the four-image reproduction immediately before the display of the nine images and causes the image processing unit 104 to resize images of the image files to be displayed to sizes that allow the placement of nine images. Then, the CPU 101 displays the nine images.
- Fig. 6E illustrates examples of the images subjected to nine-image display in step S401 in Fig. 4 . If the state where the images with the file numbers "1" to "4" are displayed as in Fig. 6C transitions to the nine-image reproduction by a user strengthening the pressure of the touch push, nine images with file numbers "1" to “9” are displayed as illustrated in Fig. 6E .
- step S402 the CPU 101 determines whether the CPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, the CPU 101 detects that a touch move is performed in the up or down direction (YES in step S402), the processing proceeds to step S406. If not (NO in step S402), the processing proceeds to step S403.
- step S403 the pressure detection unit 113 detects the pressure P of the touch push in the state where the touch-on is performed. Then, the CPU 101 determines whether the detected pressure P of the touch push exceeds the threshold SH1. If, as a result of this determination, the pressure P of the touch push exceeds the threshold SH1 (YES in step S403), the processing proceeds to step S404. If not (NO in step S403), the processing proceeds to the "single-reproduction process" in step S311.
- step S404 the CPU 101 further determines whether the pressure P of the touch push exceeds a predetermined threshold SH2'.
- the relationship between the thresholds SH2, SH2', SH1, and SH1' are threshold SH2 > threshold SH2' > threshold SH1 > threshold SH1'.
- the value of the threshold SH2' is set to a value with hysteresis with respect to the threshold SH2 so that an operation unintended by the user is not performed based on a change in pressure in the state where the touch push state is maintained. That is, the processing does not return to the during-detection-of-pressure four-image multi-reproduction process with a slight decrease in the pressure of the touch push.
- step S404 If, as a result of this determination, the pressure P exceeds the threshold SH2' (YES in step S404), the processing proceeds to step S405. If not (NO in step S404), the processing proceeds to the "during-detection-of-pressure four-image multi-reproduction process" in step S209.
- step S405 the CPU 101 determines whether the CPU 101 detects that a touch-up is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a touch-up is performed (YES in step S405), the processing proceeds to the "single-reproduction process" in step S311. If not (NO in step S405), the processing returns to step S402.
- step S406 the processes of steps S403 to S405 are not performed. That is, once a touch move in the up or down direction (the operation of scrolling the images) is performed, the number and the sizes of images to be displayed are not changed even if the pressure changes by a touch push.
- the nine-image reproduction can return to the previous four-image reproduction.
- images to be displayed in the four-image reproduction are the same images as those in the previous four-image reproduction.
- the user can return to the four-image reproduction by weakening the pressure of the touch and perform an intended operation.
- the user can also decrease the pressure P of the touch push to less than or equal to the pressure of the threshold SH1 in the during-detection-of-pressure nine-image multi-reproduction process to return to the one-image reproduction, and continue the touch operation in this state without releasing the touch.
- step S406 according to whether the direction of the touch move is the up direction or the down direction, the CPU 101 scrolls images to be displayed on the display 105.
- the CPU 101 newly reads, from the recording medium 108, images to be displayed with scrolling. In a case where the images are scrolled in the down direction, the CPU 101 reads nine image files with file numbers before those of the currently displayed images. In a case where the images are scrolled in the up direction, the CPU 101 reads nine image files with file numbers after those of the currently displayed images.
- the image processing unit 104 resizes images of the newly read nine image files to sizes that allow the placement of nine images. Then, the CPU 101 displays the nine images.
- a touch move is performed in the up direction in the state where the nine images with the file numbers "1" to “9” are displayed as in Fig. 6E , the images can be scrolled upward as a whole, and nine images with file numbers "10" to “18” can be displayed as illustrated in Fig. 6F .
- a touch move is performed in the down direction in the state where the nine images with the file numbers "10" to "18” are displayed as in Fig. 6F
- the images can be scrolled downward as a whole, and the nine images with the file numbers "5" to "13” can be displayed as illustrated in Fig. 6G .
- step S407 the CPU 101 determines whether the CPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, the CPU 101 detects that a touch move is performed in the up or down direction (YES in step S407), the processing returns to step S406. If not (NO in step S407), the processing proceeds to step S408.
- step S408 the CPU 101 determines whether the CPU 101 detects that a touch-up is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a touch-up is performed (YES in step S408), the processing proceeds to the "multi-reproduction process" in step S210. If not (NO in step S408), the processing returns to step S407.
- Fig. 5 is a flowchart illustrating an example of the detailed processing procedure of the multi-reproduction process in step S210 in Fig. 2 .
- This process is a multi-reproduction process in the state where a touch push is not detected. The processing proceeds to this process in a case where during the four-image display or the nine-image display performed with a touch push, scrolling display is performed without the touch being released, and then, a touch-up is performed.
- step S501 the CPU 101 reproduces a plurality of image files saved in the recording medium 108 and displays a plurality of images on the display 105.
- the number of images to be subjected to the multi-reproduction is four or nine.
- a touch up is performed during the during-detection-of-pressure four-image multi-reproduction process or the during-detection-of-pressure nine-image multi-reproduction process, and if a touch-up is performed, the images displayed on the display 105 when the touch-up is performed are displayed as they are.
- step S502 the CPU 101 determines whether the CPU 101 detects that a tap is performed on any one of the plurality of displayed images. If, as a result of this determination, the CPU 101 detects that a tap is performed on any one of the images (YES in step S502), the processing proceeds to the single-reproduction process in step S311. If not (NO in step S502), the processing proceeds to step S503. If the processing proceeds to the single-reproduction process, the image on which the tap is performed is subjected to the one-image display. That is, the details of an image (an item) selected by the user from among the plurality of images (items) displayed in a list are displayed.
- step S503 the CPU 101 detects a touch-on on the touch panel 112 and determines whether the CPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, the CPU 101 detects that a touch move is performed in the up or down direction (YES in step S503), the processing proceeds to step S507. If not (NO in step S503), the processing proceeds to step S504.
- step S507 the CPU 101 scrolls images to be displayed on the display 105.
- the CPU 101 newly reads, from the recording medium 108, images to be displayed with scrolling.
- the CPU 101 reads image files with file numbers before those of the currently displayed images.
- the CPU 101 reads image files with file numbers after those of the currently displayed images.
- the number of image files to be read is determined based on the number of images to be subjected to the multi-reproduction.
- the image processing unit 104 resizes images of the read image files to sizes that allow placement for the multi-reproduction display. Then, the CPU 101 displays these images.
- step S504 the CPU 101 determines whether the CPU 101 detects that a multi-touch is performed on the touch panel 112. If, as a result of this determination, the CPU 101 detects that a multi-touch is performed (YES in step S504), the processing proceeds to step S505. If not (NO in step S504), the processing proceeds to step S506.
- step S505 the CPU 101 determines whether the CPU 101 detects that a pinch operation (a pinch-in or a pinch-out) is performed. If, as a result of this determination, the CPU 101 detects that a pinch operation is performed (YES in step S505), the processing proceeds to step S508. If not (NO in step S505), the processing proceeds to step S506.
- a pinch operation a pinch-in or a pinch-out
- step S508 the CPU 101 changes the number of images to be subjected to the multi-reproduction. That is, if a pinch-in is performed, the CPU 101 increases the number of images to be subjected to the multi-reproduction and reduces the size of each image to be displayed. For example, the four-image display transitions to the nine-image display. In a case where a pinch-out is performed, the CPU 101 reduces the number of images to be subjected to the multi-reproduction and increases the size of each image to be displayed. For example, the nine-image display transitions to the four-image display, or the four-image display transitions to the one-image display. In a case where a pinch-in is performed when the nine-image display is performed, the number of images is not changed.
- step S506 the CPU 101 determines whether the multi-reproduction process ends. This determination is the determination of whether the number of images to be displayed becomes one by the process of step S508. If, as a result of this determination, the multi-reproduction process ends (YES in step S506), the process in Fig. 5 ends, and the processing proceeds to step S211 in Fig. 2 . If not (NO in step S506), the processing returns to step S502.
- the multi-reproduction state in a case where, after a touch push is performed, a touch move is performed in the up or down direction, the multi-reproduction state is maintained. Alternatively, only in a case where a touch push is performed, the current state may transition to the multi-reproduction state. Then, even after a touch move is performed, but if a touch-on is canceled, the current state may return to the single-reproduction state. Furthermore, in the present embodiment, in a case where a touch move is performed in the up or down direction, scrolling display is performed. Alternatively, in a case where a touch move is performed in the right or left direction, scrolling display may be performed.
- images to be subjected to the four-image display may differ according to the position of a touch push.
- a description is given below of the difference between multi-display screens displayed on the display 105 according to the position of a touch push.
- Fig. 7A in a case where a touch push is performed on an area 701 on an upper side of a screen in the state where the image with the file number "9" is subjected to the one-image display, the four images with the file numbers "9" to "12" are displayed as illustrated in Fig. 7B .
- images with file numbers following that of the image subjected to the one-image display are displayed.
- Fig. 7A when a touch push is performed on an area 702 on a lower side of the screen in the state where the image with the file number "9" is subjected to the one-image display, the four images with the file numbers "6" to "9” are displayed as illustrated in Fig. 7C .
- images with file numbers before the number of the image subjected to the one-image display are displayed.
- changing the pressing force of a touch push in the single-reproduction process switches from the one-image display to the multi-image display. Further strengthening the pressing force increases the number of images to be subjected to the multi-reproduction.
- this configuration in a case where a desired item is selected from among a plurality of images, it is possible to easily select the desired image with a small number of touch operations and an intuitive touch operation.
- a second embodiment of the present invention will be described below.
- images are arranged and displayed in a vertically and horizontally uniform matrix.
- images to be subjected to the multi-reproduction may be placed in a single horizontal row.
- a description is given below of an example where images to be subjected to the multi-reproduction are arranged in a single horizontal row.
- the internal configuration of an electronic device according to the present embodiment is similar to that in Fig. 1 and thus the description thereof is omitted here.
- processing procedures according to the present embodiment basically, portions similar to those in Figs. 2 to 5 are not described here. The differences from the first embodiment are described below.
- Figs. 8A to 8C are diagrams illustrating an example of screen transition when the multi-reproduction is performed in the horizontal direction.
- step S301 in Fig. 3 the CPU 101 places the image subjected to the one-image display in the middle and arranges images before and after the image in the order of file numbers, thereby performing multi-display on these images.
- the image placed in the middle is displayed in a size slightly larger than the other images.
- a during-detection-of-pressure five-image multi-reproduction process is performed instead of the during-detection-of-pressure four-image multi-reproduction process.
- the number of images to be subjected to the multi-display may be any number. Further, the number of images to be subjected to the multi-display may be changed according to the degree of the pressure of the touch push.
- the multi-display screen After the one-image display is switched to the multi-display by a touch push, and if the state of the touch push is canceled (the pressure P is less than or equal to the threshold SH1') without performing a touch move, or a touch-up is performed, the multi-display screen returns to the single-reproduction state. At this time, the multi-display screen returns to the single-reproduction state without wait for the lapse of a predetermined time.
- images to be subjected to the multi-reproduction are scrolled according to the direction of the move.
- scrolling display is performed if a touch move is performed in the up or down direction (or alternatively in the right or left direction), scrolling display is performed. In the present embodiment, if a touch move is performed in the right or left direction, scrolling display is performed. In the present embodiment, in a case where a touch move is performed in the right or left direction, scrolling display is performed to change a part of the group of images displayed at that time. That is, scrolling display is performed to shift images frame by frame.
- Fig. 8C illustrates an example of the multi-display when a touch move is performed in the left direction in the state illustrated in Fig. 8B .
- the multi-reproduction state returns to the single-reproduction state.
- the multi-reproduction state may not immediately return to the single-reproduction state.
- the multi-reproduction state may return to the single-reproduction state. In such a manner, in a case where a touch move is repeatedly performed to scroll images by a large amount, it is possible to prevent the multi-reproduction state from frequently returning to the single-reproduction state.
- control is performed so that the image displayed in the middle is displayed.
- the multi-reproduction state returns to the single-reproduction state in response to, for example, a touch-up in the state illustrated in Fig. 8C
- an image is displayed as illustrated in Fig. 8D .
- control may be performed so that if a tap is performed in the multi-reproduction state, the multi-reproduction state returns to the single-reproduction state.
- control may be performed so that if a touch operation is not performed for a predetermined time or more, the multi-reproduction state returns to the single-reproduction state.
- the multi-reproduction state returns to the single-reproduction state.
- the multi-reproduction state may not return to the single-reproduction state.
- the present embodiment described above compared with the first embodiment, it is possible to omit the operation of switching to the multi-reproduction state with a touch push, performing a touch move, and then returning to the single-reproduction state.
- the present embodiment excludes the need for the operation of selecting and tapping any one of images subjected to the multi-reproduction. Accordingly, with a touch operation within the reach of a single finger of one hand holding the electronic device, it is possible to perform the operation of, for example, transitioning to the multi-reproduction, searching for an image by scrolling in the multi-reproduction, and placing a desired image in the middle to return to the single-reproduction. Furthermore, in a case where a desired item is selected from among a plurality of images, a user can easily select the desired image with a small number of touch operations and an intuitive touch operation.
- a third embodiment of the present invention will be described below.
- examples have been described where an image is subjected to single-reproduction, or images are subjected to multi-reproduction.
- the present embodiment an example is described where the present invention is applied to other than a list of images.
- the internal configuration of an electronic device according to the present embodiment is similar to that in Fig. 1 , and thus the description thereof is omitted here.
- processing procedures according to the present embodiment basically, portions similar to those in Figs. 2 to 5 are not described here. The differences from the first embodiment are described below.
- Figs. 9A to 9D are diagrams each illustrating an example of screen transition when the present invention is applied to a web browser.
- Fig. 9A illustrates an example of a screen on which a web browser displays information on a particular web page.
- the CPU 101 acquires information on a page to be displayed from the communication I/F 110 via the Internet 111 and displays a detailed information display screen (a content display screen) for this page on the display 105.
- the example illustrated in Fig. 9A corresponds to the single-reproduction state in the first embodiment. If a touch push is executed in this state, a list of currently opened web pages is displayed as illustrated in Fig. 9B .
- the state of this list display corresponds to the multi-reproduction state during the detection of the pressure.
- the number of web pages to be subjected to the list display may be any number, and the number of the web pages to be subjected to the list display may be changed according to the degree of the pressure of the touch push.
- Fig. 9C illustrates an example of the list display in a case where a touch move has been performed in the down direction on the screen illustrated in Fig. 9B .
- control is performed so that a web page corresponding to the position of a tap on a selected item is displayed.
- Fig. 9D illustrates an example of a screen in a case where a tap has been performed on a web browser corresponding to the fifth page, which is placed in the middle of the list display illustrated in Fig. 9C .
- the one-image reproduction process is replaced by the process of displaying the screen illustrated in Fig. 9A or 9D
- the four-image reproduction process is replaced by the process of displaying the screen illustrated in Fig. 9B or 9C .
- the present embodiment is similar in other respects to the first embodiment. In a case where more web pages are subjected to the list display as in the nine-image reproduction in the first embodiment, a list screen for more web pages than the examples illustrated in Figs. 9B and 9C may be able to be displayed.
- the aforementioned configurations enable a user to easily select the desired web page with a small number of touch operations and an intuitive touch operation in selecting a desired web page from among a plurality of opened web pages.
- a fourth embodiment of the present invention will be described below.
- a list of web pages is displayed.
- information about an email is displayed.
- the internal configuration of an electronic device according to the present embodiment is similar to that in Fig. 1 and thus the description thereof is omitted.
- processing procedures according to the present embodiment basically, portions similar to those in Figs. 2 to 5 are not described here. The differences from the first embodiment are described below.
- Figs. 10A to 10D are diagrams illustrating an example of screen transition when the present invention is applied to an email client.
- Fig. 10A illustrates an example of a screen on which information (body text) about a particular email is displayed.
- the example illustrated in Fig. 10A corresponds to the single-reproduction state in the first embodiment.
- a list of received emails is displayed as illustrated in Fig. 10B .
- the state of this list display corresponds to the multi-reproduction state during the detection of the pressure.
- the list display is performed in such a manner that the amount of information is reduced and, for example, only a title and a single line of body text is to be displayed in the list.
- the number of emails to be subjected to the list display may be any number, and the number of emails to be subjected to the list display may be changed according to the degree of the pressure of the touch push.
- Fig. 10C illustrates an example of the list display of emails in a case where a touch move has been performed in the down direction in the state illustrated in Fig. 10B .
- control is performed so that the detailed information about an email corresponding to the position of a tap on a selected item is displayed.
- Fig. 10D illustrates an example of a screen in a case where a tap is performed on the item of an email placed at the top of the list display illustrated in Fig. 10C .
- the aforementioned configuration enables the user to easily select the email with a small number of touch operations and an intuitive touch operation in selecting a desired email from among a plurality of emails.
- the present invention is also applicable to, for example, the following screens each displaying detailed information (herein after referred to as a content display screen) and list screens in addition to the above images, web pages, and emails.
- the present invention is not limited to this example, and is applicable to any apparatus including a touch panel and capable of detecting the pressure of a touch push. That is, the present invention is applicable to, for example, a personal computer, a personal digital assistant (PDA), a mobile phone terminal, a mobile image viewer, a printer apparatus including a display, a digital photo frame, a music player, and a game apparatus. Furthermore, the present invention is also applicable to an electronic book reader, a tablet terminal, a smartphone, a projection apparatus, a household electrical appliance apparatus including a display, and an in-car apparatus.
- PDA personal digital assistant
- the present invention is also applicable to an electronic book reader, a tablet terminal, a smartphone, a projection apparatus, a household electrical appliance apparatus including a display, and an in-car apparatus.
- Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a 'non-transitory computer-readable storage medium') to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s).
- computer executable instructions e.g., one or more programs
- a storage medium which may also be referred to more fully as
- the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
- the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
- the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.
Description
- The present invention particularly relates to an electronic device suitable for use in an operation in a device including a touch panel, a method for controlling an electronic device, and a storage medium.
- In recent years, various electronic products have included touch panels. A touch panel is a device obtained by integrating a display unit and an operation unit with which a user performs an operation. The user touches the touch panel according to information displayed on the touch panel to operate an electronic product. Thus, the touch panel is an input and output interface enabling a highly intuitive operation.
- In a case where a user operates the touch panel, the user performs a desired operation by moving their finger to a button displayed on the touch panel and touching the button to select the button. At this time, the user may touch the touch panel for a plurality of times until the desired operation is completed. If the user performs a plurality of touches, particularly in a case where the procedure of the operation becomes long, the operation is difficult to understand. In addition, if the procedure of the operation is long, the distance at which the user moves the finger on the touch panel may become long. Consequently, the user may feel weary of the operation of performing a touch.
- In response, Japanese Patent Application Laid-Open No.
2009-245037 - In the method discussed in Japanese Patent Application Laid-Open No.
2009-245037 -
EP2 458 487 discloses an operation control device which includes a contact detection unit for detecting contact of an operation body with a display surface of a display unit on which information is displayed, a pressure detection unit, provided on the display unit, for detecting a pressure at which the operation body presses the display surface of the display unit, and an operation control unit for changing a display state of the information displayed on the display unit in a forward or reverse direction on the basis of an amount of pressure detected by the pressure detection unit until the operation body makes contact with and is separated from the display surface of the display unit. - The present invention is directed to a technique for enabling a user to intuitively and easily switch to list display with a small number of touch operations to easily search for another item.
- According to an aspect of the present invention, there is provided an electronic device as specified in
claims 1 to 13. According to a second aspect of the present invention, there is provided a method for controlling an electronic device as specified inclaim 14. According to a third aspect of the present invention, there is provided a program for causing a computer to function as the units of the electronic device, as specified inclaim 15. According to a fourth aspect of the present invention, there is provided a non-transitory computer-readable storage medium having stored therein a program for causing a computer to function as the units of the electronic device, as specified in claim 16. - Further features of the present invention will become apparent from the following description of embodiments with reference to the attached drawings.
-
-
Fig. 1 is a block diagram illustrating an example of an internal configuration of an electronic device according to an embodiment. -
Fig. 2 is a flowchart illustrating an example of a detailed processing procedure of a single-reproduction process. -
Fig. 3 is a flowchart illustrating an example of a detailed processing procedure of a during-detection-of-pressure four-image multi-reproduction process. -
Fig. 4 is a flowchart illustrating an example of a detailed processing procedure of a during-detection-of-pressure nine-image multi-reproduction process. -
Fig. 5 is a flowchart illustrating an example of a detailed processing procedure of a multi-reproduction process. -
Figs. 6A to 6G are diagrams illustrating examples of images displayed on a display. -
Figs. 7A to 7C are diagrams illustrating examples where images to be subjected to multi-display change according to a position of a touch. -
Figs. 8A to 8D are diagrams illustrating examples of multi-display in a horizontal direction. -
Figs. 9A to 9D are diagrams illustrating examples of screens for a list of web pages and content of the web pages. -
Figs. 10A to 10D are diagrams illustrating examples of screens for a list of emails and contents of the emails. - A first embodiment of the present invention is described in detail below based on the accompanying drawings.
-
Fig. 1 is a block diagram illustrating an example of the internal configuration of anelectronic device 100 according to the present embodiment. - The
electronic device 100 includes a central processing unit (CPU) 101, amemory 102, anon-volatile memory 103, animage processing unit 104, adisplay 105, anoperation unit 106, a recording medium interface (I/F) 107, an external I/F 109, a communication I/F 110, atouch panel 112, and apressure detection unit 113. These components are connected to each other via aninternal bus 150, and the components connected to theinternal bus 150 can exchange data with each other via theinternal bus 150. - The
memory 102 includes, for example, a random-access memory (RAM) (e.g., a volatile memory with semiconductor devices). - According to a program stored, for example, in the
non-volatile memory 103, theCPU 101 controls the components of theelectronic device 100 using thememory 102 as a work memory. - The
non-volatile memory 103 stores image data, sound data, other types of data, and various programs for the operation of theCPU 101. Thenon-volatile memory 103 includes, for example, a hard disk (HD) and a read-only memory (ROM). - Under the control of the
CPU 101, theimage processing unit 104 performs various types of image processing on, for example, image data stored in thenon-volatile memory 103 or arecording medium 108, an image signal acquired via the external I/F 109, and image data acquired via the communication I/F 110. The image processing performed by theimage processing unit 104 includes an analog-to-digital (A/D) conversion process, a digital-to-analog (D/A) conversion process, a compression process, a decoding process, an enlargement and reduction process (resizing), a noise reduction process, and a color conversion process. Theimage processing unit 104 may be configured with a dedicated circuit block for performing particular image processing. Alternatively, depending on the type of image processing, theCPU 101 can also perform the image processing according to a program without using theimage processing unit 104. - Under the control of the
CPU 101, thedisplay 105 displays an image or a graphical user interface (GUI) screen, which forms a GUI. According to a program, theCPU 101 generates a display control signal and controls the components of theelectronic device 100 so as to generate an image signal to be used for displaying an image on thedisplay 105 and output the image signal to thedisplay 105. Thedisplay 105 displays an image based on the output image signal. Theelectronic device 100 itself may include only an interface for outputting an image signal with which an image is to be displayed on thedisplay 105, and thedisplay 105 may be configured with an external monitor (e.g., television). - The
operation unit 106 is an input device for receiving an operation of a user. The input device includes a text information input device such as a keyboard, a pointing device such as a mouse, a button, a dial, and a joystick. - The
recording medium 108, such as a memory card, a compact disc (CD), and a digital versatile disc (DVD), is attachable to the storage medium I/F 107. Under the control of theCPU 101, the storage medium I/F 107 reads and writes data from and to the attachedrecording medium 108. - The external I/
F 109 is an interface for connecting to an external device via a cable for wired connection or wirelessly, and inputting and outputting an image signal or a sound signal. - The communication I/
F 110 is an interface for communicating with an external device or theInternet 111, and transmitting and receiving various types of data such as a file and a command. - The
electronic device 100 includes thetouch panel 112 capable of detecting a contact with thedisplay 105. Thetouch panel 112 and thedisplay 105 can be formed in an integrated manner. For example, thetouch panel 112 is configured so that the transmittance of light does not hinder the display of thedisplay 105. Then, thetouch panel 112 is attached to an upper layer of a display surface of thedisplay 105. Then, input coordinates on thetouch panel 112 are associated with display coordinates on thedisplay 105. Consequently, it is possible to configure a GUI as if a user can directly operate a screen displayed on thedisplay 105. TheCPU 101 can detect the following operations on the touch panel 112 (the following operations on an operation surface of the display 105) or the following states based on a touch. - An operation that a finger or a pen that has not touched the
touch panel 112 newly touches thetouch panel 112, i.e., the start of a touch (hereinafter referred to as a "touch-down"). - A state where a finger or a pen is touching the touch panel 112 (hereinafter referred to as a "touch-on").
- An operation that a finger or a pen is moving while the finger or the pen keeps touching the touch panel 112 (hereinafter referred to as a "touch move").
- An operation that a finger or a pen having touched the
touch panel 112 is released from thetouch panel 112, i.e., the end of a touch (hereinafter referred to as a "touch-up"). - A state where nothing touches the touch panel 112 (hereinafter referred to as a "touch-off").
- In response to a detection of a touch-down, simultaneously, a touch-on is also detected. After the touch-down, normally, the touch-on continues to be detected unless a touch-up is detected. A touch-on is detected also in the state where a touch move is detected. Even if a touch-on is detected, but if the touch position does not move, a touch move is not detected. After a touch-up of all the fingers or the pen having touched the
touch panel 112 is detected, a touch-off is detected. - The
CPU 101 is notified via theinternal bus 150 of these operations or states and the position coordinates where the finger or the pen touches thetouch panel 112. TheCPU 101 determines, based on the information of which theCPU 101 is notified, what operation is performed on thetouch panel 112. In the case of a touch move, theCPU 101 can also determine, based on changes in the position coordinates, the moving direction of the finger or the pen moving on thetouch panel 112 with respect to each of the vertical and horizontal components on thetouch panel 112. - Further, if a user performs a touch-down, a certain touch move, and a touch-up on the
touch panel 112, such an operation is regarded as drawing a stroke. The operation of quickly drawing a stroke is referred to as a "flick". A flick is the operation of quickly moving the finger by a certain distance while the finger keeps touching thetouch panel 112, and then releasing the finger from thetouch panel 112 immediately after the quick movement. In other words, a flick is the operation of quickly tracing thetouch panel 112 with the finger in a flipping manner. If a touch move performed by a predetermined distance or more at a predetermined speed or more is detected, and a touch-up is detected immediately after the touch move, theCPU 101 can determine that a flick is performed. - Further, if a touch move performed by a predetermined distance or more at less than a predetermined speed is detected, the
CPU 101 determines that a drag is performed. If a touch move is performed by less than a predetermined distance, and an operation from a touch-down to a touch-up is detected within a predetermined time, theCPU 101 determines that a tap is performed. In addition, if an operation from a touch-down to a touch-up is performed with a touch move not being performed by a predetermined distance or more, regardless of time, theCPU 101 may determine that a tap is performed. - A touch operation for simultaneously touching a plurality of points (e.g., two points) and bringing the touch positions close to each other is referred to as a "pinch-in", and a touch operation for releasing the touch positions from each other is referred to as a "pinch-out". A pinch-out and a pinch-in are collectively referred to as a "pinch operation" (or simply as a "pinch").
- The
touch panel 112 may be a touch panel of any of various types such as a resistive type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and a photo-sensor type. A method for detecting the presence of a touch according to the presence of the contact of the finger or the pen with thetouch panel 112, or a method for detecting the presence of a touch according to the presence of the approach of the finger or the pen to thetouch panel 112 is included depending on the type of the touch panel can be applicable. - The
pressure detection unit 113 detects the pressing force on the operation surface of thedisplay 105. Thepressure detection unit 113 can continuously detect the strength of the pressing force in a case where thedisplay 105 is pressed with a touch operation on thedisplay 105. Thepressure detection unit 113 can be configured to detect the pressing force on the operation surface of thedisplay 105 based on an output value from a strain gauge sensor installed in a portion that is distorted by the pressing force on the operation surface of thedisplay 105. Alternatively, with a capacitance sensor provided parallel to thedisplay 105, thepressure detection unit 113 calculates, from the capacitance value, the distance between the finger on the operation surface of thedisplay 105 and the capacitance sensor resulting from the distortion of the operation surface by the pressing force on the operation surface. Thepressure detection unit 113 may calculate a pressure based on the calculated distance or equate the calculated distance with a pressure. Yet alternatively, thepressure detection unit 113 may employ any other methods capable of detecting the pressing force on the operation surface of thedisplay 105. Thepressure detection unit 113 and thetouch panel 112 may be formed in an integrated manner. Hereinafter, the operation of pressing the operation surface of thedisplay 105 will be referred to as a "touch push". - Next, a description is given of an operation when a touch-down is performed in the state where an image is displayed on the
display 105. - In the
recording medium 108, a plurality of image files is saved with file numbers. In a case where an image of an image file saved in therecording medium 108 is displayed on thedisplay 105, an image to be displayed can be switched by a touch operation on thetouch panel 112. Further, theelectronic device 100 according to the present embodiment can be switched to "one-image reproduction" for displaying a single image full-screen, "four-image reproduction" for simultaneously displaying four different images, or "nine-image reproduction" for simultaneously displaying nine different images. -
Figs. 2 to 5 illustrate examples of a series of processing procedures according to a touch operation and a touch push operation in the present embodiment. These processes are implemented by a program recorded in thenon-volatile memory 103 being loaded into thememory 102, and by theCPU 101 executing the program. -
Fig. 2 is a flowchart illustrating an example of the detailed processing procedure of a single-reproduction process for performing one-image reproduction to display on thedisplay 105 an image of an image file saved in therecording medium 108. This process starts in a case where the user operates thetouch panel 112 to give an instruction to reproduce an image, or processing described below proceeds to the single-reproduction process. Then, in step S201, theCPU 101 reads an image file from therecording medium 108 and displays an image of the image file on thedisplay 105. -
Fig. 6A illustrates an example of the image subjected to one-image display in step S201 inFig. 2 . In the one-image display, in a display area of thedisplay 105 for displaying an image, a single image is displayed in the maximum size that allows the entirety of the image to fall within the display area. That is, in the one-image display, an image is displayed at the smaller of a display magnification at which the vertical length of the image matches the vertical length of the display area, and a display magnification at which the horizontal length of the image matches the horizontal length of the display area. The one-image display also corresponds to a detailed display screen for displaying each image with more details than multi-reproduction (list display) described below. In the examples of display illustrated inFigs. 6A to 6G , for convenience, a file number is displayed at the bottom right of each image so that the order of images to be displayed is easily understandable. The file number, however, may not actually be displayed. - Next, in step S202, the
CPU 101 determines whether a one-point touch-down (a touch-down on a single point) on thetouch panel 112 is detected. If, as a result of this determination, theCPU 101 detects a one-point touch-down (YES in step S202), the processing proceeds to step S203. If not (NO in step S202), the processing proceeds to step S211. - In step S203, the
pressure detection unit 113 detects a pressure P of a touch push in the state where a touch-on is being performed. Then, theCPU 101 determines whether the detected pressure P of the touch push exceeds a predetermined threshold SH1. If, as a result of this determination, the pressure P exceeds the threshold SH1 (YES in step S203), the processing proceeds to step S209. If not (NO in step S203), the processing proceeds to step S204. A "during-detection-of-pressure four-image multi-reproduction process" in step S209 will be described below with reference to the flowchart inFig. 3 . - In step S204, the
CPU 101 determines whether a touch move being performed in a right or left direction on thetouch panel 112 is detected. If, as a result of this determination, theCPU 101 detects that a touch move in the right or left direction is being performed (YES in step S204), the processing proceeds to step S208. If not (NO in step S204), the processing proceeds to step S205. - In step S208, according to the direction of the touch move, the
CPU 101 scrolls (moves the display position of) an image to be displayed on thedisplay 105. At this time, theCPU 101 reads from therecording medium 108 an image file of an image to be displayed next with scrolling and displays the image on thedisplay 105. In this manner, it is possible to switch from the current image to the next image or the previous image in a predetermined order (e.g., the order of file names) with scrolling. If the image is scrolled in the left direction by a touch move, theCPU 101 reads from therecording medium 108 an image file having a file number after that of the currently displayed image. If, on the other hand, the image is scrolled in the right direction by the touch move, theCPU 101 reads from therecording medium 108 an image file having a file number before that of the currently displayed image. For example, if a touch move is performed in the left direction in the state ofFig. 6A , and the image is scrolled to the left and switched to the next image, the next image is displayed as illustrated inFig. 6B . - Next, in step S205, the
CPU 101 determines whether theCPU 101 detects that a multi-touch is performed on thetouch panel 112. At this time, a "multi-touch" refers to the state where a touch-on is performed at two or more points. If, as a result of this determination, theCPU 101 detects that a multi-touch is performed (YES in step S205), the processing proceeds to step S206. If not (NO in step S205), the processing proceeds to step S207. - In step S206, the
CPU 101 determines whether theCPU 101 detects that a pinch-in is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a pinch-in is performed (YES in step S206), the processing proceeds to step S210. If not (NO in step S206), the processing proceeds to step S207. A "multi-reproduction process" in step S210 will be described below with reference to a flowchart inFig. 5 . - In step S207, the
CPU 101 determines whether theCPU 101 detects that a touch-up is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a touch-up is performed (YES in step S207), the processing proceeds to step S211. If not (NO in step S207), the processing returns to step S203. - In step S211, the
CPU 101 determines whether an event for ending the image reproduction process occurs. Examples of the event for ending the image reproduction process include turning off theelectronic device 100, switching to an operation mode different from that for reproducing an image, and terminating application software that is reproducing an image. If, as a result of this determination, an event for ending the image reproduction process occurs (YES in step S211), the single-reproduction process ends. If not (NO in step S211), the processing returns to step S202. -
Fig. 3 is a flowchart illustrating an example of the detailed processing procedure of the during-detection-of-pressure four-image multi-reproduction process in step S209 inFig. 2 . - First, in step S301, the
CPU 101 reproduces four image files saved in therecording medium 108 and displays four images on thedisplay 105. At this time, theCPU 101 newly reads, from therecording medium 108, three image files with file numbers following that of the image file subjected to the one-image reproduction immediately before the displaying of the four images, and causes theimage processing unit 104 to resize images of the image files to be displayed to sizes that allow the placement of four images. Then, theCPU 101 displays the four images. -
Fig. 6C illustrates examples of the images subjected to four-image display in step S301 inFig. 3 . Four images are displayed in sizes smaller than in the one-image reproduction on thedisplay 105. In a case where the state of the one-image reproduction transitions to the four-image reproduction with a touch push, the image displayed in one-image reproduction immediately before the touch push is included in the four images to be displayed. For example, in a case where the state where an image with a file number "1" is displayed with the one-image reproduction as inFig. 6A transitions to the four-image reproduction, four images with file numbers "1" to "4" are displayed as illustrated inFig. 6C . - Next, in step S302, the
CPU 101 determines whether theCPU 101 detects that a touch move is performed in an up or down direction with a touch operation continuous from the touch-down determined in step S202 (a touch operation performed without releasing the touch from the touch panel 112). If, as a result of this determination, theCPU 101 detects that a touch move is performed in the up or down direction (YES in step S302), the processing proceeds to step S307. If not (NO in step S302), the processing proceeds to step S303. - In step S303, the
pressure detection unit 113 detects the pressure P of the touch push in the state where the touch-on is performed. Then, theCPU 101 determines whether the detected pressure P of the touch push exceeds a predetermined threshold SH1'. Here, the relationship between the thresholds SH1 and SH1' is threshold SH1 > threshold SH1'. The threshold SH1' is set to a value with hysteresis with respect to the threshold SH1 so that an operation unintended by the user is not performed based on a change in pressure in the state where the touch push state is maintained. That is, the processing does not return to the single-reproduction process with a slight decrease in the pressure of the touch push. If, as a result of this determination, the pressure P exceeds the threshold SH1' (YES in step S303), the processing proceeds to step S304. If not (NO in step S303), the processing returns to the "single-reproduction process" inFig. 2 , which is step S311. - In step S304, the
CPU 101 further determines whether the pressure P of the touch push exceeds a predetermined threshold SH2. Here, the threshold SH2 is a pressure greater than the thresholds SH1 and SH1'. If, as a result of this determination, the pressure P exceeds the threshold SH2 (YES in step S304), the processing proceeds to step S306. If not (NO in step S304), the processing proceeds to step S305. A "during-detection-of-pressure nine-image multi-reproduction process" in step S306 will be described below with reference to a flowchart inFig. 4 . - In step S305, the
CPU 101 determines whether theCPU 101 detects that a touch-up is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a touch-up is performed (YES in step S305), the processing proceeds to the "single-reproduction process" in step S311. If not (NO in step S305), the processing returns to step S302. - Once a touch move in the up or down direction (the operation of scrolling the images) is performed, the processing proceeds to step S307, and the processes of steps S303 to S305 are not performed. That is, once a touch move in the up or down direction (the operation of scrolling the images) is performed, the number and the sizes of images to be displayed are not changed even if the pressure changes by a touch push. On the other hand, after the state of the one-image reproduction is switched to the four-image reproduction by a touch push, and if the pressure P of the touch push is made less than or equal to the threshold SH1' without a touch move in the up or down direction, or a touch-up is performed, the four-image reproduction can return to the previous one-image reproduction. In this case, an image to be displayed in the one-image reproduction is the same image as that before the touch push.
- If the pressure P of the touch push is made less than or equal to the threshold SH1' without a touch move, and even if the processing returns to the single-reproduction process in
Fig. 2 , the touch-on continues to be performed. In such a case, after the process of step S201, the process of step S202 is skipped, and the processing proceeds to step S203. That is, various touch operations and a touch push operation in the single-reproduction process may be enabled in the state where the touch-on continues to be performed. With such a configuration, even if the processing proceeds to the processing inFig. 3 by the user inadvertently performing a strong touch without intending to perform a touch push in the state of the one-image reproduction, the user can return to the one-image reproduction by weakening the pressure of the touch push, and perform an intended operation. - Conversely, in a case where the processing returns to the single-reproduction process in
Fig. 2 , the determination may be NO in step S202 after the process of step S201 so long as the touch continues to be performed. In this manner, various touch operations and a touch push operation in the single-reproduction process may not be allowed unless the touch is released once and a touch-down is performed again. - In step S307, according to whether the direction of the touch move is the up direction or the down direction, the
CPU 101 scrolls images to be displayed on thedisplay 105. TheCPU 101 newly reads, from therecording medium 108, images to be newly displayed with scrolling. If the images are scrolled in the down direction, theCPU 101 reads four image files with file numbers before those of the currently displayed images. If the images are scrolled in the up direction, theCPU 101 reads four image files with file numbers after those of the currently displayed images. Theimage processing unit 104 resizes images of the newly read four image files to sizes that allow the placement of four images. Then, theCPU 101 displays the four images. For example, if a touch move is performed in the up direction in the state where the four images with the file numbers "1" to "4" are displayed as inFig. 6C , the images can be scrolled upward as a whole, and four images with file numbers "5" to "8" can be displayed as illustrated inFig. 6D . - Next, in step S308, the
pressure detection unit 113 detects the pressure P of a touch push in the state where the touch-on is performed. Then, theCPU 101 determines whether the detected pressure P exceeds the threshold SH2. If, as a result of this determination, the pressure P exceeds the threshold SH2 (YES in step S308), the processing proceeds to the "during-detection-of-pressure nine-image multi-reproduction process" in step S306. If not (NO in step S308), the processing proceeds to step S309. - In step S309, the
CPU 101 determines again whether theCPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, theCPU 101 detects that a touch move is performed in the up or down direction (YES in step S309), the processing returns to step S307. If not (NO in step S309), the processing proceeds to step S310. - In step S310, the
CPU 101 determines whether theCPU 101 detects that a touch-up is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a touch-up is performed (YES in step S310), the "during-detection-of-pressure four-image multi-reproduction process" ends, and the processing proceeds to step S210 inFig. 2 . If not (NO in step S310), the processing returns to step S308. -
Fig. 4 is a flowchart illustrating an example of the detailed processing procedure of the during-detection-of-pressure nine-image multi-reproduction process in step S306 inFig. 3 . - First, in step S401, the
CPU 101 reproduces nine image files saved in therecording medium 108 and displays nine images on thedisplay 105. At this time, theCPU 101 newly reads, from therecording medium 108, five image files with file numbers following those of the image files displayed with the four-image reproduction immediately before the display of the nine images and causes theimage processing unit 104 to resize images of the image files to be displayed to sizes that allow the placement of nine images. Then, theCPU 101 displays the nine images. -
Fig. 6E illustrates examples of the images subjected to nine-image display in step S401 inFig. 4 . If the state where the images with the file numbers "1" to "4" are displayed as inFig. 6C transitions to the nine-image reproduction by a user strengthening the pressure of the touch push, nine images with file numbers "1" to "9" are displayed as illustrated inFig. 6E . - Next, in step S402, the
CPU 101 determines whether theCPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, theCPU 101 detects that a touch move is performed in the up or down direction (YES in step S402), the processing proceeds to step S406. If not (NO in step S402), the processing proceeds to step S403. - In step S403, the
pressure detection unit 113 detects the pressure P of the touch push in the state where the touch-on is performed. Then, theCPU 101 determines whether the detected pressure P of the touch push exceeds the threshold SH1. If, as a result of this determination, the pressure P of the touch push exceeds the threshold SH1 (YES in step S403), the processing proceeds to step S404. If not (NO in step S403), the processing proceeds to the "single-reproduction process" in step S311. - Next, in step S404, the
CPU 101 further determines whether the pressure P of the touch push exceeds a predetermined threshold SH2'. Here, the relationship between the thresholds SH2, SH2', SH1, and SH1' are threshold SH2 > threshold SH2' > threshold SH1 > threshold SH1'. The value of the threshold SH2' is set to a value with hysteresis with respect to the threshold SH2 so that an operation unintended by the user is not performed based on a change in pressure in the state where the touch push state is maintained. That is, the processing does not return to the during-detection-of-pressure four-image multi-reproduction process with a slight decrease in the pressure of the touch push. If, as a result of this determination, the pressure P exceeds the threshold SH2' (YES in step S404), the processing proceeds to step S405. If not (NO in step S404), the processing proceeds to the "during-detection-of-pressure four-image multi-reproduction process" in step S209. - In step S405, the
CPU 101 determines whether theCPU 101 detects that a touch-up is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a touch-up is performed (YES in step S405), the processing proceeds to the "single-reproduction process" in step S311. If not (NO in step S405), the processing returns to step S402. - As in the during-detection-of-pressure four-image multi-reproduction process, once a touch move in the up or down direction (the operation of scrolling the images) is performed, the processing proceeds to step S406, and the processes of steps S403 to S405 are not performed. That is, once a touch move in the up or down direction (the operation of scrolling the images) is performed, the number and the sizes of images to be displayed are not changed even if the pressure changes by a touch push. Meanwhile, after the state of the four-image reproduction is switched to the nine-image reproduction with a touch push, and if the pressure P of the touch push is made greater than the threshold SH1 and less than or equal to the threshold SH2' with a touch move not being performed in the up or down direction, the nine-image reproduction can return to the previous four-image reproduction. In this case, images to be displayed in the four-image reproduction are the same images as those in the previous four-image reproduction.
- In a case where the pressure P of the touch push is made less than or equal to the threshold SH2' with a touch move not being performed in the up or down direction, and even if the processing returns to the during-detection-of-pressure four-image multi-reproduction process in
Fig. 3 , the touch continues to be performed. Various touch operations and a touch push operation in the during-detection-of-pressure four-image multi-reproduction process can be performed with the touch not being released in this state. In such a manner, even if the processing proceeds toFig. 4 by the user inadvertently performing a strong touch without intending to perform a touch push in the state of the four-image reproduction, the user can return to the four-image reproduction by weakening the pressure of the touch and perform an intended operation. The user can also decrease the pressure P of the touch push to less than or equal to the pressure of the threshold SH1 in the during-detection-of-pressure nine-image multi-reproduction process to return to the one-image reproduction, and continue the touch operation in this state without releasing the touch. - In step S406, according to whether the direction of the touch move is the up direction or the down direction, the
CPU 101 scrolls images to be displayed on thedisplay 105. TheCPU 101 newly reads, from therecording medium 108, images to be displayed with scrolling. In a case where the images are scrolled in the down direction, theCPU 101 reads nine image files with file numbers before those of the currently displayed images. In a case where the images are scrolled in the up direction, theCPU 101 reads nine image files with file numbers after those of the currently displayed images. Theimage processing unit 104 resizes images of the newly read nine image files to sizes that allow the placement of nine images. Then, theCPU 101 displays the nine images. For example, if a touch move is performed in the up direction in the state where the nine images with the file numbers "1" to "9" are displayed as inFig. 6E , the images can be scrolled upward as a whole, and nine images with file numbers "10" to "18" can be displayed as illustrated inFig. 6F . For example, if a touch move is performed in the down direction in the state where the nine images with the file numbers "10" to "18" are displayed as inFig. 6F , the images can be scrolled downward as a whole, and the nine images with the file numbers "5" to "13" can be displayed as illustrated inFig. 6G . - Next, in step S407, the
CPU 101 determines whether theCPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, theCPU 101 detects that a touch move is performed in the up or down direction (YES in step S407), the processing returns to step S406. If not (NO in step S407), the processing proceeds to step S408. - In step S408, the
CPU 101 determines whether theCPU 101 detects that a touch-up is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a touch-up is performed (YES in step S408), the processing proceeds to the "multi-reproduction process" in step S210. If not (NO in step S408), the processing returns to step S407. -
Fig. 5 is a flowchart illustrating an example of the detailed processing procedure of the multi-reproduction process in step S210 inFig. 2 . This process is a multi-reproduction process in the state where a touch push is not detected. The processing proceeds to this process in a case where during the four-image display or the nine-image display performed with a touch push, scrolling display is performed without the touch being released, and then, a touch-up is performed. - In step S501, the
CPU 101 reproduces a plurality of image files saved in therecording medium 108 and displays a plurality of images on thedisplay 105. In the present embodiment, the number of images to be subjected to the multi-reproduction is four or nine. In a case where, after scrolling display is performed, a touch up is performed during the during-detection-of-pressure four-image multi-reproduction process or the during-detection-of-pressure nine-image multi-reproduction process, and if a touch-up is performed, the images displayed on thedisplay 105 when the touch-up is performed are displayed as they are. - Next, in step S502, the
CPU 101 determines whether theCPU 101 detects that a tap is performed on any one of the plurality of displayed images. If, as a result of this determination, theCPU 101 detects that a tap is performed on any one of the images (YES in step S502), the processing proceeds to the single-reproduction process in step S311. If not (NO in step S502), the processing proceeds to step S503. If the processing proceeds to the single-reproduction process, the image on which the tap is performed is subjected to the one-image display. That is, the details of an image (an item) selected by the user from among the plurality of images (items) displayed in a list are displayed. - In step S503, the
CPU 101 detects a touch-on on thetouch panel 112 and determines whether theCPU 101 detects that a touch move is performed in the up or down direction. If, as a result of this determination, theCPU 101 detects that a touch move is performed in the up or down direction (YES in step S503), the processing proceeds to step S507. If not (NO in step S503), the processing proceeds to step S504. - In step S507, according to the direction of the touch move, the
CPU 101 scrolls images to be displayed on thedisplay 105. TheCPU 101 newly reads, from therecording medium 108, images to be displayed with scrolling. In a case where the images are scrolled in the down direction, theCPU 101 reads image files with file numbers before those of the currently displayed images. In a case where the images are scrolled in the up direction, theCPU 101 reads image files with file numbers after those of the currently displayed images. The number of image files to be read is determined based on the number of images to be subjected to the multi-reproduction. Theimage processing unit 104 resizes images of the read image files to sizes that allow placement for the multi-reproduction display. Then, theCPU 101 displays these images. - Next, in step S504, the
CPU 101 determines whether theCPU 101 detects that a multi-touch is performed on thetouch panel 112. If, as a result of this determination, theCPU 101 detects that a multi-touch is performed (YES in step S504), the processing proceeds to step S505. If not (NO in step S504), the processing proceeds to step S506. - In step S505, the
CPU 101 determines whether theCPU 101 detects that a pinch operation (a pinch-in or a pinch-out) is performed. If, as a result of this determination, theCPU 101 detects that a pinch operation is performed (YES in step S505), the processing proceeds to step S508. If not (NO in step S505), the processing proceeds to step S506. - In step S508, the
CPU 101 changes the number of images to be subjected to the multi-reproduction. That is, if a pinch-in is performed, theCPU 101 increases the number of images to be subjected to the multi-reproduction and reduces the size of each image to be displayed. For example, the four-image display transitions to the nine-image display. In a case where a pinch-out is performed, theCPU 101 reduces the number of images to be subjected to the multi-reproduction and increases the size of each image to be displayed. For example, the nine-image display transitions to the four-image display, or the four-image display transitions to the one-image display. In a case where a pinch-in is performed when the nine-image display is performed, the number of images is not changed. - In step S506, the
CPU 101 determines whether the multi-reproduction process ends. This determination is the determination of whether the number of images to be displayed becomes one by the process of step S508. If, as a result of this determination, the multi-reproduction process ends (YES in step S506), the process inFig. 5 ends, and the processing proceeds to step S211 inFig. 2 . If not (NO in step S506), the processing returns to step S502. - In the present embodiment, in a case where, after a touch push is performed, a touch move is performed in the up or down direction, the multi-reproduction state is maintained. Alternatively, only in a case where a touch push is performed, the current state may transition to the multi-reproduction state. Then, even after a touch move is performed, but if a touch-on is canceled, the current state may return to the single-reproduction state. Furthermore, in the present embodiment, in a case where a touch move is performed in the up or down direction, scrolling display is performed. Alternatively, in a case where a touch move is performed in the right or left direction, scrolling display may be performed.
- In the one-image reproduction, images to be subjected to the four-image display may differ according to the position of a touch push. With reference to
Figs. 7A to 7C , a description is given below of the difference between multi-display screens displayed on thedisplay 105 according to the position of a touch push. - For example, as illustrated in
Fig. 7A , in a case where a touch push is performed on anarea 701 on an upper side of a screen in the state where the image with the file number "9" is subjected to the one-image display, the four images with the file numbers "9" to "12" are displayed as illustrated inFig. 7B . In such a case, images with file numbers following that of the image subjected to the one-image display are displayed. Thus, it is possible to visually confirm images to be displayed when a touch move is performed in the down direction. - As illustrated in
Fig. 7A , when a touch push is performed on anarea 702 on a lower side of the screen in the state where the image with the file number "9" is subjected to the one-image display, the four images with the file numbers "6" to "9" are displayed as illustrated inFig. 7C . In this case, images with file numbers before the number of the image subjected to the one-image display are displayed. Thus, it is possible to visually confirm images to be displayed when a touch move is performed in the up direction. - As described above, according to the present embodiment, changing the pressing force of a touch push in the single-reproduction process switches from the one-image display to the multi-image display. Further strengthening the pressing force increases the number of images to be subjected to the multi-reproduction. With this configuration, in a case where a desired item is selected from among a plurality of images, it is possible to easily select the desired image with a small number of touch operations and an intuitive touch operation.
- A second embodiment of the present invention will be described below. In the first embodiment, in performing the multi-reproduction, images are arranged and displayed in a vertically and horizontally uniform matrix. Alternatively, images to be subjected to the multi-reproduction may be placed in a single horizontal row. In the present embodiment, a description is given below of an example where images to be subjected to the multi-reproduction are arranged in a single horizontal row. The internal configuration of an electronic device according to the present embodiment is similar to that in
Fig. 1 and thus the description thereof is omitted here. Regarding processing procedures according to the present embodiment, basically, portions similar to those inFigs. 2 to 5 are not described here. The differences from the first embodiment are described below. -
Figs. 8A to 8C are diagrams illustrating an example of screen transition when the multi-reproduction is performed in the horizontal direction. - If a touch push is executed in the state illustrated in
Fig. 8A , and the pressure P of the touch push exceeds the threshold SH1, for example, the current screen switches to a multi-reproduction screen on which images are arranged in a single horizontal row as illustrated inFig. 8B . In step S301 inFig. 3 , theCPU 101 places the image subjected to the one-image display in the middle and arranges images before and after the image in the order of file numbers, thereby performing multi-display on these images. Here, the image placed in the middle is displayed in a size slightly larger than the other images. In the present embodiment, a during-detection-of-pressure five-image multi-reproduction process is performed instead of the during-detection-of-pressure four-image multi-reproduction process. However, the number of images to be subjected to the multi-display may be any number. Further, the number of images to be subjected to the multi-display may be changed according to the degree of the pressure of the touch push. - After the one-image display is switched to the multi-display by a touch push, and if the state of the touch push is canceled (the pressure P is less than or equal to the threshold SH1') without performing a touch move, or a touch-up is performed, the multi-display screen returns to the single-reproduction state. At this time, the multi-display screen returns to the single-reproduction state without wait for the lapse of a predetermined time. After the one-image display is switched to the multi-display by a touch push, and if a touch move is performed, images to be subjected to the multi-reproduction are scrolled according to the direction of the move. In the first embodiment, scrolling display is performed if a touch move is performed in the up or down direction (or alternatively in the right or left direction), scrolling display is performed. In the present embodiment, if a touch move is performed in the right or left direction, scrolling display is performed. In the present embodiment, in a case where a touch move is performed in the right or left direction, scrolling display is performed to change a part of the group of images displayed at that time. That is, scrolling display is performed to shift images frame by frame.
-
Fig. 8C illustrates an example of the multi-display when a touch move is performed in the left direction in the state illustrated inFig. 8B . In the present embodiment, unlike the first embodiment, even after scrolling display is performed with a touch move, if the state of a touch push is canceled, or a touch-up is performed, the multi-reproduction state returns to the single-reproduction state. At this time, even if the state of the touch push is canceled, or the touch-up is performed, the multi-reproduction state may not immediately return to the single-reproduction state. Then, after the lapse of a predetermined time, the multi-reproduction state may return to the single-reproduction state. In such a manner, in a case where a touch move is repeatedly performed to scroll images by a large amount, it is possible to prevent the multi-reproduction state from frequently returning to the single-reproduction state. - In returning from the multi-reproduction state to the single-reproduction state, control is performed so that the image displayed in the middle is displayed. For example, in a case where the multi-reproduction state returns to the single-reproduction state in response to, for example, a touch-up in the state illustrated in
Fig. 8C , an image is displayed as illustrated inFig. 8D . Alternatively, control may be performed so that if a tap is performed in the multi-reproduction state, the multi-reproduction state returns to the single-reproduction state. Yet alternatively, control may be performed so that if a touch operation is not performed for a predetermined time or more, the multi-reproduction state returns to the single-reproduction state. - In the present embodiment, in a case where the user selects a desired image by a touch move, it is assumed that the user moves the desired image to the middle. Thus, there is no need for a configuration in which the processing proceeds to the multi-reproduction process, and the user is allowed to tap and select a desired image as in the first embodiment. In the present embodiment, an image placed in the middle when the state of a touch push is canceled (that is, the pressure P of the touch push became less than or equal to the threshold SH1') or a touch-up is performed is regarded as a desired image, and the multi-reproduction state returns to the single-reproduction state. As in the first embodiment, the multi-reproduction state may not return to the single-reproduction state.
- According to the present embodiment described above, compared with the first embodiment, it is possible to omit the operation of switching to the multi-reproduction state with a touch push, performing a touch move, and then returning to the single-reproduction state. The present embodiment excludes the need for the operation of selecting and tapping any one of images subjected to the multi-reproduction. Accordingly, with a touch operation within the reach of a single finger of one hand holding the electronic device, it is possible to perform the operation of, for example, transitioning to the multi-reproduction, searching for an image by scrolling in the multi-reproduction, and placing a desired image in the middle to return to the single-reproduction. Furthermore, in a case where a desired item is selected from among a plurality of images, a user can easily select the desired image with a small number of touch operations and an intuitive touch operation.
- A third embodiment of the present invention will be described below. In the first and second embodiments, examples have been described where an image is subjected to single-reproduction, or images are subjected to multi-reproduction. In the present embodiment, an example is described where the present invention is applied to other than a list of images. The internal configuration of an electronic device according to the present embodiment is similar to that in
Fig. 1 , and thus the description thereof is omitted here. Regarding processing procedures according to the present embodiment, basically, portions similar to those inFigs. 2 to 5 are not described here. The differences from the first embodiment are described below. -
Figs. 9A to 9D are diagrams each illustrating an example of screen transition when the present invention is applied to a web browser. -
Fig. 9A illustrates an example of a screen on which a web browser displays information on a particular web page. In the case of a web browser, theCPU 101 acquires information on a page to be displayed from the communication I/F 110 via theInternet 111 and displays a detailed information display screen (a content display screen) for this page on thedisplay 105. Thus, the example illustrated inFig. 9A corresponds to the single-reproduction state in the first embodiment. If a touch push is executed in this state, a list of currently opened web pages is displayed as illustrated inFig. 9B . The state of this list display corresponds to the multi-reproduction state during the detection of the pressure. The number of web pages to be subjected to the list display may be any number, and the number of the web pages to be subjected to the list display may be changed according to the degree of the pressure of the touch push. - If a touch move is performed in the state of the list display, the list of web pages is scrolled according to the direction of the move.
Fig. 9C illustrates an example of the list display in a case where a touch move has been performed in the down direction on the screen illustrated inFig. 9B . In a case where the state of the list display returns to the state where a particular web page is displayed, control is performed so that a web page corresponding to the position of a tap on a selected item is displayed.Fig. 9D illustrates an example of a screen in a case where a tap has been performed on a web browser corresponding to the fifth page, which is placed in the middle of the list display illustrated inFig. 9C . - In the present embodiment, in the processes described with reference to
Figs. 2 to 5 , the one-image reproduction process is replaced by the process of displaying the screen illustrated inFig. 9A or 9D , and the four-image reproduction process is replaced by the process of displaying the screen illustrated inFig. 9B or 9C . The present embodiment is similar in other respects to the first embodiment. In a case where more web pages are subjected to the list display as in the nine-image reproduction in the first embodiment, a list screen for more web pages than the examples illustrated inFigs. 9B and 9C may be able to be displayed. - Accordingly, the aforementioned configurations enable a user to easily select the desired web page with a small number of touch operations and an intuitive touch operation in selecting a desired web page from among a plurality of opened web pages.
- A fourth embodiment of the present invention will be described below. In the third embodiment, an example has been described where a list of web pages is displayed. In the present embodiment, an example is described where information about an email is displayed. The internal configuration of an electronic device according to the present embodiment is similar to that in
Fig. 1 and thus the description thereof is omitted. In processing procedures according to the present embodiment, basically, portions similar to those inFigs. 2 to 5 are not described here. The differences from the first embodiment are described below. -
Figs. 10A to 10D are diagrams illustrating an example of screen transition when the present invention is applied to an email client. -
Fig. 10A illustrates an example of a screen on which information (body text) about a particular email is displayed. The example illustrated inFig. 10A corresponds to the single-reproduction state in the first embodiment. In a case where a touch push is executed in this state, a list of received emails is displayed as illustrated inFig. 10B . The state of this list display corresponds to the multi-reproduction state during the detection of the pressure. The list display is performed in such a manner that the amount of information is reduced and, for example, only a title and a single line of body text is to be displayed in the list. The number of emails to be subjected to the list display may be any number, and the number of emails to be subjected to the list display may be changed according to the degree of the pressure of the touch push. - In response to a touch move performed in the state of the list display, the list of emails to be subjected to the list display is scrolled according to the direction of the move.
Fig. 10C illustrates an example of the list display of emails in a case where a touch move has been performed in the down direction in the state illustrated inFig. 10B . In a case where the state of the list display returns to the state where a particular email is displayed, control is performed so that the detailed information about an email corresponding to the position of a tap on a selected item is displayed.Fig. 10D illustrates an example of a screen in a case where a tap is performed on the item of an email placed at the top of the list display illustrated inFig. 10C . - Performing the processes described with reference to
Figs. 2 to 5 with the replacing of the one-image reproduction with the process of displaying the screen inFig. 10A or 10D , and with the replacing the four-image reproduction with the process of displaying the screen inFig. 10B or 10C enables the above screen transition control. The present embodiment is similar in other respects to the first embodiment. As in the nine-image reproduction in the first embodiment, a list screen for more emails than the examples illustrated inFigs. 10B and 10C may be able to be displayed. - Accordingly, the aforementioned configuration enables the user to easily select the email with a small number of touch operations and an intuitive touch operation in selecting a desired email from among a plurality of emails.
- The present invention is also applicable to, for example, the following screens each displaying detailed information (herein after referred to as a content display screen) and list screens in addition to the above images, web pages, and emails.
- A content display screen for a single document (e.g., a Word file or a text file) and a list screen for a plurality of documents.
- A content display screen for a single file and a list screen for a plurality of files.
- A content display screen for a single folder (directory) and a list screen for a plurality of folders (directories).
- A content display screen for a single composition, album, or artist and a list screen for a plurality of compositions, albums, or artists.
- A content display screen (e.g., a reproduction screen) for a single moving image and a list screen for a plurality of moving images.
- A content display screen for a single wireless connection destination and a list screen for a plurality of wireless connection destinations.
- A content display screen (e.g., a work screen) for a single piece of application software and a list screen for a plurality of pieces of application software.
- A content display screen for a single message (talk) target and a list screen for a plurality of message (talk) targets.
- A content display screen for a single posted article and a list screen for a plurality of posted articles.
- Content display screens and list screens to which the present invention is applicable are not limited to the above.
- The description has been given on the assumption that the
CPU 101 controls the above various types of control. Alternatively, a single piece of hardware may control the above various types of control. Yet alternatively, a plurality of pieces of hardware may share processing to control the entirety of the apparatus. - While the present invention has been described in detail based on its suitable embodiments, the present invention is not limited to these specific embodiments. The present invention also includes various forms without departing from the scope of the invention. Further, the above embodiments merely illustrate embodiments of the present invention, and can also be appropriately combined with each other.
- Further, the above embodiments have been described taking as an example a case where the present invention is applied to an electronic device. The present invention, however, is not limited to this example, and is applicable to any apparatus including a touch panel and capable of detecting the pressure of a touch push. That is, the present invention is applicable to, for example, a personal computer, a personal digital assistant (PDA), a mobile phone terminal, a mobile image viewer, a printer apparatus including a display, a digital photo frame, a music player, and a game apparatus. Furthermore, the present invention is also applicable to an electronic book reader, a tablet terminal, a smartphone, a projection apparatus, a household electrical appliance apparatus including a display, and an in-car apparatus.
- According to the present invention, it is possible for a user to intuitively and easily switch to list display with a small number of touch operations.
- Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a 'non-transitory computer-readable storage medium') to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
- While the present invention has been described with reference to embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. It will of course be understood that this invention has been described above by way of example only, and that modifications of detail can be made within the scope of the appended set of claims.
Claims (9)
- A method for controlling an electronic device, the method comprising:detecting a touch operation on an operation surface;detecting a pressing force, on the operation surface, of the detected touch operation; andperforming control so that, in a case where a pressing force exceeding a first pressure (SH1) is detected while detailed information about a particular item is displayed as a detailed information display screen on a display means, the display of the display means is switched to a list screen for displaying a plurality of items;wherein control is performed so that in a case where, after the display of the display means is switched to the list screen:in a case where it is detected that an operation of moving a touch position is performed (S302-YES) after the switching, scrolling display is performed switching at least some of the plurality of items displayed on the list screen, until (S308-YES) the detected pressing force exceeds a second pressure (SH2) greater than the first pressure (SH1), or until the touch is released (S310-YES), and in a case the pressing force exceeds the second pressure (SH2), the display of the display means is switched to another list screen for displaying more items than the list screen (S306);in a case where, without detection of an operation of moving a touch position (S302-NO) the detected pressing force becomes less than or equal to a third pressure (SH1'; S303-NO)less than the first pressure (SH1), the display is switched (S311) back to the detailed information display screen for displaying detailed information about the particular item,if instead the detected pressing force exceeds the second pressure (SH2; S304-YES) greater than the first pressure (SH1), the display of the display means is switched to the another list screen for displaying more items than the list screen;and wherein each of the plurality of items is an image, and the detailed information display screen is a screen on which a single image is displayed.
- The method according to claim 1, comprising, in response to a touch operation for selecting any of the plurality of items displayed on the list screen, performing control so that the list screen is switched to a screen for displaying detailed information about the item selected with the touch operation.
- The method according to claim 1 or 2, further comprising performing control so that, in a case where the display means is displaying detailed information about a particular item, an operation of moving a touch position is performed and the detected pressing force does not exceed the first pressure, the display of the display means is switched to a detailed information display screen for another item different from the particular item (S204).
- The method according to any one of claims 1 to 3,wherein a plurality of touch operations are detected, andwherein, in a case where a plurality of detected touch positions come close to each other while the display means is displaying detailed information about a particular item, performing control so that the display of the display means is switched to a list screen for displaying a plurality of items (S206 YES, S210).
- The method according to any one of claims 1 to 4, comprising perform control so that, in a case where the list screen is displayed in response to a detected pressing force exceeding the first pressure while the display means is displaying detailed information about a particular item, a plurality of items to be displayed on the list screen depends on a detected position of a touch, and the detected pressing force exceeding the first pressure.
- An electronic device comprising:touch detection means (112) configured to detect a touch operation on an operation surface;pressure detection means configured to detect a pressing force, on the operation surface, of the touch operation detected by the touch detection means; anddisplay control means (101) configured to carry out the method of claims 1-5.
- The electronic device according to claim 6, wherein the operation surface is a display surface of the display means.
- A computer program for causing the device of any of claims 6 or 7 to carry out the steps of the method of any of claims 1 to 5.
- A computer-readable storage medium storing a program according to claim 8.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016110006A JP6758921B2 (en) | 2016-06-01 | 2016-06-01 | Electronic devices and their control methods |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3252588A1 EP3252588A1 (en) | 2017-12-06 |
EP3252588B1 true EP3252588B1 (en) | 2020-09-02 |
Family
ID=59021322
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17173946.9A Active EP3252588B1 (en) | 2016-06-01 | 2017-06-01 | Electronic device and method for controlling the same |
Country Status (5)
Country | Link |
---|---|
US (1) | US20170351398A1 (en) |
EP (1) | EP3252588B1 (en) |
JP (1) | JP6758921B2 (en) |
KR (1) | KR102179712B1 (en) |
CN (1) | CN107450768B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20180018150A (en) * | 2016-08-12 | 2018-02-21 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
CN108595083A (en) * | 2018-03-16 | 2018-09-28 | 北京达佳互联信息技术有限公司 | a kind of interface processing method and device |
JP2019164548A (en) * | 2018-03-19 | 2019-09-26 | 京セラドキュメントソリューションズ株式会社 | Information processing apparatus |
CN111801145A (en) * | 2018-03-29 | 2020-10-20 | 科乐美数码娱乐株式会社 | Information processing apparatus and recording medium having program recorded therein for information processing apparatus |
CN109656444B (en) * | 2018-12-13 | 2021-06-08 | 广州市百果园信息技术有限公司 | List positioning method, device, equipment and storage medium |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4951569B2 (en) | 2008-03-31 | 2012-06-13 | 株式会社日立製作所 | Display method of information display device |
JP4752900B2 (en) * | 2008-11-19 | 2011-08-17 | ソニー株式会社 | Image processing apparatus, image display method, and image display program |
CN101446884B (en) * | 2008-12-19 | 2010-12-01 | 腾讯科技(深圳)有限公司 | Touch screen device and scrolling method thereof |
KR101135071B1 (en) * | 2009-02-09 | 2012-04-13 | 에스케이플래닛 주식회사 | Method, Touch Screen Terminal And Computer-Readable Recording Medium with Program for Presenting Contents List |
JP2010191892A (en) * | 2009-02-20 | 2010-09-02 | Sony Corp | Information processing apparatus, display control method, and program |
JP2011028560A (en) * | 2009-07-27 | 2011-02-10 | Sony Corp | Information processing apparatus, display method, and display program |
JP2011028635A (en) * | 2009-07-28 | 2011-02-10 | Sony Corp | Display control apparatus, display control method and computer program |
JP5593655B2 (en) * | 2009-08-31 | 2014-09-24 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
JP2011053974A (en) * | 2009-09-02 | 2011-03-17 | Sony Corp | Device and method for controlling operation, and computer program |
KR101304321B1 (en) * | 2010-01-22 | 2013-09-11 | 전자부품연구원 | Method for providing UI according to single touch pressure and electronic device using the same |
US9256361B2 (en) * | 2011-08-03 | 2016-02-09 | Ebay Inc. | Control of search results with multipoint pinch gestures |
JP5975794B2 (en) * | 2012-08-29 | 2016-08-23 | キヤノン株式会社 | Display control apparatus, display control method, program, and storage medium |
CN102880415A (en) * | 2012-08-30 | 2013-01-16 | 华为终端有限公司 | Multi-task switching method and terminal |
JP6099912B2 (en) * | 2012-09-14 | 2017-03-22 | キヤノン株式会社 | Image processing apparatus, image processing method, and program thereof |
US20140109012A1 (en) * | 2012-10-16 | 2014-04-17 | Microsoft Corporation | Thumbnail and document map based navigation in a document |
KR102001332B1 (en) * | 2012-12-29 | 2019-07-17 | 애플 인크. | Device, method, and graphical user interface for determining whether to scroll or select contents |
-
2016
- 2016-06-01 JP JP2016110006A patent/JP6758921B2/en active Active
-
2017
- 2017-05-23 US US15/602,777 patent/US20170351398A1/en not_active Abandoned
- 2017-05-30 KR KR1020170066490A patent/KR102179712B1/en active IP Right Grant
- 2017-06-01 EP EP17173946.9A patent/EP3252588B1/en active Active
- 2017-06-01 CN CN201710405040.8A patent/CN107450768B/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
KR102179712B1 (en) | 2020-11-17 |
CN107450768B (en) | 2021-05-11 |
JP6758921B2 (en) | 2020-09-23 |
CN107450768A (en) | 2017-12-08 |
KR20170136441A (en) | 2017-12-11 |
EP3252588A1 (en) | 2017-12-06 |
JP2017215838A (en) | 2017-12-07 |
US20170351398A1 (en) | 2017-12-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3252588B1 (en) | Electronic device and method for controlling the same | |
US10684757B2 (en) | Information processing apparatus and information processing method for independently moving and regrouping selected objects | |
EP2835731B1 (en) | Image display apparatus, image display method, and image display program | |
JP7342208B2 (en) | Image processing device, control method and program for the image processing device | |
US8681111B2 (en) | Information processing device and information processing method | |
US9977523B2 (en) | Apparatus and method for displaying information in a portable terminal device | |
US9195373B2 (en) | System and method for navigation in an electronic document | |
US9165534B2 (en) | Information processing apparatus, method for controlling information processing apparatus, and storage medium | |
US20130268851A1 (en) | Bookmark setting method of e-book, and apparatus thereof | |
US11175763B2 (en) | Information processing apparatus, method for controlling the same, and storage medium | |
JP2014041516A (en) | Data processing apparatus and program | |
KR20090017828A (en) | Method for controling interface, and apparatus for implementing the same | |
JP2014203202A (en) | Information processing device, information processing device control method, and program | |
JP6004746B2 (en) | Information display device, information display method, information display program, and program recording medium | |
JP6971573B2 (en) | Electronic devices, their control methods and programs | |
JP6210664B2 (en) | Information processing apparatus, control method therefor, program, and storage medium | |
JP2014106596A (en) | Information processor, control method thereof, and program | |
JP6759023B2 (en) | Display control device, its control method, program, and storage medium | |
WO2014148352A1 (en) | Information terminal, operating region control method, and operating region control program | |
US20130298070A1 (en) | Method for switching display interfaces | |
JP2015225483A (en) | Display control device | |
US10353494B2 (en) | Information processing apparatus and method for controlling the same | |
US20180059890A1 (en) | Information processing apparatus, information processing method, and storage medium storing program | |
JP2023163762A (en) | Information processing method, information processing device, and program | |
JP2015087806A (en) | Device and program for viewing electronic book |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20180606 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20190320 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20200331 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1309609 Country of ref document: AT Kind code of ref document: T Effective date: 20200915 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602017022628 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201203 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1309609 Country of ref document: AT Kind code of ref document: T Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210104 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210102 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602017022628 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20210603 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602017022628 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20210630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210601 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210630 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210601 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220101 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20170601 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200923 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230523 Year of fee payment: 7 |