JP2017027563A - Electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus capable of executing specific processing through simple operation with respect to an object.SOLUTION: The electronic apparatus, in a first state in which a first object and a second object are displayed on the display screen, in the case where a first operation for selecting the first object and the second object is detected and then a second operation for separating the position of the first object and the position of the second object is detected, changes display of the display screen into a second state in which the first object and the second object, the positions of which are separated from each other compared with the first state, are displayed and a third object is displayed between the first object and the second object.SELECTED DRAWING: Figure 4

Description

  Embodiments of the present disclosure relate to an electronic device.

  In recent years, electronic devices such as personal computers and mobile terminals (cell phones, tablet terminals, mobile game machines, etc.) have a function of displaying objects such as thumbnails, icons, applications, images, and the like.

  For example, Patent Document 1 describes an electronic device that can enlarge an image by a touch operation.

JP2013-114558A

  Electronic devices that can display objects are required to be further improved in operability. An object of this indication is to provide the electronic device which can perform a specific process with respect to the displayed object by simple operation.

  An electronic device according to an embodiment of the present disclosure includes a display screen and a control unit. The display screen can display a first object and a second object. The control unit includes the first object, the second object, and a control unit that is displayed on the display screen. In the first state where the first object and the second object are displayed on the display screen, the control unit performs a first operation to select the first object and the second object. After the detection, when a second operation for separating the position of the first object and the position of the second object is detected, the positions of the first objects separated from each other than the first state are detected. And the second object are displayed, and the display screen is changed to a second state in which a third object is displayed between the first object and the second object. Let

  The electronic apparatus of the present disclosure can display the third object by performing a simple operation on the first object and the second object.

FIG. 1 is an external perspective view of a mobile phone 100 showing an embodiment of the present disclosure. FIG. 2 is a block configuration diagram of the mobile phone 100. FIG. 3 is a diagram illustrating an example of the display screen 102 of the mobile phone 100. 4A to 4D are diagrams illustrating screen transitions of the display screen 102 of the mobile phone 100. FIG. 5A to 5D are screen transition diagrams on the display screen 102 after the screen transition of FIG. 6A and 6B are screen transition diagrams on the display screen 102 after the screen transition of FIG. 7A and 7B are screen transition diagrams of the display screen 102 of the mobile phone 100. FIG. 8A and 8B are screen transition diagrams of the display screen 102 of the mobile phone 100. FIG. FIG. 9 is a part of a flowchart of a program in the mobile phone 100. FIG. 10 is a diagram showing a display screen 102 of the mobile phone 100. FIGS. 11A to 11D are screen transition diagrams relating to the display screen 102 different from the display screen 102 in FIGS. 4 to 8.

  An electronic apparatus according to an embodiment of the present disclosure will be described.

〔Constitution〕
As an electronic apparatus according to an embodiment of the present disclosure, a personal computer, a portable terminal (a mobile phone, a tablet terminal, a portable game machine, a wearable device (a device such as a watch, glasses, a belt, clothes, etc. having a display screen)) Etc.

  Hereinafter, a mobile phone is given as a specific example of the electronic device, but the electronic device of the present disclosure is not limited to the mobile phone.

  The present disclosure will be described below using a mobile phone that is an example of an electronic device.

  FIG. 1 is an external perspective view of the mobile phone 100. FIG. 1 shows a straight-type mobile phone 100 capable of touch operation as an example.

  As a specific example of the mobile phone, the straight type mobile phone 100 is shown as described above, but other types of mobile phones such as a folding type and a slide type may be used.

  A mobile phone 100 shown in FIG. 1 includes a lamp 101, a display screen 102, an optical sensor 103, a speaker (receiver) 104, a microphone 105, a button unit 106, and a camera window 107.

  The lamp 101 externally receives incoming call information such as that a call is being received or a missed call exists, or incoming mail information such as that a new mail has been received or an unread mail exists. The user can be notified by emitting light. In addition, the lamp 101 can also notify the user of the arrival of an alarm date and time. The lamp 101 is composed of a light emitting element such as an LED. Examples of the lamp 101 include an LED lamp. The lamp 101 emits light such as lighting and blinking to notify the user.

  The display screen 102 can display various information. Examples of the various information include an icon indicating an application, a running application, a radio wave state display, a remaining battery level, a date display, and a time display. The display screen 102 includes a transparent cover panel and a display unit 120 provided on the back side thereof. Examples of the display unit 120 include a liquid crystal display unit, an organic EL (ELECTRO LUMINESENCE) display unit, a plasma display unit, and electronic paper. When the display unit 120 is a liquid crystal display unit, the backlight of the display unit 120 is emitted to display various information on the display screen 102. When the display unit 120 is an organic EL display unit, the light emitter of the display unit 120 emits light and various information is displayed on the display screen 102.

  As a specific example of the operation unit that receives an operation from the user, for example, the touch operation unit 114 can be cited. Examples of the touch operation unit 114 include a touch panel. There are various types of touch panels such as a capacitance method, a resistance film method, an optical method, an ultrasonic surface acoustic wave method, an infrared light shielding method, an electromagnetic induction method, and an image recognition method. The operation unit may be a proximity operation unit that can be operated when proximity is detected instead of the touch operation unit 114. An example of the proximity operation unit is one that detects and operates a hand movement or the like using a proximity sensor or the like. In addition, as the operation unit, for example, a user's movement may be detected by a camera or the like, and an operation from the user may be received.

  The display screen 102 in the specific example shown in FIG. 1 has a cover panel, a display unit 120, and a touch operation unit 114 that overlap each other when the display screen 102 is viewed from the front. When the user performs a touch operation on the cover panel, the object can be operated.

  The optical sensor 103 functions as a brightness detection unit that detects ambient brightness. Although the optical sensor 103 is provided on the front surface of the mobile phone 100 in FIG. 1, the installation location is not limited and may be any location where the surrounding environment can be accurately detected. Examples of the optical sensor 103 include those using a phototransistor, a photodiode, or the like.

  The speaker 104 has a function of outputting sound to the outside by a control signal from the control unit 108 described later. The position of the speaker is not particularly limited. For example, the speaker is provided on the front surface, the side surface, or the back surface of the mobile phone 100. For example, the speaker 104 can output a voice from a call partner, a melody, a ringing tone, or the like.

  The microphone 105 converts the collected sound into a sound signal and outputs the sound signal to a sound encoder 117 described later.

  The button unit 106 is a button-like hard key that receives an operation input from the user. The operation from the user accepted by the button unit 106 is input to the control unit 108 as a signal. In the case of FIG. 1, the operation is performed by pressing the button unit 106. Examples of the button unit 106 include a power key, a volume key, and a home key.

  The camera window 107 is provided on the front surface or the back surface of the mobile phone 100. The camera window 107 is provided with a transparent panel or lens, and sends the subject image to the camera module 116 described later.

  FIG. 2 is a block configuration diagram of the mobile phone 100.

  The control unit 108 controls software and hardware provided in the mobile phone 100. For example, the control unit 108 detects input operations received by the user, such as the touch operation unit 114 and the button unit 106, and executes various functions provided in the mobile phone 100. The control unit 108 executes a program stored in the mobile phone 100 in cooperation with the ROM 110 or the RAM 111. An example of the control unit 108 is a control CPU.

  The vibration unit 109 generates mechanical vibration in response to a control signal from the control unit 108. The vibration unit 109 includes, for example, a motor, and notifies the user of incoming call information, incoming mail information, arrival of alarm date and time, etc. as mechanical vibrations to the user.

  A ROM (READ ONLY MEMORY) 110 stores programs, data, and the like for executing various processes provided in the mobile phone 100.

  A RAM (RANDOM ACCESS MEMORY) 111 is accessible from the control unit 108 and is used as a temporary storage area (also referred to as a buffer area) for the control unit 108 to execute various processes. In addition, the RAM 111 can store various data generated in the device such as address book data, mail data, data used in the telephone mode, image data photographed in the camera mode, moving image data, and the like. . The images stored in the RAM 111 include still images and moving images. A moving image is composed of a plurality of frames, and each frame is composed of a still image. The still image includes an icon, a button, a photo, a thumbnail image, and a text layout area. The text layout area is an area where text information is displayed. A moving image and a thumbnail image of the moving image, which will be described later, are stored in the RAM 111 in association with the moving image identification information.

  The radio circuit 112 performs demodulation processing and decoding processing on a predetermined high-frequency signal input from the antenna 113 to convert it into a digital audio signal. The digital audio signal input from the control unit 108 is subjected to encoding processing and modulation processing to be converted into a high frequency signal. Then, the radio circuit 112 outputs a high frequency signal to the antenna 113.

  The antenna 113 receives a predetermined frequency band and outputs it to the radio circuit 112 as a high frequency signal. The high-frequency signal output from the wireless circuit 112 is output as a signal in a predetermined frequency band.

  The camera module 116 has an image sensor such as a CCD. The camera module 116 digitizes the image signal output from the image sensor, performs various corrections such as gamma correction on the image signal, and outputs the image signal to the video encoder 115. The video encoder 115 encodes the imaging signal from the camera module 116 and outputs the encoded signal to the control unit 108. The camera module 116 captures a subject image through the camera window 107.

  The audio encoder 117 converts an analog audio signal from the microphone 105 into a digital audio signal, encodes the digital audio signal, and outputs it to the control unit 108.

  The video decoder 119 converts the image information from the control unit 108 into an image signal that can be displayed on the display unit 120, and outputs these to the display unit 120. The display unit 120 displays an image corresponding to the image signal on the display surface.

  The audio decoder 118 performs a decoding process on the audio signal from the CPU 100 and the sound signals of various notification sounds such as a ring tone and an alarm sound, converts the decoded signal into an analog audio signal, and outputs the analog audio signal to the speaker 104.

  The clock 121 measures time and outputs a signal corresponding to the measured time to the control unit 108.

[Operation processing]
Hereinafter, an operation process of the mobile phone 100 according to an embodiment of the present disclosure will be described.

FIG. 3 is a diagram illustrating an example of the display screen 102 of the mobile phone 100. FIG. 3 shows a moving image editing screen. Specifically, on the display screen 102, thumbnails 11a to 11c indicating a part obtained by dividing one moving image by time (in the case of FIG. 3, the moving image is divided every 5 minutes), a moving image preview screen 10, and the current moving image. A progress bar 12 is shown (in the case of FIG. 3, the progress of the moving image displayed on the preview screen 10 is 8 minutes 57 seconds). Below the thumbnails 11a to 11c, the time of the moving image (for example, 5:00 indicates 5 minutes and 0 seconds) is displayed. The state of the display screen 102 shown in FIG. 3 corresponds to the “first state” in the claims.

  Note that the moving image may be taken by a camera included in the mobile phone 100 or downloaded from a site on the Internet.

  A series of screen transitions are displayed in FIGS.

  4A, on the display screen 102, the user's finger F1 touches the thumbnail 11a (corresponding to “first object” in the claims), and the adjacent thumbnail 11b (“second object” in the claims). The thumbnail 11a and the thumbnail 11b are selected (corresponding to "first operation" in the claims). When the fingers F1 and F2 are spread out while touching the thumbnails 11a and 11b with the fingers F1 and F2 as shown in FIG. 4B from the state of FIG. The thumbnail 11a and the thumbnail 11b are moved and displayed in accordance with the movement of the finger F1 and the finger F2, and the operation menu 13 is displayed between the moved thumbnails 11a and 11b. (Corresponding to “second state” in the claims). In the case of FIG. 4B, the operation menu 13 displays copy, paste, and cut, but the present disclosure is not limited to this.

  As shown in FIG. 4C, after the finger F1 and the finger F2 are separated from the thumbnail 11a and the thumbnail 11b, the finger F1 is touched on the operation menu 13 so as to select “Copy” from the items of the operation menu 13. The Thereafter, as shown in FIG. 4D, the finger F1 is touched on the thumbnail 11b so as to select a thumbnail to be copied (in this case, the thumbnail 11b).

  5 and 6 show screen transitions of the display screen 102 when a copy destination of a thumbnail to be copied is selected and copy is executed.

  After FIG. 4D, as shown in FIG. 5A, the finger F1 is slid from the right side of the thumbnail 11b to the left (D direction in FIG. 5A). By sliding the finger F1, the thumbnails 11c to 11e positioned behind the thumbnail 11b are displayed as shown in FIG. 5B.

  As shown in FIG. 5C, the paste destination of the copied thumbnail 11b is selected. In the case of FIG. 5C, the user intends to paste the thumbnail 11b between the thumbnail 11d and the thumbnail e. As shown in FIG. 5D, when the fingers F1 and F2 are touched on the thumbnails 11d and 11e and the fingers are spread out, the message “Do you want to paste?” Between the moved thumbnails 11d and 11e. "Is displayed. Next, as shown in FIG. 6A, when the display 14 “Do you want to paste?” Is touched with the finger F1, as shown in FIG. 6B, a thumbnail is placed between the thumbnail 11d and the thumbnail 11e. 11b is pasted. By these operations, in the moving image, the moving image part represented by the thumbnail 11b can be positioned between the moving image part represented by the thumbnail 11d and the moving image part represented by the thumbnail 11e.

As described above, by performing the operations shown in FIGS. 4 to 6, in order to release the positions of two objects (in this case, the objects correspond to thumbnails related to a plurality of parts that form one moving image). By moving the two objects, another display (in this case, the operation menu 13) can be displayed from between the objects. Therefore, on the normal display screen (in this case, the normal display screen when editing a movie), the operation menu display can be called by a simple operation without providing a separate display area for the operation menu. . This is particularly useful when the electronic device is an electronic device with a small display screen (particularly, a mobile communication terminal device such as a mobile phone).

  As shown in FIGS. 5C and 5D, when the paste destination of the thumbnail 11b to be copied is selected, the finger F1 and the finger F2 are separated so that the thumbnail 11d and the thumbnail 11e are separated from each other. However, the present disclosure is not limited to this content. For example, as shown in FIG. 7A, by tapping between the thumbnails 11d and 11e with the finger F1, the user wants to paste between the thumbnail 11d and the thumbnail 11e as shown in FIG. 7B. A thumbnail (in this case, thumbnail 11b) may be pasted.

  FIG. 8 shows an example of the operation after FIG. 4 (a) to FIG. 4 (b). For example, when the operation menu 13 is displayed on the display screen 102 as shown in FIG. 4B, but the display of the operation menu 13 is to be canceled, the finger F1 and the finger F2 are touched on the thumbnail 11a and the thumbnail 11b. If the thumbnail 11a and the thumbnail 11b are moved in such a direction as to approach (direction D1 and direction D2 in FIG. 8A), the operation menu 13 disappears as shown in FIG. 11a and thumbnail 11b return to the original display. In the example of FIG. 8, the operation of closing the finger F1 and the finger F2 with the finger F1 and the finger F2 touching the thumbnail 11a and the thumbnail 11b is shown, but the present disclosure is not limited to this. For example, after the finger F1 and the finger F2 are once removed from the state of the display screen in FIG. 4B, the finger F1 and the finger F2 touch the thumbnail 11a and the thumbnail 11b again, and then the state shown in FIG. In this manner, the thumbnail 11a and the thumbnail 11b may be operated so as to be closed with the finger F1 and the finger F2.

  As mentioned above, based on FIGS. 3 to 8, the moving image editing on the mobile phone, which is an embodiment of the present disclosure, has been described, but the content of the claims is not limited to the specific examples of FIGS. 3 to 8.

  Next, a program that executes an embodiment of the present disclosure will be described with reference to FIG. An example based on FIGS. 3 to 8 is shown.

  In step S01, it is detected whether or not there is contact between the two thumbnails. Specifically, as shown in FIG. 4A, it is detected whether the thumbnail 11a and the thumbnail 11b are touched. If no touch is detected (step S01: NO), the process returns to step S01 again. When a touch is detected (step S01: YES), it is detected whether there has been an operation of releasing the positions of the two thumbnails (step S02). Specifically, as shown in FIG. 4B, it is detected whether or not the touch position has moved away from the state in which the finger or the like has touched the thumbnails 11a and 11b. If there is no operation to release the two thumbnails (step S02: NO), the process returns to step S01. When there is an operation for releasing two thumbnails (step S02: YES), the positions of the two thumbnails are released and an operation menu is displayed (step S03). Specifically, as shown in FIG. 4B, the thumbnail 11a and the thumbnail 11b move so that their display positions are separated from each other, and the operation menu 13 is displayed between the thumbnails 11a and 11b after the movement.

It is detected whether contact has been released with respect to the two thumbnails, that is, whether the detected touch is no longer detected (step S04). When the contact with the two thumbnails is not released (step S04: NO), that is, when the contact with the two thumbnails is maintained, the flow proceeds to step S08 described later. When the contact with the two thumbnails is released (step S04: YES), it is detected whether or not there has been a selection operation on the operation menu (step S05). Specifically, as shown in FIG. 4C, it is detected whether a touch is detected for selection with respect to any of the items (COPY, PASTE, CUT) described in the operation menu 13. . If there is no menu selection operation (step S05: NO), the flow proceeds to step S09 described later. If there is a selection operation on the menu (step S05: YES), it is detected whether a thumbnail has been selected (step S06). Specifically, as shown in FIG. 4D, regarding the copy selected in the menu 13, it is detected whether a thumbnail to be copied has been selected. If no thumbnail is selected (step S06: NO), the flow returns to step S06. When a thumbnail is selected (step S06: YES), a menu is executed (step S07). Specifically, as shown in FIG. 6B, the copied thumbnail 11b is pasted between the thumbnail 11d and the thumbnail 11e, and the flow ends.

  If the contact between the two thumbnails is not released in step S04 (step S04: NO), it is detected whether or not there is an operation for bringing the positions of the two thumbnails closer (step S08). Specifically, as shown in FIG. 8A, whether or not there has been a movement to bring the touch position closer from a state in which a finger or the like has touched the thumbnail 11a and the thumbnail 11b displayed separately via the operation menu 13 Is detected (step S08). If there is no operation for bringing the positions of the two thumbnails closer (step S08: NO), the flow returns to step S04. When there is an operation for bringing the positions of the two thumbnails closer (step S08: YES), the display of the operation menu is erased and the display positions of the two thumbnails are restored (step S10).

  If no menu is selected in step S05 (step S05: NO), it is detected whether a predetermined time has passed (step S09). If the predetermined time has not elapsed (step S09: NO), the flow returns to step S05. If the predetermined time has elapsed (step S09: YES), the display of the operation menu is erased, and the display positions of the two thumbnails are restored (step S10).

3 to 9, the touch operation on the thumbnail at the time of editing the moving image in the electronic apparatus (in this case, the mobile phone) has been described, but the claims are not limited to the operation on the thumbnail at the time of moving image editing. For example, when a plurality of different videos are displayed as thumbnails on the display screen, the two thumbnails are selected and then operated so that their display positions are separated from each other. , The operation menu described in FIG. 4, and the like may be displayed.

  FIGS. 10 and 11 show a touch operation for displaying two applications while two applications are activated as an embodiment different from FIGS. 3 to 9.

  In FIG. 10, two applications are activated on the display screen 102 of the mobile phone 100. One application is application A and the other application is application B. These applications are displayed side by side on the display screen 102. 3 to 8, the cellular phone 100 is displayed in the portrait orientation, whereas in FIGS. 10 and 11, it is displayed in the landscape orientation. However, the orientation of the display may be any. The state of the display screen 102 shown in FIG. 10 corresponds to the “first state” in the claims.

  As shown in FIG. 11A, the finger F1 touches the application A and the finger F2 touches the adjacent application B on the display screen 102 on which the application A and the application B are displayed. From FIG. 11A, as shown in FIG. 11B, when the fingers F1 and F2 are spread on the application A and the application B while the fingers A1 and F2 are spread, the application A and the application B are connected to the finger F1. It is moved and displayed in accordance with the movement of the finger F2. Then, at least a part of the application C is displayed between the application A and the application B after movement. The application C displayed in FIG. 11 indicates an application that is activated but not displayed on the display screen 102 in FIG. FIG. 11B shows a state in which the application A and the application B are displayed apart to some extent, but the application A and the application B are not separated from the case shown in FIG. 11B. In the state, at least a part of the application C may be displayed. By performing such a display, the user can perform a simple operation of bringing the fingers F1 and F2 into contact with the application A and the application B and then widening the fingers a little, but they are not displayed but are activated. It is possible to confirm the presence of the application C inside. After the confirmation is completed, for example, by applying the operation of FIG. 8 described in the previous specific example, the application A and the application B are touched with the fingers F1 and F2, respectively, and the application A and the application B are brought close to each other. By moving in the direction, the display of the application C may be erased, and the applications A and B may be returned to their original positions as shown in FIG.

  In FIG. 11B, the application C is displayed so as to be positioned behind the application A and the application B, but the display of the application C is not limited to this.

  In FIG. 11C, after the fingers F1 and F2 are spread from the display screen 102 with the fingers F1 and F2 touching the applications A and B in FIG. 11B, the fingers F1 and F2 are separated from the display screen 102. Application C displayed between application A and application B is displayed instead of application B. Specifically, after the finger F1 is touched on the application C, the finger F1 is positioned on the application B by moving the finger along the direction from left to right (direction D) as shown in FIG. ing. Thereby, the display of the application C is moved so as to be positioned above the application B.

  As shown in FIG. 11D, the display in the right region of the display screen 102 can be changed from the application B to the application C through the operations in FIG. 11A to FIG. 11C. . In FIG. 11D, the application B that is no longer displayed is activated.

  In the specific examples of FIGS. 10 and 11, the first object and the second object in the claims show the application display being activated and being displayed, and the third object is being activated but is being displayed. It shows the application display that was not done.

  As described above, the present disclosure has been described using the drawings, but the present disclosure is not limited to the specific examples described in the drawings. 3 to 11, the first object and the second object are adjacent to each other without a gap in the first state shown in FIGS. 3 and 10, but in the first state, the first object and the second object are adjacent to each other. There may be a gap between the two objects, or another object may be located between the first object and the second object.

  In the specific examples described in the drawings, thumbnails and application displays are shown as the objects (including the first object, the second object, and the third object) in the claims, but are not limited thereto. For example, the object includes an icon (an icon indicating an application, an icon indicating a notification), a character, a soft key on a soft keyboard, and the like.

  In the specific example shown in the drawings, the operation by the touch operation is shown, but the present disclosure is not limited to this. For example, the object may be operated by bringing them close to each other without touching the display screen 102, or the object may be operated even if the distance between the user and the electronic device is 1 m or more, for example. .

  Further, the operation by the user is not limited to the operation by the finger, and may be an operation using a line of sight, an operation using a voice, an operation using a gesture, or an operation using an operation tool such as a stylus.

DESCRIPTION OF SYMBOLS 10 Preview screen 11 Thumbnail 12 Progress bar 13 Operation menu 14 Paste display 100 Mobile phone 101 Lamp 102 Display part 103 Optical sensor 104 Speaker 105 Microphone 106 Button part 108 Control part 109 Vibration part 110 ROM
111 RAM
112 Radio circuit 113 Antenna F1, F2 Finger D direction

Claims (5)

A display screen capable of displaying a first object and a second object;
A control unit for displaying the first object and the second object on the display screen;
An electronic device having
The controller is
In the first state where the first object and the second object are displayed on the display screen, after the first operation for selecting the first object and the second object is detected, When a second operation for separating the position of the first object and the position of the second object is detected,
The first object and the second object that are separated from each other than the first state are displayed, and a third object is displayed between the first object and the second object. Changing the display on the display screen to the second state,
Electronics.   The electronic device according to claim 1, wherein the first operation and the second operation are touch operations. The first object and the second object are thumbnails related to a video,
The electronic device according to claim 1, wherein the third object is an operation menu related to the moving image. The first object and the second object are active applications,
The electronic device according to claim 1, wherein the third object is a running application that is not displayed in the first state. The display of the third object is erased when an operation for returning the position of the first object and the position of the second object to the first state is performed in the second state. 5. The electronic device according to any one of

Images