WO2013069276A1 - Electronic device, display system, display control method, and display control program - Google Patents

Abstract

This electronic device comprises an input unit for accepting a move operation for changing the position of a first object on a screen, and a layer control unit, which, in a case where the relative positions of the first object and a second object, after having gone from an overlapping state to a non-overlapping state, have once again been changed to an overlapping state, changes the sequence of a first layer in which the first object is arranged and a second layer in which the second object is arranged on the basis of layer information that includes the sequence of layers in which each of a plurality of objects is arranged.

Description

Electronic device, display system, display control method, and display control program

The present invention relates to an electronic device, a display system, a display control method, and a display control program. In particular, the present invention relates to an electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit.

Conventionally, a plurality of objects may be arranged on the display screen of an electronic device. In order to change the order of layers (layers) due to this overlap, it is conceivable to move the target object to the front in one step or to move to the forefront.

However, when there are a plurality of layers, it is necessary to perform a moving operation many times in order to rearrange them in a desired order, which may be troublesome.

As a conventional technique of this type, for example, a technique is known in which an object that is separated from a target object without overlapping is excluded from a change target of the layer order, and the layer order is changed only between overlapping objects ( For example, see Patent Document 1). Thereby, it is possible to easily change the layer order for only overlapping objects.

Japanese Unexamined Patent Publication No. 7-152356

However, depending on how multiple objects overlap, it may take time to change the layer order in which the objects are arranged.

The present invention has been made in view of the above circumstances, and includes an electronic device, a display system, a display control method, and a display control program that can change the layer order of objects to a desired order with a simple operation. The purpose is to provide.

The first electronic device of the present invention is an electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit, and the first object among the plurality of objects is on the screen. An input unit that accepts a moving operation for changing the position of the plurality of objects, a layer information storage unit that stores layer information including the order of a plurality of layers in which the plurality of objects are arranged, and the first of the plurality of objects If the positional relationship between the second object and the second object changes from the overlapping state to the non-overlapping state and then changes to the overlapping state again, the first object is based on the layer information stored in the layer information storage unit. A layer control unit that changes the order of a first layer in which an object is placed and a second layer in which the second object is placed; A display control unit for displaying the first object and the second object respectively arranged on the first layer and the second layer changed by the layer control unit on the screen of the display unit; Prepare.

According to this configuration, the layer order of the objects can be changed to a desired order by a simple operation of changing the positional relationship between the object to be moved of the layer and other objects to the overlapping state, the non-overlapping state, and the overlapping state again. It is possible to change.

A second electronic device of the present invention is an electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit, and applies to a first object that is one of the plurality of objects. An input unit that receives an input operation; an input operation region that is a part of the region of the first object that has received an input operation by the input unit; a second object that is one of the plurality of objects; A first layer on which the first object is arranged and a second layer on which the second object is arranged based on a positional relationship with an overlapping area that is an area in which the one object overlaps A layer control unit for controlling the order, and the first object disposed in each of the first layer and the second layer controlled by the layer control unit. Extract and the second object and a display control unit for displaying on the screen of the display unit.

This configuration makes it possible to change the layer order of objects to a desired order with a simple operation. In addition, the first object can be moved and the layer order can be changed smoothly by moving the first object and superimposing it on the second object. That is, it is possible to easily move the object and change the layer order.

A third electronic device of the present invention is an electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit, and applies to a first object that is one of the plurality of objects. Duplicate from the overlapping state to the non-overlapping state after the positional relationship between the input unit that receives the input operation and the first object and the second object of the plurality of objects is changed from the non-overlapping state to the overlapping state When the process is executed, the second layer in which the first object is disposed and the second object in which the second object is disposed on the basis of the second layer in which the second object is disposed. A layer control unit for determining a layer, and the first object disposed in each of the first layer and the second layer controlled by the layer control unit. -Object and the second object and a display control unit for displaying on the screen of the display unit.

This configuration makes it possible to change the layer order of objects to a desired order with a simple operation. Further, when changing the layer order of a plurality of objects, the layer where the objects are arranged can be easily moved by the overlapping process of the first object and the second object. Further, the first object and the second object can be arbitrarily selected.

The first display system of the present invention is a display system including an electronic device and a server that communicates with the electronic device, and the electronic device receives display data from the server. A display unit that displays a plurality of objects respectively arranged in a plurality of layers on a screen based on display data received by the first reception unit, and a plurality of the objects An input unit that receives a movement operation for changing the position of the first object on the screen, and a first transmission unit that transmits movement data associated with the movement operation received by the input unit to the server, The server includes: a second reception unit that receives movement data from the electronic device; and layer information including an order of a plurality of layers in which the plurality of objects are respectively arranged. The positional relationship between the first object and the second object among the plurality of objects is non-overlapping from the overlapping state from the memorized layer information storage unit and the movement data received by the second receiving unit. When it is recognized that the state has changed to the overlapping state again after entering the state, based on the layer information stored in the layer information storage unit, the first layer in which the first object is arranged and the second layer A layer control unit that changes the order of second layers in which objects are arranged, and the first object and the second object that are arranged in the first layer and the second layer, respectively, changed by the layer control unit, and A display control unit for generating display data for displaying a second object on the screen of the display unit, and the display control unit Comprising a second transmission unit for transmitting display data to the electronic device, the.

According to this configuration, the layer order of the objects can be changed to a desired order by a simple operation of changing the positional relationship between the object to be moved of the layer and other objects to the overlapping state, the non-overlapping state, and the overlapping state again. It is possible to change. In addition, since the electronic device is operated as a cloud terminal, the processing load on the electronic device can be reduced.

The first display control method of the present invention is a display control method for displaying a plurality of objects respectively arranged on a plurality of layers on a display screen, wherein the first object among the plurality of objects is the display control method. The step of accepting a moving operation for changing the position on the display screen by the input unit, and the positional relationship between the first object and the second object among the plurality of objects has changed from an overlapping state to a non-overlapping state. When the state is changed to the overlapping state later, the first object is arranged based on the layer information stored in the layer information storage unit including the order of the plurality of layers in which the plurality of objects are arranged. Changing the order of the first layer and the second layer in which the second object is arranged, and before the changed It has a step of displaying the first layer and the second layer to be arranged a the first object and the second object on the display screen, the.

According to this method, the layer order of objects can be changed to a desired order by a simple operation of changing the positional relationship between the object to be moved of the layer and other objects to the overlapping state, the non-overlapping state, and the overlapping state again. It is possible to change.

A second display control method of the present invention is a display control method for an electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit, and is one of the plurality of objects. A step of accepting an input operation to a certain first object, an input operation region that is a part of the region of the first object that has accepted the input operation, and a second object that is one of the plurality of objects And a first layer in which the first object is disposed and a second layer in which the second object is disposed, based on a positional relationship between the first object and the overlapping region, which is an overlapping region. A step of controlling the order of the layers, and the first object and the second object respectively disposed in the controlled first layer and second layer. Having a step of displaying the second object on the screen of the display unit.

This method makes it possible to change the layer order of objects to a desired order with a simple operation. In addition, the first object can be moved and the layer order can be changed smoothly by moving the first object and superimposing it on the second object. That is, it is possible to easily move the object and change the layer order.

A third display control method of the present invention is a display control method in an electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit, and is one of the plurality of objects. The step of accepting an input operation to a certain first object, and the positional relationship between the first object and the second object of the plurality of objects is changed from the non-overlapping state to the overlapping state, and then from the overlapping state. When duplication processing for non-overlapping state is executed, the first layer on which the first object is arranged and the second object are arranged on the basis of the second layer on which the second object is arranged. Determining a second layer to be disposed; and the first layer disposed in the controlled first layer and the second layer, respectively. Objects and said second object having a step of displaying on the screen of the display unit.

This method makes it possible to change the layer order of objects to a desired order with a simple operation. Further, when changing the layer order of a plurality of objects, the layer where the objects are arranged can be easily moved by the overlapping process of the first object and the second object. Further, the first object and the second object can be arbitrarily selected.

The first display control program of the present invention is a program for causing a computer to execute each step of the first display control method.

According to this program, the layer order of objects can be changed to the desired order by a simple operation of changing the positional relationship between the object to be moved and other objects from the overlapping state, non-overlapping state, and overlapping state again. It is possible to change.

The second display control program of the present invention is a program for causing a computer to execute each step of the second display control method.

This program can change the layer order of objects to a desired order with a simple operation. In addition, the first object can be moved and the layer order can be changed smoothly by moving the first object and superimposing it on the second object. That is, it is possible to easily move the object and change the layer order.

Further, the third display control program of the present invention is a program for causing a computer to execute each step of the third display control method.

This program can change the layer order of objects to a desired order with a simple operation. Further, when changing the layer order of a plurality of objects, the layer where the objects are arranged can be easily moved by the overlapping process of the first object and the second object. Further, the first object and the second object can be arbitrarily selected.

According to the present invention, the layer order of objects can be changed to a desired order with a simple operation.

1 is a block diagram illustrating a configuration example of an electronic device according to a first embodiment of the present invention. (A)-(C) The figure for demonstrating the example of operation which changes the layer order of the layer movement object in the 1st Embodiment of this invention. The flowchart which shows an example of the layer order change procedure in the 1st Embodiment of this invention FIGS. 8A to 8C are diagrams showing examples of effects applied to layer order change target objects in the first embodiment of the present invention. FIGS. FIGS. 4A to 4E are diagrams showing examples of layer change operations when a plurality of objects overlap in the first embodiment of the present invention. FIGS. 8A to 8E are diagrams illustrating an example of a layer change operation in a case where the layer movement target object in the first embodiment of the present invention does not move away from other overlapping objects unless the object moves out of the screen. FIGS. 8A to 8C are diagrams illustrating an example of a layer change operation when simultaneously changing the layers of a plurality of objects in the first embodiment of the present invention. FIGS. 8A to 8D are diagrams illustrating an example of a layer change operation when the movement of a layer image fails in the first embodiment of the present invention. FIGS. 8A to 8D are diagrams showing an example of layer change operation when changing the layer order with non-overlapping objects in the first embodiment of the present invention. (A)-(H) The figure which shows an example of the effect pattern in the 1st Embodiment of this invention The block diagram which shows the structural example of the display system in the 1st Embodiment of this invention. The block diagram which shows the structural example of the electronic device in the 2nd Embodiment of this invention. (A)-(E) The figure for demonstrating the operation example of the object of the operation target in the 2nd Embodiment of this invention. The figure which shows the image of operation in the 2nd Embodiment of this invention. (A), (B) The figure which shows the example of basic operation in the 2nd Embodiment of this invention. The flowchart which shows an example of the display control procedure of the electronic device in the 2nd Embodiment of this invention. FIGS. 9A to 9D are diagrams illustrating an operation example in the case of performing only movement without changing the layer order with respect to an operation target object in the second exemplary embodiment of the present invention. (A)-(F) The figure which shows the various operation examples from which the way of applying the effect in the 2nd Embodiment of this invention differs. The figure which shows the example of operation when the object of the operation target in the 2nd Embodiment of this invention is smaller than a finger | toe. FIGS. 8A to 8C are diagrams illustrating an operation example when another object is not a quadrangle in the second exemplary embodiment of the present invention. (A), (B) The figure which shows the operation example in case the operation target object in the 2nd Embodiment of this invention is hidden in the other object FIGS. 9A to 9C are diagrams illustrating an example of how to apply an effect when the operation target object is not a rectangle in the second embodiment of the present invention; The flowchart which shows an example of the effect process sequence which applies an effect to the operation target object in step S12 of FIG. (A)-(C) The figure which shows an example of how to apply the various effects in the 2nd Embodiment of this invention. The block diagram which shows the structural example of the electronic device in the 3rd Embodiment of this invention. The figure which shows an example of the data structure of the object contact log | history memory | storage part in the 3rd Embodiment of this invention. FIGS. 8A to 8C are diagrams for explaining an example of dragging an operation target object in the third embodiment of the present invention; FIGS. 7A to 7C are diagrams for explaining an example of drag operation of an operation target object in the third embodiment of the present invention (continuation of FIG. 27). The flowchart which shows an example of the process sequence until the overlapping object leaves | separates in the 3rd Embodiment of this invention. The flowchart which shows an example of the process procedure of the drag operation which pokes another object by the object in drag operation in the 3rd Embodiment of this invention. The flowchart which shows an example of the insertion mode process sequence in the 3rd Embodiment of this invention. The flowchart which shows an example of the process sequence which fixes the object in drag | drug operation in the 3rd Embodiment of this invention. FIGS. 8A to 8D are diagrams showing examples of drag operations for pecking corners of other objects in the third embodiment of the present invention; FIGS. 9A to 9D are diagrams showing examples of drag operations for pecking sides of other objects in the third embodiment of the present invention; (A)-(C) The figure which shows an example of the display form of the other object in the 3rd Embodiment of this invention.

Hereinafter, an electronic device, a display system, a display control method, and a display control program according to an embodiment of the present invention will be described with reference to the drawings.

(First embodiment)
The electronic device of this embodiment is applied to a smart phone, for example.

FIG. 1 is a block diagram illustrating a configuration example of an electronic device according to the first embodiment of the present invention. FIG. 1 mainly shows the configuration of a part related to display control in the electronic apparatus 1.

The electronic device 1 includes a coordinate input unit 11, a position determination unit 12, a layer order control unit 13, an effect control unit 14, a layer information storage unit 15, a display control unit 16, and a display unit 17.

The coordinate input unit 11 includes a touch panel provided on the screen 18 of the display unit 17 and detects a contact (touch) position of a user's finger or the like as coordinates. For example, the coordinate input unit 11 has a function as an input unit that receives a moving operation for changing the position of the first object on the screen 18 among a plurality of objects. Moreover, intuitive operation | movement is attained by accepting movement operation based on the touch to a touch panel.

The layer information storage unit 15 stores layer information including the order of layers in which a plurality of objects (layer images) are arranged.

Based on the contact position of the finger or the like input by the coordinate input unit 11, the position determination unit 12 overlaps or separates a plurality of objects (layer images) displayed on the screen 18 of the display unit 17. Determine. That is, the position determination unit 12 determines the positional relationship between the target layer image and another layer image. Specifically, it is determined whether or not the layer image to be moved (layer moving target object: first object) has moved away from other layer images and overlapped again.

Furthermore, the position determination unit 12 determines whether or not to change the layer order (also simply referred to as layer order) based on the positional relationship between the plurality of objects and the layer information of the plurality of objects stored in the layer information storage unit 15. Determine whether.

The effect control unit 14 performs display control of effect information for performing effect processing on another layer image (layer order change target object: second object) whose positional relationship with the target layer image is determined. To the unit 16. That is, the effect control unit 14 controls the effect processing indicating that the second layer in which the second object is arranged is a target for changing the layer order, with respect to the second object. This makes it easier to recognize an object whose layer order is about to be changed.

The layer order control unit 13 (an example of a layer control unit) sends a layer order change command to the layer information storage unit 15 when the position determination unit 12 determines to change the layer order. The layer information storage unit 15 changes the layer information of the plurality of objects in accordance with the layer information change command.

The display control unit 16 generates display data according to the layer information stored in the layer information storage unit 15. For example, the display control unit 16 displays the first object and the second object respectively arranged in the first layer and the second layer changed by the layer order control unit 13 as the layer control unit. It is displayed on the screen 18.

Further, the display control unit 16 applies an effect to the layer order change target object displayed on the screen 18 based on the effect information from the effect control unit 14. As an effect, for example, control is performed so that a color change (gradation) occurs (see FIG. 4B described later).

The display unit 17 is provided, for example, on the front surface of the housing of the electronic device 1 and displays a plurality of objects based on display data from the display control unit 16 on the screen 18. That is, the electronic device 1 displays a plurality of objects respectively arranged on a plurality of layers on the screen 18 of the display unit 17.

The position determination unit 12, the layer order control unit 13, the effect control unit 14, and the display control unit 16 are realized as functions when the CPU executes a display control program stored in the ROM in the electronic device 1. Alternatively, it may be realized by hardware.

FIGS. 2A to 2C are diagrams for explaining an operation example for changing the layer order of the layer movement target object. FIG. 2A shows an operation example for the layer movement target object. On the screen 18 of the display unit 17, a layer image 21 as a layer movement target object is arranged on the foreground, and two other layer images 22 and 23 are arranged on the foreground and the front of the layer image 21, respectively. These three layer images 21 to 23 are displayed on the screen 18 so as to overlap each other.

The user touches the part where the layer image 21 is displayed on the screen 18, drags the layer image 21 and once separates it from the layer image 23 arranged on the front surface (see FIG. 2B). The image is superimposed on the front layer image 23 again. That is, after the positional relationship between the layer image 21 and the other layer image 23 changes from the overlapping state to the non-overlapping state, it is changed again to the overlapping state. As a result, as shown in FIG. 2C, the layer image 21 arranged on the backmost surface is arranged on a higher layer than the other layer images 23 arranged on the front surface thereof.

As described above, in the layer order control unit 13, the first layer in which the layer image 21 is arranged before the movement operation by the coordinate input unit 11 is lower than the second layer in which the layer image 23 is arranged. In this case, the first layer is changed to a layer one level higher than the second layer. The layer image 21 is an example of a first object. The layer image 23 is an example of a second object. Conversely, when the first layer is higher than the second layer, the first layer is changed to a layer one step lower than the second layer.

This allows the user to move the layer with a simple operation of separating the layer images and then overlaying them again. Such an operation is intuitively easy to understand as if the card is cut.

Next, the display control operation of the electronic device 1 will be described.
FIG. 3 is a flowchart illustrating an example of the layer order changing procedure of the electronic apparatus 1. This display control program is stored in the ROM in the electronic device 1 and is executed when an image displayed on the screen 18 of the display unit 17 is touched with a finger or the like by the CPU that controls the electronic device 1. .

First, the position determination unit 12 of the electronic device 1 determines whether or not the touched layer image (movement target layer image) and another layer image overlap each other (step S1). When not overlapping, the electronic device 1 repeats the process of step S1.

On the other hand, when the layer image to be moved overlaps with other layer images, the electronic device 1 moves the layer image to be moved in accordance with the movement operation of the finger or the like by the coordinate input unit 11 (step S2). ).

The position determination unit 12 determines whether or not the layer image to be moved has moved away from the other layer images and the image overlap has been eliminated (step S3). When the layer image to be moved is not separated from the other layer images and the images remain overlapped, the electronic device 1 returns to the process of step S1.

On the other hand, when the layer image to be moved is separated from the other layer images and there is no overlapping of the images, the electronic device 1 proceeds to the layer stripe change phase. In this phase, the effect control unit 14 applies an effect to other layer images from which the layer image to be moved is separated (step S4). Thereby, it becomes easy to recognize other layer images which are layer order change object.

4 (A) to 4 (C) are diagrams showing effects applied to the layer order change target object. Here, the effect is achieved by an arbitrary color change, that is, a gradation that changes from the color of the other layer image 32 (shown in white in the drawing) to the color of the layer image 31 to be moved (shown in black in the drawing). It is expressed. That is, when the layer image 31 to be moved is moved from the other layer image 32 (see FIG. 4A) and the layer image 31 to be moved is separated from the other layer image 32, the effect control unit 14 An effect is applied to the layer image 32 (see FIG. 4B). When the layer image 31 to be moved again overlaps the other layer images 32, the layer order control unit 13 changes the layer order of these images (see FIG. 4C). At this time, the effect control unit 14 cancels the effect processing. Thereby, the user can easily recognize other layer images whose layer order is to be changed.

Thereafter, the position determination unit 12 determines whether or not the touch of the moving target layer image by the user's finger or the like has been released, that is, whether or not there has been a release (step S5). If there is a release, the electronic device 1 returns to the process of step S1. In this case, the layer image to be moved remains at the release position. Here, the movement of the layer image to be moved and the operation of changing the layer order are performed simultaneously. However, when only the operation of changing the layer order is performed, the layer order control unit 13 The layer image to be moved may return to the original overlapping position.

On the other hand, when there is no release in step S5, the position determination unit 12 determines whether or not the layer image to be moved overlaps with another layer image (separated layer image) separated in step S3 (step S3). S6). If the layer image to be moved does not overlap again with the separated layer image, the electronic device 1 returns to the process of step S5.

On the other hand, when the layer image to be moved overlaps again with the separated layer image, the layer order control unit 13 changes the layer order of the layer image to be moved (step S7). That is, when a layer image that overlaps again with the layer image to be moved is in the upper layer, the layer image to be moved moves to a layer higher than the layer image that has overlapped again. Conversely, when a layer image that has overlapped again with the layer image to be moved is in a lower layer, the layer image to be moved moves to a lower layer than the layer image that has overlapped again. Thereafter, the electronic device 1 ends this operation.

Next, specific examples of various layer change operations will be described.

FIGS. 5A to 5E are diagrams showing examples of layer change operations when a plurality of objects are overlapped. Here, in FIG. 5A, the layer image (layer movement target object) “5” to be moved is three other layer images (layer order change target objects) “4”, “3”, “2”. A case where the image is separated from one layer image “1” is shown. Here, “1”, “2”, “3”, “4”, “5” and the numbers in the layer images in the figure represent the values of the layers when the layers are counted in order from the top. That is, the layer image 41 to be moved is arranged in the fifth layer from the top, and the other layer images 42, 43, 44, and 45 are arranged in the fourth, third, second, and first layers from the top, respectively. The In addition, the layer image “1” indicates that the layer image is arranged in the “1” (first) layer.

When the user touches the layer image “5” to be moved with a finger or the like and moves it in the direction of the arrow a in the figure to move away from the other layer image “4”, the effect is applied to the other layer image “4”. Such (see FIG. 5B).

Furthermore, if the layer image “5” to be moved is moved while being touched so as to move away from the other layer image “3”, the effect is applied to the other layer image “3” (see FIG. 5C).

Furthermore, if the layer image “5” to be moved is moved while being touched so as to move away from the other layer image “2”, the effect is applied to the other layer image “2” (see FIG. 5D).

When the layer image “5” to be moved is overlaid on the other layer image “2” again with the layer image “5” to be moved away from the other layer image “2”, the layer of the layer image to be moved Changes from “5” to “2”. Further, the layers of the other layer images change from “2”, “3”, “4” to “3”, “4”, “5”, respectively (see FIG. 5E). This improves the operability when changing the layer order even when a plurality of objects overlap.

FIGS. 6A to 6E are diagrams showing an example of a layer change operation in a case where the layer movement target object does not protrude from the screen 18 and does not move away from other overlapping objects. When the electronic device 1 is applied to a smartphone having a relatively small screen size as in the present embodiment, the following can be considered. That is, even if the layer image to be moved (layer movement target object) 51 is separated from the other layer image (layer order change target object) 52 that overlaps, the image cannot be released unless it extends from the screen 18. is there.

In this case, the layer image “2” to be moved is moved (see FIG. 6A), and the layer image “2” to be moved reaches the end of the screen 18. Then, the display control unit 16 reduces the size of the layer image “2” to be moved so that the entire layer image “2” to be moved does not protrude from the screen 18 (see FIG. 6B).

If the layer image “2” to be moved is moved in a state where the size is reduced and separated from the other layer image “1”, the effect is applied to the other layer image “1” (see FIG. 6C). . When the layer image “2” to be moved again is superimposed on the other layer image “2”, the layer image of the layer image to be moved changes from “2” to “1”, and the layers of the other layer images are also “1”. “→” changes to “2” (see FIG. 6D). At this time, the effect of the layer image “1” is canceled.

Then, when the finger or the like is released (released) from the layer image “1” to be moved, the display control unit 16 performs control so that the size of the layer image “1” to be moved returns to the original size (FIG. 6 ( E)).

As described above, when the first object (for example, the layer image “2”) reaches the end of the screen 18 of the display unit 17 by the moving operation by the coordinate input unit 11 as the input unit, the display control unit 16 These objects may be reduced and displayed on the screen 18 of the display unit 17. This improves the operability when changing the layer order even on a small screen such as a smartphone.

FIGS. 7A to 7C are diagrams showing an example of a layer change operation in the case where layers of a plurality of objects are changed simultaneously. Here, a case where the layers of the two layer images 61 and 62 are simultaneously changed with respect to the other layer image 63 is shown.

When two layer images “5” and “4” in different layers are touched to change the layer at the same time, the two layer images “5” and “4” are moved (see FIG. 7A), etc. Is separated from the layer image “3”. At this time, the effect is applied to the two layer images “5” and “4” so as to be seen as one body (see FIG. 7B). Here, it is exemplified that the outline of the overlapping portion is hidden and not displayed so that the shape of the two layer images “5” and “4” becomes one. On the other hand, the other layer image “3” in the upper layer is also subjected to the above-described effect different from the two layer images “5” and “4”.

When the two layer images “5” and “4” are superimposed on the other layer image “3” again, the layers of the two layer images change from “5”, “4” to “4”, and “3”, respectively. The other image layers change from “3” to “5”. At this time, the effect on the two layer images “5” and “4” is canceled, and the display of the outline of the overlapping portion between these layer images is restored (see FIG. 7C).

As described above, when the first object is composed of a plurality of objects (for example, two layer images “5” and “4”) arranged in different layers, the plurality of objects are arranged. The order of layers to be applied may be changed at once.

This allows the layer order of the two layer images to be changed simultaneously, improving operability. In addition, the above operation can be similarly applied to two or more, for example, three layer images.

In this case, the layer order of the two layer images was continuous. Instead, when the layer order of the two layer images is separated and overlapped with the layer image in the intermediate layer again, the layer order control unit 13 gives priority to one of the two layer images and sets the layer order. May be determined.

FIGS. 8A to 8D are diagrams showing an example of a layer change operation when the movement of the layer image fails. Here, a case where the layer image 71 to be moved overlaps with the other layer images 72 and 73 is shown. Assume that the user moves the layer image “3” to be moved (see FIG. 8A), moves away from the other layer image “2”, and further away from the other image “1” (see FIG. 8A). (See FIG. 8B). Initially, the user intended to release only from the other layer image “2”, but because it was an erroneous operation, in this state, the user moved the finger etc. away from the layer image “3” to be moved, Release.

That is, since the release was performed in a state where the layer image “3” to be moved does not overlap with other layer images, this operation is performed when there is a release in step S5 of FIG. 3 described above (YES). It corresponds to.

In this case, when the layer image “3” to be moved is moved again (see FIG. 8C) and superimposed on another layer image “2”, the layer order control unit 13 causes the layer image “3” to be moved. Is stored in the original layer (see FIG. 8D).

Thus, after the positional relationship between the first object and the second object changes from the overlapping state to the non-overlapping state, the layer control unit ends the moving operation by the input unit before changing to the overlapping state again. In this case, the order of the first layer and the second layer may be unchanged.

Thus, even if the layer change operation fails, the original layer order can be maintained with the layer order unchanged, and the layer order change operation can be easily canceled.

FIGS. 9A to 9D are diagrams showing an example of a layer change operation in the case where the layer order with non-overlapping objects is changed. This operation corresponds to the operation in the case where the layer image 81 to be moved does not overlap with another layer image 82 in step S1 of FIG. 3 described above (NO).

Since the layer image “2” to be moved does not overlap with the other layer image “1” (see FIG. 9A), the layer image “2” to be moved is temporarily overlapped with the other layer image “1”. (See FIG. 9B). Then, after the layer image “2” to be moved is separated from the other layer image “1” (see FIG. 9C), the layer image “2” to be moved is overlaid on the other layer image “1” again. (See FIG. 9D). As a result, the layer of the layer image to be moved changes from “2” to “1”, and the layers of the other layer images change from “1” to “2”. Thereby, the layer order with the layer image which does not overlap can be changed, and operativity improves.

As described above, when the layer control unit changes again from the overlapping state to the non-overlapping state after the positional relationship between the layer image to be moved and the other layer image changes to the overlapping state, the electronic device 1 The order of the layer and the second layer is changed. The first layer is a layer in which a layer image to be moved is arranged. The second layer is a layer in which other layer images are arranged.

This makes it possible to change the layer order of objects to a desired order with a simple operation. For example, the layer image to be moved can be moved to the front or back of another layer image with a simple operation.

In addition, even when there is a layer of an object that is distant between each layer of overlapping objects, it is necessary to perform the operation for changing the layer many times when changing the layer between overlapping objects. And can save time. Further, even when an arbitrary object is moved to the intermediate layer, it is not necessary to perform the operation for changing the layer over and over, and labor can be reduced.

In the above-described embodiment, the layer order change target object is displayed in gradation as an effect pattern when the effect control unit 14 performs the effect processing, but the effect can be expressed in various modes. FIGS. 10A to 10H are diagrams showing effect patterns. As shown in FIGS. 10A to 10H, in addition to the above-described color change (including gradation), various types of effects may be applied. For example, various types of effects may be applied, such as adding a pattern, making it transparent, applying an action such as expansion / contraction, vibration, rotation, blinking, or adding a balloon.

Moreover, although the case where it applied to the smart phone as the electronic device 1 was shown in the said embodiment, as long as it is an electronic device which can display an object on a screen, such as a personal computer (PC) and a digital photo frame, it applies to all. Is possible.

In addition to images such as graphics and photographs, text, tables, windows, etc. can be displayed as objects.

In the above embodiment, the case where the drag operation is performed by selecting an object on the touch panel provided on the screen 18 of the display unit 17 has been described. Instead, the above selection and operation may be performed using an input device such as a mouse, a touch pad, or a direction key provided separately from the screen 18.

Further, the layer change operation examples shown in FIGS. 6 to 9 described above may be appropriately combined.

Further, the present embodiment may be realized by a display system having the electronic device 1B and the server 2 via a network as shown in FIG. The electronic device 1B includes a coordinate input unit 11, a display unit 17, and a communication unit 19. The server 2 includes a position determination unit 12, a layer order control unit 13, an effect control unit 14, a layer information storage unit 15, a display control unit 16, and a communication unit 20. That is, the electronic device 1B may operate as a cloud terminal in consideration of the cloud computing.

This display system has the same function as the electronic device 1 as a whole. The same components as those of the electronic device 1 in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted or simplified. Unlike the electronic device 1 illustrated in FIG. 1, the electronic device 1 </ b> B and the server 2 include communication units 19 and 20, respectively.

The communication unit 19 receives an input result from the coordinate input unit 11 and transmits this information to the server 2 as movement data associated with the movement operation. The movement data includes the same information as the position coordinates sent from the coordinate input unit 11 to the position determination unit 12 in the electronic device 1 shown in FIG. In addition, the communication unit 19 receives display data from the server 2.

The position determination unit 12 of the server 2 performs the same operation as the position determination unit 12 of the electronic device 1 shown in FIG. 1 based on the movement data from the electronic device 1B.

The communication unit 20 receives movement data from the electronic device 1B. Further, the communication unit 20 receives display data generated by the display control unit 16 and transmits this data to the electronic device 1B. This display data is the same as the display data sent from the display control unit 16 to the display unit 17 in the electronic device 1.

The display unit 17 of the electronic device 1B performs the same operation as the display unit 17 of the electronic device 1 shown in FIG. 1 based on the display data from the server 2.

As described above, in the display system, the display unit 17 displays a plurality of objects respectively arranged in a plurality of layers on the screen based on the display data received by the communication unit 19 as the first receiving unit. .

In addition, after the position determination unit 12 changes the positional relationship between the first object and the second object among the plurality of objects from the overlapping state to the non-overlapping state from the movement data received by the communication unit 20. It is determined again whether or not the state has changed to the overlapping state. The communication unit 20 is an example of a second receiving unit. When such a change is recognized, the layer order control unit 13 as the layer control unit, based on the layer information stored in the layer information storage unit 15, the first layer in which the first object is arranged and The order of the second layer in which the second object is arranged is changed.

Further, the display control unit 16 displays the first object and the second object respectively arranged in the first layer and the second layer changed by the layer order control unit 13 as the layer control unit. Display data to be displayed on the screen is generated.

According to such a display system, the layer order of the objects is desired by a simple operation of changing the positional relationship between the object to be moved of the layer and other objects to the overlapping state, the non-overlapping state, and the overlapping state again. It is possible to change the order. Moreover, since the electronic device 1B is operated as a cloud terminal, the processing load on the electronic device 1B can be reduced.

(Second Embodiment)
The electronic device of this embodiment is applied to an electronic device that can display and edit a plurality of objects on a screen, for example.

FIG. 12 is a block diagram illustrating a configuration example of the electronic device 100 according to the embodiment of the present invention. FIG. 12 mainly shows the configuration of a part related to display control in the electronic apparatus 100. The electronic device 100 includes a coordinate input unit 111, a display position determination unit 112, an effect determination unit 113, a layer order determination unit 114, a layer order management unit 115, a display control unit 116, and a display unit 117.

The coordinate input unit 111 includes, for example, a touch panel provided on the screen 118 of the display unit 117, and detects a contact (touch) position of a user's finger or the like as coordinates. The coordinate input unit 111 outputs information on the coordinate position including the detection result to the display position determination unit 112. For example, the coordinate input unit 111 has a function as an input unit that receives an input operation to a first object (for example, the operation target object 121 in FIG. 13) that is one of a plurality of objects.

The display position determination unit 112 determines the display position of the operation target object based on the contact position of the finger or the like input by the coordinate input unit 111. The display position determination unit 112 outputs information on the display position of the object including the determination result to the effect determination unit 113.

The effect determination unit 113 determines a position where the effect (effect) is applied to the operation target object. The effect determination unit 113 outputs effect display content information including the determination result to the layer order determination unit 114 and the display control unit 116. As an effect, it is conceivable to give some visual effect such as adding a color to the target part or applying a shadow. The content of the effect may be determined in advance or may be arbitrarily selected by the user. The contents of this effect are also included in the information of the effect display contents.

The layer order determination unit 114 determines the layer order (simply, based on the operation region that is a part of the operation target object touched by the finger and the contact position (overlap region) between the other object and the operation target object. Whether to change the layer order) is determined. When the layer order determination unit 114 determines to change the layer order, the layer order determination unit 114 sends a layer order change command for changing the layer order to the layer order management unit 115.

The layer order management unit 115 manages the layer order of each object. For example, the layer order management unit 115 holds layer information including the order of layers in which a plurality of objects are arranged in an internal memory. Further, the layer order management unit 115 changes layer information such as the layer order of objects in accordance with the layer information change instruction from the layer order determination unit 114.

The display control unit 116 generates display data according to the layer information stored in the layer order management unit 115 and outputs the display data to the display unit 117. For example, the display control unit 116 causes the screen 118 of the display unit 117 to display the first object and the second object respectively arranged in the first layer and the second layer changed by the layer order determination unit 114. . Further, the display control unit 116 applies an effect to the first object and the second object (executes effect processing) in accordance with the effect display content from the effect determination unit 113. In addition, the display control unit 116 outputs information on the layer in which each object is arranged to the layer order management unit 115.

The display unit 117 is provided, for example, on the front surface of the housing of the electronic device 100, and displays a plurality of objects based on display data from the display control unit 116 on the screen 118. That is, the electronic device 100 displays a plurality of objects respectively arranged on a plurality of layers on the screen 118 of the display unit 117.

The display position determination unit 112, the effect determination unit 113, the layer order determination unit 114, the layer order management unit 115, and the display control unit 116 execute a display control program stored in the ROM in the electronic device 100 by the CPU. This is realized as a function. These may be realized by hardware (logic circuit).

FIGS. 13A to 13E are diagrams for explaining an operation example of the operation target object. As illustrated in FIG. 13A, an operation target object 121 is displayed on the screen 118 of the display unit 117 of the electronic device 100. The operation target object 121 is divided into four operation areas (A, B, and B in FIG. 13A) divided by center lines 122 and 123 in the horizontal direction (horizontal direction) and the vertical direction (vertical direction). C, D). The operation areas A to D are one of input operation areas.

As shown in FIGS. 13B and 13C, when the finger 131 is brought into contact with any one of the operation areas, the display control unit 116 applies an effect to each of the side facing the finger and the side facing the finger. Multiply 125, 127.

For example, as shown in FIG. 13B, when the finger 131 touches the operation area D, for example, a yellow line (halftone dot in the figure) is added as an effect 125 to the upper side 121a and the left side 121b on the opposite side of the object 121. Is done. Further, for example, a blue line (indicated by a diagonal line in the figure) is added to the lower side 121c and the right side 121d of the object 121 as the effect 127.

Further, as shown in FIG. 13C, when the finger 131 touches the operation area C, for example, a yellow line (a halftone dot in the figure) is added as an effect 125 to the upper side 121a and the right side 121d on the opposite side of the object 121. Is done. Furthermore, for example, a blue line (indicated by a diagonal line in the figure) is added to the lower side 121c and the left side 121b of the object 121 as the effect 127.

As shown in FIG. 13D, in a state where the finger 131 is in contact with the operation area D, the operation target object 121 is dragged, and the other side from the upper side 121a and the left side 121b on the opposite side (opposite the input operation area) Overlay the object (image) 140. As a result, the operation target object 121 is arranged in an upper layer of the other object 140. In this case, for example, the operation target object 121 is arranged in a layer one level higher than the other object 140.

Further, as shown in FIG. 13E, with the finger 131 in contact with the operation area D, the object 121 to be operated is dragged, and the other side 121c and the right side 121d on the finger side (input operation area side) Overlay the object (image) 140. As a result, the operation target object 121 is arranged in a lower layer of the other object 140. In this case, for example, the operation target object 121 is arranged in a layer one level lower than the other object 140.

In this manner, the layer order is changed by moving the operation target object 121 and superimposing it on the other object 140.

FIG. 14 is a diagram showing an image of operation. When the finger 131 is brought into contact with one operation region in the operation target object 121, an image is assumed in which the finger-side end of the object 121 sinks and the opposite end of the object 121 rises.

Then, when the object 121 to be operated is moved as it is and superimposed on the other object 140 from the opposite end that is lifted, an image in which the object 121 to be operated overlaps the other object 140 is assumed.

On the other hand, when the end of the sinking finger is overlapped with another object 140, an image is assumed in which the operation target object 121 overlaps the other object 140.

As described above, when the electronic device 100 according to the present embodiment is used, the operation image is intuitive and easy to understand for the user.

FIGS. 15A and 15B are diagrams showing basic operation examples. FIG. 15A shows a case where the object 142 is arranged in an upper layer of the object 143 and the operation target object 121 is arranged between the objects 142 and 143. Note that “1” and “2” written in the objects 142 and 143 respectively indicate the layer order.

When the operation target object 121 is overlapped with the object 143 from the opposite end and the object 142 is overlapped with the object 142 while the finger 131 is in contact with the operation area D, the operation target object 121 is the object. 142 and 143.

FIG. 15B shows a case where the objects 144 and 145 are not overlapped and the layer order is unknown, and the operation target object 121 is arranged between the objects 144 and 145.

In such a case, it is also assumed that the operation target object 121 is overlapped with the object 144 from the opposite end and the object 145 is overlapped with the finger side end while the finger 131 is in contact with the operation area D. Then, the operation target object 121 is arranged between the objects 144 and 145.

An example of the display control operation of the electronic device 100 having the above configuration will be shown. FIG. 16 is a flowchart illustrating an example of a display control procedure of the electronic device 100. This display control program is stored in the ROM in the electronic device 100 and is executed by the CPU in the electronic device 100. This will be described with reference to FIG.

The display position determination unit 112 refers to the information on the coordinate position from the coordinate input unit 111 and waits until the operation target object 121 is pressed (step S11).

When the operation target object 121 is pressed, the effect determination unit 113 determines in which of the operation areas divided into four the position of the pressed finger. Then, the display control unit 116 applies an effect to the finger side and the opposite end of the operation target object 121 based on the determination result of the effect determination unit 113 (step S12).

When the operation target object 121 is dragged on the screen via the coordinate input unit 111, the display control unit 116 moves the operation target object 121 according to this operation (step S13).

The layer order determination unit 114 determines whether or not the operation target object 121 has come into contact with another object 140 as a result of the movement of the operation target object 121 (step S14). If the electronic device 100 is not in contact with another object 140, the electronic device 100 proceeds to the process of step S18.

On the other hand, when contacting with another object 140, the layer order determination unit 114 determines whether or not the contact location is on the opposite side (step S15).

If the contact location is on the opposite side in step S15, the layer order management unit 115 places the operation target object 121 on the upper layer of the other object 140 (step S16).

On the other hand, if the contact location is the finger side in step S15, the layer order management unit 115 places the operation target object 121 on the lower layer of the other object 140 (step S17).

After the processing of steps S16 and S17, the display position determination unit 112 determines whether or not the finger 131 is released (released) from the operation target object 121 and the movement of the operation target object 121 is finished (step S18). ). When the movement is not finished, the electronic device 100 returns to the process of step S13.

On the other hand, when the finger 131 is released from the operation target object 121 and the movement of the operation target object 121 is terminated, the display control unit 116 erases the effects 125 and 127 applied to the operation target object 121 in step S12 ( Step S19). Thereafter, the electronic device 100 ends this operation.

In addition, when the pressing position of the finger 131 is changed to another operation area during the movement, the display control unit 116 may change the method of applying the effect along with this change. Specifically, in the case of NO in step S18, this change is realized by returning to the process of step S12.

Further, in the electronic device 100, various applied operations are prepared as operations for the operation target object 121 in addition to the above basic operations. Below, an applied operation will be described.

FIGS. 17A to 17D are diagrams illustrating an example of an operation when only moving the operation target object 121 without changing the layer order. As shown in FIG. 17A, effect determination is performed by touching (touching) the center portion including the intersection of the center lines 122 and 123 in the left-right direction (horizontal direction) and the vertical direction (vertical direction) with the finger 131. The unit 113 prevents the effect from being applied.

Alternatively, as shown in FIG. 17B, by touching any one operation area with two fingers 131, 132 (single place double touch), the effect determination unit 113 does not apply an effect. To do.

In this way, by performing a specific operation, only the movement can be performed, and the operability is not impaired.

As illustrated in FIG. 17C, when a plurality of objects 146, 147, 148, and 149 are arranged in a complicated manner, when the center part 121 g is touched and dragged with the finger 131, the display control unit 116 performs an effect. The object 121 to be operated is moved without applying. At this time, even if the other objects 146 and 147 are contacted, the layer order is not changed.

As shown in FIG. 17D, when the center of the operation target object 121 is hidden behind another object 150 and cannot be touched, one operation area (for example, the operation area D) is touched with two fingers 131 and 132. And drag. Accordingly, as in the case of FIG. 17C, the display control unit 116 moves the operation target object 121 without applying an effect.

18 (A) to 18 (F) are diagrams showing various operation examples in which effects are applied differently. When it is desired to always make the object 121 to be manipulated under another object, as shown in FIG. 18A, the two fingers 131 and 132 are placed on the respective operation areas (for example, operation areas) at diagonal positions. Touch A, D). For example, blue lines (indicated by diagonal lines in the figure) are added to the four sides on the top, bottom, left, and right of the operation target object 121 as an effect 127, which is an image that appears to sink.

Also, if you want to change the place where the effect is applied, there are various operations. As shown in FIG. 18B, an operation of bringing the finger 131 into contact with the vertical center line 123 is performed. By this operation, an effect process is applied to apply an effect 125 that floats to the upper end of the operation target object 121 across the horizontal center line 122 and to apply an effect 127 that sinks to the lower end. Done. The effect 125 is an example of a second effect. The effect 127 is an example of a first effect. The method of applying an effect corresponding to such an input operation is effective because it is easy to operate when a bar-shaped figure is moved or the layer order is changed.

Also, as shown in FIG. 18C, when the fingers 131 and 132 are brought into contact with the operation areas C and D, respectively, an effect 125 is applied so as to float on the upper side 121a of the operation target object 121. In this case, an effect 127 that sinks to the other three sides is applied.

Moreover, although the case where it divided | segmented into four operation areas was shown in the said embodiment, you may divide | segment more finely. For example, as shown in FIGS. 18D, 18E, and 18F, it is divided into 4 × 4 16 sections, and a finger is brought into contact with a surrounding operation area or a line that divides the operation area. The manner of applying 125 and 127 may be changed.

As shown in FIG. 18D, when the finger 131 is brought into contact with the line that divides the operation areas J and K, the display control unit 116 finely adjusts how the effects 125 and 127 are applied based on the contact position. To do.

As shown in FIG. 18E, when the operation area K is pressed with a finger so as to be pushed in strongly, the display control unit 116 applies effects 125 and 127 so that the sinking amount increases.

As shown in FIG. 18 (F), when the operation area K is touched with a finger so as to push in weakly, the display control unit 116 applies effects 125 and 127 so that the amount of floating increases.

In this case, as the touch panel capable of detecting the pressing force as the coordinate input unit 111, a resistive film type or a capacitive type is used. As described above, how the effects 125 and 127 are applied can be changed by various touch operations.

FIG. 19 is a diagram illustrating an operation example when the operation target object 171 is smaller than the finger 131. When the object 171 to be operated is smaller than the finger 131, the effect cannot be seen and it is not known from which direction the other object should be contacted. However, in general, when the operation target object 171 is smaller than the finger 131, it is often placed on another object 175.

Therefore, in this embodiment, when the operation target object 171 is equal to or smaller than a certain size, the operation target object 171 is always arranged in the upper layer. Further, when the ratio of the contact area of the finger 131 to the area of the operation target object is equal to or greater than a certain value, the operation target object 171 is always arranged in the upper layer.

As shown in FIG. 19, when the operation target object 171 is touched with the finger 131, an effect 125 that floats on all sides of the operation target object 171 is added. Thereby, even if the operation target object 171 is smaller than the finger 131, it is avoided that the operability is impaired.

20 (A) to 20 (C) are diagrams showing an operation example when the other object 181 is not a quadrangle. When the other object 181 has a shape such as a round shape instead of a quadrangle, even if the object 121 to be operated is moved, it is difficult to determine contact with the other object 181 and it is difficult to determine whether the layer order has been changed. .

In this embodiment, even if the other object 181 is not a quadrangle, as shown in FIG. 20A, a square frame (dotted line frame in the figure) 183 surrounding the other object 181 is treated as the other object 181. . However, this square frame 183 is not displayed. As shown in FIG. 20B, when the operation target object 121 comes into contact with the square frame 183, as shown in FIG. 20C, for example, a green line as an effect 185 is added to the square frame 183 (in the drawing). , A solid line), and it can be seen that the layer order has been changed.

Thereby, even when the other object 181 is not a quadrangle, the contact with the other object 181 can be easily understood, and the change in the layer order can be easily identified.

FIGS. 21A and 21B are diagrams illustrating an example of an operation when the operation target object 191 is hidden behind another object 195. FIG. As shown in FIG. 21A, when the operation target object 191 is hidden behind another object 195, the outline of the entire operation target object 191 is unknown. In such a case, as shown in FIG. 21B, only the effects 125 and 127 added around the operation target object 191 are displayed on the uppermost layer, so that the outer shape of the entire operation target object 191 is displayed. This makes it easier to operate. Note that the effects 125 and 127 may be displayed on the same layer as the other objects 195.

FIGS. 22A to 22C are diagrams showing an example of how to apply the effect when the operation target object 196 is not a rectangle. Even when the operation target object 196 has a round shape or the like instead of a quadrangle, the object itself is handled by a square frame 197 as shown in FIG. As shown in FIG. 22B, the effects 125 and 127 are added around the square frame 197. However, it may be felt that handling an object that is not a rectangle as a rectangle is not an intuitive operation.

In this embodiment, an effect 165 that floats and an effect 167 that sinks are added around the object 196 that is not a quadrangle, for example, a round operation target. In this case, as a method of applying the effects 165 and 167, for example, there are the following methods. Of the operation target object 196, the center of gravity of an image other than the transparent part (the image of the part where the object actually exists) is calculated, and the position of the center of gravity and the contact point of the finger 131 are connected by a straight line. Note that the contact point of the finger 131 is obtained from the touch position of the touch panel (for example, the center point of the contact portion). Further, with the line intersecting the straight line perpendicularly and passing through the center of gravity, an end on the finger side is added as an effect 167, and an end on the opposite side is added as an effect 165.

Thereby, effects 165 and 167 are applied along the outline of the object 196 to be operated, and an intuitive operation is expected.

FIG. 23 is a flowchart showing an example of an effect processing procedure for applying an effect to the operation target object in step S12 of FIG.

First, the effect determination unit 113 determines whether or not the ratio of the area of another object to the area of the operation target object is equal to or greater than a certain value (step S21).

When the value is equal to or larger than the predetermined value in step S21, the display control unit 116 floats around the operation target object 171 so that the operation target object 171 is arranged in a higher layer than the other objects 175, as shown in FIG. A special effect 125 is applied (step S22). Thereafter, the electronic device 100 returns to the original process. That is, the process proceeds to step S13 in FIG.

On the other hand, if the area ratio is not greater than or equal to the predetermined value in step S21, the effect determination unit 113 determines whether or not the contact has occurred as follows. Specifically, as shown in FIG. 17A, the center of the operation target object 121 is touched with the finger 131, or as shown in FIG. It is determined whether the fingers 131 and 132 are in contact (step S23).

When the center part is touched with a finger in step S23 or when two fingers are touched, the display control unit 116 does not apply the effects 125 and 127 (step S24). Thereafter, the electronic device 100 returns to the original process.

On the other hand, in step S23, when the center is not touched with a finger and the fingers are not touched with two fingers, the effect determination unit 113 sets the finger 131 as shown in FIG. It is determined whether or not the contact location is on the center line 123 (step S25).

When the contact location is on the center line 123 in step S25, the display control unit 116 applies the effects 125 and 127 by dividing the operation target object 121 vertically as shown in FIG. S26). Thereafter, the electronic device 100 returns to the original process.

On the other hand, if the contact point of the finger 131 is not on the center line 123 in step S25, the display control unit 116, as shown in FIGS. The effect 127 that sinks in is applied (step S27). Thereafter, the electronic device 100 returns to the original process.

As described above, in the electronic device according to the present embodiment, the first layer in which the first object is arranged and the second object in which the second object is arranged are based on the positional relationship between the input operation area and the overlapping area. A layer control unit that controls the order of the layers is provided. The input operation area is a part of the area of the first object that has accepted the input operation. The overlapping area is an area where the second object and the first object overlap. The electronic device is, for example, the electronic device 100. The layer control unit is, for example, the layer order management unit 115. The first object is, for example, the operation target object 121 of FIG. The second object is, for example, another object 140 in FIG.

This makes it easy to move objects and change layer order. That is, by moving the operation target object 121 and superimposing it on another object 140, the operation target object 121 can be moved and the layer order can be changed smoothly.

In Patent Document 1, the layer order can be changed between overlapping objects by a single operation. However, when objects are moved simultaneously, at least two operations are required. In other words, the change of the layer order and the movement of the object have to be operated separately, which sometimes takes time. On the other hand, according to the electronic device 100, it is possible to easily move the object and change the layer order.

In addition, when the first object overlaps with the second object from the input operation area side by the input operation received by the input unit, the layer control unit becomes the lower layer of the second layer. You may control as follows. In addition, when the first object overlaps with the second object from the input operation area side by the input operation received by the input unit, the layer control unit becomes the lower layer of the second layer. You may control so. The layer control unit may control the first layer to be an upper layer of the second layer when the first object overlaps with the second object from the side opposite to the input operation area.

This makes it possible to smoothly move and change the layer order to the upper and lower layers according to the area where the first object and the second object start to overlap.

Further, the layer control unit performs the following control when the ratio of the contact area to the area of the first object region is a predetermined ratio or more, or when the region of the first object is a certain size or less. May be. Specifically, in such a case, when the first object and the second object are overlapped by the input operation received by the input unit, the layer control unit is higher in the first layer than the second layer. You may control to become a layer.

This makes it possible to always display small objects on top of other objects, and to move and change the layer order smoothly.

Further, the layer control unit may perform control so that the order of the first layer and the second layer is unchanged when an input operation to the central portion of the region of the first object is received by the input unit. . In addition, when the layer control unit simultaneously receives a plurality of input operations to the same input operation region (for example, the operation region D) in the first object by the input unit, the order of the first layer and the second layer May be controlled to be unchanged.

This makes it easy to change the layer order without changing the layer.

In addition, when the layer control unit simultaneously receives a plurality of input operations to the opposing input operation areas (for example, the operation areas A and D) in the first object by the input unit, the first layer is the second layer. You may control so that it may become a lower layer.

This makes it possible to easily change the layer order so that the first object is always arranged in a lower layer than the second object.

In addition, the layer control unit increases the range of the input operation area side as the pressing force at the time of the input operation received by the input unit increases, and opposes the input operation area side as the pressing force at the time of the input operation decreases. The range may be increased.

As a result, the higher the pressing force, the easier it is for the first object to be placed in a lower layer than the second object, and the lower the pressing force, the first object is placed in a higher layer than the second object. It becomes easy to arrange. Therefore, it is possible to move the object and change the layer order intuitively and easily.

The electronic device 100 performs the first effect process on the end portion on the input operation area side of the first object, and performs the second effect process on the end portion on the opposite side to the input operation area of the first object. You may provide the effect process part which performs the effect process. The effect processing unit is, for example, the display control unit 116. The first effect process is a process of coloring blue, for example. The second effect process is a process of coloring yellow, for example.

In addition, when the first object and the second object are overlapped by the input operation received by the input unit, the effect processing unit performs the third operation on the rectangular frame as the end of the second object region. Effect processing (for example, processing for coloring in green) may be performed.

Thereby, even if the image of the first object is not rectangular, it is possible to easily grasp the layer order relationship between the first object and the second object.

Further, the effect processing unit may display the following when the first layer is a lower layer than the second layer and the first object and the second object overlap. Specifically, in this case, the effect processing unit may display the result of the first effect processing and the second effect processing for the end portion of the first object in a layer higher than the second layer. Good.

Thereby, even when the first object is hidden by the second object when the first object overlaps with the second object, the effect applied to the end of the first object can be confirmed. . Therefore, it is possible to easily check how the layer order is to be changed.

Further, the effect processing unit may perform the first effect processing and the second effect processing on the edge of the image when the image of the first object has a shape other than the rectangular shape. Further, the effect processing unit may perform the first effect processing and the second effect processing based on the positional relationship between the input position received by the input unit and the reference point of the image. The reference point is, for example, the center of gravity. Here, the first effect processing is performed on the end portion on the input position side of the reference point in the image. The second effect processing is performed on the end portion on the opposite side of the input position from the reference point in the image.

This allows the effect to be applied to the edge of the image, not the rectangular portion outside the image, so that the image within the object to be operated can be moved and the layer order can be changed more intuitively.

In the above embodiment, the effect is applied by adding, for example, yellow and blue lines to the end of the object. However, the present invention is not limited to this, and various effects can be expressed. 24A to 24C are diagrams showing examples of applying various effects.

For example, as shown in FIG. 24A, an effect that lifts up may be applied by expressing the object 121 to be operated as a corner turned up. Moreover, you may apply an effect that sinks by shadowing the object. Also, as shown in FIG. 24B, an effect that floats with an upward arrow may be expressed, and an effect that sinks with a downward arrow may be expressed. Also, as shown in FIG. 24C, it may be expressed by a balloon in which characters “Up” and “Down” are written.

In the above-described embodiment, the cross-shaped center line that divides the operation target object 121 into four operation areas is not displayed. However, in order to make the operation area partitioned by the user easier to understand, A line may be displayed.

Further, in the above embodiment, when the operation target object 121 is in contact with (overlaps with) the other object 140, the case where it is simply placed on the upper layer or the lower layer is shown. Instead of this, it is not limited to a single layer change, and may be arranged in two or more upper layers or lower layers. Further, it may be possible to change whether the layer is changed in one step or two or more layers by an operation unit (not shown) or the layer order management unit 115.

Also, examples of the object include a figure, an image, and text. Moreover, although the case where the operation target object 121 is operated with the finger 131 has been described, the operation may be performed with a stylus pen or the like.

Further, examples of the electronic device 100 that can display and edit a plurality of objects on the screen include a smartphone, a tablet terminal, and a notebook PC.

Also, the present embodiment may be realized by a display system having an electronic device and a server via a network, as in the first embodiment. That is, the electronic device may operate as a cloud terminal in consideration of the cloud computing.

(Third embodiment)
The electronic device of this embodiment is applied to an electronic device that can display and edit a plurality of objects on a screen, for example.

FIG. 25 is a block diagram illustrating a configuration example of the electronic device 200 according to the embodiment. FIG. 25 mainly shows a configuration of a part related to display control in the electronic apparatus 200.

The electronic device 200 includes a coordinate input unit 211, a position determination unit 212, a calculation unit 213, a drag operation determination unit 220, a layer order control unit 214, an object shape change unit 215, a layer information storage unit 219, a display control unit 216, and a display Part 217. The drag operation determination unit 220 includes an object position determination unit 221, an object contact determination unit 222, and an object contact history storage unit 223.

The coordinate input unit 211 includes a touch panel provided on the screen 218 of the display unit 217, and detects a contact (touch) position of input means (for example, a user's finger) on the touch panel as coordinates. The coordinate input unit 211 has a function as an input unit that receives an input operation to an object.

The position determination unit 212 determines the display position of the operation target object based on the contact position of the finger or the like input by the coordinate input unit 211.

The calculation unit 213 determines an input operation (for example, a touch operation, a flick operation, or a drag operation) on the operation target object, and notifies the drag operation determination unit 220 of the determination result.

The drag operation determination unit 220 determines a drag operation based on information from the calculation unit 213. The drag operation determination unit 220 activates the object position determination unit 221 and the object contact determination unit 222 based on the operation content.

The object position determination unit 221 determines the positional relationship between the layer where the object being dragged (the operation target object) is arranged and the layer where another object is arranged (layer order change determination).

The object contact determination unit 222 determines whether the object being dragged and another object are in contact (overlapping state) or separated (non-overlapping state).

Also, the object contact determination unit 222 detects the object in the foreground among the objects that the object being dragged contacts more than a predetermined number of times within a specified time (object contact determination).

In the present embodiment, a drag operation for bringing objects into contact with each other and separating them, that is, an operation for dragging the object being dragged against another object is referred to as “peck dragging operation” or “duplicate processing”. Say. In other words, the duplication processing is performed by moving the operation target object according to the input operation so that the operation target object is brought into contact with another object to be in an overlapping state, and then the operation target object is separated from the other object. This is a process for making a non-overlapping state.

For example, a drag operation that is brought into contact and released once is a duplication process once, and a drag operation that is brought into contact and released twice is a duplication process twice. In the following, it is exemplified that the duplication process is mainly performed twice.

Further, the measurement of the specified time may be started when the object being dragged first comes into contact with another object, that is, from the first contact. Further, the measurement of the specified time may be started from the time when the object being dragged first leaves (separates) from another object, that is, from the first time of leaving. Furthermore, it may be started from the previous contact or may be started from the previous departure.

Also, the object contact determination unit 222 has a function as a history information storage control unit that stores, updates, or deletes information on the history of contact or separation between objects stored in the layer information storage unit 219.

The object contact history storage unit 223 holds information on the history of an object that has been touched or detached from the object being dragged. Details of the object contact history storage unit 223 will be described later.

The layer order control unit 214 (an example of a layer control unit) issues a layer order change command to the layer information storage unit 219 in accordance with the layer order change determination and the object contact determination from the drag operation determination unit 220.

The object shape changing unit 215 (an example of an effect processing unit) changes the shape of the object by referring to the effect processing pattern stored in the layer information storage unit 219 in accordance with the object contact determination from the layer order control unit 214. Generate. Information on the effect processing pattern for the object (for example, a pattern with a turned shape or a pattern for decoration such as blinking) is stored in the layer information storage unit 219.

The layer information storage unit 219 stores, for example, information on the position, shape, and layer order of objects displayed on the screen 218 of the display unit 217.

The display control unit 216 generates display data according to the layer order information stored in the layer information storage unit 219, and outputs the display data to the display unit 217. Further, the display control unit 216 outputs the display data of the changed object shape to the display unit 217.

For example, the display control unit 216 displays on the screen 218 of the display unit 217 the first object and the second object respectively arranged in the first layer and the second layer changed by the layer order control unit 214. . The first object is, for example, an object to be operated for a drag operation. The second object is another object different from the operation target of the drag operation, for example.

The display unit 217 is provided on the front surface of the housing of the electronic device 200, for example, and displays a plurality of objects based on the display data from the display control unit 216 on the screen 218. That is, the electronic device 200 displays a plurality of objects respectively arranged on a plurality of layers on the screen 218 of the display unit 217.

Note that the functions of the drag operation determination unit 220, the layer order control unit 214, the object shape change unit 215, and the display control unit 216 are executed by the CPU executing a display control program stored in, for example, a ROM in the electronic device 200. Is realized. These may be realized by hardware (logic circuit).

FIG. 26 is a diagram illustrating an example of a data structure of data stored in the object contact history storage unit 223. In the object contact history storage unit 223, the number of times of contact or separation between the object being dragged and another object, and the timer time at the time of contact or separation are registered in a table format. In addition, other information may be registered in the object contact history storage unit 223.

Therefore, the object contact history storage unit 223 is an example of a history information storage unit that stores information on the history of contact or separation between the first object and the second object in the overlap processing within a predetermined time.

For example, the first contact time (0.00 seconds), the first release time (0.15 seconds), the second contact time (0.30 seconds), and the second time for another object a The information of the time of departure (0.48 seconds) is registered. Also, for example, the time of the first contact with the object a is the starting point, the time of the first contact with the other object b (0.35 seconds), and the time of the first release (0.41 seconds). It is registered. Also, for example, the time of the first contact (0.43 seconds) is registered for the other object c, starting from the time of the first contact with the object a.

Note that the layer order control unit 214 deletes history information about an object when a predetermined time (α seconds) has elapsed from a reference time (for example, the time of the first contact or previous contact with any other object). May be. The reference time is included in the time from the start to the end of the drag operation. Further, the reference time may be another contact or separation timing, and is obtained by appropriately calculating from time information stored in the object contact history storage unit 223, for example.

Further, as will be described later, for example, after the object to be operated is inserted into a predetermined layer, that is, after the dragging drag operation is completed, the layer order control unit 214 stores all the history stored in the object contact history storage unit 223. Information may be deleted. Thereby, unnecessary history information is deleted, and the memory capacity can be reduced.

Note that if the object to be operated and another object have been in contact before the start of the drag operation, this contact is not regarded as the first contact, but once the contact is made by dragging and then touching again, the first time It is good also as contact.

FIGS. 27A to 27C and FIGS. 28A to 28C are diagrams for explaining examples of drag operation of an operation target object.

As shown in FIG. 27A, the operation target object 241 is displayed on the screen 218 of the display unit 217 of the electronic device 200 in a state where the object 241 overlaps the other object 243. The user touches the object 241 with the finger 230 and performs a drag operation so that the object 241 is pulled away from the other object 243 to make the non-overlapping state (see FIG. 27B). The object position determination unit 221 detects a non-overlapping state. By setting the non-overlapping state first, the criteria for starting the execution of the subsequent overlapping process becomes clear.

In a state where the operation target object 241 is dragged with the finger 230, a drag operation is performed by tapping the corner of another object 244 twice (see FIG. 27C). When this drag operation is performed, the operation target object 241 overlaps the layer of another object 244 (overlapping state). The object position determination unit 221 detects a drag operation that is tucked twice.

The object shape changing unit 215 turns the corners 244a of the other objects 244 as a result of the drag operation that is tucked twice (see FIG. 28A).

When the object 241 is dragged and moved with the finger 230 while the corner 244a of the other object 244 is turned, the object 241 is inserted, for example, below the other object 244 (see FIG. 28B). The state where the corner portion 244a is turned is a state where a predetermined number of overlapping processes have been executed. The layer order control unit 214 inserts the operation target object 241 into, for example, one layer below the layer where the other object 244 is arranged.

If the finger 230 is released from the operation target object 244 in a state where the operation target object 244 is inserted, the object shape changing unit 215 removes the turn of the corner portion 244a and restores the shape of the other object 244 (see FIG. 28 (C)).

Next, an operation example of the electronic device 200 will be described.
FIG. 29 is a flowchart illustrating an example of a processing procedure until overlapping objects are separated. This process is executed every time the position of the object being dragged is input by the coordinate input unit 211. The coordinate input unit 211 periodically detects an input to the touch panel.

First, the object position determination unit 221 determines whether or not another object overlaps the object being dragged as an operation target on the screen 218 of the display unit 217 (in an overlapping state) (step S101). .

If other objects overlap, the process of FIG. 29 ends.

On the other hand, if no other object overlaps, the layer order control unit 214 sets the layer of the object being dragged to the forefront (step S102).

The layer order control unit 214 aligns the layer order while maintaining the layer order relationship of the objects other than during the drag operation (step S103). For example, in the stage of FIG. 27A, the layer order of the objects 241 to 244 is object 242 → object 244 → object 243 → object 241 in order from the upper layer. In the stage of FIG. 27B, the layer order of the objects 241 to 244 is object 241 → object 242 → object 244 → object 243 in order from the upper layer. Thereafter, the process of FIG. 29 is terminated.

FIG. 30 is a flowchart showing an example of a processing procedure of a drag operation in which another object is picked by an object being dragged.

The object contact determination unit 222 determines whether the object being dragged has newly contacted another object or has newly detached from the other object (step S111).

30. When a new object has been contacted or when it has not newly detached from another object, the processing in FIG. 30 ends.

When a new object is touched or a new object is released, the object contact determination unit 222 refers to the object contact history storage unit 223. Then, the object contact determination unit 222 determines whether or not there is information on the contact or detachment history of the new other object (step S112).

If there is no other object contact or departure history, the object contact determination unit 222 saves the new other object contact or departure history in the object contact history storage unit 223 (step S116). For example, the object contact determination unit 222 stores the time information of the first contact with the new other object in the object contact history storage unit 223. Thereafter, the process of FIG. 30 ends.

When there is a history of contact or detachment of another object, the object contact determination unit 222 determines whether or not a timer time (not shown) is within a specified time (α seconds) from the previous contact or detachment (step S113). For the specified time, for example, an appropriate time (for example, 0.5 seconds) required for the user to start and end the operation on the operation target object is set. Further, it may be determined whether it is within a specified time from a reference time other than the previous contact or separation time.

When a predetermined time has elapsed since the previous contact or separation, the object contact determination unit 222 updates the information on the contact or separation history of the operation target object stored in the object contact history storage unit 223 to be deleted. (Step S117). Thereafter, the process of FIG. 30 ends.

In this way, it is possible to prevent erroneous operations by limiting the execution of object duplication processing on the screen due to contact or separation within a specified time.

On the other hand, if it is within the prescribed time from the previous contact or separation, the object contact determination unit 222 determines whether or not the current drag operation is the second release operation (step S114).

If it is not the second separation, the object contact determination unit 222 updates the contact or separation history of this object (step S118). For example, when the current contact or detachment is the first detachment, the object contact determination unit 222 stores the time information of the first detachment of the object in the object contact history storage unit 223. Thereafter, the process of FIG. 30 ends.

On the other hand, when the current drag operation is the second release operation, the electronic device 200 performs an object insertion mode process during the drag operation (step S115). Thereafter, the process of FIG. 30 ends.

FIG. 31 is a flowchart showing an example of the procedure of the insertion mode process in step S115 of FIG.

The object contact determination unit 222 performs the following operation when there are two or more other objects that have left the second time from the object being dragged. That is, the object contact determination unit 222 detects the object of the foremost layer among these objects based on the layer order information stored in the layer information storage unit 219 (step S121). If there is one object that has left the second time, that object is detected.

The object shape changing unit 215 sets the detected object as a layer operation target and changes the shape of the detected object (step S122). For example, the object shape changing unit 215 changes the detected object so as to turn the corner on the side on which the object being dragged contacts.

The layer order control unit 214 sets the layer of the object being dragged below the layer of the other detected object (step S123). For example, the layer order control unit 214 sets the layer of the object being dragged one level below the layer of the other detected object.

The layer order control unit 214 arranges the layer order while maintaining the layer order relationship of the objects other than the object being dragged and the detected other objects (step S124).

Subsequently, the object position determination unit 221 discards the information on the contact / separation history of all the objects stored in the object contact history storage unit 223 (step S125). Thereby, unnecessary history information can be deleted, and the memory capacity can be effectively utilized. Thereafter, the process of FIG. 31 is terminated.

FIG. 32 is a flowchart showing an example of a processing procedure for determining a layer of an object being dragged.

The drag operation determination unit 220 determines whether or not the finger 230 is released from the object being dragged (step S131). If the finger 230 has not been released, the processing in FIG. 32 ends.

On the other hand, when the finger 230 is released from the object being dragged, the object shape changing unit 215 restores the changed shape of the other object (step S132). Thereafter, the process of FIG. 32 ends.

Next, an example of a drag operation for picking another object will be described.
FIGS. 33A to 33D are diagrams showing examples of drag operations for pecking the corner 244a of another object 244. FIG.

In the present embodiment, a drag operation may be performed to prick the corner 244a at the lower right corner of another object 244 shown in FIG. Alternatively, a drag operation may be performed to prick the corner 244a at the lower left corner of another object 244 shown in FIG. Alternatively, a drag operation may be performed to prick the corner 244a at the upper left corner of another object 244 shown in FIG. Alternatively, a drag operation may be performed to prick the corner 244a at the upper right corner of another object 244 shown in FIG. The coordinates input by the user operation are detected by the coordinate input unit 211, and the drag operation determination unit 220 determines that the drag operation is a drag operation.

Thereby, for example, even if it is difficult to prick the lower right corner depending on the overlapping state of a plurality of objects, the layer order can be changed to a desired layer order by dragging the other corner 244a.

Also, unlike FIGS. 33 (A) to (D), a drag operation that pokes the side of another object may be performed. FIGS. 34A to 34D are diagrams showing an example of a drag operation for pecking the side 244b of another object 244. FIG.

In this embodiment, a drag operation may be performed to prick the side 244b on the right side of the other object 244 shown in FIG. In this case, the right side 244b is turned up. Alternatively, a drag operation may be performed to prick the left side 244b of another object 244 shown in FIG. In this case, the left side 244b is turned up. Alternatively, a drag operation may be performed by pecking the upper side portion 244b of another object 244 shown in FIG. In this case, the upper side portion 244b is turned up. Alternatively, a drag operation may be performed to prick the lower side 244b of the other object 244 shown in FIG. In this case, the lower side 244b is turned up.

In any of the cases of FIGS. 33A to 33D and FIGS. 34A to 34D, the shape of the object is changed so that the corner 244a or the side 244b of the other object that is tucked up is turned. The unit 215 changes the display shape of the other object on the screen 218.

The deformation turned by the corner 244a is an example of effect processing, and other effect processing may be performed. For example, the corner portion 244a may be deformed and opened, or the corner portion 244a may be deformed into a jagged shape. Further, the corners 244a of other objects may be blinked or discolored.

Next, variations of the display form of other objects will be described.

The shape of the other object may be a rectangle or another shape (for example, an ellipse, a star, or other shape). FIGS. 35A to 35C are diagrams showing examples of display forms of other objects.

As shown in FIG. 35 (A), when the other object 251 is circular, the arc portion 251a on which the dragging operation has been performed may be turned up.

FIG. 35B shows a case where the object 260 being dragged is turned by dragging the corner (for example, the lower left corner) of another object 261 with the object 260 being dragged, and then the object 260 being dragged is moved to another corner (for example, Shown when moved to the lower right corner. In this case, the position of the turned portion 261a of the other object 261 changes. Specifically, the turning portion 261a of the other object 260 changes to a position facing the object 260 being dragged. Accordingly, the lower side of the other object 260 is turned over.

In FIG. 35C, the objects 272 and 273 move so as to be non-overlapping with the other objects 271 on the screen by dragging the corners of the other objects 271 with the object 270 being dragged. . Such movement control is performed by the display control unit 216. Accordingly, it is possible to prevent the objects 272 and 273 other than the layer change target from interfering with other objects 271 as the layer change target for visual recognition during the layer operation.

As described above, in the electronic device 200, when the layer control unit performs the overlapping process, the first layer in which the first object is arranged on the basis of the second layer in which the second object is arranged. And a second layer in which the second object is arranged.

According to the electronic device 200, when changing the layer order of a plurality of objects, the layer in which the objects are arranged can be easily moved by the overlapping process of the first object and the second object. Further, the first object and the second object can be arbitrarily selected. Therefore, a desired object can be changed to a desired layer order by a simple operation. In addition, since the overlapping process is performed in the same manner as an actual operation of, for example, removing (sealing) the seal, it is easy to understand intuitively.

In addition, even when there is a layer of an object that is distant between each layer of overlapping objects, it is necessary to perform the operation for changing the layer many times when changing the layer between overlapping objects. And can save time. Further, even when an arbitrary object is moved to the intermediate layer, it is not necessary to perform the operation for changing the layer over and over, and labor can be reduced.

Further, the layer control unit may determine the first layer and the second layer when the overlapping process is executed a plurality of times. Thereby, the layer operation can be performed only when the user consciously operates, and erroneous operation can be prevented.

In addition, when the overlapping process is executed, the layer control unit may determine the first layer as one layer lower than the second layer or one layer higher than the second layer. Thereby, a 1st layer can be made into the layer of the hierarchy which a user understands easily.

In addition, the layer control unit may determine the first layer and the second layer when the second overlapping process is executed before a predetermined time elapses after the first overlapping process is executed. Good. The second overlap process follows the first overlap process in time. Thereby, even when an input operation unintended by the user is performed, malfunction can be prevented.

In addition, the history information storage control unit, when the first object and the second object are in an overlapping state or a non-overlapping state until the predetermined time has elapsed or the predetermined number of times has been reached, is as follows: It may be updated. Specifically, in such a case, the history information storage control unit may update information on the history of contact or detachment of the second object stored in the history information storage unit. Thereby, for example, the number of times of contact or withdrawal or information on the time can be appropriately managed.

The history information storage control unit may delete the history information of the second object stored in the history information storage unit when a predetermined time has elapsed. The passage of the predetermined time is, for example, the passage of the predetermined time from the first contact or the previous contact. Thereby, unnecessary histories are efficiently deleted, and the memory capacity can be reduced.

Further, the effect processing unit may execute effect processing on the second object. As a result, the user can visually recognize another object that is a reference for insertion. In addition, it is easy to visually understand which object the first object is inserted directly above or directly below on the screen.

Further, the effect processing unit may end the effect processing when the input operation accepted by the input unit is completed. Thereby, the user can visually recognize that the change of the layer order has been completed.

Further, when the overlap processing is executed, the effect processing unit may deform the end portion of the second object on the side facing the first object as the effect processing. Thereby, the user can visually recognize other objects serving as a reference for insertion, and can also visually recognize from which position the first object is inserted.

In the above embodiment, a drag operation that is tucked twice within a specified time is shown. However, when a drag operation that is tucked once or three times or more is performed, the layer order control unit 214 controls the layer order, and the object shape The changing unit 215 may perform effect processing.

Also, instead of the dragging drag operation, when a predetermined time has elapsed in a single contact (overlap) state, the layer order control unit 214 controls the layer order, and the object shape changing unit 215 performs effect processing. Also good. Thus, the layer order can be easily changed without any special user operation.

In the above embodiment, when the dragging operation is performed, the operation target object (first object) is overlapped with another object (second object). However, the object may be simply touched without overlapping. The overlap processing may include a case where the contact is simply made.

In the above embodiment, the case where the corners or sides of the object are in contact with or separated from each other is shown, but one may be a corner and the other may be a side.

In the above embodiment, a case has been described in which the layer of the object to be operated is determined as a layer one step lower than the layers of other objects. However, the layer may be determined as a layer one step higher. Even in this case, the same effect as in the case of a layer one step lower can be obtained. In addition, the operation target object may be inserted not only in one stage but at a predetermined level in the layer.

Moreover, the electronic device 200 can be applied to any electronic device (for example, a smartphone, a personal computer (PC), or a digital photo frame) that can display an object on a screen.

Further, the object may be, for example, a text or a table in addition to an image (for example, a graphic or a photograph).

In the above embodiment, a case where an object is selected using a touch panel and a drag operation is performed has been described. However, various inputs (for example, a mouse or a touchpad) provided separately from the screen 218 ( For example, a selection or drag operation may be performed.

In the above embodiment, the case where the drag operation is performed with the finger 230 has been described. However, the drag operation may be performed using other input means (for example, a stylus pen).

Also, the present embodiment may be realized by a display system having an electronic device and a server via a network, as in the first embodiment. That is, the electronic device may operate as a cloud terminal in consideration of the cloud computing.

Note that at least a part of the first to third embodiments may be combined.

The present invention also applies a program for supplying a display control program for realizing the functions of the above-described embodiment to the electronic device 1 via a network or various storage media, and reading and executing the computer (CPU) in the electronic device 1. It is a range.

Although the present invention has been described in detail and with reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention.
This application is based on Japanese Patent Application No. 2011-243640 filed on November 7, 2011 and Japanese Patent Application No. 2011-285728 filed on December 27, 2011, the contents of which are hereby incorporated by reference. It is captured.

The present invention is useful for an electronic device, a display system, a display control method, a display control program, and the like that can change the layer order of objects to a desired order with a simple operation.

DESCRIPTION OF SYMBOLS 1, 1B Electronic device 2 Server 11 Coordinate input part 12 Position determination part 13 Layer order control part 14 Effect control part 15 Layer information storage part 16 Display control part 17 Display part 18 Screen 19, 20 Communication part 21-23, 31, 32 , 41 to 45, 51, 52, 61 to 63, 71 to 73, 81, 82 Layer image 100 Electronic device 111 Coordinate input unit 112 Display position determination unit 113 Effect determination unit 114 Layer order determination unit 115 Layer order management unit 116 Display Control unit 117 Display unit 118 Screen 121, 171, 181, 191, 196 Operation target object 122, 123 Center line 125, 127, 165, 167, 185 Effect 131, 132 Fingers 140, 142, 143, 144, 145, 146 147, 148, 149, 150, 175 195 Other objects 183, 197 Square frames A, B, C, D Operation area 200 Electronic device 211 Coordinate input unit 212 Position determination unit 213 Calculation unit 214 Layer order control unit 215 Object shape change unit 216 Display control unit 217 Display unit 218 Screen 219 Layer information storage unit 220 Drag operation determination unit 221 Object position determination unit 222 Object contact determination unit 223 Object contact history storage unit 230 Fingers 241, 242, 243, 244, 251, 260, 261, 270, 271, 272, 273 Object 244a Corner 244b Side 251a Arc part 261a Turning part

Claims (36)

1. An electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit,
   An input unit that receives a moving operation of changing the position of the first object on the screen among the plurality of objects;
   A layer information storage unit that stores layer information including an order of a plurality of layers in which the plurality of objects are respectively arranged;
   When the positional relationship between the first object and the second object among the plurality of objects changes from the overlapping state to the non-overlapping state and then changes to the overlapping state again, it is stored in the layer information storage unit A layer control unit that changes the order of the first layer in which the first object is arranged and the second layer in which the second object is arranged, based on layer information;
   A display control unit for displaying the first object and the second object respectively arranged on the first layer and the second layer changed by the layer control unit on the screen of the display unit;
   Electronic equipment comprising.
2. The electronic device according to claim 1,
   When the first layer is higher than the second layer before the moving operation by the input unit, the layer control unit moves the first layer one step lower than the second layer. If the first layer is lower than the second layer before the moving operation by the input unit, the first layer is changed to a layer one level higher than the second layer. Electronic equipment.
3. The electronic device according to claim 1 or 2,
   The layer control unit is an electronic device that collectively changes the order of layers in which the plurality of objects are arranged when the first object includes a plurality of objects arranged in different layers.
4. The electronic device according to any one of claims 1 to 3,
   The display control unit, when the first object reaches the end of the screen of the display unit by a movement operation by the input unit, reduces the first object and displays it on the screen of the display unit .
5. The electronic device according to any one of claims 1 to 4,
   The layer control unit finishes the moving operation by the input unit after the positional relationship between the first object and the second object changes from the overlapping state to the non-overlapping state and then changes to the overlapping state again. In such a case, an electronic device in which the order of the first layer and the second layer is unchanged.
6. The electronic device according to claim 1, further comprising:
   An electronic apparatus comprising an effect control unit that controls an effect process indicating that the second layer is a target for changing the order of layers with respect to the second object.
7. The electronic device according to claim 1, further comprising:
   The input unit is an electronic device that receives the moving operation based on contact with a touch panel provided on a screen of the display unit.
8. An electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit,
   An input unit that receives an input operation to a first object that is one of the plurality of objects;
   An input operation area that is a part of the area of the first object that has received an input operation by the input unit, and an area in which the second object that is one of the plurality of objects and the first object overlap A layer control unit that controls the order of the first layer in which the first object is arranged and the second layer in which the second object is arranged, based on a positional relationship with the overlapping region ,
   A display control unit for displaying the first object and the second object respectively arranged on the first layer and the second layer controlled by the layer control unit on the screen of the display unit;
   Electronic equipment comprising.
9. The electronic device according to claim 8,
   When the first object is overlapped with the second object from the input operation area side by the input operation received by the input unit, the layer control unit is configured such that the first layer is the second layer. An electronic device that controls the lower layer.
10. The electronic device according to claim 8,
    When the first object overlaps with the second object from the side opposite to the input operation area by the input operation received by the input unit, the layer control unit determines that the first layer is the second An electronic device that controls to be a higher layer.
11. The electronic device according to claim 10,
    When the ratio of the contact area to the area of the first object region is equal to or greater than a predetermined ratio, or when the region of the first object is a certain size or less, the layer control unit An electronic device that controls the first layer to be an upper layer of the second layer when the first object and the second object overlap with each other by an accepted input operation.
12. The electronic device according to any one of claims 8 to 11,
    The layer control unit performs control so that the order of the first layer and the second layer is unchanged when an input operation to the central portion of the region of the first object is received by the input unit. Electronics.
13. The electronic device according to any one of claims 8 to 11,
    When the layer control unit simultaneously receives a plurality of input operations to the same input operation region in the first object by the input unit, the order of the first layer and the second layer is unchanged. Electronic equipment that controls to
14. The electronic device according to claim 8,
    When the layer control unit simultaneously receives a plurality of input operations to opposing input operation areas in the first object by the input unit, the first layer becomes a lower layer of the second layer. To control the electronic equipment.
15. The electronic device according to any one of claims 8 to 14,
    The layer control unit increases the range of the input operation region side as the pressing force at the time of the input operation received by the input unit increases, and the input operation region side increases as the pressing force at the time of the input operation decreases. And electronic equipment that increases the range of the opposite side.
16. The electronic device according to any one of claims 8 to 15, further comprising:
    A first effect process is performed on the end portion of the first object on the input operation area side, and a second effect process is performed on the end section of the first object opposite to the input operation area. An electronic device equipped with an effect processing unit.
17. The electronic device according to claim 16,
    When the first object and the second object are overlapped by the input operation received by the input unit, the effect processing unit applies a rectangular frame as an end of the region of the second object. Electronic equipment that performs third effect processing.
18. The electronic device according to claim 16 or 17,
    When the first layer is a lower layer than the second layer, and the first object and the second object overlap, the effect processing unit has an end portion of the first object. An electronic device that displays the results of the first effect processing and the second effect processing on the layer higher than the second layer.
19. The electronic device according to any one of claims 16 to 18,
    The effect processing unit is an electronic device that performs the first effect processing and the second effect processing on an end portion of the image when the image of the first object has a shape other than a rectangular shape.
20. The electronic device according to claim 19,
    The effect processing unit is configured to make the first position relative to an end of the image closer to the input position than the reference point based on the positional relationship between the input position received by the input unit and the reference point of the image. An electronic apparatus that performs the first effect process and performs the second effect process on an end of the image that is opposite to the input position with respect to the reference point.
21. An electronic device that displays a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit,
    An input unit that receives an input operation to a first object that is one of the plurality of objects;
    When the overlapping process of changing the positional relationship between the first object and the second object of the plurality of objects from the non-overlapping state to the non-overlapping state after executing the overlapping state is performed, A layer control unit that determines a first layer in which the first object is disposed and a second layer in which the second object is disposed with reference to a second layer in which the second object is disposed; ,
    A display control unit for displaying the first object and the second object respectively arranged on the first layer and the second layer controlled by the layer control unit on the screen of the display unit;
    Electronic equipment comprising.
22. The electronic device according to claim 21,
    The said layer control part is an electronic device which determines a said 1st layer and a said 2nd layer, when the said duplication process is performed in multiple times.
23. The electronic device according to claim 21 or 22,
    The layer control unit is an electronic device that determines the first layer as a layer one step lower or one step higher than the second layer when the overlap processing is executed.
24. The electronic device according to any one of claims 21 to 23,
    The layer control unit, when a second duplication process that temporally follows the first duplication process is executed before a predetermined time elapses from the time when the first duplication process is executed, An electronic device for determining a layer and the second layer.
25. 25. The electronic device according to claim 21, further comprising:
    A history information storage unit that stores information on the history of contact or separation between the first object and the second object in the duplication process within the predetermined time;
    When the first object and the second object are in an overlapping state or a non-overlapping state until the predetermined time elapses or the predetermined number of times is reached, the history information storage unit stores the A history information storage control unit for updating information on the history of contact or withdrawal of the second object;
    Electronic equipment comprising.
26. The electronic device according to any one of claims 21 to 25, further comprising:
    A history information storage unit for storing information on the history of contact or separation between the first object and the second object in the duplication process within the predetermined time;
    A history information storage control unit that deletes history information of the second object stored in the history information storage unit when the predetermined time has elapsed;
    Electronic equipment comprising.
27. The electronic device according to any one of claims 21 to 26, further comprising:
    An electronic apparatus comprising an effect processing unit that executes an effect process on the second object when the overlapping process is executed.
28. The electronic device according to claim 27,
    The effect processing unit is an electronic device that terminates the effect processing when the input operation received by the input unit is completed.
29. The electronic device according to claim 27 or 28,
    The effect processing unit is an electronic device that deforms an end of the second object on the side facing the first object as the effect processing when the overlap processing is executed.
30. A display system comprising an electronic device and a server that communicates with the electronic device,
    The electronic device is
    A first receiver for receiving display data from the server;
    A display unit configured to display a plurality of objects respectively arranged on a plurality of layers on a screen based on display data received by the first receiving unit;
    An input unit that receives a moving operation of changing the position of the first object on the screen among the plurality of objects;
    A first transmission unit for transmitting movement data associated with the movement operation received by the input unit to the server;
    With
    The server
    A second receiving unit for receiving movement data from the electronic device;
    A layer information storage unit that stores layer information including an order of a plurality of layers in which the plurality of objects are respectively arranged;
    From the movement data received by the second receiving unit, the positional relationship between the first object and the second object among the plurality of objects is changed to the non-overlapping state again from the overlapping state. The first layer where the first object is arranged and the second object where the second object is arranged based on the layer information stored in the layer information storage unit. A layer controller that changes the order of the layers;
    Display data for displaying the first object and the second object respectively arranged in the first layer and the second layer changed by the layer control unit on the screen of the display unit is generated. A display control unit,
    A second transmission unit for transmitting display data generated by the display control unit to the electronic device;
    A display system comprising:
31. A display control method for displaying a plurality of objects respectively arranged on a plurality of layers on a display screen,
    Receiving a movement operation for changing a position of the first object on the display screen among the plurality of objects by the input unit;
    When the positional relationship between the first object and the second object among the plurality of objects changes from the overlapping state to the non-overlapping state and then to the overlapping state again, the layer information is stored in the layer information storage unit. Based on the layer information including the order of the plurality of layers in which the plurality of objects are respectively arranged, the first layer in which the first object is arranged and the second layer in which the second object is arranged Changing the order, and
    Displaying the first object and the second object respectively arranged on the changed first layer and second layer on the display screen;
    A display control method.
32. An electronic device display control method for displaying a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit,
    Receiving an input operation to a first object that is one of the plurality of objects;
    An overlap of an input operation area that is a part of the area of the first object that has received the input operation and an area in which the second object that is one of the plurality of objects and the first object overlap. Controlling the order of the first layer on which the first object is arranged and the second layer on which the second object is arranged, based on the positional relationship with the region;
    Displaying the first object and the second object respectively arranged on the controlled first layer and second layer on the screen of the display unit;
    A display control method.
33. A display control method in an electronic device for displaying a plurality of objects respectively arranged on a plurality of layers on a screen of a display unit,
    Receiving an input operation to a first object that is one of the plurality of objects;
    When the overlapping process of changing the positional relationship between the first object and the second object of the plurality of objects from the non-overlapping state to the non-overlapping state after executing the overlapping state is performed, Determining a first layer on which the first object is arranged and a second layer on which the second object is arranged with reference to a second layer on which the second object is arranged;
    Displaying the first object and the second object respectively arranged on the controlled first layer and the second layer on the screen of the display unit;
    A display control method.
34. A display control program for causing a computer to execute each step of the display control method according to claim 31.
35. A display control program for causing a computer to execute each step of the display control method according to claim 32.
36. A display control program for causing a computer to execute each step of the display control method according to claim 33.
    

Images