WO2012120978A1

WO2012120978A1 - Display method, display device and program

Info

Publication number: WO2012120978A1
Application number: PCT/JP2012/053415
Authority: WO
Inventors: 雄一伊藤; 和毅高嶋; 正憲大脇
Original assignee: 国立大学法人大阪大学
Priority date: 2011-03-09
Filing date: 2012-02-14
Publication date: 2012-09-13

Abstract

This display method includes a step for displaying an image upon a display surface (12a), and a step for displaying a partially bent image upon the display surface (12a). In the step for displaying the partially bent image, the partially bent image is formed, in response to input from a user, by bending at least one portion of an area of an image displayed before the input and moving an area that is contiguous to the at least one portion of the area with the bending of the at least one portion of the area. Preferably, the step of displaying the partially bent image includes a step of forming the partially bent image by the user performing pinching or spreading as input.

Description

Display method, display device, and program

The present invention relates to a display method, a display device, and a program.

In display elements such as personal computers, digital cameras, mobile phones, smartphones, tablet PCs, car navigation systems, and PDAs (Personal Data Assistants), images displayed on the display screen are operated using a mouse, stylus, or touch panel. The In such a display element, when the display target image is larger than the display screen, or when the image is displayed at a high magnification, the entire target image cannot be displayed in the display screen. For example, generally, the image of the entire map is larger than the display screen, and a part of the map is displayed on the display screen.

In such a case, the user causes the display device to display a desired image by operating the display screen. Specifically, when the user wants to display an image of a region that is not currently displayed on the display screen, the user moves the image displayed on the display screen in the up / down, left / right, or diagonal directions. Such an operation is also called a pan operation or a scroll operation. In addition, when the user wants to display the details of the currently displayed image or an image around the image on the display screen, the user enlarges or reduces the image displayed on the display screen. Such an operation is also called a zoom operation. For example, Patent Document 1 discloses a display device in which an input unit that performs a pan operation and a zoom operation is provided in the vicinity of a display screen.

JP-T-2005-502142

Such panning and zooming operations are widely used at present. However, such a general pan operation and zoom operation may not be able to efficiently change the image displayed on the display screen.

For example, when there are two objects arranged relatively apart from each other, the two objects cannot be displayed at the same time. Therefore, it is necessary to separately display the two objects on the display screen by the pan operation. In this case, the two objects may not be accurately compared, and it may take time to grasp the path connecting the two objects. Also, when performing a zoom operation, two objects can be displayed on the display screen at the same time by reducing the magnification, but the two objects and all the information in the display screen are displayed small due to the change in magnification. For example, it may not be possible to accurately compare two objects.

The present invention has been made in view of the above problems, and an object thereof is to provide a display method, a display device, and a program that enable an efficient change of an image displayed on a display screen.

The display method according to the present invention is a display method including a step of displaying an image on a display screen and a step of displaying a partial deflection image on the display screen. In the step of displaying the partial deflection image, In response to an input from the user, the partial deflection image bends at least a part of the image displayed before the input, and the at least a part of the at least a part of the image is bent. It is formed by moving a continuous area to the area.

In one embodiment, the step of displaying the partial deflection image includes performing the partial deflection by performing a pinch-in that is an operation of the user narrowing two fingers or a pinch-out of an operation of spreading two fingers as the input. Forming an image.

In one embodiment, in the step of displaying the partial deflection image, the user narrows a space between two fingers as the input and performs a pinch-in, thereby bending a region between the two fingers of the user. Process.

In one embodiment, the step of displaying the partial deflection image is performed by enlarging an area between the two fingers of the user by performing a pinch out by the user expanding the gap between the two fingers as the input. The process of carrying out is included.

In one embodiment, in the step of displaying the partial deflection image, the partial deflection image includes an area that was not displayed before the input.

In one embodiment, the display method further includes a step of displaying again the image displayed before the input on the display screen after the input.

In one embodiment, the step of displaying the image displayed before the input again includes a step of flicking. A flick is an operation to play in one direction.

In one embodiment, after the input, the display method eliminates bending of the at least a part of the area, and displays an image including an area that was not displayed before the input on the display screen. Is further included.

In one embodiment, the display method includes a wide area including both the entire image displayed before the input and the area not displayed before the input on the display screen after the input. The method further includes displaying an image.

In one embodiment, the step of displaying the wide area image includes a step of tapping or clicking the at least a part of the region.

In one embodiment, in the step of displaying the partial deflection image, the partial deflection image is displayed on the display screen until further input from a user is received.

In one embodiment, the step of displaying the partial deflection image includes a step of converting coordinates of at least a partial region of the image displayed before the input.

A display device according to the present invention is a display device including a display unit having a display screen on which an image is displayed, an input unit, and a control unit, and according to an input from a user via the input unit, The control unit bends at least a part of the image displayed before the input and moves a region continuous to the at least a part of the region as the at least part of the image is bent. The partially bent image formed by the display is displayed on the display screen.

The program according to the present invention is a program for executing a step of displaying an image on a display screen and a step of displaying a partial deflection image on the display screen, wherein the partial deflection image is displayed in the step of displaying the partial deflection image. In response to an input from the user, bends at least a part of the image displayed before the input, and causes the at least a part of the image to be deflected to the at least a part of the area. It is formed by moving successive areas.

According to the present invention, the image displayed on the display screen can be changed efficiently.

(A)-(c) is a schematic diagram for demonstrating embodiment of the display method by this invention. It is a schematic diagram for demonstrating the bending in this embodiment. It is a schematic diagram of the image displayed after a partial deflection image. It is a schematic diagram of the image displayed after a partial deflection image. It is a schematic diagram of the image displayed after a partial deflection image. It is a figure which shows the partial bending image in the display method of this embodiment. (A) And (b) is a figure for demonstrating the formation method of the partial bending image in this embodiment. It is a figure which shows the image displayed after a partial bending image. It is a figure which shows the image displayed after a partial bending image. It is a figure which shows the image displayed after a partial bending image. (A) And (b) is a figure for demonstrating the bending area | region in this embodiment. (A) is a figure which shows the partial bending image in this embodiment, (b) is a figure which shows the image displayed after the image of (a). It is a schematic diagram of the display apparatus of this embodiment. It is a schematic diagram for demonstrating the measuring method performed in order to compare the display method of this embodiment and a comparative example. It is a schematic diagram for demonstrating the measuring method performed in order to compare the display method of this embodiment and a comparative example. It is a figure for demonstrating the measuring method performed in order to compare the display method of this embodiment and a comparative example. It is a figure for demonstrating the measuring method performed in order to compare the display method of this embodiment and a comparative example. It is a graph which shows the result of the measurement performed by the display method of this embodiment and a comparative example. It is a graph which shows the result of the measurement performed by the display method of this embodiment and a comparative example. It is a graph which shows the result of the measurement performed by the display method of this embodiment and a comparative example. (A) is a schematic diagram showing one bending region, (b) is a schematic diagram showing a plurality of bending regions, and (c) is a combined schematic diagram of the plurality of bending regions. (A) And (b) is a figure for demonstrating the method of forming multiple bending area | regions in this embodiment. (A) is a schematic diagram which shows the bending area | region formed with the low drag or flick speed, (b) is a schematic diagram which shows the bending area | region formed with the high drag or flick speed. (A) And (b) is a schematic diagram for demonstrating the bending in this embodiment. It is a schematic diagram for demonstrating the bending in this embodiment. (A) is a schematic diagram showing an image before pinch-in, (b) is a schematic diagram showing a partially bent image formed by pinch-in, and (c) and (d) show images displayed after pinch-in. It is a schematic diagram. (A) is a schematic diagram showing an image before pinch out, (b) is a schematic diagram showing a partially bent image formed by pinch out, and (c) and (d) are displayed after pinch out. It is a schematic diagram which shows an image. (A) And (b) is a figure which shows the bending area | region in this embodiment. (A)-(d) is a schematic diagram which shows the change of the display screen in this embodiment.

Hereinafter, embodiments of a display method, a display device, and a program according to the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments.

Hereinafter, an embodiment of a display method according to the present invention will be described with reference to FIGS. 1 and 2. FIG. 1A shows a display screen 12 a of the display unit 12. An arbitrary image is displayed on the display screen 12a. Here, the image displayed on the display screen 12a is a part of a continuous image. For example, a part of the map is displayed on the display screen 12a. When a general pan operation is performed on the display screen 12a, an image continuous with the image currently displayed on the display screen 12a is displayed. For example, a part of the continuous image is displayed at a substantially uniform magnification on the entire display screen 12a. Here, the display screen 12a occupies the entire displayable area of the display unit 12, but the display screen 12a may be a part of the displayable area of the display unit 12.

As shown in FIG. 1B, input from the user is performed on the display screen 12a. For example, the user performs input by dragging or flicking the display screen 12a using a touch panel, a mouse, or a stylus. The arrow shown in FIG. 1B represents the position and direction of the input made by the user, and here, the input is made in the horizontal direction. Here, a region on the opposite side of the input direction with respect to the input start point is referred to as region A, and a region on the input direction side with respect to the input start point is referred to as region B. In the display method according to the present embodiment, in accordance with an input from the user, at least a part of the image displayed before the input (region B in FIG. 1B) bends and bends. A region (region A in FIG. 1 (b)) that moves continuously is moved.

As shown in FIG. 1 (c), an image including a region B ′ that is partially bent is displayed on the display screen 12a. This image is formed by the region B being bent and the region A being moved in accordance with the bending of the region B in response to an input from the user. In FIG.1 (c), the area | region A displayed on the display screen 12a after the input from a user is not displayed on the display screen 12a before the area | region A1 currently displayed on the display screen 12a before input. Region A2. Here, in response to the input, the region B bends and the region A continuing to the region B moves, and accordingly, the region A2 that has not been displayed before the input is displayed on the display screen 12a.

For example, when the input is dragging or flicking, the extent of movement of region A and the extent of bending of region B may vary depending on the drag length, drag or flick strength (pressure), and / or speed. Good. In the following description of the present specification, a region B ′ bent in response to an input from a user may be referred to as a bent region B ′, and an image having a partially bent region B ′ is referred to as a partially bent image. Sometimes called. FIG. 1C shows a partial deflection image. Note that the display content of the bending area B ′ corresponds to the display content of the area B before bending, but the display content of the bending area B ′ does not exactly match the display content of the area B before bending. Also good. For example, the display content of the bending area B ′ may be partially added or deleted as compared with the display content of the area B before being bent.

In such an image display method, the area A included in the image displayed on the display screen 12a before the input is deflected on the display screen 12a in accordance with the input from the user, and the area A continuous with the area B is displayed. The partial deflection image that is moved is displayed. Therefore, new image information can be displayed without substantially losing the image information before input, and the change of the image displayed on the display screen can be determined efficiently. In general zoom-in, the magnification changes uniformly in the display screen, whereas in this embodiment, new image information is displayed in a display area that is vacant by bending at least a part of the area before input. (At least information of high user interest at the time of input) is displayed, and the image displayed before the input is displayed even if it is in a partially bent state. , The image displayed on the display screen can be changed efficiently. In addition, here, not only the area that was not displayed before the input is displayed according to the input from the user, but also the image that was displayed before the input is in a partially bent state. For example, the user visually recognizes the new area, compares the newly displayed area with the originally displayed area, and determines the direction and degree of image change. be able to.

In the above description, the area B is a part of the display screen 12a, and the moved area A includes the area A1 displayed before the input, but the present invention is not limited to this. The entire display screen 12a becomes a bent area B, and the area A after input may not include the area A1 displayed before the input.

Here, the bending in the present embodiment will be described with reference to FIG. In this embodiment, a partially bent image is formed by bending at least a part of an image before input in accordance with an input from a user. For example, at least a part of an image before input is deflected, so that at least a part of the image that was not distorted before input is distorted and displayed. Such bending is the same as the phenomenon that occurs in paper and cloth in the real world (real space), and the bent one has a smaller area (display) than the one that does not bend without any change (display contents). It is possible to intuitively recognize that it exists in the area) and that the deflection can be eliminated by performing a predetermined operation.

For example, an image is assigned to grid points located in a matrix shape defined by a plurality of rows and a plurality of columns before bending, and the grid points are moved by an input from the user. Thus, at least a part of the area of the image before input may be bent and displayed. The movement of the grid points may be controlled by an algorithm in consideration of visibility. Alternatively, the movement of the grid points may be controlled by a physics engine that reproducibly describes real world motion using physical equations. Further, the undulation and shape of the bending method may be arbitrary.

In the present embodiment, in response to an input from the user, the display screen 12a is caused to bend the region B included in the image displayed on the display screen 12a before the input and move the region A continuous to the region B. A partial deflection image is displayed. The display screen 12a may display the following image according to the user's reaction after displaying the partial deflection image. For example, the display screen 12a displays (1) the image that was displayed before the input after displaying the partial deflection image, (2) the image after the input in the state where the deflection has been eliminated, and (3) the input You may display either the image including both the whole image displayed previously and the area newly displayed by the input. Alternatively, the display screen 12a may continue to display the partial deflection image as it is, for example, until there is further input from the user (4).

For example, when the user does not want to display an image including the newly displayed region A2 in the partially bent image illustrated in FIG. 1C, the image before input is displayed on the display screen 12a after the input. .

FIG. 3 shows a schematic diagram of an image displayed after displaying a partial deflection image. For example, when the user who has seen the partial deflection image performs further input in a direction opposite to the input direction, the image displayed before the input from the user is displayed on the display screen 12a.

In addition, when the user desires to display the image including the area A2 newly displayed in the partial deflection image shown in FIG. 1C without any deflection, the image is newly displayed on the display screen 12a after the input. An image including the area A2 is displayed.

FIG. 4 shows a schematic diagram of an image displayed after displaying the partial deflection image. For example, when the user finishes inputting (for example, dragging) as it is, an image moved by the input direction and distance with respect to the image before input is displayed on the display screen 12a. At this time, the area Bb of the area B displayed before the input is still displayed on the display screen 12a after the input, but the area Ba of the area B displayed before the input is displayed after the input. It is no longer displayed on the display screen 12a. This display may be the same as a general scrolled display except that it is via a partial deflection image.

Alternatively, the user includes both the entire image (including the area A1 and the area B) displayed before the input in the partial deflection image illustrated in FIG. 1C and the area A2 newly displayed by the input. When an image is desired to be displayed, after the input, an image in which the deflection in the partial deflection image is eliminated is displayed on the display screen 12a.

FIG. 5 shows a schematic diagram of an image displayed after displaying the partial deflection image. For example, when the user who has seen the partial deflection image taps or clicks the deflection area, an image including both the entire image before input and the newly displayed area is displayed on the display screen 12a. In this specification, such an image may be referred to as a wide area image. The wide area image is the same as the image after the so-called zoom-out operation. When displaying a wide area image, the size of the display screen 12a of the display unit 12 may be equal to the size before the wide area image is displayed. Alternatively, the size of the display screen 12a of the display unit 12 may be larger than the size before displaying the wide area image. Alternatively, the partial deflection image may be continuously displayed on the display screen 12a until the user performs further input.

The display method of this embodiment is preferably used for displaying a map. Hereinafter, display of a map to which the display method of the present embodiment is applied will be described with reference to FIGS. Here, a map of Japan with a grid extending in the vertical and horizontal directions is used as the map.

FIG. 6 shows a partial deflection image. Here, a finger is dragged to the touch panel as an input, and the input direction is diagonally lower left. In FIG. 6, the grid extends in the vertical direction and the horizontal direction in the region A, while the grid extends in the oblique direction in the bending region B ′.

The bending region B ′ is determined according to the user input. For example, when the user performs a drag or flick, the deflection is determined according to the direction, length, strength (pressure) and / or speed of the drag or flick. Further, the relationship between the input and the deflection may be arbitrarily settable.

Here, an example of a method for determining the region A and the region B will be described with reference to FIG. As shown in FIG. 7A, the region A and the region B are determined from the input start point and direction. Region A has a sector shape. There is an input start point on a part of the circle (arc Ka) that defines the fan shape, and the center O of the circle is located on a straight line extending antiparallel to the input direction from the input start point. Yes. The radius of the circle is set so that the display is appropriately performed even when the moving distance of the region A is the maximum value. For example, the radius of the circle is about 1.5 times the short side of the display screen 12a.

Area B is an area obtained by removing area A from the sector shape. The circle defining the sector shape of the area B has the same center O as the area A, and the radius of the circle extends from the center O to the intersection P of the display screen 12a with a straight line extending in the input direction from the input start point. Indicates distance. The intersection point P is on the arc Kb.

As shown in FIG. 7B, in response to the input, the region B bends into the bending region B ′, and the region A continuing to the region B moves along with this bending. Here, the area A continuous with the area B is moved along with the bending, and thereby the area that was not displayed before the input is displayed. The region B is distorted so as to maintain continuity with the surroundings including the region A. For example, the region B is distorted so as to maintain linearity. Thus, in response to the input, the region B bends and the region A moves.

For example, the extent to which the region B bends and the moving distance of the region A are determined according to the length of the drag. For example, the arc Ka and the arc Kb are determined by the user's drag, and the area between the arc Ka and the arc Kb is flexibly displayed according to the drag length. The longer the drag distance, the narrower the bending area B ′, and the area A moves with the bending of the area B.

In the display method of the present embodiment, an area that was not displayed before the input can be displayed according to the input from the user, and the user wants to display the new area after visually recognizing the new area. Direction and area can be determined. In the present embodiment, since the image displayed before the input is in a partially bent state but is still displayed, a comparison between the newly displayed region and the originally displayed region is performed. It is possible to easily change the image displayed on the display screen.

For example, input from the user is defined by the input start point, direction, and distance. For example, the area A to be moved and the area B to be a bending area are determined according to an input from the user, and the bending and the movement are realized by coordinate conversion. After the start of input, it is determined whether or not each coordinate in the image before input corresponds to region A and region B. The coordinates determined to be within the region B are converted so that the distance from the arc Ka and the distance from the arc Kb are shortened while maintaining the ratio before the input. In addition, the coordinates determined to be within the area A are converted so as to be translated by the input length. By such coordinate conversion, it is possible to form a partially bent image including a bent region B ′ and a region A that moves in accordance with the bending to the bent region B ′.

For example, the display screen 12a displays the partial deflection image shown in FIG. 6 and then (1) the image displayed before the input and (2) the input after the deflection is canceled according to the user's reaction. And (3) a wide area image including both the entire image displayed before the input and the area newly displayed by the input may be displayed. Alternatively, the display screen 12a may continue to display the partial deflection image as it is, for example, until there is further input from the user (4).

FIG. 8 shows an image displayed after the partial deflection image. For example, by flicking in the direction opposite to the direction previously input by the user who viewed the partial deflection image, the image displayed before the input is displayed on the display screen 12a.

FIG. 9 shows an image displayed after the partial deflection image. When the user who has seen the partially bent image does not perform further input (for example, the drag is ended as it is), an image moved by the input direction and distance with respect to the image before input is displayed on the display screen 12a. .

FIG. 10 shows a schematic diagram of an image displayed after displaying the partial deflection image. When the user who has seen the partial deflection image taps the deflection area, a wide area image including both the entire image before input and the newly displayed area is displayed on the display screen 12a.

Here, referring again to FIG. As described above, the coordinates of the region B are converted so that the ratio of the distances from the arc Ka and the arc Kb is kept constant. For this reason, all of the rectangles surrounded by the grids that intersect with each other in the bending region B ′ have substantially the same size and shape. Here, the degree and magnification of each part in the bending region B ′ are substantially constant. However, the magnification may be changed stepwise in the bending region B ′. Further, the degree of bending may be non-uniform in each portion of the bending region B ′. In this case, there may be a region with a higher magnification than the other regions in a part of the bending region B ′, and a display similar to so-called zoom-in is performed in the region with a higher magnification.

In the above description, the region B to be the bending region B ′ is determined according to the input from the user, but the present invention is not limited to this. If a portion of high interest of the user is included in the bending region B ′, the portion may be difficult to see. For this reason, a part with a high user's interest may be determined using some aspect or algorithm, and the region B may be determined not to include the part.

In the above description, the arc Kb is determined according to the starting point and direction of the drag or flick, but the present invention is not limited to this. The arc Kb may be determined according to the length of the drag, the strength (pressure) and / or speed of the drag or flick. Alternatively, the region B may be determined in another manner. Further, in the above description, the intersection point P used when determining the region B is located on the outer periphery of the display screen 12a, but the present invention is not limited to this. The intersection point P may be set arbitrarily. However, the calculation at the time of coordinate conversion can be simplified by setting the intersection point P on the outer periphery of the display screen 12a. In the above description with reference to FIG. 7, the width of the flexure region B ′ changes depending on the length of the user's drag or flick. For example, it can be understood from FIGS. 11 (a) and 11 (b). As described above, the bending region B ′ may be moved while maintaining a substantially constant width in accordance with a user's drag or flick. The coordinate conversion described above is an example of forming a partially bent image, and the partially bent image may be formed by another method.

The display method of the present embodiment is preferably used for comparing two objects. FIG. 12A shows a schematic diagram of a partial deflection image. Here, the two comparison objects Oa and Ob are surrounded by a circle. Although the object Oa is displayed on the display screen 12a (not shown) before the input but the object Ob is not displayed, the object Ob moves into the display screen 12a due to bending according to the input. . Note that the magnification of the bending area is different from that before the input, but the magnifications of the two objects Oa and Ob and the vicinity thereof are substantially equal to the magnification before the input. In this way, the object Ob that has not been displayed can be displayed on the display screen 12a by forming the flexure region, and a plurality of objects Oa and Ob that were originally unable to be displayed simultaneously at the magnification before the input are compared. And an outline of the path between the objects Oa and Ob can be easily grasped.

Thereafter, when the two objects Oa and Ob are to be displayed at the same time, the deflection is eliminated by the user tapping or clicking on the deflection area. As a result, as shown in FIG. 12B, an image including the objects Oa and Ob can be displayed at a uniform magnification on the display screen 12a.

The display method of this embodiment is preferably performed by a display device. Hereinafter, an embodiment of the display device 10 according to the present invention will be described with reference to FIG.

FIG. 13 shows a schematic diagram of the display device 10 of the present embodiment. The display device 10 includes a display unit 12 having a display screen 12a, an input unit 14, and a control unit 16. The display device 10 is also called an image display device. The display unit 12 is a liquid crystal panel, for example. Or the display part 12 may display by arbitrary systems, such as a cathode ray tube, a plasma panel, an organic electroluminescent panel, for example.

The user inputs the image on the display screen 12a via the input unit 14. The input unit 14 is, for example, a touch panel. The input unit 14 may be a mouse or a stylus, or may be any other pointing device.

In the display device 10 of the present embodiment, the control unit 16 displays a partial deflection image on the display screen 12a in response to an input from the user via the input unit 14. The partially deflected image is formed by deflecting at least a part of the area of the image displayed before the input and moving an area continuous with the deflected area. For this reason, the user can efficiently change the image displayed on the display screen. For example, the control unit 16 performs coordinate conversion of an image displayed on the display screen 12a in accordance with the input.

After displaying the partial deflection image on the display screen 12a, the control unit 16 (1) the image displayed before the input, (2) after the input of the state in which the deflection is eliminated, according to the reaction of the user And (3) an image including both the entire image displayed before the input and an area newly displayed by the input may be displayed. Alternatively, the control unit 16 may continue to display the partial deflection image as it is (4) until there is further input from the user, for example, on the display screen 12a.

For example, when the user performs flicking via the input unit 14 after displaying the partial deflection image, the control unit 16 may cause the display screen 12a to display the image that was displayed before the input. Alternatively, after the partial deflection image is displayed, when the user does not input for a predetermined period, the control unit 16 eliminates the deflection of the deflection region, and the display screen 12a includes a region that was not displayed before the input. An image may be displayed. Alternatively, when the user taps or clicks through the input unit 14 after displaying the partial deflection image, the control unit 16 displays the entire image displayed before the input on the display screen 12a and the input before the input. A wide area image including both the area that has not been displayed may be displayed.

The display device 10 may further include a recording unit 18 in which a program read by the control unit 16 is recorded as necessary. The control unit 16 causes the display method of the present embodiment to be executed according to this program. The recording unit 18 may be a medium on which a program is recorded. The recording unit 18 may be built in the display device 10, and the recording unit 18 may be removable from the display device 10. Alternatively, the control unit 16 may include an integrated circuit (for example, a semiconductor chip) that executes the display method described above in response to an input via the input unit 14. Such a display device 10 is suitably used as a display element of an arbitrary information display device such as a personal computer, a digital camera, a mobile phone, a PDA (Personal Data Assistant), a tablet PC, a car navigation system, and a smartphone.

Here, with reference to FIG. 14 to FIG. 20, advantages of the display method of this embodiment compared to the display method of the comparative example will be described. The display method of the comparative example is performed by a so-called pan operation (pan). Here, the zoom operation is not used. In the display method of the present embodiment, after forming a partially bent image, it is possible to return to the original image by flicking. Here, the resolution of the display screen is 1024 × 768 pixels, and input is performed with a stylus. Prior to the measurement, when a simple test was performed to move an object outside the display screen into the display screen, the task completion times of the display method of the comparative example and the display method of the present embodiment were almost equal. .

Hereinafter, a predetermined task will be described using the display method of the comparative example and the display method of the present embodiment.

FIG. 14 shows a schematic diagram of the display screen 12a of the display unit 12 and an image. One object (icon) is displayed in the display screen 12a. In the following description, this object may be referred to as a start object. Also, another object (icon) exists outside the current display screen 12a. In the following description, this object may be referred to as a goal object.

[This task is completed by comparing the size of two objects, displaying a large object in a predetermined area on the display screen, and tapping. Although the goal object is not displayed on the task start display screen, the direction of the goal object is indicated by an arrow.

Figure 15 shows a schematic diagram at the start of the task. Here, the goal object is located in the upper direction of the display screen. An area for storing an object to be tapped when the task is completed is indicated by a circle. At the start of the task, the start object is located at the center of the display screen. The distance from the start object to the goal object is 600, 800 or 1000 pixels. In the display method of the comparative example, it is necessary to perform dragging at least once when the distance is 600 or 800 pixels, and it is necessary to perform dragging at least twice when the distance is 1000 pixels.

Here, as shown in FIG. 16, the goal object is arranged in any of the eight directions above, diagonally upper right, right, diagonally lower right, lower, diagonally lower left, left, diagonally upper left with respect to the start object. Yes. Here, the image is a map of about 1/3700 scale with a size of 3000 × 3000 pixels.

Figure 17 shows a diagram at the start of the task. Here, the shape of the start object is a circle, and the goal object is located above the start object. Note that the shape of the object is any one of a circle, a triangle, and a rhombus at random, and the size of the object is any one of 20, 25, 30, 35, or 40 pixels at random. Each of the 12 subjects performed the task 32 times per person.

FIG. 18 shows the task completion time with respect to the target distance. When the target distance representing the distance between the start object and the goal object is 600 pixels, the difference between the task completion time of this embodiment and the task completion time of the comparative example is relatively small, but the target distance is as large as 800 and 1000 pixels. Then, the difference between the task completion time of the present embodiment and the task completion time of the comparative example becomes relatively large. According to this embodiment, especially when the target distance is relatively long, the task completion time can be shortened as compared with the comparative example.

FIG. 19 shows the task completion time for the correct object. When the finally tapped object (correct object) is a goal object, the difference between the task completion time of this embodiment and the task completion time of the comparative example is relatively small, but when the correct object is a start object, this implementation The difference between the task completion time of the configuration and the task completion time of the comparative example is relatively large. Thus, according to the present embodiment, when selecting an object displayed in an image before input after comparing with an object not displayed in the image before input, the task completion time is compared with the comparative example. Can be shortened. This is considered to be because in the present embodiment, it was possible to immediately return to the original image by the flick after the comparison in the partially bent image.

FIG. 20 shows the drag distance relative to the target distance. Regardless of whether the correct object is a start or a goal, the drag distance of this embodiment is shorter than that of the comparative example. In particular, when the correct object is started, the drag distance of the present embodiment is considerably shorter than the drag distance of the comparative example. This is considered to be because in the present embodiment, it was possible to immediately return to the original image by the flick after the comparison in the partially bent image.

Thus, in the display method of the present embodiment, the image displayed on the display screen can be changed efficiently compared to the display method of the comparative example. In the display method of the comparative example, it is necessary to reciprocally compare the start object and the goal object that cannot be displayed on the display screen, whereas in the display method of the present embodiment, the start object and the goal object are displayed in the partial deflection image. Since both can be compared on the display screen at the same time, an image to be displayed can be selected at high speed and with few operations.

In the above description, the partially bent image has one bent region, but the present invention is not limited to this. The partial deflection image may have a plurality of deflection regions.

After forming one bending region B ′ as shown in FIG. 21 (a), another bending region B ′ may be formed as shown in FIG. 21 (b). In FIG. 21B, the plurality of bending regions B 'are located in the vicinity of each other, but this is merely an example, and the plurality of bending regions B' may be located in regions separated from each other. For example, when a human hand and a leg are broken due to an accident or the like, a plurality of affected parts can be obtained by effectively using the display screen 12a by forming a partial deflection image with the human body part as a deflection region from the whole body X-ray image. At the same time and / or the affected area can be enlarged and displayed.

In addition, when a plurality of flexures of cloth or paper are formed in an adjacent region, they may be combined into one. Also in the present embodiment, when a plurality of bends are formed in the vicinity region, as shown in FIG. 21C, the bends may be combined into one.

In addition, after the formation of the bending region B ', the bending region B' may be eliminated as time passes. In this case, a plurality of bending regions B 'can be easily formed by setting a relatively long time until the bending region B' is eliminated. As an example, as shown in FIG. 22 (a), immediately after forming the bending region B ′, as shown in FIG. 22 (b), dragging in the same direction as the previously formed bending region B ′. Thus, a plurality of bending regions B ′ can be formed. By forming such a bending region B 'a plurality of times, a region relatively distant from the display screen before input can be displayed on the display screen 12a. In addition, when forming a plurality of bending regions B ′ in this way, the bending region B ′ formed earlier is moved in accordance with dragging or flicking of the bending region B ′ formed later if necessary. Also good.

Also, the degree of deflection may be changed according to the speed of dragging or flicking. For example, when the drag or flick speed is low, the degree of deflection is reduced as shown in FIG. 23A, and when the drag or flick speed is high, the degree of deflection is as shown in FIG. May be larger. Note that here, the speed of the drag or flick is focused, but the length of the drag or the strength (pressure) of the drag or flick may be focused. For example, when the drag is short or when the drag or flick is weak, the degree of bending may be reduced, and when the drag is long or when the drag or flick is strong, the degree of deflection may be increased.

As shown in FIG. 24A, the deflection region B 'may be displayed flat. Alternatively, as shown in FIG. 24B, the bending region B ′ may be displayed so as to be undulated. The degree of undulation may vary depending on the drag distance or the flick distance. For example, the magnification at the center of the bending region B ′ and in the vicinity thereof may be higher than the magnification of the region A. As described above, since at least a part of the bending region B ′ exhibits a higher magnification than the region A, the image can be locally enlarged. Alternatively, as shown in FIG. 25, the bending area B ′ may be displayed so as to be recessed with respect to the area A. By denting in this way, it is possible to reduce the area for displaying a less important image. If necessary, the characteristics of the bend (the degree of bendability and the time for which the bend is eliminated) may be appropriately set by the user as a parameter of the cloth metaphor.

In recent years, a touch panel has been suitably used as the input unit 14 of the display device 10. In the touch panel, the zoom-out of the image may be performed by narrowing (pinch-in) the interval between the two fingers of the user on the touch panel, and the zoom-in of the image is performed between the two fingers of the user on the touch panel. May be performed by widening (pinch out).

In this embodiment, pinch-in may be performed as an input. Hereinafter, a display method when pinch-in is performed will be described with reference to FIG.

FIG. 26A shows a display screen 12a and an image before pinching in. Here, a straight line extending in the horizontal direction and the vertical direction is displayed on the display screen 12a. The object Oa is displayed on the display screen 12a, but the object Ob is not displayed on the display screen 12a.

ピン Pinch-in is performed by the user narrowing the interval between two fingers. FIG. 26B shows a partial deflection image formed by pinch-in. As a result of the pinch-in, the region sandwiched between the two fingers becomes the bending region B ′, and the region A2 that has not been displayed before the input due to this bending is displayed. For this reason, the object Ob that was not displayed before the pinch-in is displayed on the display screen 12a.

Note that, in the partial deflection image shown in FIG. 26B, the straight line before the input is bent and displayed so as to be directed to the deflection region B ′. In addition, although the display content of bending area | region B 'respond | corresponds with the display content before bending, the display content of bending area B' does not need to correspond exactly with the display content before bending. A part of the display content of the bending area B ′ may be deleted compared to the display content before the bending.

FIG. 26C shows an image displayed after the partial deflection image. When the user desires to display an image including the newly displayed area A2 in the partially bent image shown in FIG. 26B, for example, when the user ends the pinch-in and releases his / her finger from the touch panel, the display screen 12a In addition, the image including the newly displayed region A2 is displayed in a state without deflection. This image is almost the same as the image obtained by performing the zoom-out operation on the image before input.

FIG. 26 (d) shows an image displayed after the partial deflection image. When the user does not want to display an image including the newly displayed area A2 in the partially bent image shown in FIG. 26B, for example, the user flicks two fingers to widen the interval between them. As a result, the image displayed before the input is displayed on the display screen 12a.

In this embodiment, pinch out may be performed as an input. In addition, the area that moves with bending may be displayed at a different magnification from that before the input.

Hereinafter, a display method when a pinch out is performed will be described with reference to FIG. FIG. 27A shows a display screen 12a and an image before pinching out. Again, lines extending in the horizontal and vertical directions are displayed on the display screen 12a. Objects Oa and Ob are displayed on the display screen 12a.

ピン Pinch out is performed by the user widening the interval between two fingers. FIG. 27B shows a partial deflection image formed by pinching out. Here, by increasing the interval between the two fingers of the user, a bending region B ′ is formed between each of the two fingers and the outer peripheral portion of the display screen 12a. In the bending area B ′, the image before input is displayed in a bent state. In this case as well, the area A moves with the formation of the bending area B ′, but the area A between the two fingers is enlarged, and the area A is displayed at a higher magnification than the image before input. . In the partial deflection image shown in FIG. 27B, the straight line before input is displayed so as to be bent toward the deflection region B ′.

In addition, although the display content of bending area | region B 'respond | corresponds with the display content before bending, the display content of bending area B' does not need to correspond exactly with the display content before bending. For example, the display content of the bending area B ′ may be partially deleted as compared with the display content before bending. Further, the display content of the area A corresponds to the display content before the movement, but the display content of the area A may not exactly match the display content before the movement. For example, a part of the display content of the area A may be added as compared to the display content before moving, and the added information may be detailed information of objects in the area A, for example.

FIG. 27C shows an image displayed after the partial deflection image. When the user desires an enlarged display of the region A in the partial deflection image shown in FIG. 27B, an image including an enlarged region between two fingers is displayed on the display screen 12a after the input. Let At this time, the bending of the bending region may be eliminated. For example, when the user finishes pinching out and releases his / her finger from the touch panel, the image centered on the area A at the same magnification as the area A displayed by enlarging the space between the two fingers on the display screen 12a. Is displayed. This image is almost equal to an image obtained by performing a zoom-in operation on the image before input.

FIG. 27D shows an image displayed after the partial deflection image. When the user does not want to enlarge the display of the area A in the partial deflection image shown in FIG. 27A, for example, the user can input to the display screen 12a by flicking in the direction of shortening the interval between two fingers. Display the previous image.

In addition, when performing pinch in or pinch out, two fingers may be released one by one. For example, when pinching in with two fingers, the area A2 that was not displayed before the input is displayed on the display screen 12a by moving from two directions. In this case, by releasing one finger from the display screen 12a, the area A2 corresponding to the released finger moves out of the display screen 12a, and the area A2 corresponding to another finger is displayed on the display screen 12a. Remains.

Also, pinch-in or pinch-out may be performed using fingers of different hands. For example, as shown in FIG. 28 (a), after the user's two fingers drag or flick in different directions to form the respective bent regions B ', the bent region B' formed by one finger. The other finger is moved away from the display screen 12a while leaving the mark, and then, as shown in FIG. 28 (b), another bending region B ′ is formed by dragging with this finger in a further different direction. Good. Alternatively, when a large-screen display device is used, the bending regions B 'may be formed at a plurality of locations on the display screen 12a by a plurality of human inputs.

For example, an icon can be activated by pinching out. Here, with reference to FIG. 29, activation of an icon by pinch-out will be described.

First, as shown in FIG. 29A, the display screen 12a displays icons arranged in a matrix. Here, a plurality of icons are schematically shown in a circle.

Next, as shown in FIG. 29B, the user sandwiches a predetermined icon with two fingers, and widens the interval between the two fingers so as to enlarge the icon. In this case, as shown in FIG. 29C, this icon is enlarged while being bent. Here, the icon is bent into a vertically long shape.

Then, when the distance between fingers is further expanded and the icon is zoomed in so that the icon exceeds a predetermined size, the application specified by the icon is started as shown in FIG. Here, a map application is activated, and a map of Japan is displayed as an example. As described above, the application may be activated by pinching out a specific area.

According to the present invention, the image displayed on the display screen can be changed efficiently. The present invention is suitably applied to a personal computer, a digital camera, a mobile phone, a smartphone, a tablet PC, a car navigation system, a PDA (Personal Data Assistant), and the like.

DESCRIPTION OF SYMBOLS 10 Display apparatus 12 Display part 12a Display screen 14 Input part 16 Control part 18 Recording part

Claims

Displaying the image on the display screen;
Including a step of displaying a partial deflection image on the display screen,
In the step of displaying the partial deflection image, the partial deflection image causes the at least part of the image displayed before the input to bend and the at least part according to an input from a user. The display method is formed by moving a region continuous with the at least a portion of the region as the region is bent.
The display method according to claim 1, wherein the step of displaying the partial deflection image includes a step of forming the partial deflection image by the user performing pinch-in or pinch-out as the input.
The step of displaying the partial deflection image includes the step of bending the region between the two fingers of the user by performing the pinch-in by narrowing the gap between two fingers as the input. The display method according to claim 2.
The step of displaying the partial deflection image includes a step of enlarging a region between the two fingers of the user by performing the pinch out by spreading the gap between two fingers as the input. The display method according to claim 2.
4. The display method according to claim 1, wherein in the step of displaying the partial deflection image, the partial deflection image includes an area that has not been displayed before the input.
The display method according to any one of claims 1 to 5, further comprising a step of displaying again the image displayed before the input on the display screen after the input.
The display method according to claim 6, wherein the step of displaying the image displayed before the input again includes a step of flicking.
The method further includes the step of eliminating the bending of the at least a part of the area after the input and causing the display screen to display an image including an area that was not displayed before the input. The display method in any one of.
After the input, the display screen further includes a step of displaying a wide area image including both the entire image displayed before the input and an area not displayed before the input. The display method according to claim 1.
The display method according to claim 9, wherein the step of displaying the wide area image includes a step of tapping or clicking the at least part of the region.
The display method according to any one of claims 1 to 4, wherein in the step of displaying the partial deflection image, the partial deflection image is displayed on the display screen until further input from a user is received.
The display method according to claim 1, wherein the step of displaying the partial deflection image includes a step of converting coordinates of at least a partial region of the image displayed before the input. .
A display device comprising a display unit having a display screen on which an image is displayed, an input unit, and a control unit,
In response to an input from a user via the input unit, the control unit bends at least a part of the image displayed before the input and flexes the at least part of the area. A display device that causes a partial deflection image formed by moving a region continuous with the at least a portion of the region to be displayed on the display screen.
Displaying the image on the display screen;
A program for executing a step of displaying a partial deflection image on the display screen,
In the step of displaying the partial deflection image, the partial deflection image causes the at least part of the image displayed before the input to bend and the at least part according to an input from a user. A program formed by moving a region that is continuous with the at least a portion of the region as the region is bent.