JP2015053040A - Image display device, image display method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device or the like for overlappingly displaying images in a comparable manner with a user's simple operation.SOLUTION: A display control part 113 displays each image in vertically overlapped display layers different from each other and displays two or more images by making the transmission factor of an image of the upper display layer a predetermined positive value less than 100% when displaying the two or more images in a display panel 131. An image processing part 114 specifies an image of the uppermost display layer among images displayed at a position at which a touch panel 132 detects a user's touch, and performs image processing of the specified image on the basis of a touch operation performed by the user in an area where the specified image is displayed with no other images displayed on the specified image.

Description

  The present invention relates to an image display device that displays two or more images on a touch panel, an image display method, and a program.

  2. Description of the Related Art In recent years, a technique has been utilized in which an action such as a sports competition is photographed and the action is evaluated based on a photographed moving image. In addition, in a method for evaluating these operations, a portable information terminal such as a smartphone, a tablet terminal, or a laptop computer may be used.

  For example, there has been a method in which still images captured from moving images taken of the exercises of the instructor and the instructor are displayed side by side, and these are compared and evaluated (for example, Patent Document 1).

  In the teaching method described in Patent Document 1, sports, performances or acts performed by a leader and a trainee are taken with a video camera from substantially the same place, and the captured images are displayed on the same screen. Two images were compared and the trainee understood the difference between the two.

  When the movements are evaluated and displayed side by side, it is difficult to grasp even the slight displacement of the limbs and the inclination of the body. On the other hand, a method of comparing two or more images to be compared in an overlapping manner is conceivable. As a technique for superposing two or more images, for example, an image processing technique described in Patent Document 2 is known.

  Patent Document 2 describes that, based on a user's operation input, an image area is designated, and the composition ratio of two images in the designated area can be changed by changing the transmittance of the upper image. doing.

JP-A-7-144038 JP 2012-213019 A

  Since it is assumed that a system for evaluating exercise is used by various persons regardless of gender, it is desirable that the system can be used with a simple operation. In particular, there is an increasing expectation for a system that can be used by an intuitive operation even by a person who is not familiar with the use of information terminals.

  The image processing method disclosed in Patent Document 2 has a problem that operations are complicated such as area designation, transmittance setting, image arrangement setting in the vertical direction, and the like and can only be used by a person who knows the operation method. If the operation method is not fully understood, there is a problem in that it is difficult to visually recognize image shifts and model images, and it is difficult to make an objective judgment.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image display device or the like that displays images in a comparatively overlapping manner by a simple operation of a user.

In order to achieve the above object, an image display device according to a first aspect of the present invention provides:
A storage unit for storing two or more images;
A display panel;
When the two or more images stored in the storage unit are displayed on the display panel, the two or more images are displayed on different display layers stacked one above the other, and the image of the display layer above A display control unit for displaying the transmittance of a predetermined positive value less than 100%;
A touch panel that is placed over the display panel, detects a user's touch, and outputs the position of the detection point;
In the display panel, an image of the uppermost display layer is identified among images displayed at a position where the touch panel detects a user's touch, and the identified image has no other image displayed thereon And an image processing unit that performs image processing on the identified image without changing the vertical relationship of the display layer based on the touch operation performed in the area displayed in (1).

When the touch operation on the touch panel is a movement of the touch position 1 or 2,
The image processing unit may perform any one of image processing of movement, enlargement, reduction, and rotation of the identified image according to the number of touch positions and a movement direction.

When the touch operation on the touch panel is a long press or a continuous tap,
The image processing unit may perform image processing for reversing the specified image or changing the fixed image to a fixed size in accordance with the continuous time of touch or the number of taps.

At least a part of the image stored in the storage unit is a series of still images showing a continuous operation,
The image processing unit performs the image processing based on the touch operation on all the series of the still images,
The display control unit may perform reproduction including frame-by-frame reproduction of the series of still images subjected to the image processing.

At least a part of the image stored in the storage unit is a still image selected from a plurality of still images captured from a moving image obtained by capturing a continuous operation,
The image processing unit performs the image processing based on the touch operation on all selected still images,
The display control unit may perform playback including frame-by-frame playback for the still image that has been subjected to the image processing.

  The display control unit displays an instruction button for instructing to switch between a parallel display state in which the two or more images are displayed side by side and an overlapped display state in which the two or more images are displayed in an overlapping manner; Based on the touch operation on the instruction button, the two or more images may be displayed by switching to the parallel display state or the overlap display state.

  In the parallel display state in which two images of the two or more images are displayed side by side, the display control unit detects two detection points in each region where the two images are displayed. Thereafter, when it is detected that at least one of the two detection points has moved in a direction approaching the other, the image displayed in the area where the moved detection point exists is roughly referred to as the movement direction of the detection point. When moving in the same direction and the distance between the reference points corresponding to each other in the two images is equal to or less than a predetermined value, the two images are superimposed on each other at different display layers at the substantially same positions. It is also possible to display the image with the transmittance of the image of the display layer above set to a predetermined positive value less than 100%.

  In the parallel display state, the display control unit detects two detection points in each region where the two images are displayed, and then at least one of the two detection points is the other. When the movement of the detection point is detected, the image displayed in the area where the moved detection point exists is moved in substantially the same direction as the movement direction of the detection point, and one of the two detection points is moved. Alternatively, when both touches are released and the distance between the reference points corresponding to each other in the two images is equal to or less than a predetermined value, the two images are superposed vertically at substantially the same position, and the reference points If the distance between them exceeds a predetermined value, the two images may be returned to their original positions.

  In the parallel display state, the display control unit detects two detection points in each area where the two images are displayed, and then both of the two detection points approach each other. When it is detected that the image has moved in the direction, the two images are moved toward the approximate center, and when the distance between the reference points is equal to or less than a predetermined value, the images are displayed superimposed on the approximate center of the screen. You may do it.

  In the parallel display state, the display control unit detects two detection points in each region where the two images are displayed, and then selects only one of the two detection points as the other. When it is detected that the image has moved in a direction approaching the image, the image displayed in the area where the moved detection point exists is moved in substantially the same direction as the movement direction of the detection point. The layers may be set so as to be layers, and when the distance between the reference points is equal to or less than a predetermined value, they may be displayed in an overlapping manner in the area where the other image is displayed.

  The display control unit is configured to change the transmittance of the image of the upper display layer based on a user's operation when the two or more images are displayed on the display layers different from each other in the vertical direction. It may be.

  The display control unit extracts an image of a comparison object from at least one of the two or more images, and the size of another image is set so that the size of the image of the comparison object is substantially the same. You may make it change the length.

A program according to the second aspect of the present invention is:
In the image display device according to the first aspect, the processing of the display control unit and the image processing unit is executed.

An image display method according to a third aspect of the present invention is:
A storage unit for storing two or more images;
A display panel;
An image display method executed by an image display device provided with a touch panel that is installed over the display panel, detects a user's touch, and outputs the coordinates of a detection point,
When the two or more images stored in the storage unit are displayed on the display panel, the two or more images are displayed on different display layers stacked one above the other, and the image of the display layer above A display step of displaying the transmittance of a predetermined positive value less than 100%;
In the display panel, an image of the uppermost display layer is specified among images displayed at a position where the touch panel detects a user's touch, and the specified image is in a state where no other image is displayed thereon. And an image processing step of performing image processing on the identified image without changing the vertical relation of the display layer based on a touch operation performed in the displayed area.

  According to the present invention, it is possible to display images so that they can be compared with each other with a simple operation by a user.

1 is a block diagram illustrating an internal configuration of an image display device according to Embodiment 1. FIG. It is a figure which shows a model image selection screen. (A) It is a figure which shows the screen of a parallel display state. (B) It is a figure which shows the screen of an overlapping display state. (A) It is a figure which shows the screen of a parallel display state. (B) It is a figure which shows the screen of an overlapping display state. (A) It is a figure which shows the operation | movement of the movement of an image. (B) It is a figure which shows the operation | movement of the size change of an image. (A) It is a figure which shows the operation | movement of rotation of an image. (B) It is a figure which shows the operation | movement of the change to the fixed size of an image. It is a figure which shows a comparative image selection screen. FIG. 6 is a diagram illustrating a screen of an image display device according to a second embodiment. (A) It is a figure which shows the screen of a parallel display state. (B) It is a figure which shows the screen of an overlapping display state. It is a figure which shows the screen of the parallel display state which concerns on Embodiment 2. FIG. 10 is a flowchart illustrating display control processing according to the second embodiment. It is a figure which shows the operation | movement of a size change in a parallel display state. It is a figure for demonstrating the operation | movement of the superimposition of an image. (A) It is a figure which shows a parallel display state. (B) It is a figure which shows the movement middle of an image. (C) It is a figure which shows a superimposed display state. It is a figure for demonstrating the operation | movement of the superimposition of an image. (A) It is a figure which shows the operation | movement in the case of overlapping on the left side. (B) It is a figure which shows the operation | movement in the case of overlapping on the right side.

(Embodiment 1)
Hereinafter, Embodiment 1 of the present invention will be described in detail with reference to FIGS.

  The image display device 1 according to the present embodiment is an information terminal for comparing two or more images. The image display device 1 is configured by an information terminal such as a smartphone, a tablet terminal, or a personal computer.

  As shown in FIG. 1, the image display device 1 includes a touch screen 13 including a control unit 11, a storage unit 12, a display panel 131, and a touch panel 132.

  The storage unit 12 includes a readable / writable nonvolatile semiconductor memory such as a flash memory, a hard disk, and the like. The storage unit 12 stores data including two or more still images 121. The storage unit 12 also stores a control program executed by the control unit 11.

  The display panel 131 is composed of a thin display device such as an LCD (Liquid Crystal Display), for example, and performs information display output of figures, characters, symbols, and the like.

  The touch panel 132 is a position input device that is provided so as to overlap the display panel 131 and detects a contact (touch) with a finger or a touch pen, which is a user operation input, and outputs coordinates of a detection point (touch position). An input corresponding to the information of the display image displayed on the display panel 131 is detected.

  The touch panel 132 is a device such as a projection capacitive method that can simultaneously detect multiple points designated by a plurality of fingers or the like. Thereby, for example, a pinch-out operation in which two detection points are separated from each other, a pinch-in operation in which two detection points are close to each other, and the like can be determined.

  The control unit 11 includes an arithmetic processing unit, an internal memory, and the like, generates a display image to be displayed on the display panel 131, and generates a display image that is changed according to a user input to the touch panel 132. I do.

  The control unit 11 functions as functional units such as a detection point coordinate acquisition unit 111, an image acquisition unit 112, a display control unit 113, and an image processing unit 114 by executing a control program stored in the storage unit 12. .

  The detection point coordinate acquisition unit 111 acquires the coordinates of the touch detection point detected by the touch panel 132 and outputs the acquired information to the image acquisition unit 112, the display control unit 113, and the image processing unit 114.

  In the image acquisition unit 112, the coordinates of the detection points output from the detection point coordinate acquisition unit 111, the contents of the image displayed on the display panel 131 at the time of touch detection output from the display control unit 113, and the display position are displayed. Information etc. are input. The image acquisition unit 112 determines an image to be acquired from the storage unit 12 and which display layer to display the acquired image based on the coordinates of the input detection points and information on the display position of the image. Here, a case will be described in which it is determined that the image A is displayed on the first layer and the image B is displayed on the second layer.

  For example, when the model image selection screen 1100 for selecting the model image of the mat exercise shown in FIG. 2 is displayed on the display panel 131, the image acquisition unit 112 displays the coordinates of the detection points and the display position of the image. Query information for. Based on the result of the inquiry, if one of the areas in the leftmost image A is touched and it is determined that the “Select model image” button has been touched, the model image is displayed. It is determined that the image A, which is a model image, is displayed on the first layer that is determined in advance as the layer to be used. Then, the image acquisition unit 112 acquires the image A determined from the storage unit 12, and outputs the image A as a model image to be displayed on the first layer by the image processing unit 114.

  The image acquisition unit 112 acquires the image B to be compared with the image A, which is a model image, from the storage unit 12 by the same procedure, and uses the image B as a comparison image to be displayed on the second layer in the image processing unit 114. Output.

  The image processing unit 114 performs image processing on the image acquired by the image acquisition unit 112 and outputs the processed image to the display control unit 113 together with information on the display layer.

  The display control unit 113 generates a display image to be displayed on the display panel 131 based on the image output from the image processing unit 114 and information on the display layer, and outputs the display image to the display panel 131.

  First, as shown in FIG. 3A, the display control unit 113 displays a display image of a basic screen 1200 (parallel display state) in which the first layer image A and the second layer image B are arranged in the horizontal direction. Is output to the display panel 131.

  On the basic screen 1200, a button 1201 for instructing to display the image A and the image B in an overlapping manner is displayed. When the user touches the button 1201, the display control unit 113 superimposes the image A and the image B at substantially the same position in the center of the screen as shown in FIG. 3B (overlapping display state). When the images are overlapped, it may be determined in advance which of the first layer image A and the second layer image B is to be upward (frontward toward the screen).

  By overlapping images representing the same operation, the difference between the two can be easily grasped. In this embodiment, the position or form of the body of the person who is the subject of the image B to be compared with the image A that is the model image can be easily compared. You can train to move closer.

  The process of superimposing the two images is executed by aligning the two images so that the overlapping reference positions corresponding to each other are the same. When the two images have the same size, they can be completely overlapped by setting the overlap reference position to the same position. The overlapping reference position may be any position as long as it is a position corresponding to each other of the image A and the image B, and is, for example, one of the center of the image and the four corners of the image (upper left, upper right, lower left, lower right).

  FIG. 3B shows a screen when the first layer on which the image A is displayed is set to be displayed on the top. The upper first layer image A is displayed with a preset transmittance. The transmittance can be changed by the user performing an operation input on a control bar or a numerical value input box showing the transmittance as shown in FIG. In FIG. 3B, the transmittance is 50%.

  The two images are superimposed by, for example, alpha blending the image A of the first layer with respect to the image B of the second layer. At this time, the transmittance is expressed as a percentage of an α value that is a weighting coefficient for alpha blending.

  In the superimposed image, when the α value is 0, the image A of the upper first layer A is displayed as it is, and when the α value is 1, the image B of the lower second layer B is displayed as it is. Since the purpose is to compare two images, 0 <α <1. That is, the initial transmittance after superposition is a positive value set in advance of less than 100%. When the α value is 0 <α <1, a value obtained by multiplying each pixel value of the lower second layer image B by the α value and each pixel value of the upper first layer image A are (1−α ) And a value obtained by adding (blending) with the value obtained by multiplying the value by ()) becomes each pixel value of the superimposed image.

  From the state in which the two images as shown in FIG. 3B are superimposed (overlapping display state), the state is returned to the state in which the two images as shown in FIG. 3A are arranged side by side (parallel display state). The operation is executed when the user touches a “parallel display” button shown in FIG.

  Here, as shown in FIG. 4A, in the image A and the image B, there are cases where the size of the subject is greatly different, the direction is different, or the left and right are reversed. In this case, as shown in FIG. 4B, it is difficult to grasp the difference between the two images even if they are displayed in an overlapping manner. In that case, it is necessary to adjust the size of the subject of the image B to the size of the subject of the image A that is a model image.

  A method for adjusting the images A and B will be described in detail.

  First, the image processing unit 114 specifies an image of the uppermost display layer among images displayed at a position where the touch panel 132 detects a user touch. Then, based on the touch operation performed in the area where the identified image is displayed in a state where no other image is displayed on the identified image, image processing is performed without changing the vertical relationship of the display layers. I do.

  For example, as shown in FIG. 5A, when the user touches the area where the image A is displayed, the image processing unit 114 displays the first layer at the top of the images displayed at the position where the touch is detected. The image A is specified. Then, when the user slides the touch position in the area where the specified image A is displayed, the image processing unit 114 performs a process of moving the image A as shown in FIG.

  When the image A is moved, a region B1 in which no other image is displayed appears on the image B. When the user touches the area, the image processing unit 114 specifies the image B of the uppermost second layer among the images displayed at the position where the touch is detected. When the user performs a pinch-in operation in the area (B1) in which the identified image B is displayed in a state where no other image is displayed thereon, the image processing unit 114 reduces the identified image B. I do. Further, when a pinch-out operation is performed in the area B1, a process for enlarging the specified image B is performed. At this time, the image processing unit 114 does not change the vertical relationship of the layers, and performs image processing while the second layer is below the first layer.

  Accordingly, the user can easily change the size of the image B by an intuitive operation, and can select an optimal size while comparing the size of the image A and the subject.

  Similarly, when it is detected that the two touch positions are rotated in the area B1 where no other image is displayed on the image B, as shown in FIG. Rotate the image B.

  Thereby, when the orientation of the subject of the image B is shifted in the rotation direction with respect to the subject of the image A, the user easily changes the orientation of the image B by an intuitive operation of rotating the finger. It is possible to select the optimum direction while comparing the direction of the image A and the subject.

  In addition, in the area B1 where no other image is displayed on the image B, when the touch time at substantially the same position exceeds a predetermined time (when a long press operation is detected), the image processing unit 114 specifies The image B is reversed horizontally.

  Thus, when the orientation of the subject of the image B is symmetrical with respect to the subject of the image A, the user can easily change the orientation of the image B by a simple operation of long press. That is, even when the movement direction of the subject of the image A and the subject of the image B is opposite to each other, the comparison of the movement can be facilitated.

  In addition, in the area B1 where no other image is displayed on the image B, as shown in FIG. 6B, when touches at substantially the same location are detected twice (double tap), image processing is performed. The unit 114 performs image processing for changing the identified image B to a fixed size and orientation, and displays it on the full screen. When a double tap is detected after displaying the full screen, it returns to the original position, size and orientation.

  Thereby, when it is desired to enlarge the image B of the second lower layer, the user can easily enlarge the image B and display it on the full screen by a double tap operation.

  As described above, in the present embodiment, when displaying two or more images on the display panel 131, the display control unit 113 displays the images on different display layers that are stacked one above the other, and displays the image of the upper display layer. Is displayed with a predetermined positive value of less than 100%. The image processing unit 114 identifies the image of the uppermost display layer among the images displayed at the position where the touch panel 132 has detected the user's touch, and the identified image has no other image displayed thereon. Based on the touch operation performed by the user in the area displayed in, image processing is performed on the identified image. Thereby, in a state where the images are displayed in an overlapped manner, each image can be changed to an optimal size or the like based on a user's intuitive and simple operation, so that comparison of images can be facilitated.

(Embodiment 2)
Hereinafter, Embodiment 2 of the present invention will be described in detail with reference to FIGS.

  The image display device 1 according to the present embodiment has the same configuration as the image display device 1 of the first embodiment. However, the still image 121 stored in the storage unit 12 includes a plurality of still images 121 indicating a continuous operation and a plurality of still images 121 obtained by capturing a moving image obtained by capturing the continuous operation at regular intervals.

  The image acquired by the image acquisition unit 112 of the control unit 11 is, for example, an image selected by the user on the comparison image selection screen 2100 for selecting an image to be compared with the model shown in FIG. On the comparison image selection screen 2100 of FIG. 7, a series of images A showing a continuous operation as a model stored in advance are displayed in an upper row 2101. On the other hand, a lower image 2103 displays a still image obtained by capturing a moving image obtained by capturing a continuous operation at regular intervals.

  The user selects an image at the same timing as the operation timing indicated by the image A, which is a model image, from among the still images in the lower row 2103 and moves the touch position into the frame in the middle row 2102. Similarly, an image at each timing is selected. Thereby, a series of images B corresponding to the series of images A are selected as comparison images.

  As shown in FIG. 8A, in the basic screen 2200 of this embodiment, the image A is displayed on the left side of the screen in the first layer and the image B is displayed on the right side of the screen in the second layer, as in the first embodiment. It is displayed. The image of each layer is one in a group of a series of images showing a continuous operation, and can be changed to an image of another frame in the group.

  The user can change the image to be displayed to an image of another frame by operating the control bar 2201 below each image in FIG. Further, the playback control button group 2202 can perform frame-by-frame playback and the like of the images A and B in the order of continuous operation.

  A basic screen 2200 shown in FIG. 8A displays a button 2203 for instructing to display the image A and the image B in an overlapping manner. When the user touches the button 2203, the display control unit 113 superimposes the image A and the image B at the same position in the approximate center of the screen as shown in FIG. 8B. When the images are overlapped, it may be determined in advance which of the first layer image A and the second layer image B is to be upward (frontward toward the screen). The method for superimposing images is the same as in the first embodiment.

  As shown in FIG. 8B, even when two images are superimposed (overlapping display state), at least one of the images can be changed to an image at another timing, or frame-by-frame playback can be performed. .

  When the touch panel 132 detects that the button of the playback control button group 2202 is touched, the display control unit 113 performs frame advance playback and the like. Use the “Right”, “Left”, and “Both” buttons to select which of the left and right images (Image A or Image B) to perform frame advance playback. When the right arrow and left arrow buttons are touched, playback and reverse playback are performed. FIG. 8B shows a state in which both images are being played back frame by frame.

  Here, as in the first embodiment, the image processing unit 114 performs image processing such as size change on the two images based on a user's touch operation.

  That is, the image processing unit 114 specifies the image of the uppermost display layer among the images displayed at the position where the touch panel 132 has detected the user's touch. Then, based on the touch operation performed in the area where the identified image is displayed in a state where no other image is displayed on the identified image, image processing is performed without changing the vertical relationship of the display layers. I do.

  When the image processing unit 114 performs image processing on at least one of the image A and the image B, the same image processing is performed on all other frames. The display control unit 113 performs frame-by-frame playback and the like with the size, orientation, and the like changed. Thus, frame advance playback or the like can be performed in a state where the sizes and orientations of the images A and B match each other, and it becomes easy to grasp the difference in the flow of operations.

  As described above, in the present embodiment, the display control unit 113 divides the image A and the image B, which are one image in the group of images showing continuous operation, into the first layer and the second layer that are stacked one above the other. Each is displayed, and the transmittance of the upper first layer image is set to a predetermined positive value of less than 100%. The image processing unit 114 identifies the image of the uppermost display layer among the images displayed at the position where the touch panel 132 has detected the user's touch, and the identified image has no other image displayed thereon. Image processing is performed on the identified image based on the touch operation performed in the area displayed in. Then, the same image processing is performed for the images of other frames, and the images after the image processing are subjected to frame advance playback and the like. As a result, in a state where the images are displayed in an overlapping manner, the image can be changed to an optimal size or the like based on the user's intuitive and simple operation for frame-by-frame playback and the like. Can be easily compared.

(Embodiment 3)
Hereinafter, Embodiment 3 of the present invention will be described in detail with reference to FIGS.

  The image display device 1 according to the present embodiment has the same configuration as the image display device 1 of the first embodiment. However, the operation of the user and the control of the display control unit 113 when the image A and the image B are displayed in parallel and displayed in a superimposed manner are different from those in the first embodiment. The user operation and control of the display control unit 113 at this time will be described in detail.

  First, as shown in FIG. 9, the display control unit 113 generates a display image of the basic screen 3200 in which the first layer image A and the second layer image B are arranged in the horizontal direction, and is displayed on the display panel 131. Output.

  In this basic screen 3200, the display control unit 113 displays the image A and the image B in a superimposed manner based on the touch position (detection point) information on the touch panel acquired by the detection point coordinate acquisition unit 111. I do.

  Of the operations of the image display device 1, the display control processing by the display control unit 113 when the user performs a touch operation on the touch panel 132 on the basic screen 3200 shown in FIG. 9 will be described in detail with reference to the flowchart of FIG. Explained.

  First, the display panel 131 displays a basic screen 3200 in which the screen A is displayed at the left side of the first layer and the screen B is displayed at the right side of the second layer. In this state, the control unit 11 monitors the input of the touch detection signal from the touch panel 132 (step S101), and continues the monitoring when no detection signal is input (step S102: No).

  When a touch detection signal is input from the touch panel 132 (step S102: Yes), the detection point coordinate acquisition unit 111 acquires the coordinates of the detection point from the touch panel 132 (step S103).

  When the number of detection points detected by the touch panel 132 is 1 (step S104: 1), processing corresponding to the preset number of detection points 1 is executed (step S105). The process corresponding to the number of detection points 1 may be any conventional process. For example, when the touch operation is a swipe in the area of the image A, the image is simply moved in the swipe direction. If the operation button is touched once, processing corresponding to the operation button is executed.

  When the number of detection points detected by the touch panel 132 is 2 (step S104: 2), it is determined whether or not the two detection points are within one image display area, and one image display area. If it is within the range (step S106: Yes), a process of changing the size of the image displayed in the area where the detection point is present is performed (step S107). For example, as shown in FIG. 11, when the detection point moves in the image B so that the two detection points approach each other, the size of the image B is continuously reduced. The moving direction of the detection point here may be defined so as to exclude the substantially horizontal direction in order to avoid confusion with the process of overlapping images described later.

  On the other hand, when the two detection points are not in one image but in the areas of the two images, that is, one is in image A and the other is in image B (step S106: No), image A and image B is moved in the same direction as the moving direction of each detection point (step S108). The moving direction of the image may be limited to a substantially horizontal direction. Then, when the distance between the reference points corresponding to each other in the images A and B exceeds a predetermined value after a predetermined time (step S109: No), the state is returned to the state where the two images are displayed in parallel (step S109). S110). Here, the reference points of the image A and the image B are arbitrary points indicating positions corresponding to each other of the image A and the image B, for example, the center of the image, the four corners of the image (upper left, upper right, lower left, lower right). One of them.

  On the other hand, when the distance between the reference points corresponding to each other in the images A and B is equal to or less than a predetermined value (step S109: Yes), whether or not both of the two detection points are moving simultaneously. Is determined (step S111). If both of the two detection points are moving (step S111: Yes), the two images are moved to the same position at the approximate center of the screen and the two images are superimposed (step S112). When superimposing images, it may be determined in advance which of the first layer and the second layer is to be upward (frontward toward the screen).

  The process of superimposing the two images is executed by aligning the two images so that the overlapping reference positions corresponding to each other are the same. When the two images have the same size, they can be completely overlapped by setting the overlap reference position to the same position. The overlapping reference position is an arbitrary position as long as it is a position corresponding to each other of the image A and the image B, and is, for example, one of the center of the image and the four corners (upper left, upper right, lower left, lower right) of the image. Moreover, it is good also as the same position as the reference point for determining whether to superimpose.

  The operation of step S112 will be described with reference to FIGS. FIG. 12A shows a basic screen 3200 displayed in a horizontal direction so that the image A on the left side and the image B on the right side are in contact with each other (parallel display state). On basic screen 3200, the user touches each image with two fingers. At this time, the touch positions are arranged in a substantially horizontal direction. Thereafter, the fingers are moved in a substantially horizontal direction so as to approach each other as shown in FIG. Accordingly, the image A is moved to the right side and the image B is moved to the left side. The movement of the finger at this time is an operation called “pinch-in”.

  When the distance between the reference points of each image becomes equal to or smaller than a predetermined value due to the movement of the images A and B, the two images are displayed at the same position in the approximate center of the screen as shown in FIG. Overlapping display. Here, it is assumed that the first layer on which the image A is displayed is set to be displayed on the top. Further, the upper first layer image A is displayed with a preset transmittance. In FIG. 12C, the transmittance is 50%.

  The image superimposition in step S112 is the same as that in the first embodiment. After the overlay display, the transmittance can be changed by the user operating the control bar or numerical value input box indicating the transmittance as shown in FIG.

  In step S111, if the two detection points are not moving simultaneously (step S111: No), one detection point is substantially fixed, and only the other detection point is moving, the moving side The layer of the image in the region where the detection point exists is changed upward (step S113), and the two images are superimposed in the region where the detection point on the substantially fixed side exists (step S114).

  The operations in steps S113 and S114 will be described with reference to FIGS. In the basic screen 3200 as shown in FIG. 12A, the user touches each image with two fingers. At this time, the touch positions are arranged in a substantially horizontal direction. When only the finger touching the image B on the right side of the second layer is moved as shown in FIG. 13A, only the right point of the two detection points moves to the left. At this time, the second layer is changed to the upper side (frontward toward the screen), and display control is performed so that the image B is moved to the left.

  When the distance between the reference points of each image becomes equal to or smaller than a predetermined value due to the movement of the image B, the two areas in the left side where the image A of the first layer where the detection points are substantially fixed are located. Display images superimposed. At this time, the transmittance of the image B is a predetermined positive value of less than 100%, as in step S112, but can be changed based on a user operation after the superimposed display.

  On the other hand, on the basic screen 3200, after the user touches the inside of each image with two fingers and moves only the finger touching the left first layer image A as shown in FIG. 13B. Of the two detection points, only the left point moves to the right. At this time, the first layer is changed to the upper side (frontward toward the screen), and display control is performed so that the image A moves to the right. When the distance between the reference points of each image becomes equal to or smaller than a predetermined value due to the movement of the image A, the two detection points in the right region where the second layer image B was substantially fixed Display images superimposed. At this time, the transmittance of the image A is a predetermined value of less than 100% as in step S112, but can be changed based on the user's operation after the superimposed display.

  Here, when an input to the touch panel 132 is detected again in a state in which the two images are superimposed and displayed in steps S112 and S114 (overlapping display state), various inputs are made based on the touch input to the image. Display control.

  The operation in the overlapping display state in which the image A and the image B are overlapped is the same as in the first and second embodiments. The image processing unit 114 specifies the image of the uppermost display layer among the images displayed at the position where the touch panel 132 has detected the user's touch in the overlapping display state. Then, based on the touch operation performed in the area where the identified image is displayed in a state where no other image is displayed on the identified image, image processing is performed without changing the vertical relationship of the display layers. I do.

  The operation of returning from the overlapping display state to the parallel display state may be performed based on a horizontal pinch-out operation. Alternatively, the “parallel display” button may be displayed and touched to return to the parallel display state.

  As described above, in the present embodiment, in the basic screen 3200 in which the images A and B are displayed side by side, the touch panel 132 detects that the area where the images A and B are displayed is touched at the same time. After that, when it is detected that at least one of the two detection points has moved in a direction approaching the other, the image A or the image B is moved, and the distance between the reference points corresponding to each other is less than a predetermined value. At that time, the display control is performed such that the two images are superimposed at the substantially same position with each other while the upper image is transmitted. Thus, the two images can be easily overlapped by an intuitive and simple operation of touching the two images with two fingers and then bringing them closer to each other, and an objective image comparison is possible.

  As described above, according to the present invention, when two or more images are displayed on the display panel, the two or more images are displayed on different display layers that are stacked one above the other, and the transmittance of the image on the upper display layer is 100%. A predetermined positive value of less than is displayed. Then, in the display panel, the image of the uppermost display layer is specified among the images displayed at the position where the touch panel detects the touch of the user, and the specified image is in a state in which no other image is displayed thereon. Based on the touch operation performed in the displayed area, the specified image is subjected to image processing without changing the vertical relationship of the display layer. Thereby, it is possible to display the images so as to be compared with each other by a simple operation of the user.

  In addition, this invention is not limited to the said embodiment, Of course, the various change in the range which does not deviate from the summary of this invention is possible.

  For example, in the above embodiment, the state in which the two images A and B are displayed in parallel and displayed in an overlapping manner has been described, but three or more images may be displayed in parallel and displayed in an overlapping manner. Among the three or more images displayed at the position where the touch panel 132 detects the touch of the user, the image of the uppermost display layer is specified, and the specified image is displayed in a state where no other image is displayed thereon. The image processing may be performed on the identified image without changing the vertical relationship of the display layers based on the touch operation performed in the region. In addition, the image arrangement direction in the parallel display state is not limited to the horizontal direction, and may be displayed in parallel in other directions such as the vertical direction. When three or more images are displayed in parallel, the image may be divided into three or more and displayed in each area.

  In the above-described embodiment, the case of a still image has been described for the sake of simplicity. However, at least one of two or more images may be a moving image. For example, on the basic screens 1200, 2200, and 3200, display control for reproducing a moving image as a moving image in a state where two images are superimposed may be performed. At this time, the image processing unit 114 performs image processing on all the frame images of the moving image. As a result, the reproduced moving image can be viewed with two or more images superimposed in an optimal state.

  Also, when one of the two or more images is a captured image (moving image) being shot, the image processing may be performed by displaying the two or more images superimposed by the same operation as in the above embodiment. For example, by displaying a model image superimposed on the moving image being shot, it is possible to shoot in the same position range as the model image, and good shooting as a comparative image for the model image There is an effect that can be done.

  In addition, in a superimposed display state in which the images A and B are overlapped, the comparison target is extracted from either the image A or the image B, and the extracted target substantially matches the size of the target in the other. The size of the image A or the image B may be automatically changed. This makes it easier to compare the objects of image A and image B.

  In addition, when the image A and the image B are overlapped, the range of the α value that is the transmittance is set to 0 <α <1, but the α value is set to 0 or 1 (0% in a state where the overlapped image is displayed). Or 100%) may be set.

  In the third embodiment, when two images are overlapped, the alignment is performed so that the overlapping reference position is the same position. Instead, the alignment is performed so that two touch detection points overlap. You may do. For example, when the heads of the persons in the two images are touched, the positions can be aligned so that the heads overlap. When one detection point moves, a predetermined position of the image indicated by the moving detection point may overlap with a predetermined position of the other image indicated by the detection point of the movement destination. For example, if the head of a person in one image is moved by touching (dragging) and the touch is released (dropped) at the head position of the person in the other image, the heads are aligned so that they overlap. Can do.

  In the third embodiment, whether to overlap the images or return to the original display arranged in parallel is selected depending on whether the distance between the reference points of the images is equal to or less than a predetermined value. The determination of the inter-distance may be performed when the touch detection is canceled, that is, when the user lifts the finger from the touch panel. That is, while the touch detection continues, the image is moved along with the movement of the detection point, and when the touch detection is canceled, two images are displayed when the distance between the reference points is equal to or less than a predetermined value. When the values exceed a predetermined value, the two images may be returned to the original arrangement. Alternatively, the images may be superimposed when the touch detection points are moved by a predetermined value or more in the direction in which the touch detection points approach each other.

  In addition, in step S114 of the flowchart of FIG. 10, when one of the two detection points moves and the other is fixed, it is overlapped on the fixed point side. After the touch detection continues for about 1 second or longer (touch and hold), when the detection point moves to the other image area, the touched and held image may be superimposed on the other.

  In the third embodiment, when three or more images are displayed, the same concept as in the case of two images can be applied by detecting detection points for each region. For example, when three or more detection points are detected at the same time and the moving directions of the three or more detection points are close to each other, the three or more images are moved, and the corresponding reference points of the three or more images When the distance between them becomes a predetermined value or less, three or more images may be superimposed.

  In addition, by applying the processing program executed by the control unit 11 of the above embodiment to an existing information terminal such as a smartphone or a tablet terminal, the terminal can also function as the image display device 1 according to the present invention. It is.

  The distribution method of such a program and necessary information (various information that can be distributed such as a model image A different from the program) is arbitrary. For example, a CD-ROM (Compact Disc Read-Only Memory), a DVD ( It may be distributed by storing in a computer-readable recording medium such as a digital versatile disc (MO), an MO (Magneto Optical Disc), or a memory card, or via a communication network such as a mobile phone network or the Internet. .

DESCRIPTION OF SYMBOLS 1 ... Image display apparatus 11 ... Control part 111 ... Detection point coordinate acquisition part 112 ... Image acquisition part 113 ... Display control part 114 ... Image processing part 12 ... Memory | storage part 121 ... Still image 13 ... Touch screen 131 ... Display panel 132 ... Touch panel 1100 ... Model image selection screen 1200, 2200, 3200 ... Basic screen 1201 ... Button 2100 ... Comparison image selection screen 2101 ... Upper row 2102 ... Middle row 2103 ... Lower row 2201 ... Control bar 2202 ... Playback control button group 2203 ... Button

Claims (14)

A storage unit for storing two or more images;
A display panel;
When the two or more images stored in the storage unit are displayed on the display panel, the two or more images are displayed on different display layers stacked one above the other, and the image of the display layer above A display control unit for displaying the transmittance of a predetermined positive value less than 100%;
A touch panel that is placed over the display panel, detects a user's touch, and outputs the position of the detection point;
In the display panel, an image of the uppermost display layer is identified among images displayed at a position where the touch panel detects a user's touch, and the identified image has no other image displayed thereon An image processing unit that performs image processing on the identified image without changing the vertical relationship of the display layer based on the touch operation performed in the area displayed in
An image display device characterized by that. When the touch operation on the touch panel is a movement of the touch position 1 or 2,
The image processing unit performs image processing of any one of movement, enlargement, reduction, and rotation of the identified image according to the number of touch positions and a movement direction.
The image display apparatus according to claim 1. When the touch operation on the touch panel is a long press or a continuous tap,
The image processing unit performs image processing for reversing the specified image or changing to a fixed size according to the continuous time of touch or the number of taps.
The image display device according to claim 1, wherein the image display device is an image display device. At least a part of the image stored in the storage unit is a series of still images showing a continuous operation,
The image processing unit performs the image processing based on the touch operation on all the series of the still images,
The display control unit performs reproduction including frame-by-frame reproduction of the series of still images subjected to the image processing.
The image display apparatus according to claim 1, wherein the image display apparatus is an image display apparatus. At least a part of the image stored in the storage unit is a still image selected from a plurality of still images captured from a moving image obtained by capturing a continuous operation,
The image processing unit performs the image processing based on the touch operation on all selected still images,
The display control unit performs playback including frame-by-frame playback of the still image subjected to the image processing.
The image display device according to claim 1, wherein the image display device is an image display device. The display control unit displays an instruction button for instructing to switch between a parallel display state in which the two or more images are displayed side by side and an overlapped display state in which the two or more images are displayed in an overlapping manner; Based on a touch operation on the instruction button, the two or more images are displayed by switching to the parallel display state or the overlapping display state.
The image display device according to claim 1, wherein the image display device is an image display device. In the parallel display state in which two images of the two or more images are displayed side by side, the display control unit detects two detection points in each region where the two images are displayed. Thereafter, when it is detected that at least one of the two detection points has moved in a direction approaching the other, the image displayed in the area where the moved detection point exists is roughly referred to as the movement direction of the detection point. When moving in the same direction and the distance between the reference points corresponding to each other in the two images is equal to or less than a predetermined value, the two images are superimposed on each other at different display layers at the substantially same positions. Display, and display the above-described display layer image with a predetermined positive value of less than 100%,
The image display device according to claim 1, wherein the image display device is an image display device. In the parallel display state, the display control unit detects two detection points in each region where the two images are displayed, and then at least one of the two detection points is the other. When the movement of the detection point is detected, the image displayed in the area where the moved detection point exists is moved in substantially the same direction as the movement direction of the detection point, and one of the two detection points is moved. Alternatively, when both touches are released and the distance between the reference points corresponding to each other in the two images is equal to or less than a predetermined value, the two images are superposed vertically at substantially the same position, and the reference points If the distance between them exceeds a predetermined value, the two images are returned to their original positions;
The image display device according to claim 7. In the parallel display state, the display control unit detects two detection points in each area where the two images are displayed, and then both of the two detection points approach each other. When it is detected that the image has moved in the direction, the two images are moved toward the approximate center, and when the distance between the reference points is equal to or less than a predetermined value, the images are displayed superimposed on the approximate center of the screen. ,
The image display device according to claim 7, wherein the image display device is an image display device. In the parallel display state, the display control unit detects two detection points in each region where the two images are displayed, and then selects only one of the two detection points as the other. When it is detected that the image has moved in a direction approaching the image, the image displayed in the area where the moved detection point exists is moved in substantially the same direction as the movement direction of the detection point. Set the layer to be a layer, and when the distance between the reference points is equal to or less than a predetermined value, the other image is displayed in a superimposed manner.
The image display device according to claim 7, wherein the image display device is an image display device. The display control unit changes the transmittance of the image of the display layer on the basis of a user's operation when displaying the two or more images on the display layers different from each other stacked one above the other.
The image display apparatus according to claim 1, wherein the image display apparatus is an image display apparatus. The display control unit extracts an image of a comparison object from at least one of the two or more images, and the size of another image is set so that the size of the image of the comparison object is substantially the same. Change the
The image display device according to claim 1, wherein the image display device is an image display device.   The program for performing the process of a display control part and an image process part in the image display apparatus of any one of Claims 1 thru | or 12. A storage unit for storing two or more images;
A display panel;
An image display method executed by an image display device provided with a touch panel that is installed over the display panel, detects a user's touch, and outputs the coordinates of a detection point,
When the two or more images stored in the storage unit are displayed on the display panel, the two or more images are displayed on different display layers stacked one above the other, and the image of the display layer above A display step of displaying the transmittance of a predetermined positive value less than 100%;
In the display panel, an image of the uppermost display layer is specified among images displayed at a position where the touch panel detects a user's touch, and the specified image is in a state where no other image is displayed thereon. An image processing step for performing image processing on the identified image without changing the vertical relationship of the display layer based on a touch operation performed in the displayed region,
Image display method.