JP6607083B2 - Program and information processing apparatus - Google Patents

Description

  The present application relates to a program and an information processing apparatus for displaying an image on a display unit.

  Patent Document 1 discloses a technique for designating an arbitrary area by a user's touch operation on image data displayed on a touch panel. Specifically, an area inside the range designation frame is designated by displaying a range designation frame having a closed boundary line having an arbitrary shape. In addition, a technique for performing various processes on an image in a designated area is disclosed.

JP 2011-035539 A

  In the above technique, when determining the shape of the range designation frame, the boundary line may be hidden by the indicator that operates the touch panel. Examples of the indicator include a user's fingertip and a touch pen. In this case, there is a problem that an accurate area cannot be specified. In this specification, the technique which can eliminate such inconvenience is provided.

  (1) A program described in this specification is a computer-readable program of an information processing apparatus including a display unit and a touch panel, and has a closed boundary line indicating a predetermined range on the computer. A first display process for displaying on the display unit a boundary line on which a plurality of positioning points for determining a predetermined range are located on the line, and an input for a moving operation for moving the plurality of positioning points. A second display process for displaying a plurality of object images in the vicinity of each of the plurality of positioning points so as not to overlap the boundary line; and within a display area of a selected object image selected by the user from the plurality of object images When the indicator touches or approaches, the touch panel detects a first pointing position indicating a position where the indicator touches or approaches the first point. Corresponding to the selected object image, the output process, the second detection process in which the touch panel detects a second designated position different from the first designated position after the first designated position is detected by the first detection process. A first positioning process for determining the first display position of the selected positioning point, which is a positioning point, in the vicinity of the second indicated position detected in the second detection process; and the selected positioning point is positioned at the first display position. The third display process for redisplaying the boundary line, and the selected positioning point where the selected object image after the movement is displayed again in the third display process so that the selected object image after the movement does not overlap the boundary line. A second positioning process for determining a second display position that is a display position of the selected object image so that the selected object image is displayed in the vicinity; and a selection option so that the selected object image is positioned at the second display position. A fourth display processing for redisplay the object image, characterized in that to the execution.

  According to the above configuration, a plurality of object images for moving a plurality of positioning points can be displayed so as not to overlap the boundary line. Thereby, the boundary line is not hidden by the indicator during the input of the operation for determining the shape of the boundary line. It is possible to accurately determine the predetermined range.

  (2) Preferably, the program described in the present specification is a specific area arranged along the frame line inside the frame line of the boundary line display area, and is a first predetermined distance from the frame line. The computer further executes a first determination process for determining whether or not at least a part of the selected object image overlaps a specific area that is an inner area, and the second positioning process is performed by the first determination process. When it is determined that at least a part of the image overlaps the specific area, the second display position is determined so that the entire area of the selected object image is not included in the specific area.

  According to the above configuration, the object image is not displayed in the vicinity of the frame line of the boundary line display area. A situation in which the input operability with respect to the object image is deteriorated can be prevented.

  (3) Preferably, the program described in the present specification is an object image displayed within a predetermined range, and an object image partially overlapping with another object image or a boundary line When the first object image is determined to be present and the second determination processing determines that the first object image exists, the first object image is predetermined. A third positioning process for determining a third display position of the first object image so that the first object image does not overlap the boundary line, and the first object image is the third display position. And a fifth display process for displaying the first object image so as to be positioned in the computer.

  According to the above configuration, the display position of the object image can be appropriately changed according to the shape of the predetermined range. As a result, the predetermined range can be appropriately determined regardless of the shape of the predetermined range.

  (4) Preferably, the program described in this specification is characterized in that the predetermined range is a polygon, and the plurality of positioning points are each vertex of the polygon.

  According to the above configuration, a polygonal predetermined range can be determined by inputting a moving operation to the object image.

  (5) Preferably, the program described in the present specification is an object image displayed within a predetermined range, and is an object image that receives an input of a movement operation with respect to a positioning point positioned at an acute vertex. The second object image is determined when the second object image is determined to be present, and when the third determination process determines that the second object image exists. A fourth positioning process for determining a fourth display position of the second object image so that the second object image does not overlap the boundary line, and the second object image is the fourth display position. And a sixth display process for displaying the second object image so as to be positioned in the computer.

  According to the above configuration, even when the shape in the predetermined range is a shape having acute vertices, the object image can be appropriately displayed so as not to overlap the boundary line.

  (6) Preferably, the program described in this specification generates four divided regions around a positioning point by drawing two orthogonal virtual dividing lines with the positioning point as an intersection. The computer further executes a dividing process for executing the processing for each of the plurality of positioning points, and the second display process and the fourth display process are performed for the divided areas that do not include the boundary line among the four divided areas. A process of displaying an object image in an area is executed for each of a plurality of positioning points.

  According to the above configuration, it is possible to appropriately determine the display position of the object image.

  (7) Preferably, the program described in the present specification causes the detection unit of the information processing device to detect a projection area in which the indicator is projected on the display unit when the display unit is viewed from above. (3) causing the computer to further execute a detection process and a direction determination process for executing a process for determining a predetermined direction, which is a direction in which the projection area is located when the positioning point is used as a reference, for each of the plurality of positioning points; The second display process is characterized in that a process of displaying an object image on a predetermined direction side with respect to the positioning point is executed for each of the plurality of positioning points.

  According to the above configuration, the display position of the object image can be changed according to the arrival direction of the indicator. Thereby, the boundary line is not hidden by the indicator during the input of the operation for determining the shape of the boundary line. It is possible to accurately determine the predetermined range.

  (8) Preferably, the program described in the present specification is any one of a first mode in which the indicator is brought closer from the right side of the display unit and a second mode in which the pointer is brought closer from the left side of the display unit. In the second display process, when the first mode is selected, the object image is displayed on the right side when the positioning point is used as a reference, and the second display process When the mode is selected, the processing for displaying the object image on the left side with respect to the positioning point is executed for each of the plurality of positioning points.

  According to the above configuration, it is possible to change the display position of the object image depending on whether the user inputs an operation input to the right hand or the left hand. Thereby, the boundary line is not hidden by the indicator during the input of the operation for determining the shape of the boundary line. It is possible to accurately determine the predetermined range.

  (9) Preferably, the program described in the present specification is an object image whose distance from the selected object image is within a predetermined second predetermined distance and is an object image other than the selected object image. A fourth determination process for determining whether or not a third object image exists, and a second predetermined distance from the third object image when it is determined by the fourth determination process that the third object image exists. There is no selected object image and the third object image does not overlap the boundary line, a fifth positioning process for determining the fifth display position of the third object image, and the third object image is displayed in the fifth And causing the computer to further execute a seventh display process for displaying the third object image so as to be positioned at the position. That.

  According to the above configuration, when the selected object image is likely to overlap another object image due to movement, the other object image can be moved away from the selected object image. A moving operation is not erroneously input to another object image.

  (10) Preferably, the program described in the present specification is an object image whose distance from the selected object image is within a predetermined second predetermined distance and is an object image other than the selected object image. A fourth determination process for determining whether or not a third object image exists, and an eighth display for hiding the third object image when it is determined in the fourth determination process that the third object image exists. A ninth display process for re-displaying the third object image when the second designated position is detected by the second detection process after the third object image has been hidden by the eighth display process. Are further executed by a computer.

  According to the above configuration, when the selected object image is likely to overlap another object image due to movement, the other object image can be prevented from being displayed. A moving operation is not erroneously input to another object image.

  (11) Preferably, the program described in the present specification hides all object images other than the selected object image when the first designated position is detected by the first detection process. After all the other object images are hidden by the tenth display process and the tenth display process, when the second designated position is detected by the second detection process, all the other object images are re-displayed. An eleventh display process for displaying is further executed by a computer.

  According to the above configuration, it is possible to prevent other object images from being displayed during a period in which a movement operation is input to the selected object image. A moving operation is not erroneously input to another object image.

  (12) Preferably, in the program described in the present specification, each of the plurality of object images has a first area, a width narrower than the first area, and a first end and a second end. The first end is connected to the first region, and the second end is a position in the vicinity of the positioning point between the first region and the positioning point. The second region is not overlapped with the boundary line.

  According to the above configuration, the user can clearly recognize the positioning point corresponding to the object image.

  (13) An information processing apparatus described in the present specification is an information processing apparatus including a display unit and a touch panel, and is a closed boundary line indicating a predetermined range, and determines the predetermined range. A plurality of object images for receiving input of a moving operation for moving a plurality of positioning points; Second indicator means for displaying in the vicinity of each of the positioning points so as not to overlap the boundary line, and the indicator is in contact with or close to the display area of the selected object image selected by the user from among the plurality of object images In this case, a first detection means for causing the touch panel to detect a first indication position indicating a position where the indicator is in contact with or close to the indicator, and a first indication position detected by the first detection means. After that, the second detection means for causing the touch panel to detect a second designated position different from the first designated position, and the first display position of the selected positioning point, which is the positioning point corresponding to the selected object image, are First positioning means for determining in the vicinity of the second designated position detected by the detecting means; third display means for redisplaying the boundary line so that the selected positioning point is located at the first display position; This is the display position of the selected object image so that the selected object image does not overlap the boundary line, and the selected object image after movement is displayed in the vicinity of the selected positioning point redisplayed by the third display means. Second positioning means for determining the second display position; and fourth display means for redisplaying the selected object image so that the selected object image is positioned at the second display position. And wherein the door.

It is a block diagram of an information processor. It is a figure which shows the operation | movement flowchart of information processing apparatus. It is a figure which shows the operation | movement flowchart of information processing apparatus. It is a figure which shows the operation | movement flowchart of information processing apparatus. It is a figure which shows an example of a display screen. It is explanatory drawing of a prohibition area | region. It is a figure which shows an example of a display screen. It is explanatory drawing of the method of determining the display position of an object image. It is an enlarged view of an object image. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen.

  FIG. 1 shows a block diagram of an information processing apparatus 10 exemplified as the present embodiment. As illustrated in FIG. 1, the information processing apparatus 10 includes a CPU 11, a storage unit 12, a front camera 14, a wireless transmission / reception unit 15, a wireless antenna unit 16, a button input unit 17, a panel 18, a coordinate detection unit 19, a main camera 23, A contact strength sensor 22 is mainly provided. Examples of the information processing apparatus 10 include a smartphone, a tablet terminal, a mobile phone, and a PC.

  The front camera 14 is a camera disposed in front of the information processing apparatus 10. The main camera 23 is a camera disposed on the back surface of the information processing apparatus 10. The button input unit 17 receives an operation by the user of the information processing apparatus 10. An example of the button input unit 17 is a hardware key. The panel 18 displays various function information of the information processing apparatus 10. The coordinate detection unit 19 is a part that detects indication coordinates, which are coordinates indicating a position where an indicator (eg, a user's fingertip) contacts the display area of the panel 18. Moreover, the coordinate detection part 19 can detect the contact strength of a pointer. The coordinate detection unit 19 functions as the touch panel 20 by being configured integrally with the panel 18. The coordinate detection unit 19 can detect a plurality of designated coordinates at the same time. The wireless transmission / reception unit 15 performs wireless communication based on a cellular phone standard or a wireless LAN standard via the wireless antenna unit 16. The contact strength sensor 22 is a sensor used to measure the force (or pressure) of contact with the touch panel 20. The contact strength sensor 22 is disposed integrally with or close to the touch panel 20.

  The CPU 11 executes processing according to the program 21 in the storage unit 12. Hereinafter, the CPU 11 that executes a program such as the document creation application 31 or the operating system 21e may be simply described by a program name. For example, the description “operating system 21e” may mean “the CPU 11 executing the operating system 21e”.

  The storage unit 12 is configured by combining a RAM, a ROM, a flash memory, an HDD, a buffer included in the CPU 11, and the like. The storage unit 12 stores a program 21. The program 21 includes an operating system 21e, a document creation application 31, an image processing application 32, and a printing application 33.

  The operating system 21e is a program that provides a function for displaying various images on the panel 18 and a basic function commonly used by the document creation application 31 and the printing application 33. The operating system 21e is also a program that provides an API (abbreviation of application programming interface) for each application to instruct various hardware.

  The document creation application 31 is a program for creating various document files. The image processing application 32 is a program for executing various processes on the image. The print application 33 is a program for causing a printer (not shown) to perform printing using image data. Each application of the document creation application 31 to the printing application 33 can be used by being installed in the information processing apparatus 10 by a user or the like.

<Operation of information processing apparatus>
The operation of the information processing apparatus 10 according to the present embodiment will be described using the flowchart of FIG. When the user inputs an operation for starting the image processing application 32 via the button input unit 17, the CPU 11 reads the image processing application 32 and starts overall control of the information processing apparatus 10. Thereby, the flow of FIG. 2 is started. For example, the image processing application 32 may be activated in response to input of an operation for displaying a preview of an image captured by the main camera 23.

  In S80, the CPU 11 acquires processed image data to be processed. When the image processing application 32 is activated in response to the preview display of the image captured by the main camera 23, the processed image data may be image data of an image captured by the main camera 23. Alternatively, the processed image data may be image data selected by the user from among a plurality of image data stored in the storage unit 12.

  In S <b> 90, the CPU 11 displays a display screen on the touch panel 20. FIG. 5 shows an example of the display screen. The display screen includes display areas G1 and G2. The display area G1 is an area in which various statuses such as the remaining battery level are displayed. The display area G <b> 2 is an area where various images are displayed by the image processing application 32. In the example of FIG. 5, the processing image M1 and the button images B1 and B2 are displayed in the display area G2. The processed image M1 is an image displayed by the processed image data. The button image B1 is an image for receiving an input of a determination instruction. The button image B2 is an image for receiving an input of a cancel instruction.

  Further, the prohibited area R11 is set in the processed image M1. The prohibited area R11 is an area where display of object images O1 to O4 described later is prohibited. The prohibited region R11 will be described with reference to FIG. The prohibited area R11 is an area arranged along the frame line inside the frame line of the processed image M1. The prohibited area R11 is an area within the first predetermined distance T1 from the frame line of the processed image M1. The first predetermined distance T1 may be determined according to the size of the object image. For example, the first predetermined distance T1 may be a value larger than the maximum width of the object image. The prohibited area R11 may not be recognized by the user by being hidden. The prohibited area R11 may be displayed in the processed image M1 so that the user can recognize it by displaying it with a color, for example.

  In S100, the CPU 11 displays a range designation frame F1 in the processed image M1. The range designation frame F1 is a closed boundary line indicating a predetermined range. The range designation frame F1 is a polygon. In the explanation example of the present embodiment, a case where the range designation frame F1 is a rectangle will be described below. Positioning points N1 to N4 for determining a predetermined range are located at each vertex of the range designation frame F1.

  In S <b> 102, the CPU 11 determines whether a projection area is detected by the front camera 14. The projection area is an area where the indicator is projected onto the touch panel 20 when the touch panel 20 is viewed from above. In other words, the projection area is an area hidden by the indicator. In the explanation example of the present embodiment, as shown in FIG. 7, a case where a projection area A <b> 11 on which a user's hand is projected is detected on the left side of the touch panel 20 will be described.

  When a negative determination is made in S102 (S102: NO), the process proceeds to S106, and when an affirmative determination is made (S102: YES), the process proceeds to S104. In S104, the CPU 11 executes a process for determining the display direction of the object image. The display direction of the object image is a direction in which the object images O1 to O4 are displayed with respect to the positioning points N1 to N4. Specifically, a predetermined direction that is a direction in which the indicator approaches the touch panel 20 is determined based on the projection area detected in S102. Then, the display direction of the object image is determined to the predetermined direction side. In the example of the present embodiment, as shown in FIG. 7, the predetermined direction is “left direction”. Therefore, the display direction of the object image is determined as “left direction”.

  In S106, the CPU 11 displays the object images O1 to O4 in the processed image M1. The object image is an image for receiving an input of a moving operation for moving the plurality of positioning points N1 to N4. The object image is displayed in the vicinity of the corresponding positioning point so as not to overlap the boundary line of the range designation frame F1.

  Here, a specific method for determining the display position of the object image will be described with reference to FIG. Two perpendicular virtual dividing lines L1 and L2 having the positioning point N as an intersection are drawn. The dividing line L1 is a line parallel to the vertical contour line of the processed image M1. The dividing line L2 is a line parallel to the horizontal outline of the processed image M1. As a result, four divided regions R1 to R4 are generated around the positioning point N. Then, two or more selected divided regions that do not include the boundary line B are selected from the four divided regions R1 to R4. In the example of FIG. 8, the selected divided regions R1 and R3 are selected.

  Then, the object image is displayed in an area corresponding to the display direction of the object image determined in S104 among the two or more selected divided areas. In the example of FIG. 8, for example, when the display direction of the object image is “left direction”, the object image is displayed in the selected divided region R1 that is the region on the left side of the dividing line L1. On the other hand, when the display direction of the object image is “right direction”, the object image is displayed in the selected divided region R3 which is the region on the right side of the dividing line L1. If no projection area is detected in S102 (S102: NO), an object image is displayed in an area corresponding to a predetermined display direction (for example, “right direction”).

  In addition, when the positioning point N is a vertex of 90 degrees, the boundary line B overlaps the dividing lines L1 and L2. In this case, all of the four divided regions R1 to R4 are selected divided regions.

  In the explanation example of the present embodiment, object images O1 to O4 are displayed as shown in FIG. Each of the object images O1 to O4 corresponds to each of the positioning points N1 to N4.

  FIG. 9 shows an enlarged view of the object image O1. The object image O1 has a so-called balloon graphic shape. The object image O1 includes a first area A1 and a second area A2. The first area A1 is an area for receiving an input of an operation for moving the positioning point N1. The second area A2 is an area indicating that the first area A1 corresponds to the positioning point N1. The second area A2 has a narrower width than the first area A1. The first end E1 of the second area A2 is connected to the first area A1. The second end E2 of the second area A2 is located in the vicinity of the positioning point N1 and between the first area A1 and the positioning point N1. The second region A2 does not overlap with the boundary line B. The shape of the object images O2 to O4 is the same as that of the object image O1.

  In S110, the CPU 11 determines whether or not the first designated position P1 is detected in the display area G2 of the touch panel 20. The first indication position P1 is a position where the indicator contacts the display area G2. Examples of the indicator include a user's fingertip and a stylus pen. When a negative determination is made (S110: NO), the process returns to S110, and when an affirmative determination is made (S110: YES), the process proceeds to S120.

  In S120, the CPU 11 determines whether or not the detected first designated position P1 is within any display area of the object images O1 to O4. If a negative determination is made (S120: NO), the process proceeds to S125.

  In S125, the CPU 11 determines whether or not the detected first designated position P1 is within one of the display areas of the button images B1 and B2. When a negative determination is made (S125: NO), the process returns to S102, and when an affirmative determination is made (S125: YES), the process proceeds to S130.

  In S130, the CPU 11 executes a process associated with the selected button image. When the button image B1 is selected, the predetermined range in the range designation frame F1 is determined as the processing target range. Various image processes are performed on the image within the processing target range. The image processing may be, for example, processing for trimming an image within the processing target range. Further, when the image within the processing target range is a trapezoid, it may be a trapezoid correction process for correcting the image to a rectangle. When an object that should be rectangular, such as a document or a whiteboard, is photographed from an oblique direction, the photographed image may be distorted into a trapezoid. The trapezoidal correction process is a process that can return an image distorted to this trapezoid to the original rectangle. Alternatively, the image data may be generated by recognizing an image within the processing target range and recognizing the character. Then, the flow ends.

  Further, when the button image B2 is selected in S130, a cancel process is executed. In the cancel process, for example, the image processing application 32 may be terminated.

  On the other hand, when a positive determination is made in S120 (S120: YES), it is determined that any one of the object images O1 to O4 is selected as the selected object image, and the process proceeds to S140.

(Display processing while moving the object image)
In S140 to S180, the object image moving display process will be described. The moving display process is a process executed during a period in which the selected object image touched with the indicator is moved by a drag operation.

  In S140, the CPU 11 determines whether an operation for moving the selected object image has been input. Specifically, it is determined whether the movement of the first designated position is detected. For example, when the indicator moves on the surface of the touch panel 20 while maintaining the state in which the indicator is in contact with the selected object image, an affirmative determination is made in S140. When a negative determination is made (S140: NO), the process proceeds to S190, and when an affirmative determination is made (S140: YES), the process proceeds to S150.

  In the explanation example of this embodiment, as shown in FIG. 10, a case where the object image O1 is a selected object image will be described. In this example, the case where the first designated position P1 is detected in the object image O1 and moved to the first designated position P1a will be described (see arrow Y11). In this case, a positive determination is made in S140.

  In S150, the CPU 11 moves the display position of the selected object image to the first designated position after the movement. In the example of the present embodiment, as shown in FIG. 11, the selected object image O1 moves to the first designated position P1a after movement.

  In S155, the CPU 11 determines the position after the movement of the selected positioning point. The selected positioning point is a positioning point corresponding to the selected object image. Specifically, the display position of the selected positioning point N1 is determined in the vicinity of the first designated position P1a after the movement. In the example of this embodiment, as shown in FIG. 11, the selected positioning point N1a after the movement is determined in the vicinity of the first designated position P1a after the movement.

  In S160, the CPU 11 redisplays the boundary line B in accordance with the moved positioning point. As a result, the shape of the range specification frame F1 changes from the shape of FIG. 10 to the shape of FIG.

  In S <b> 170, the CPU 11 determines whether there is a moving target object image whose distance from the selected object image is within a predetermined second predetermined distance T <b> 2. When a negative determination is made (S170: NO), the process proceeds to S190, and when an affirmative determination is made (S170: YES), the process proceeds to S175. In the explanation example of the present embodiment, as shown in FIG. 11, the case where the distance K1 between the selected object image O1 and the object image O2 is within the second predetermined distance T2 will be described. Therefore, it is determined that the object image O2 is a movement target object image.

  In S175, the CPU 11 determines the position after the movement of the movement target object image. Specifically, the selected object image does not exist within the range of the second predetermined distance T2 from the movement target object image, and the movement target object image is moved so that the movement target object image does not overlap the boundary line. Determine the position. In S180, the CPU 11 moves the movement target object image to the display position determined in S175.

  In the example of the present embodiment, the display position of the movement target object image O2 moves from the position shown in FIG. 11 to the position shown in FIG.

(Display processing after completion of movement of object image)
In S190 to S270, a display process executed after the movement of the selected object image is completed will be described. In S190, the CPU 11 determines whether or not the first designated position detected in S110 is no longer detected. If a negative determination is made (S190: NO), the process returns to S140. If an affirmative determination is made (S190: YES), the process proceeds to S200.

  In S200, the CPU 11 determines the second designated position. The second designated position is a position indicating the position after the selected object image is moved. For example, when the indicator moves on the surface of the touch panel 20 while maintaining the state in contact with the selected object image, and then the indicator moves away from the surface of the touch panel 20, the separation position is determined as the second indication position. Is done. That is, the second designated position is determined by a so-called drag operation.

  In the description example of the present embodiment, a case will be described in which the object image O1 is a selected object image as shown in FIG. In this explanation example, a case will be described in which the first designated position P1 is detected in the object image O1, and then the second designated position P2 is determined.

  In S205, the CPU 11 virtually determines the display position of the selected object image as the second designated position P2. “Virtually determining the display position” means that the selected object image is not actually displayed at the second designated position P2. That is, in the internal processing of the CPU 11, the subsequent processing is executed assuming that the selected object image is displayed at the second designated position P2. In the example of the present embodiment, as shown in FIG. 13, the position of the selected object image O1 is virtually determined at the second designated position P2.

  In S210, the CPU 11 determines the position after the movement of the selected positioning point. The selected positioning point is a positioning point corresponding to the selected object image. Specifically, the display position of the selected positioning point is determined in the vicinity of the second designated position determined in S200. In the example of this embodiment, as shown in FIG. 13, the selected positioning point N1b after the movement is determined in the vicinity of the second designated position P2. In S215, the CPU 11 redisplays the boundary line B according to the positioning point after the movement. As a result, the shape of the range designation frame F1 changes from the shape of FIG. 13 to the shape of FIG.

  In S220, the CPU 11 determines whether or not at least a part of the selected object image whose display position is virtually determined in S205 overlaps the prohibited area R11. If a negative determination is made, the process proceeds to S222. In S222, the CPU 11 determines the display position of the selected object image virtually determined in S205 as the actual display position. Then, the process proceeds to S230.

  On the other hand, when a positive determination is made in S220 (S220: YES), the process proceeds to S225. In S225, the CPU 11 changes the display position of the selected object image from the position virtually determined in S205. At this time, the display position of the selected object image is determined so that the entire area of the selected object image does not overlap the prohibited area R11. Then, the process proceeds to S230. In S230, the CPU 11 displays the selected object image at the display position determined in S222 or S225.

  In the explanation example of the present embodiment, as shown in FIG. 14, a part of the selected object image O1 whose display position is virtually determined overlaps the prohibited area R11 (S220: YES). Accordingly, in S225, the display position of the selected object image is determined so that the entire area of the selected object image O1 does not overlap the prohibited area R11. In S230, the selected object image O1 is displayed as shown in FIG.

  In S240 to S250, processing for moving the duplicate object image is performed. In S240, the CPU 11 determines whether or not a duplicate object image exists among the object images O1 to O4. An overlapping object image is an object image that partially overlaps another object image or boundary line. When a negative determination is made (S240: NO), the process proceeds to S260, and when an affirmative determination is made (S240: YES), the process proceeds to S245.

  In S245, the CPU 11 changes the display position of the overlapping object image. The display position after the overlapping object image is changed is determined so that the overlapping object image is located outside the range of the prohibited region R11 and does not overlap the boundary line B. In S250, the CPU 11 displays the overlapping object image at the display position determined in S245.

  In the explanation example of the present embodiment, as shown by the arrow Y1 in FIG. 17, a processing example in the case where the positioning point N1 has moved to the positioning point N1c will be described. In this case, in S240, it is determined that there is an overlapping object image O2 that overlaps the boundary line B (S240: YES). Accordingly, in S245, the display position of the overlapping object image O2 is changed to a position that does not overlap the boundary line B. Then, the display position of the overlapping object image O2 is changed from the position of FIG. 16 to the position of FIG.

  In S260 to S270, a process of moving the acute angle object image is performed. In S260, the CPU 11 determines whether or not an acute angle object image exists among the object images O1 to O4. The acute angle object image is an object image displayed within the range of the range designation frame F1. In addition, it is an object image for receiving an input of a movement operation for a positioning point located at an acute vertex. If a negative determination is made (S260: NO), the process returns to S102, and if an affirmative determination is made (S260: YES), the process proceeds to S265.

  In S265, the CPU 11 changes the display position of the acute angle object image. The display position after the change of the acute angle object image is determined such that the acute angle object image is located outside the range designation frame F1 and does not overlap the boundary line B. In S270, the CPU 11 displays the acute angle object image at the display position determined in S265.

  In the explanation example of the present embodiment, as shown by the arrow Y2 in FIG. 18, a processing example in the case where the positioning point N1 has moved to the positioning point N1c will be described. In this case, in S260, it is determined that the acute angle object image O2 exists (S260: YES). Therefore, in S265, the display position of the acute angle object image O2 is changed to a position that does not overlap the boundary line B. Then, the display position of the overlapping object image O2 is changed from the position in FIG. 18 to the position in FIG.

<Effect>
As shown in FIG. 7, a plurality of object images O1 to O4 can be displayed so as not to overlap a plurality of positioning points N1 to N4 and a boundary line B that constitutes the range designation frame F1. As a result, even when the selected object image is touched with an indicator to move the selected positioning point, the selected positioning point itself or the boundary line B connected to the selected positioning point is hidden by the indicator. There is nothing. It becomes possible to accurately determine the shape of the range designation frame F1.

  For example, as shown in FIG. 14, it is assumed that the object image O1 is located in the immediate vicinity of the left frame line of the processed image M1. In this case, since the object image O1 cannot move to the left side beyond the frame line, the positioning point N1 cannot be moved further to the left side. That is, the positioning point N1 cannot be moved to the left side border line of the processed image M1. According to the technique of the present specification, as shown in FIG. 15, the object image can be displayed so that at least a part of the object image does not overlap the prohibited region R11 (S225, S230). As a result, the object image is not displayed near the frame line of the processed image M1. Therefore, the movement of the object image is not limited by the frame line of the processed image M1. As described above, the positioning points N1 to N4 can be moved to the frame line of the processed image M1.

  For example, as shown by an arrow Y1 in FIG. 16, when the range designation frame F1 is deformed, an overlapping object image O2 that overlaps the boundary line B may occur. In this case, the boundary line B is always hidden by the indicator when trying to select the overlapping object image O2. As a result, the operation input performance is degraded. According to the technique of this specification, when the overlapping object image O2 occurs (S240: YES), the display position of the overlapping object image O2 is changed to a position that does not overlap the boundary line B as shown in FIG. (S245, S250). Thereby, it becomes possible to prevent the operation input property of the overlapping object image O2 from being deteriorated.

  For example, as shown by the arrow Y2 in FIG. 18, when the range designation frame F1 is deformed, the acute angle object image O2 is generated in the region where the boundary line B forms an acute angle with the positioning point N2 as the vertex. There is a case. When the boundary line B forms an acute angle, the distance between the acute angle object image O2 and the boundary line B becomes shorter than when the boundary line B forms an obtuse angle. Therefore, when the acute angle object image O2 is touched, the boundary line B near the acute angle object image O2 is likely to be hidden by the indicator. The operation input property of the acute angle object image O2 is deteriorated. According to the technique of the present specification, when the acute angle object image O2 is generated (S260: YES), the display position of the acute angle object image O2 is sandwiched between the acute boundary lines B as shown in FIG. The area can be changed outside the area (S265, S270). Thereby, it becomes possible to prevent the operation input property of the acute angle object image O2 from being deteriorated.

  As shown in FIG. 8, four divided areas R1 to R4 are formed around the positioning point N, and an object image can be displayed in the area of the divided area not including the boundary line B (S106). As a result, the object image can be displayed at an appropriate position that does not overlap the boundary line B.

  By detecting the projection area, it is possible to determine a predetermined direction indicating from which of the up, down, left and right directions of the touch panel 20 the indicator has come (S102). Then, the object image can be displayed on the predetermined direction side with the positioning point as a reference (S106). As a result, even when the selected object image is touched with an indicator to move the selected positioning point, the selected positioning point itself or the boundary line B connected to the selected positioning point is hidden by the indicator. There is nothing. In S102, the predetermined direction is detected every time. Therefore, even when the direction in which the indicator is brought close to the touch panel is frequently changed, such as when the user changes the hand holding the information processing apparatus 10, the selected positioning point and the boundary line B are not hidden by the indicator. It becomes possible.

  When the selected object image is likely to overlap another object image due to movement (S170: YES), the other object image can be moved away from the selected object image (S175, S180). This prevents other object images from being touched by mistake.

  As shown in FIG. 9, the object image can have a so-called balloon graphic shape. Accordingly, even when the object image is displayed so as not to overlap with the boundary line or the positioning point, the user can clearly recognize the positioning point corresponding to the object image.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. The modifications of the above embodiment are listed below.

<First Modification>
The method of determining the display direction of the object image is not limited to the method of detecting the projection area in S102, and various methods can be used. For example, the selection by the user as to which of the first mode in which the indicator is brought closer from the right side of the touch panel 20 and the second mode in which the pointer is brought closer from the left side of the display unit may be accepted. Then, setting information indicating the selection result may be stored in the storage unit 12. The CPU 11 may execute the process of determining the display direction of the object image (S104) without detecting the projection area in S102. In the process of S104, when the setting information indicates that the first mode is selected, the “right direction” with respect to the positioning point is determined as the display direction of the object image. On the other hand, when the setting information indicates that the second mode is selected, the “left direction” with respect to the positioning point is determined as the display direction of the object image.

  As a result, the display position of the object image can be appropriately set according to whether the user's operation input is the right hand or the left hand. Therefore, the selected positioning point itself and the boundary line B connected to the selected positioning point are not hidden by the indicator.

<Second Modification>
When it is determined that the movement target object image exists (S170: YES), the movement target object image may be hidden. Then, when the second designated position is detected after the movement target object image is not displayed (S200), the movement target object image may be displayed again. Thereby, when the selected object image is likely to overlap another object image due to movement, the other object image can be prevented from being displayed. Therefore, no other object image is touched by mistake.

<Third Modification>
When the first designated position P1 is detected within the display range of the selected object image (S120: YES), all other object images other than the selected object image may be hidden. In this case, it is not necessary to execute the processes of S170 to S180 in FIG. Then, when the second designated position is detected after all the other object images are hidden (S200), all the other object images may be redisplayed. Accordingly, it is possible to prevent other object images from being displayed during a period in which a movement operation is input to the selected object image. Therefore, no other object image is touched by mistake.

<Fourth Modification>
For example, as shown in FIG. 14, in the case where the object image O1 is located in the immediate vicinity of the left frame line of the processed image M1, it is assumed that the object image O1 is moved further to the left beyond the frame line. . In this case, the object image O1 may be moved to the left beyond the frame line by scrolling the processed image M1. An example of scroll display will be described with reference to FIG. A display frame C1 is displayed in the display area G2. The object image O1 is moved to the left beyond the left frame line of the processed image M1, as indicated by an arrow Y21. At this time, scroll display is performed so that the processed image M1 moves to the right side of the display frame C1 by the distance moved beyond the frame line. In addition, the area | region which protruded from the display frame C1 among the process images M1 is not displayed in the display area G2. The moved object image O1a is displayed in the newly displayed blank area R21 by scroll display. Thereby, the movement of the object image is not limited by the frame line of the processed image M1. As described above, the positioning point can be moved to the frame line of the processed image M1.

<Fifth Modification>
The contact strength sensor 22 may monitor the contact strength from when the indicator starts touching the touch panel 20 until it ends. Then, the position of the indicator at the time when the output value of the contact strength exceeds a predetermined threshold value may be determined as the second indication position. In this case, the selected object image can be moved by inputting a drag operation to the selected object image. And the position after the movement of a selection object image can be determined by raising contact force so that a selection object image may be pushed in strongly.

  The contact strength sensor 22 may monitor the contact strength from when the indicator starts touching the touch panel 20 until it ends. Then, the position of the indicator at the time when the output value of the contact strength exceeds a predetermined threshold value may be determined as the second indication position. In this case, the selected object image can be moved by inputting a drag operation to the selected object image. And the position after the movement of a selection object image can be determined by raising contact force so that a selection object image may be pushed in strongly.

<Other variations>
Various methods may be used for setting the prohibited region R11. For example, a region within the first predetermined distance T1 from the frame line of the touch panel 20 may be set as the prohibited region R11.

  Although the case where the range designation frame F1 is a rectangle has been described, the present invention is not limited to this form. It may be a J square (J is a natural number of 3 or more). In this case, J positioning points and object images are displayed in the processed image M1. Further, the shape of the range designation frame F1 is not limited to a polygon, and may be a shape provided with a curve at least partially. For example, it may be circular or elliptical.

  The display position of the positioning point is not limited to each vertex of the range designation frame F1. Even if displayed on the boundary line, the technique of the present invention can be applied.

  In S102, the method of detecting the projection area may be various modes. For example, the pixel of the panel 18 may function as a light receiving element. Thereby, the panel 18 also functions as a light receiving unit. Therefore, the projection area can be detected by the panel 18. For example, the coordinate detection unit 19 may be a high-sensitivity capacitive sensor. Thereby, the projection area can be detected by the coordinate detection unit 19.

  The first designated position P1 and the second designated position P2 may be detected not only when the indicator is in contact with the surface of the touch panel 20, but also when the indicator is close.

  The display modes of the display screens shown in FIGS. 5 to 19 are examples, and other display modes can also be used.

  The technical elements described in this specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  The panel 18 is an example of a display unit. The CPU 11 is an example of a computer. The image processing application 32 is an example of a program. The CPU 11 that executes S100 is an example of a first display process. The CPU 11 that executes S106 is an example of a second display process. The CPU 11 that executes S120 is an example of a first detection process. The CPU 11 that executes S200 is an example of a second detection process. The CPU 11 that executes S210 is an example of a first positioning process. The CPU 11 that executes S215 is an example of a third display process. The CPU 11 that executes S222 and S225 is an example of a second positioning process. The CPU 11 that executes S230 is an example of a fourth display process. The prohibited area R11 is an example of a specific area. The CPU 11 that executes S220 is an example of a first determination process. The CPU 11 that executes S240 is an example of a second determination process. The CPU 11 that executes S245 is an example of a third positioning process. The CPU 11 that executes S250 is an example of a fifth display process. The acute angle object image is an example of a second object image. The CPU 11 that executes S265 is an example of a fourth positioning process. The CPU 11 that executes S270 is an example of a sixth display process. The front camera 14 is an example of a detection unit. The CPU 11 that executes S102 is an example of a third detection process. The CPU 11 that executes S104 is an example of a direction determination process. The movement target object image is an example of a third object image. The CPU 11 that executes S170 is an example of a fourth determination process. The CPU 11 that executes S175 is an example of a fifth positioning process. The CPU 11 that executes S180 is an example of a seventh display process. The CPU 11 that executes S170 is an example of a fourth determination process.

  Each program may be composed of a single program module, or may be composed of a plurality of program modules. In addition, each example may have another replaceable configuration and is within the scope of the present invention. It may be a computer (CPU 11 or the like) that executes processing based on an application program (such as the document creation application 31), a computer that executes processing based on a program other than an application program such as an operating system, A hardware configuration (panel 18 or the like) that operates according to instructions from the computer may be used, or a configuration in which the computer and the hardware configuration are linked. Of course, it may be a computer that executes processes by linking processes based on a plurality of programs, or may have a hardware configuration that operates according to instructions from a computer that executes processes by linking processes based on a plurality of programs. Good.

  10: Information processing device, 11: CPU, 12: Storage unit, 18: Panel, 19: Coordinate detection unit, 20: Touch panel, 21e: Operating system, 32: Image processing application, N1 to N4: Positioning points, O1 to O4 : Object image

Claims (13)

A display unit;
A touch panel;
A computer readable program of an information processing apparatus comprising:
In the computer,
A first display process for displaying on the display section the boundary line, which is a closed boundary line indicating a predetermined range, and a plurality of positioning points for determining the predetermined range are located on the line;
A second display process for displaying a plurality of object images for receiving an input of a movement operation for moving the plurality of positioning points in the vicinity of each of the plurality of positioning points so as not to overlap the boundary line;
When the indicator contacts or approaches the display area of the selected object image selected by the user from among the plurality of object images, the first indicating position indicating the position where the indicator contacts or approaches A first detection process to be detected by the touch panel;
A second detection process for causing the touch panel to detect a second designated position different from the first designated position after the first designated position is detected by the first detection process;
A first positioning process for determining a first display position of a selected positioning point, which is a positioning point corresponding to the selected object image, in the vicinity of the second designated position detected by the second detection process;
A third display process for redisplaying the boundary line so that the selected positioning point is located at the first display position;
The selected object image after movement does not overlap the boundary line, and the selected object image after movement is displayed in the vicinity of the selected positioning point redisplayed in the third display process. A second positioning process for determining a second display position which is a display position of the selected object image;
A fourth display process for redisplaying the selected object image so that the selected object image is positioned at the second display position;
A program characterized by having executed. The selected object image in the specific area that is arranged along the frame line inside the border line of the display area of the boundary line and that is within a first predetermined distance from the frame line. Further causing the computer to execute a first determination process for determining whether or not at least a part of the
In the second positioning process, when it is determined in the first determination process that at least a part of the selected object image overlaps the specific area, the entire area of the selected object image is not included in the specific area. The program according to claim 1, wherein the second display position is determined. Whether or not there is a first object image that is displayed within the predetermined range and that is an object image that partially overlaps with another object image or the boundary line A second determination process for determining
When it is determined in the second determination process that the first object image exists, the first object image is located outside the predetermined range, and the first object image is the boundary line. A third positioning process for determining a third display position of the first object image so as not to overlap with
A fifth display process for displaying the first object image such that the first object image is positioned at the third display position;
The program according to claim 1, further causing the computer to execute. The predetermined range is a polygon;
The program according to any one of claims 1 to 3, wherein the plurality of positioning points are each vertex of the polygon. Whether or not there is a second object image that is the object image displayed within the predetermined range and that is an object image that receives an input of the moving operation with respect to the positioning point located at the acute vertex. A third determination process for determining whether or not
When it is determined in the third determination process that the second object image exists, the second object image is located outside the predetermined range, and the second object image is the boundary line. A fourth positioning process for determining a fourth display position of the second object image so as not to overlap with
A sixth display process for displaying the second object image such that the second object image is positioned at the fourth display position;
The program according to claim 4, further causing the computer to execute. Division processing for generating four division regions around the positioning points by drawing two orthogonal virtual division lines with the positioning points as intersections for each of the plurality of positioning points Is further executed by the computer,
In the second display process and the fourth display process, a process of displaying the object image in an area of the divided area that does not include the boundary line among the four divided areas is performed on the plurality of positioning points. The program according to claim 1, wherein the program is executed for each. A third detection process for causing the detection unit of the information processing device to detect a projection area in which the indicator is projected onto the display unit when the display unit is viewed from above;
A direction determining process for executing a process for determining a predetermined direction, which is a direction in which the projection area is positioned when the positioning point is used as a reference, for each of the plurality of positioning points;
Further executing on the computer,
7. The second display process, wherein the process of displaying the object image on the predetermined direction side with respect to the positioning point is executed for each of the plurality of positioning points. The program according to any one of the above. Accepting processing for accepting selection by a user of either the first mode in which the indicator is brought closer from the right side of the display unit or the second mode in which the pointer is brought closer from the left side of the display unit Let it run
The second display process displays the object image on the right when the first mode is selected, and the second mode is displayed when the second mode is selected. The program according to any one of claims 1 to 6, wherein a process of displaying the object image on the left side with respect to a positioning point is executed for each of the plurality of positioning points. A determination is made as to whether or not there is a third object image that is an object image whose distance from the selected object image is within a predetermined second predetermined distance and is an object image other than the selected object image. 4 judgment processing,
When it is determined in the fourth determination process that the third object image exists, the selected object image does not exist within the second predetermined distance from the third object image, and the third object A fifth positioning process for determining a fifth display position of the third object image so that the image does not overlap the boundary line;
A seventh display process for displaying the third object image such that the third object image is located at the fifth display position;
The program according to claim 1, further causing the computer to execute. A determination is made as to whether or not there is a third object image that is an object image whose distance from the selected object image is within a predetermined second predetermined distance and is an object image other than the selected object image. 4 judgment processing,
An eighth display process for hiding the third object image when it is determined in the fourth determination process that the third object image exists;
Ninth display for redisplaying the third object image when the second designated position is detected by the second detection process after the third object image has been hidden by the eighth display process Processing,
The program according to claim 1, further causing the computer to execute. A tenth display process for hiding all other object images other than the selected object image when the first designated position is detected by the first detection process;
When all the other object images are hidden by the tenth display process and then the second designated position is detected by the second detection process, all the other object images are redisplayed. Eleventh display processing to
The program according to claim 1, further causing the computer to execute. Each of the plurality of object images includes a first region and a second region having a narrower width than the first region and having a first end and a second end.
The first end is connected to the first region;
The second end portion is located near the positioning point and is located between the first region and the positioning point,
The program according to claim 1, wherein the second area does not overlap the boundary line. A display unit;
A touch panel;
An information processing apparatus comprising:
First display means for displaying on the display section the boundary line, which is a closed boundary line indicating a predetermined range, and a plurality of positioning points for determining the predetermined range are located on the line;
Second display means for displaying a plurality of object images for receiving an input of a movement operation for moving the plurality of positioning points in the vicinity of each of the plurality of positioning points so as not to overlap the boundary line;
When the indicator contacts or approaches the display area of the selected object image selected by the user from among the plurality of object images, the first indicating position indicating the position where the indicator contacts or approaches First detection means for causing the touch panel to detect;
Second detection means for causing the touch panel to detect a second designated position different from the first designated position after the first designated position is detected by the first detecting means;
First positioning means for determining a first display position of a selected positioning point, which is a positioning point corresponding to the selected object image, in the vicinity of the second designated position detected by the second detecting means;
Third display means for redisplaying the boundary line so that the selected positioning point is located at the first display position;
The selected object image after moving does not overlap the boundary line, and the selected object image after moving is displayed in the vicinity of the selected positioning point redisplayed by the third display means. Second positioning means for determining a second display position which is a display position of the selected object image;
Fourth display means for redisplaying the selected object image so that the selected object image is positioned at the second display position;
An information processing apparatus comprising:

Images