JP2014154055A - Image processor and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable scroll of an object even in an oblique direction while correcting a deviation of a user's operation in a vertical and horizontal directions.SOLUTION: A scroll direction control part 126 for specifying an operation angle operated by the user, determining a horizontal direction or a vertical direction as a scroll direction in the case that the specified operation angle is included in any of a plurality of correction object ranges, and determining an oblique direction as a scroll direction in the case that the specified operation angle is not included in any of the plurality of correction object ranges, and a display content update part 127 for scrolling an object displayed in a display part 130 in the determined scroll direction are provided.

Description

  The present invention relates to an image processing apparatus and an image processing method.

  Smartphones and tablets equipped with touch panels have begun to spread, and there are increasing opportunities for users to operate objects displayed on the screen using their fingertips. In addition to touch panels, a touch pad that does not display a screen on an operation unit is also installed in a notebook computer or the like as an operation device that uses a fingertip.

  Nowadays, with the progress of digitization in the broadcasting field, a system with a very large number of channels has been realized, and the number of channels displayed in the electronic program guide has also increased. For this reason, the size of the electronic program guide is increasing.

  Since the screen size of the display unit is limited, when the size of the electronic program guide increases, only a part of the electronic program guide can be displayed. For this reason, when searching for a program that is not displayed on the screen, the user needs to repeat the operation of scrolling the screen in order to display the desired program on the screen.

  In the operation using the fingertip, there is a method of changing the amount of movement of the object depending on the type of operation in order to reduce the number of operations when scrolling the object displayed on the screen. For example, when the user touches the surface of the touch panel without releasing his finger (hereinafter referred to as a drag operation), the object moves by the same amount as the finger. Further, when the surface of the touch panel is quickly touched with a finger (hereinafter referred to as a flick operation), the object is moved more than the actual finger movement amount. As described above, many devices are equipped with user interfaces that change the amount of movement of an object depending on the type of operation.

However, when observing the movement of the user's finger while performing a flick operation, the user's movement of the finger is not vertical or horizontal even though the user tries to move the object on the screen vertically or horizontally. There are many cases that move diagonally. That is, there are rare users who can move their fingers in the vertical or horizontal direction without any difference.
To solve this problem, there is a method of correcting vertically or horizontally even when the user's finger is moving diagonally, as in Patent Document 1. In many cases, user interfaces mounted on smartphones and tablets are designed so that an object moves only in the vertical or horizontal direction.

JP2011-70554A (paragraph 0008)

  However, if the user wants to move the object diagonally, the correction method disclosed in Patent Document 1 requires the user to perform a moving operation in the vertical direction and a moving operation in the horizontal direction separately. The same applies when the object is designed to move only in the vertical and horizontal directions.

  Therefore, an object of the present invention is to enable an object to be scrolled in an oblique direction while correcting a deviation in a user operation in the vertical and horizontal directions.

  An image processing apparatus according to an aspect of the present invention stores correction information indicating a plurality of correction target ranges, which are predetermined angle ranges, and moves the finger while the user touches the touch unit. A storage unit for storing a plurality of user operation information including information indicating coordinates corresponding to a position where the finger is in contact, which is detected at a predetermined time interval, and stored in the storage unit The angle of a straight line specified by a plurality of coordinates indicated by a plurality of user operation information with respect to one coordinate axis in a predetermined coordinate system is specified as an operation angle at which the user has performed an operation, and the specified operation When the angle is included in any of a plurality of correction target ranges indicated by the correction information stored in the storage unit, the horizontal direction or vertical direction in the predetermined coordinate system is scanned. The predetermined coordinate system when the specified operation angle is not included in any of the plurality of correction target ranges indicated by the correction information stored in the storage unit. A scroll direction control unit that determines the oblique direction as a scroll direction, and a display content update unit that scrolls the object displayed on the display unit in the scroll direction determined by the scroll direction control unit. And

  In the image processing method according to one aspect of the present invention, when the user moves the finger while the finger is in contact with the touch unit, the finger is detected that is detected at a predetermined time interval. A storage process for storing a plurality of user operation information including information indicating coordinates corresponding to positions, and a straight line specified by a plurality of coordinates indicated by the plurality of user operation information stored in the storage process. The angle with respect to one coordinate axis in the coordinate system is specified as an operation angle at which the user has performed an operation, and the specified operation angle is indicated by correction information indicating a plurality of correction target ranges that are predetermined angle ranges. The horizontal direction or the vertical direction in the predetermined coordinate system is determined as the scroll direction when included in any of the plurality of correction target ranges, and the specified operation angle A scroll direction control process for determining an oblique direction of the predetermined coordinate system as a scroll direction when not included in any of the plurality of correction target ranges indicated by the correction information stored in the storage unit; And a display content update process for scrolling the object displayed on the display unit in the scroll direction determined in the scroll direction control process.

  According to one aspect of the present invention, an object can be scrolled in an oblique direction while correcting a shift in a user's operation in the vertical and horizontal directions.

1 is a block diagram schematically showing a configuration of an image processing apparatus according to Embodiments 1 and 2. FIG. In Embodiment 1, it is the schematic for demonstrating a coordinate when a user performs a flick operation. In Embodiment 1, it is the schematic which shows an example when a user performs flick operation to the perpendicular | vertical downward direction. 6 is a schematic diagram illustrating a correction target range in the first embodiment. FIG. 4 is a flowchart schematically showing processing when a user performs a flick operation in the first embodiment. 6 is a schematic diagram illustrating an image processing apparatus according to a modification example in Embodiment 1. FIG. 9 is a flowchart schematically showing processing when a user performs a flick operation in the second embodiment. FIG. 10 is a block diagram schematically showing a configuration of an image processing apparatus according to a third embodiment.

Embodiment 1 FIG.
FIG. 1 is a block diagram schematically showing the configuration of the image processing apparatus 120 according to the first embodiment. An image processing system 100 illustrated in FIG. 1 includes an input device 110 and an image processing device 120 according to the first embodiment. The reference numerals in parentheses in FIG. 1 are the configurations in the second embodiment.

The input device 110 includes a user operation reception unit 111 and a transmission unit 112.
The user operation reception unit 111 includes a touch unit (see FIG. 2) that receives an input of a touch operation by the user. When the user moves the finger while the finger is in contact with the touch unit, the user touches the finger. The detected position is detected at a predetermined time interval, and user operation information including information indicating coordinates corresponding to the detected position is generated. For example, the user operation reception unit 111 includes information indicating the state of the user's finger (contact or non-contact) and information indicating the coordinates of the position touched by the finger on the touch unit if the state of the user's finger is contact. Are acquired at regular intervals, and user operation information including the acquired information is generated. Then, the user operation reception unit 111 gives the generated user operation information to the transmission unit 112.
The transmission unit 112 transmits the user operation information given from the user operation reception unit 111 to the image processing apparatus 120. The transmission unit 112 desirably transmits wirelessly using infrared rays or radio waves having a predetermined frequency. Further, it is desirable that the transmission unit 112 transmits user operation information according to, for example, a detection time series so that the detection order of the detected coordinates can be understood.

  The image processing apparatus 120 includes a display data generation unit 121, a reception unit 122, a storage unit 123, a display control unit 124, a video memory 128, a drawing unit 129, and a display unit 130.

  The display data generation unit 121 generates display data for the entire image of the object displayed on the screen of the display unit 130. For example, if the object is an electronic program guide, the display data generation unit 121 generates display data of the electronic program guide from the broadcast date, broadcast station, and program information. The display data includes material data stored in the storage unit 123 and a display definition for drawing the material data. For example, the material data is data indicating an image to be drawn, and includes font data and icon data. The display definition includes position information indicating a location to be displayed on the display unit 130, a display magnification, and the like in the entire image generated by the display data generation unit 121. The display data generation unit 121 stores the generated display data in the video memory 128. When the overall image of the object is larger than the displayable area of the display unit 130, a part of the overall image is displayed on the display unit 130.

  The receiving unit 122 receives user operation information from the input device 110. Then, the reception unit 122 gives the received user operation information to the storage unit 123.

  The storage unit 123 includes determination information indicating conditions for determining the content of the user operation, user operation information received from the reception unit 122, and correction information indicating a plurality of correction target ranges that are predetermined angle ranges. Remember. The correction target range indicates a range of angles for correcting the scroll direction in the vertical or horizontal direction. Note that the storage unit 123 stores the user operation information received from the reception unit 122 a plurality of times according to a time series so that the coordinate detection order can be understood, for example.

  The display control unit 124 determines the user operation content from the user operation information stored in the storage unit 123, determines the scroll direction when the content is a flick operation, and is displayed on the display unit 130. Scrolls an object The display control unit 124 includes an operation content determination unit 125, a scroll direction control unit 126, and a display content update unit 127.

  The operation content determination unit 125 determines the content of the user operation from the user operation information stored in the storage unit 123. Then, the operation content determination unit 125 gives the determination result of the user operation to the scroll direction control unit 126. For example, the operation content determination unit 125 makes the finger state non-contact within a certain time (predetermined threshold time) after the finger state becomes contact, and the finger movement amount during that time is a certain amount. If it is smaller than (predetermined first threshold amount), the user operation is determined as a touch operation. In addition, the operation content determination unit 125 determines that the user's state is “contact” for a certain period of time, and the finger movement amount is greater than a certain amount (a predetermined second threshold amount). The operation is determined as a drag operation. Further, the operation content determination unit 125 determines that the finger movement amount immediately before the finger state becomes non-contact after the finger state becomes non-contact and the finger state becomes non-contact is a fixed amount (predetermined third threshold amount). If the value is greater than (), the user operation is determined as a flick operation. Note that the finger movement amount is calculated from coordinates indicated by a plurality of user operation information stored in the storage unit 123. Here, the movement amount of the finger immediately before the finger state becomes non-contact is detected by a predetermined number of detection times from the coordinates detected last in the contact state before the finger state becomes non-contact. This is the sum of the distances between the coordinates up to the given coordinates.

  When the content of the user operation determined by the operation content determination unit 125 is a flick operation, the scroll direction control unit 126 determines the angle of the user's finger movement (hereinafter referred to as the operation angle) from the user operation information held in the storage unit 123. Calculated). For example, the scroll direction control unit 126 determines the angle of a straight line specified by a plurality of coordinates indicated by a plurality of user operation information stored in the storage unit 123 with respect to one coordinate axis in a predetermined coordinate system. Is specified as the operation angle at which the operation was performed.

  The calculation method is, for example, as follows: P1 (x1, y1) is a coordinate immediately before the time when the finger is in a non-contact state, and P2 (x2, y2) is a coordinate immediately before the coordinate P1. Based on these coordinates, an operation angle is calculated.

  For example, the surface of the touch unit that is touched by the user's finger of the user operation reception unit 111 is a rectangle. At this time, a straight line parallel to the rectangular short side of the surface of P2 that passes through P2 and touches the user's finger of the user operation receiving unit 111 is X-axis, and a straight line parallel to the long side of the rectangular is Y As an axis, the user operation receiving unit 111 specifies a two-dimensional orthogonal coordinate system.

  As for the X axis and the Y axis, the long side may be the X axis and the short side may be the Y axis. Moreover, you may determine the direction where the convex part and the shaping | molding of the recessed part were given to the surface or other part which a user's finger | toe of the user operation reception part 111 touches as an X axis and a Y axis. Furthermore, directions presented to the user by display or printing may be defined as the X axis and the Y axis.

  In the XY coordinate system determined as described above, the scroll direction control unit 126 calculates an angle of a straight line connecting P2 and P1 with respect to the X axis as the operation angle θ.

  In calculating the operation angle, not only P1 and P2 but also coordinates at a point earlier than that may be used. In such a case, the operation angle may be obtained by a straight line passing through the coordinates of two points selected from three or more coordinates. Furthermore, the operation angle may be obtained by a regression line calculated from three or more coordinates. A plurality of coordinates may be leveled.

  In addition, the scroll direction control unit 126 compares the calculated operation angle θ with a plurality of correction target ranges indicated by the correction information stored in the storage unit 123. Then, when the calculated operation angle θ is included in any of the plurality of correction target ranges, the scroll direction control unit 126 determines the vertical or horizontal direction as the scroll direction. Then, the scroll direction control unit 126 gives the angle of the vertical or horizontal direction to the display content update unit 127 as the scroll direction. Further, the scroll direction control unit 126 determines the oblique direction as the scroll direction when the calculated operation angle θ is not included in any of the plurality of correction target ranges. Then, the scroll direction control unit 126 gives the calculated operation angle θ to the display content update unit 127 as the scroll direction.

Here, the correction target range will be described with reference to FIGS.
FIG. 2 is a schematic diagram for explaining coordinates when the user performs a flick operation on the touch unit 111 a of the user operation reception unit 111. The input device 110 that receives a user operation is, for example, a smartphone equipped with a touch panel as the user operation receiving unit 111.

  FIG. 2 shows the coordinate P2 described above. An orthogonal coordinate system including the X axis and the Y axis with the coordinate P2 as the origin is shown. In addition, FIG. 3 shows the coordinate P1 at the time point immediately before the time point when the flick operation is finished and the user's finger is released together with the coordinate P2.

FIG. 3 is a schematic diagram illustrating an example when the user performs a flick operation vertically downward on the touch unit 111a of the user operation reception unit 111. As shown in FIG. 3, even when the user tries to flick downward in the vertical direction, there is often a deviation between the direction of the finger moved by the user and the downward direction in the vertical direction.
In addition, not only in the vertical downward direction but also in the flick operations directed in the vertical and horizontal directions (up, down, left and right), the direction intended by the user and the direction in which the user actually moved the finger are different. Often occurs. Here, as a result of observing the movement of the user's finger, when trying to manipulate an object on the screen horizontally to the right, trying to manipulate vertically upward, and trying to manipulate horizontally left The amount of deviation between the direction in which the object originally wanted to move and the direction in which the finger actually moved differed between when the operation was performed and when the operation was attempted in the vertical downward direction.

  For this reason, in the present embodiment, as shown in FIG. 4, the correction target range is set for each of the vertical and horizontal directions (up, down, left and right). The correction target range can be set by a range formed by two or more straight lines extending radially starting from the coordinate P2. The first correction target range A arranged in the right direction of the coordinate P2 is formed by two or more straight lines extending in the diagonally right direction starting from the coordinate P2. The second correction target range B arranged in the upward direction of the coordinate P2 is formed by two or more straight lines extending in the upward oblique direction starting from the coordinate P2. The third correction target range C arranged in the left direction of the coordinate P2 is formed by two or more straight lines extending in the diagonally left direction starting from the coordinate P2. The fourth correction target range D arranged in the lower direction of the coordinate P2 is formed by two or more straight lines extending in the diagonally downward direction starting from the coordinate P2. In the present embodiment, these correction target ranges A to D are specified by the angle of the straight line forming each correction target range with respect to the X axis. These angle values are stored in the storage unit 123 as correction information. In FIG. 4, the correction information is information indicating θ1, θ2, θ3, θ4, θ5, θ6, θ7, and θ8. The first correction target range A is a range of less than 180 ° sandwiched between a straight line forming θ1 and a straight line forming θ8. The second correction target range B is a range of less than 180 ° sandwiched between the straight line forming θ2 and the straight line forming θ3. The third correction target range C is a range of less than 180 ° sandwiched between a straight line forming θ4 and a straight line forming θ5. The fourth correction target range D is a range of less than 180 ° sandwiched between a straight line forming θ6 and a straight line forming θ7. For example, in FIG. 4, if the operation angle θ is within the first correction target range A, the scroll direction control unit 126 moves to the right horizontal direction, and if the operation angle θ is within the second correction target range B, the scroll direction control unit 126 If the operation angle θ is within the third correction target range C, the scroll direction is determined in the left horizontal direction. If the operation angle θ is within the fourth correction target range D, the scroll direction is determined in the vertical direction.

  Returning to the description of FIG. 1, the display content update unit 127 scrolls the object displayed on the display unit 130 in the scroll direction determined by the scroll direction control unit 126. For example, the display content update unit 127 indicates a location to be displayed on the display unit 130 in the display definition in the display data stored in the video memory 128 based on the scroll direction given from the scroll direction control unit 126. Update location information. Accordingly, the object displayed on the display unit 130 can be scrolled in the scroll direction given from the scroll direction control unit 126.

  The video memory 128 stores the display data generated by the display data generation unit 121. The display data is updated by the display content update unit 127.

  The drawing unit 129 draws the material data included in the display data stored in the video memory 128 according to the display definition included in the display data, thereby indicating an object to be displayed on the display unit 130. Generate data. Note that, by updating the display definition by the display content updating unit 127, the part of the object displayed on the display unit 130 is changed.

  The display unit 130 displays an object based on the object data generated by the drawing unit 129.

FIG. 5 is a flowchart schematically showing processing when the user performs a flick operation in the first embodiment.
The user operation reception unit 111 of the input device 110 detects a user operation on the touch unit 111a, and touches the finger if the user's finger state (contact or non-contact) and the user's finger state are in contact. The coordinates of the current position are acquired at regular intervals, and user operation information indicating these is generated. Then, the user operation reception unit 111 gives the generated user operation information to the transmission unit 112. The transmission unit 112 transmits the given user operation information to the reception unit 122 of the image processing apparatus 120 (S10). The receiving unit 122 sends the received user operation information to the storage unit 123, and the storage unit 123 stores the user operation information.

  Next, the operation content determination unit 125 specifies the content of the user operation by referring to the determination information and user operation information stored in the storage unit 123, and whether or not the specified content is a flick operation. Is determined (S11). If the specified operation content is not a flick operation (S11: NO), in other words, if the specified operation content is a touch operation or a drag operation, the process proceeds to step S12. On the other hand, when the specified operation content is a flick operation (S11: YES), the operation content determination unit 125 notifies the scroll direction control unit 126 that the flick operation has been performed, and the process proceeds to step S13. Proceed to

  In step S12, the display control unit 124 performs processing according to the specified operation content.

  On the other hand, in step S <b> 13, the scroll direction control unit 126 calculates an operation angle indicating the direction in which the flick operation is performed by referring to the user operation information stored in the storage unit 123. Then, the scroll direction control unit 126 determines whether or not the calculated operation angle is included in the correction target range by referring to the correction information stored in the storage unit 123 (S13). When the calculated operation angle is not included in the correction target range (S13: NO), the process proceeds to step S14. When the calculated operation angle is included in the correction target range (S13: YES), the process proceeds to step S15.

  In step S14, the scroll direction control unit 126 gives the calculated operation angle to the display content update unit 127 as the scroll direction. The display content update unit 127 updates the display definition of the display data stored in the video memory 128 so as to scroll in the given scroll direction. Then, the process proceeds to step S16.

  In step S15, the scroll direction control unit 126 corrects the operation angle in accordance with the correction target range including the calculated operation angle, and provides the corrected operation angle to the display content update unit 127 as the scroll direction. The display content update unit 127 updates the display definition of the display data stored in the video memory 128 so as to scroll in the given scroll direction. Then, the process proceeds to step S16.

  In step S <b> 16, the drawing unit 129 generates object data of an object to be displayed on the display unit 130 according to the display definition stored in the video memory 128. Then, the drawing unit 129 gives the generated object data to the display unit 130. The display unit 130 displays an object based on the object data generated by the drawing unit 129.

  In the image processing apparatus 120 configured as described above, since the operation angle of the user operation is corrected by the scroll direction control unit 126, the user is inclined even though the user is moving the object vertically or horizontally. Even if the finger is moved in the direction, the object can be moved as intended by the user. Therefore, the object can be easily moved vertically or horizontally without requiring the user to operate vertically or horizontally without any difference.

In the first embodiment, an input of a user operation is received by the input device 110 which is a device different from the image processing device 120, but the present invention is not limited to such an aspect. For example, as illustrated in FIG. 6, the image processing apparatus 120 # includes a user operation reception unit 131 that includes a touch unit that receives an input of a user operation and generates user operation information instead of the reception unit 122. As a result, in the image processing apparatus 120 #, an input of a user operation can be accepted.
The user operation accepting unit 131 may be realized by using a display screen of the display unit 130 as a touch panel, or may be realized by a touch pad. The storage unit 123 stores the user operation information generated by the user operation reception unit 131.

  In addition, although this Embodiment exhibits a further effect by the touchpad system in which the input device 110 operated by the user and the image processing device 320 that displays the object are separated from each other, for example, a device operated by the user Even touch panel systems that integrate objects and devices that display objects are often useful for devices other than touchpad systems because the user's consciousness concentrates on the objects and the attention to how the fingers move is often distracted. is there.

Embodiment 2. FIG.
Next, a second embodiment will be described. In the first embodiment, correction in the vertical and horizontal directions is performed, but in the second embodiment, correction is also performed in an oblique direction.
As shown in FIG. 1, the image processing system 200 according to the second embodiment includes an input device 110 and an image processing device 220. The image processing system 200 according to the second embodiment is different from the image processing system 100 according to the first embodiment in an image processing apparatus 220.

  The image processing apparatus 220 according to the second embodiment includes a display data generation unit 121, a reception unit 122, a storage unit 123, a display control unit 224, a video memory 128, a drawing unit 129, and a display unit 130. Prepare. The image processing apparatus 220 according to the second embodiment is different from the image processing apparatus 120 according to the first embodiment in the display control unit 224.

  The display control unit 224 determines the user operation content from the user operation information stored in the storage unit 123, and when the content is a flick operation, specifies the scroll direction and displays it on the display unit 130. Scrolls an object The display control unit 224 includes an operation content determination unit 125, a scroll direction control unit 226, and a display content update unit 127. The display control unit 224 in the second embodiment is different from the display control unit 124 in the first embodiment in the scroll direction control unit 226.

  The scroll direction control unit 226 performs the same processing as the scroll direction control unit 126 in the first embodiment, and the operation angle of the user's finger movement is indicated by correction information stored in the storage unit 123. When it is not included in the vertical and horizontal correction target ranges, the operation angle is corrected in the oblique direction.

As shown in FIG. 4, for example, the operation angle θ is included in the fourth correction target range D below the coordinate P <b> 2 in the direction of the user's finger movement detected by the user operation reception unit 111. If it is, it is corrected in the lower vertical direction. For this reason, even when the user wants to perform a scroll operation in an oblique direction included in the fourth correction target range D, the user can scroll only in the downward vertical direction.
For this reason, the scroll direction control unit 226 according to the second embodiment corrects the operation angle determined to scroll in an oblique direction so that the scroll operation can be performed also in the direction of the correction target range, The corrected operation angle is included in the correction target range.

For example, the scroll direction control unit 226 uses the following equations (1) to (4) when the operation angle θ is not included in any of the correction target ranges A to D illustrated in FIG. The operation angle θ is corrected to the correction operation angle Θ.
When θ1 <θ <θ2, Θ = 90 ° × (θ−θ1) ÷ (θ2−θ1) (1)
When θ3 <θ <θ4, Θ = 90 ° × (θ−θ3) ÷ (θ4−θ3) + 90 ° (2)
When θ5 <θ <θ6, Θ = 90 ° × (θ−θ5) ÷ (θ6-θ5) + 180 ° (3)
When θ7 <θ <θ8, Θ = 90 ° × (θ−θ7) ÷ (θ8−θ7) + 270 ° (4)
Here, the functions of the formulas (1) to (4) are functions in which the range is wider than the domain and the range includes the domain.
When this correction method is adopted, the first correction target range A includes 0 °, the second correction target range B includes 90 °, the third correction target range C includes 180 °, and the fourth It is a precondition that the correction target range D includes 270 °.

When the operation angle θ is included between the first correction target range A and the second correction target range B by the function of the expression (1), the range of the corrected operation angle Θ is 0 ° or more, The range is 90 ° or less.
Further, when the operation angle θ is included between the second correction target range B and the third correction target range C by the function of the expression (2), the range of the corrected operation angle Θ is 90 °. The range is 180 ° or less.
Further, when the operation angle θ is included between the third correction target range C and the fourth correction target range D by the function of the expression (3), the range of the corrected operation angle Θ is 180 °. The range is 270 ° or less.
Furthermore, when the operation angle θ is included between the fourth correction target range D and the first correction target range A, the range of the corrected operation angle Θ is a range of 270 ° to 360 °. It becomes.

FIG. 7 is a flowchart schematically showing processing when the user performs a flick operation in the second embodiment. In the processing of the flow shown in FIG. 7, the same reference numerals as those in FIG. 5 are assigned to the same processing as the processing of the flow shown in FIG.
The process of steps S10 to S13 shown in FIG. 7 is the same as the process of steps S10 to S13 shown in FIG. However, in step S13, when the calculated operation angle is not included in the correction target range (S13: NO), the process proceeds to step S24.

  In step S24, the scroll direction control unit 226 selects the above formulas (1) to (4) according to the range including the calculated operation angle, and calculates the corrected operation angle Θ from the operation angle θ. . Then, the scroll direction control unit 226 gives the calculated correction operation angle Θ to the display content update unit 127 as the scroll direction. The display content update unit 127 updates the display definition of the display data stored in the video memory 128 so as to scroll in the given scroll direction. Then, the process proceeds to step S16.

  Note that the processing in steps S15 and S16 in FIG. 7 is the same as the processing in steps S15 and S16 in FIG.

  As described above, according to the image processing apparatus 220 according to the second embodiment, by using both the vertical horizontal correction and the oblique direction correction, the object can be moved in all directions without impairing the operability in the vertical horizontal direction. There is an effect that it can be moved.

Embodiment 3 FIG.
FIG. 8 is a block diagram schematically showing the configuration of the image processing device 320 according to the third embodiment. An image processing system 300 illustrated in FIG. 8 includes an input device 110 and an image processing device 320 according to the third embodiment. The input device 110 is the same as that in the first embodiment.

  As shown in FIG. 8, the image processing apparatus 220 according to the third embodiment includes a display data generation unit 121, a reception unit 122, a storage unit 123, a display control unit 324, a video memory 128, A drawing unit 129, a display unit 130, and a user profile storage unit 332 are provided. The image processing device 320 according to the third embodiment is different from the image processing device 120 according to the first embodiment in that the processing by the display control unit 324 and the user profile storage unit 332 are further provided. .

The user profile storage unit 332 stores user profile information including a plurality of pieces of information indicating user characteristics and a correction method for correcting the operation angle according to the characteristics.
For example, the user profile information includes information indicating a correction method for a right-handed user, information indicating a correction method for a left-handed user, and information indicating a user's dominant hand. The user's dominant hand information can be registered in the user profile information or can be changed by the user himself / herself selecting, for example, right-handed or left-handed using the input device 110.

  In addition to the above, the user characteristics include an operation method in which the hand holding the operated device and the hand operated by the finger are separate two-handed operations or the one-handed operation operated by the finger of the hand holding the operated device It may be information about. The user characteristics may be the size of the user's hand or the length of the finger, the speed at which the user moves the finger, the accuracy with which the user moves the finger, and the like. The user profile information includes information indicating a correction method according to these characteristics.

  Further, for example, the correction method information for the individual user is obtained from data when the user operates to move the object in the vertical and horizontal directions, stored in the user profile storage unit 332, and the scroll direction control unit 326 It may be used when calculating the operation angle. For example, the scroll direction control unit 326 displays a message such as “Please move your hand straight in the vertical direction” on the user operation accepting unit 111 or the display unit 130, and between the direction operated by the user and the vertical direction. The angle is calculated, and the operation angle is corrected with the calculated angle. Specifically, when the direction operated by the user is shifted 5 ° to the right with respect to the vertical direction, the scroll direction control unit 326 subtracts 5 ° from the operation angle θ calculated from the user operation information. That's fine. On the other hand, when it is shifted to the left by 5 °, the scroll direction control unit 326 may add 5 ° to the operation angle θ calculated from the user operation information.

  The display control unit 324 determines the user's operation content from the user operation information stored in the storage unit 323. When the content is a flick operation, the display control unit 324 specifies the scroll direction and is displayed on the display unit 130. Scrolls an object The display control unit 324 includes an operation content determination unit 125, a scroll direction control unit 326, and a display content update unit 127. The display control unit 324 in the third embodiment is different from the display control unit 124 in the first embodiment in the scroll direction control unit 326.

When the content of the user operation determined by the operation content determination unit 125 is a flick operation, the scroll direction control unit 326 displays the user operation information stored in the storage unit 123 and the user profile stored in the user profile storage unit 332. The operation angle of the user's finger movement is calculated from the information. For example, the scroll direction control unit 326 calculates the operation angle θ from the coordinates P1 and P2 as in the first embodiment, but this operation is performed using a correction method selected according to the user characteristics from the user profile information. The angle θ is corrected.
Then, the scroll direction control unit 326 compares the calculated operation angle after correction with the correction target range indicated by the correction information stored in the storage unit 123.
Note that the scroll direction control unit 326 may perform oblique correction as in the second embodiment. Even in such a case, it is desirable that the scroll direction control unit 326 performs the correction in the oblique direction at the operation angle after being corrected by the selected correction method.

  As described above, according to the image processing apparatus 320 according to the third embodiment, the operation angle calculated by the scroll direction control unit 326 is corrected according to the user characteristics such as the user characteristics and the user's habit of operation. Therefore, even when the user tries to move the object in the vertical or horizontal direction, even if the finger is moved in an oblique direction, the object can be moved as intended by the user. Therefore, the object can be moved vertically or horizontally without requiring the user to operate vertically or horizontally without any difference in size.

  Also in the third embodiment, similarly to the image processing device 120 # shown in FIG. 6, the image processing device 320 includes a touch unit that accepts an input of a user operation instead of the receiving unit 122. By providing the user operation receiving unit 131 that generates information, the image processing apparatus 320 can receive an input of a user operation.

  The image processing devices 120, 220, and 320 described above may be any device such as a digital broadcast receiving device or a car navigation system as long as the device includes the display unit 130. Furthermore, a device that does not include the display unit 130, such as a playback device that plays back video stored in a storage medium such as a BD, DVD, or HD, or a STB (Set Top Box) may be used.

  100, 200, 300 Image processing system, 110 Input device, 111, 131 User operation reception unit, 112 Transmission unit, 120, 120 #, 220, 320 Image processing device, 121 Display data generation unit, 122 Reception unit, 123 Storage unit 124, 224, 324 display control unit, 125 operation content determination unit, 126, 226, 326 scroll direction control unit, 127 display content update unit, 128 video memory, 129 drawing unit, 130 display unit, 332 user profile storage unit.

Claims (22)

Stores correction information indicating a plurality of correction target ranges that are predetermined angle ranges, and detects at predetermined time intervals when the user moves the finger while the finger is in contact with the touch unit. A storage unit that stores a plurality of pieces of user operation information including information indicating coordinates corresponding to a position where the finger is in contact;
The angle with respect to one coordinate axis in a predetermined coordinate system of a straight line specified by a plurality of coordinates indicated by a plurality of user operation information stored in the storage unit is specified as an operation angle at which the user performs an operation. In addition, when the specified operation angle is included in any of a plurality of correction target ranges indicated by the correction information stored in the storage unit, the horizontal direction or the vertical direction in the predetermined coordinate system Is determined as a scroll direction, and the specified coordinate system is not included in any of the plurality of correction target ranges indicated by the correction information stored in the storage unit. A scroll direction control unit that determines the oblique direction of
An image processing apparatus comprising: a display content updating unit that scrolls an object displayed on the display unit in a scroll direction determined by the scroll direction control unit. The correction information stored in the storage unit includes a first correction target range including an angle corresponding to the right horizontal direction of the predetermined coordinate system, and an angle corresponding to the upper vertical direction of the predetermined coordinate system. A second correction target range including the third correction target range including an angle corresponding to the left horizontal direction of the predetermined coordinate system, and a fourth including an angle corresponding to the lower vertical direction of the predetermined coordinate system. Indicates the correction target range,
When the specified operation angle is included in the first correction target range, the scroll direction control unit determines a right horizontal direction of the predetermined coordinate system as a scroll direction, and specifies the specified operation. When an angle is included in the second correction target range, the upper vertical direction of the predetermined coordinate system is determined as a scroll direction, and the specified operation angle is included in the third correction target range. Determines the angle corresponding to the left horizontal direction of the predetermined coordinate system as the scroll direction, and when the specified operation angle is included in the fourth correction target range, the predetermined The image processing apparatus according to claim 1, wherein a lower vertical direction of the coordinate system is determined as a scroll direction. The scroll direction control unit, when the specified operation angle is not included in any of a plurality of correction target ranges indicated by the correction information stored in the storage unit, The image processing apparatus according to claim 1, wherein in the system, a direction indicated by the specified operation angle is determined as a scroll direction. When the specified operation angle is not included in any of a plurality of correction target ranges indicated by the correction information stored in the storage unit, the scroll direction control unit has a value range that is greater than a definition range. The specified operation angle is corrected using a function that is wide and the range includes the definition range, and the direction indicated by the corrected operation angle is determined as the scroll direction. The image processing apparatus according to claim 1 or 2. When the specified operation angle is not included in any of a plurality of correction target ranges indicated by the correction information stored in the storage unit, the scroll direction control unit has a value range that is greater than a definition range. Using a function that is wide and the range includes the definition range, the specified operation angle is corrected, and the direction indicated by the corrected operation angle is determined as the scroll direction,
The function is
When the specified operation angle is included between the first correction target range and the second correction target range, the value range is 0 ° or more and 90 ° or less,
When the specified operation angle is included between the second correction target range and the third correction target range, the value range is 90 ° or more and 180 ° or less,
When the specified operation angle is included between the third correction target range and the fourth correction target range, the value range is 180 ° or more and 270 ° or less,
When the specified operation angle is included between the fourth correction target range and the first correction target range, the value range is 270 ° or more and 360 ° or less. The image processing apparatus according to claim 2. A user profile storage unit that stores user profile information including a plurality of information indicating a correction method for correcting the operation angle according to the user's characteristics;
The scroll direction control unit selects one correction method from the user profile information stored in the user profile storage unit according to the characteristics of the user, and uses the selected one correction method, The specified operation angle is corrected, and it is determined whether or not the corrected operation angle is included in a plurality of correction target ranges indicated by the correction information stored in the storage unit. Item 6. The image processing apparatus according to any one of Items 1 to 5. The predetermined coordinate system is a two-dimensional orthogonal coordinate system having one coordinate included in a plurality of coordinates indicated by a plurality of user operation information stored in the storage unit as an origin. The image processing apparatus according to claim 1. The one coordinate is a coordinate detected second after the last when a predetermined operation is performed by moving the finger while the user is in contact with the touch unit. The image processing apparatus according to claim 7, wherein the apparatus is an image processing apparatus. 9. The operation according to claim 8, wherein the predetermined operation is an operation in which a movement amount of the finger immediately before the user's finger comes into non-contact from the touch unit is larger than a predetermined movement amount. The image processing apparatus described. The user operation information from an input device that includes the touch unit and includes a user operation reception unit that generates the user operation information and a transmission unit that transmits the user operation information generated by the user operation reception unit. A receiving unit for receiving
The image processing apparatus according to claim 1, wherein the storage unit stores the user operation information received by the reception unit. A user operation receiving unit that includes the touch unit and generates the user operation information;
The image processing apparatus according to claim 1, wherein the storage unit stores the user operation information generated by the user operation reception unit. A user operation including information indicating coordinates corresponding to a position where the finger is in contact, which is detected at a predetermined time interval when the user moves the finger while the finger is in contact with the touch unit A storage process for storing a plurality of information;
An angle with respect to one coordinate axis in a predetermined coordinate system of a straight line specified by a plurality of coordinates indicated by a plurality of user operation information stored in the storage process is specified as an operation angle at which the user performs an operation. In addition, when the specified operation angle is included in any one of the plurality of correction target ranges indicated by the correction information indicating a plurality of correction target ranges that are predetermined angle ranges, the predetermined operation angle is determined in advance. When the horizontal direction or the vertical direction in the coordinate system is determined as the scroll direction and the specified operation angle is not included in any of the plurality of correction target ranges indicated by the correction information, the predetermined coordinates A scroll direction control process for determining the diagonal direction of the system as the scroll direction;
An image processing method comprising: a display content updating step of scrolling an object displayed on the display unit in a scroll direction determined in the scroll direction control step. The correction information includes a first correction target range including an angle corresponding to the right horizontal direction of the predetermined coordinate system, and a second correction target range including an angle corresponding to the upper vertical direction of the predetermined coordinate system. , A third correction target range including an angle corresponding to the left horizontal direction of the predetermined coordinate system, a fourth correction target range including an angle corresponding to the lower vertical direction of the predetermined coordinate system,
In the scroll direction control process, when the specified operation angle is included in the first correction target range, a right horizontal direction of the predetermined coordinate system is determined as a scroll direction, and the specified operation is performed. When an angle is included in the second correction target range, the upper vertical direction of the predetermined coordinate system is determined as a scroll direction, and the specified operation angle is included in the third correction target range. Determines the angle corresponding to the left horizontal direction of the predetermined coordinate system as the scroll direction, and when the specified operation angle is included in the fourth correction target range, the predetermined The image processing method according to claim 12, wherein the lower vertical direction of the coordinate system is determined as the scroll direction. In the scroll direction control method, when the specified operation angle is not included in any of the plurality of correction target ranges indicated by the correction information, the specified coordinate system is determined in the predetermined coordinate system. The image processing method according to claim 12 or 13, wherein a direction indicated by an operation angle is determined as a scroll direction. In the scroll direction control process, when the specified operation angle is not included in any of the plurality of correction target ranges indicated by the correction information, the range is wider than the defined range, and the range is The function according to claim 12 or 13, wherein the specified operation angle is corrected using a function including a range including the definition area, and a direction indicated by the corrected operation angle is determined as a scroll direction. The image processing method as described. In the scroll direction control process, when the specified operation angle is not included in any of the plurality of correction target ranges indicated by the correction information, the range is wider than the defined range, and the range is Using a function that is a range including the domain, the specified operation angle is corrected, the direction indicated by the corrected operation angle is determined as the scroll direction,
The function is
When the specified operation angle is included between the first correction target range and the second correction target range, the value range is 0 ° or more and 90 ° or less,
When the specified operation angle is included between the second correction target range and the third correction target range, the value range is 90 ° or more and 180 ° or less,
When the specified operation angle is included between the third correction target range and the fourth correction target range, the value range is 180 ° or more and 270 ° or less,
When the specified operation angle is included between the fourth correction target range and the first correction target range, the value range is 270 ° or more and 360 ° or less. The image processing method according to claim 13. In the scroll direction control process, one correction method is selected according to user characteristics from user profile information including a plurality of information indicating correction methods for correcting the operation angle according to the user characteristics, and the selected one is selected. The correction operation angle is corrected using a single correction method, and it is determined whether or not the corrected operation angle is included in a plurality of correction target ranges indicated by the correction information. The image processing method according to any one of claims 12 to 16. The predetermined coordinate system is a two-dimensional orthogonal coordinate system having one coordinate included in a plurality of coordinates indicated by a plurality of user operation information stored in the storing process as an origin. The image processing method according to any one of claims 12 to 17. The one coordinate is a coordinate detected second after the last when a predetermined operation is performed by moving the finger while the user is in contact with the touch unit. The image processing method according to claim 18, wherein: The predetermined operation is an operation in which a movement amount of the finger immediately before the user's finger comes into non-contact from the touch unit is larger than a predetermined movement amount. The image processing method as described. The user operation information from an input device that includes the touch unit and includes a user operation reception unit that generates the user operation information and a transmission unit that transmits the user operation information generated by the user operation reception unit. A receiving process for receiving
21. The image processing method according to claim 12, wherein the storing process is a process of storing the user operation information received in the receiving process. A user operation acceptance process for generating the user operation information;
The image processing method according to any one of claims 12 to 20, wherein the storage process is a process of storing the user operation information generated in the user operation reception process.

Images