JP2009140149A - Information terminal equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide information terminal equipment for precisely controlling information to be displayed on a display part by changing a spatial position relation between a photographic part and a photographic object without requiring complicated button operation or the like, nor mounting any additional hardware such as an acceleration sensor. <P>SOLUTION: This information terminal equipment includes: a photographic part 11 which outputs a photographic image; an estimation part 12 for estimating the change of a spatial position relation between the photographic part 11 and an object by analyzing the photographic image; and a control part 13 for controlling image information to be read from a storage part 14, and to be displayed on a display part 15 based on the change of the spatial position relation estimated by the estimation part 12. The estimation part 13 includes edge feature amount calculation parts 51 and 52 for calculating edge feature amount related to the prescribed direction of the photographic image; and a movement detection part 57 for detecting the movement of the photographic image by comparing the respective edge feature amount of a current image and a previous image, and configured to estimate the change of the spatial position relation between the photographic part 11 and the object based on the detection result of movement. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an information terminal device having a function of displaying information, and in particular, an information terminal device capable of controlling information displayed on a display unit by changing a spatial positional relationship between a shooting unit and a shooting target. About.

  Along with the integration of electronic equipment circuits, information terminal devices such as mobile phones and PDAs have become smaller and lighter, and the display devices included in these information terminal devices have become high definition. The amount of information displayed at a time can be increased by increasing the definition of the display device. In an information terminal device that is reduced in size and weight, the area that can be secured by a display unit that displays information is limited.

  In such an information terminal device, when an enormous amount of information is displayed without sufficiently securing the area of the display unit, it is difficult to read the information. For example, when a place name or the like is displayed with characters on the map, the place name or the like is displayed with fine characters, making it difficult to read. In order to facilitate reading of information displayed on the display unit, it is known to change the display area and display magnification displayed on the display screen.

  Japanese Patent Laid-Open No. 2004-151858 provides map data that includes a virtual scale selection button and a scale change button on the screen, and changes the display area and scale of the map displayed on the screen according to the user's operation of these buttons. An apparatus is described.

  Patent Document 2 describes a method of using a numeric keypad that uses a numeric keypad to scroll a data range to be displayed on a display.

  In Patent Document 3, in a mobile phone, a plurality of images taken at different timings by an imaging unit are analyzed to calculate a change in orientation of the mobile phone, that is, a change in direction of a display unit (imaging unit). The display control device transmits a change in the direction of the image to the display control device (server), and the display control device selects a display image to be displayed based on the change in the direction of the display unit transmitted from the mobile phone and transmits the selected display image to the mobile phone. In the cellular phone, an image display system is described in which the displayed image is switched according to the direction of the display unit by updating to the display image transmitted from the display control device.

  In Patent Document 4, a sensor such as a triaxial acceleration sensor is built in the vicinity of the display unit, and the amount of movement is detected when the display unit is moved in the vertical and horizontal directions with respect to the display screen while holding the device body. An electronic device is described in which the information display size is dynamically changed according to the amount of movement in the vertical direction, and the information display range is dynamically changed according to the amount of movement in the horizontal direction.

In Patent Document 5, images are captured by periodically capturing the front with a built-in camera of the information terminal device, and the local movement of the image when the information terminal device is moved in the up / down / left / right or front / rear direction is estimated, A technique for changing information to be displayed on a display unit in accordance with a global motion in which local motion information is integrated is disclosed.
JP 2002-277277 A JP 2003-67120 A JP-A-2005-122100 JP 2005-25170 A JP 2007-94708 A

  In the map data providing apparatus and the method of using the numeric keypad described in Patent Documents 1 and 2, not only the button operation and touch panel operation up to the desired display area and magnification are complicated, but also a small button or touch panel area. It is difficult to operate because it is necessary to press correctly. Such an interface that requires fine operation with a fingertip has a problem that it is difficult to use especially for an elderly person who desires to display information at a high magnification.

  The image display system described in Patent Document 3 has a problem that the cost increases because communication to the display control device (server) occurs every time the user operates the mobile phone. Another problem is that the response is slow because communication is performed with the display control device.

  In the electronic device described in Patent Document 4, the magnification can be changed by an intuitive and easy operation. However, an expensive sensor such as a three-axis acceleration sensor must be incorporated, and the price of the device is increased. There is a problem of inviting. There is also a problem that power consumption increases with the addition of sensors.

  In the information terminal device disclosed in Patent Document 5, intuitive operation of information to be displayed on the display is performed using only a general-purpose camera function built in the information terminal without requiring a button operation or an acceleration sensor. Can be controlled. However, since the operability depends on the accuracy of motion estimation and may not operate correctly for movements that are too fast or too large, careful and detailed operations are required.

  The object of the present invention is to solve the above-mentioned problems of the prior art, do not require detailed operation such as button operation, and without mounting additional hardware such as an acceleration sensor. It is an object of the present invention to provide an information terminal device capable of accurately controlling information to be displayed on a display unit by changing the spatial positional relationship between them.

  In order to achieve the above-described object, the present invention provides a photographing unit that outputs an image photographed at a predetermined sampling period, a storage unit that retains image information, a display unit that displays the image information, and the photographed image. And estimating means for estimating a change in a spatial positional relationship between the photographing means and the subject, and image information read out from the storage means and displayed on the display means, the spatial position estimated by the estimating means An information terminal device including a control unit that controls based on a change in the relationship is characterized by the following features.

  (1) The estimation means calculates the edge feature quantity calculating means for calculating the edge feature quantity in a predetermined direction of the photographed image, the current image photographed at the current sampling time, and the previous image photographed at the previous sampling time. A motion detection unit that detects a motion of the photographed image by comparing edge feature amounts, and estimates a change in a spatial positional relationship between the photographing unit and the subject based on a motion detection result. And

  (2) The edge feature amount calculating means calculates a differential image with respect to a predetermined direction of the photographed image.

  (3) The estimation means further includes quantitative value calculation means for calculating a quantitative value of the edge feature value, and the motion detection means compares the quantitative value of each edge feature value of the previous image and the current image. And

  (4) The quantitative value calculating means calculates a variance value of the edge feature value.

  (5) The quantitative value calculating means calculates an average value of the edge feature values.

  (6) A movement amount calculation unit that calculates a movement amount from the previous image to the current image, and the current image that is generated when the spatial positional relationship between the shooting unit and the subject changes during the shooting of the current image. A flow amount estimating means for estimating a flow amount based on the movement amount; a means for generating a post-movement estimation image equivalent to a case where the previous image is flowed by the flow amount based on the previous image and the flow amount; And direction estimation means for estimating the direction of movement based on the current image and the estimated image after movement.

  (7) The means for generating the estimated image after movement projects the image obtained by moving the previous image in the flow direction by a predetermined unit amount, and repeats this until the total movement amount reaches the flow amount; And a means for adding up the projected images and averaging them for each corresponding pixel to generate a post-movement estimated image.

  (8) The direction estimation means includes means for calculating an edge feature amount of the post-movement estimated image, means for estimating the direction of movement based on the edge feature amount of the current image and the edge feature amount of the post-movement estimation image; It is characterized by including.

  According to the present invention, the following effects are achieved.

  According to the above feature (1), since the presence or absence of motion of the captured image can be detected based on the edge feature amount of the image, this can be reliably detected even when the speed and amount of motion are large.

  According to the above feature (2), since the differential image of the photographed image can be used as the edge feature amount, the edge feature amount can be calculated with a small processing load.

  According to the features (3), (4), and (5) described above, since the edge feature amount of the captured image can be quantified, the edge feature amount can be easily compared.

  According to the features (6), (7), and (8) described above, even if the subject moves relatively while the shutter is open for shooting, the movement of the image occurs. It becomes possible to accurately detect the direction of the.

  DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the best embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a functional block diagram showing a configuration of a main part of a cellular phone 1 to which the present invention is applied. Here, illustrations of configurations unnecessary for the description of the present invention are omitted.

  The imaging unit 11 captures a subject at a predetermined sampling period and outputs the captured image. As the imaging unit 11, a digital camera provided as standard on the mobile phone 1 can be used. When the user tilts the mobile phone 1 in the horizontal (x) direction or the vertical (y) direction with respect to the subject, the spatial positional relationship between the photographing unit 11 and the subject changes in the same way, and the change is displayed. Reflected in the image. The estimation unit 12 includes a motion detection unit 12a that detects the movement of the mobile phone 1 based on a change in the captured image, and a direction estimation unit 12b that estimates the direction of the motion detected by the motion detection unit 12a. As described in detail, the image captured by the imaging unit 11 is analyzed to estimate a change in the spatial positional relationship between the imaging unit 11 and the subject.

  In the storage unit 14, image information E such as a map to be displayed on the display unit 15 is developed in advance. The control unit 13 cuts out a partial range of the image information E as a display image Edis from the storage unit 14 based on the change in the spatial positional relationship between the photographing unit 11 and the subject estimated by the estimation unit 12. Is output to the display unit 15. The display unit 15 visually displays the display image Edis output from the control unit 13.

  FIG. 2 schematically illustrates how the display image Edis cut out from the image information E stored in the storage unit 14 and displayed on the display unit 15 changes according to the estimation result in the estimation unit 12. Here, the description starts from a state in which the display image Edis is set at the center of the image information E.

  When the user tilts the mobile phone 1 to the left (panes left), the captured image moves to the left, so the display image Edis cut out from the image information E also moves to the left. When the user tilts the mobile phone 1 continuously in the left direction, the captured image also continuously moves in the left direction, so that the display image Edis cut out from the image information E also continuously moves in the left direction. The same applies when tilting to the right.

  Further, when the user tilts the cellular phone 1 upward, the captured image moves upward, so that the display image Edis cut out from the image information E also moves upward. When the user tilts the mobile phone 1 continuously upward, the captured image continuously moves upward, so that the display image Edis cut out from the image information E also continuously moves upward. The same applies when tilting downward.

  Further, when the user tilts the mobile phone 1 in the upper left direction, the captured image moves in the upper left direction, so that the display image Edis cut out from the image information E also moves in the upper left direction. When the user tilts the mobile phone 1 continuously in the upper left direction, the captured image also moves in the upper left direction, so that the display image Edis cut out from the image information E also moves in the upper left direction. The same applies when tilting in the lower left direction, upper right direction, and lower right direction.

  Next, an operation in which the estimation unit 12 estimates a change in the spatial positional relationship between the photographing unit 11 and the subject will be described. The change in the spatial positional relationship between the photographing unit 11 and the subject is based on an operation in which the user holds the mobile phone 1 and tilts it up, down, left, and right, and will be described as a user operation below. .

  FIG. 3 is a functional block diagram showing the configuration of the motion detection unit 12a. The first and second edge feature quantity calculation units 51 and 52 are arranged to apply space to the current image Fti taken at the sampling time ti. The edge feature quantity is calculated by executing a differentiation operation for each specific direction. That is, the first edge feature quantity calculation unit 51 differentiates the current image Fti in the x direction to calculate the x direction edge feature quantity Gxti. The second edge feature quantity calculation unit 52 differentiates the current image Fti in the y direction to calculate the y direction edge feature quantity Gyti. The edge feature amounts Gxti and Gyti are normalized by the normalizing units 53 and 54.

  The first and second variance value calculation units 55 and 56 calculate the variance value of the edge feature value in order to quantitatively compare the edge feature values of the images having different sampling times. That is, the first variance value calculating unit 55 calculates the variance value VARxti of the x-direction edge feature amount Gxti. The second variance value calculation unit 56 calculates the variance value VARyti of the y-direction edge feature amount Gyti. An average value may be obtained instead of the variance value.

  The motion detection unit 57 stores the current variance values VARxti and VARyti relating to the edge feature amount of the current image Fti output from the first and second variance value calculation units 55 and 56 and the previous variance value storage units 58 and 59. The presence or absence of movement in the xy direction is detected based on the result of comparison with the previous variance values VARxti-1 and VARyti-1 regarding the edge feature amount of the previous image Fti-1.

  FIG. 4 is a flowchart showing the operation of the motion detector 12a. When the current image Fti is input at time ti and is detected in step S11, in steps S12 and S13, the current image Fti is converted in the x direction and y in the first and second edge feature quantity calculation units 51 and 52, respectively. The edge feature amount Gjti is calculated by being differentiated in the direction. Note that the subscript j indicates the differential direction (x or y). In the present embodiment, the current image Fti and the differential operator Hj are applied to the product-sum operation * of the following equation (1) to calculate the differential image Gjti, which is used as the edge feature amount.

  In the present embodiment, the Sobel operators of the following expressions (2) and (3) can be applied as the differential operators Hx and Hy, respectively. Then, pixel information is read from the current image Fti in block units of 3 pixels × 3 pixels, and one pixel of the differential images Gxti and Gyti is calculated based on the product-sum operation * of this and the differential operators Hx and Hy. The differential image Gxti (Gyti) is generated by repeating one frame.

  Note that the sizes of the differential operators Hx and Hy are not limited to 3 × 3. If a differential operator having a larger size is employed, resistance to noise can be improved. Furthermore, instead of the Sobel operator described above, the Roberts operator may be used, or if the Kirsch operator is employed, the edge feature amount can be calculated not only in the two directions of xy but also in the eight directions.

  FIG. 5 shows the previous image Fti-1 [Fig. (A)] taken at time ti-1 immediately before tilting the mobile phone 1, and its x-direction differential image Gxti-1 [Fig. (B)] and y. FIG. 6 is a diagram showing a relationship with the directional differential image Gyti-1 [FIG. (C)], and FIG. 6 shows the current image Fti [FIG. (A)] taken at time ti during the tilting operation to the left. FIG. 6 is a diagram showing the relationship between the x-direction differential image Gxti [FIG. (B)] and the y-direction differential image Gyti [FIG. (C)].

  In the x-direction differential image Gxti-1 [FIG. 5 (b)], only the edge in the x direction of the previous image Fti-1 is extracted, and in the y-direction differential image Gyti-1 [FIG. 5 (c)], Only edges in the y direction of the captured image Fti-1 are extracted. On the other hand, in FIG. 6, the current image Fti [FIG. (A)] flows in the x direction. Therefore, in the y-direction differential image Gyti [FIG. (C)], an edge in the y direction of the current image Fti is obtained. Is extracted, whereas in the x-direction differential image Gxti [(b)], the edge is unclear. Therefore, it can be seen that the presence or absence of movement in each direction can be detected by evaluating the temporal change of the differential image.

  Returning to FIG. 4, in steps S <b> 14 and S <b> 15, the edge feature amounts Gxti and Gyti are normalized by the normalization units 53 and 54. In steps S16 and S17, the first and second variance value calculation units 55 and 56 calculate the variance values of the edge feature amounts Gxti and Gyti, and temporarily store them as the current variance values VARx_cur and VARy_cur, respectively. In steps S18 and S19, the previous variance values VARj_pred (VARx_pred, VARy_pred) calculated based on the previous image Fti-1 and the current variance values VARj_cur (VARx_cur, VARy_cur) are expressed by the following equations (4) and (4): Applied to 5), the presence of motion is detected.

  In the above equation (4), it is determined that there is a movement in the direction j when the variance ratio (VARj_pred / VARj_cur) is lower than the first reference value TH1 or higher than the second reference value TH2 (> TH1). . Here, the left side of the above formula (4) is established when the mobile phone 1 shifts from the stopped state to the moving state, and the right side is satisfied when the mobile phone 1 shifts from the moving state to the stopped state. When Further, when the above equation (5) is established, it is determined that there is no movement.

  In step S20, the movement of the mobile phone 1 is determined based on the presence or absence of movement in each direction. That is, when movement in either the x direction or the y direction is detected, it is estimated that there is movement in that direction. If no motion is detected in either the x direction or the y direction, it is estimated that there is no motion. In the present embodiment, when the presence of motion is detected in both the x direction and the y direction, it is determined that there is a motion in an oblique direction corresponding to the ratio of the variance values. For example, if the ratio of the dispersion value in the x direction is the same as the ratio of the dispersion value in the y direction, it is determined that there is a movement in the 45 ° direction. In steps S21 and S22, the respective variance values VARx_cur and VARy_cur are updated and registered in the previous variance value storage units 58 and 59 as the previous variance values VARx_pred and VARy_pred, respectively, and used for the next estimation.

  Next, the orientation estimation unit 12b of the estimation unit 12 will be described with reference to FIGS. In the present embodiment, the direction estimation unit 12b estimates the motion direction only in the direction in which the motion is detected by the motion detection unit 12a, thereby reducing the processing load.

  FIG. 7 is a functional block diagram showing the configuration of the direction estimation unit 12b. The flow amount estimation unit 71 is displayed on the display unit 15 based on the variance values VARj_pred and VARj_cur of the previous image Fti-1 and the current image Fti. The movement amount ΔDf from the previous image Fti-1 to the current image Fti is calculated, and further, based on this movement amount ΔDf, the shutter between the photographing unit 11 and the subject is opened while the current image Fti is photographed. The flow amount ΔD of the image generated in the current image Fti in response to the change in the spatial positional relationship is estimated.

  The projected image generation unit 72 assumes that the previous image Fti-1 has flowed by the flow amount ΔD, and generates n projected images Fti-1 + nΔd in the process. The post-movement image estimating unit 73 adds and averages the n projected images Fti-1 + nΔd, and is substantially equivalent to the case where the previous image Fti-1 is virtually flowed by the flow amount ΔD. A post-movement estimated image Fti_s is generated. The edge feature amount calculation unit 74 calculates the edge feature amounts Gti and Gti_s of the current image Fti and the post-movement estimated image Fti_s. The direction estimation unit 75 tilts the mobile phone 1 from the previous sampling time ti-1 to the current sampling time ti based on the relative position of the coordinates where the square error of each edge feature amount Gti, Gxti_s is the lowest. Estimate the direction.

  Next, a motion direction estimation method according to this embodiment will be described with reference to the flowchart in FIG. 8 and the schematic diagram in FIG. 9. Here, the presence of motion in the x direction is detected in advance in the motion detector 12a, and as shown in FIG. 9, the captured image at the previous sampling time ti-1 is the previous image Fti-1, and the current image is captured. The captured image at the sampling time ti is the current image Fti. At the time ti, the mobile phone 1 is being tilted in the x direction, and the subject relatively flows while the shutter for capturing the current image Fti is open. As a result, it is assumed that the current image Fti has a flow in the x direction.

  In step S31, the variance value VARx_pred of the previous image Fti-1 and the variance value VARx_cur of the current image Fti are taken into the flow amount estimation unit 71. In step S32, the amount of movement ΔDf in the x direction from the previous image Fti-1 to the current image Fti is estimated based on the ratio (VARx_pred / VARx_cur) of each variance value. In the present embodiment, a function equation and a data table obtained by experimentally determining the relationship between the ratio of the dispersion value and the movement amount ΔDf are registered in the flow amount estimation unit 71 in advance, and the ratio of the dispersion value is applied thereto. Thus, the movement amount ΔDf is estimated.

  In step S33, based on the movement amount ΔDf, an image flow amount ΔD generated in the current image Fti in response to a change in the spatial positional relationship between the photographing unit 11 and the subject during photographing of the current image Fti. Is estimated. That is, since the image capturing period is constant, it is estimated that if the image movement amount ΔDf is large, the movement speed is fast and therefore the flow amount ΔD is also large. Therefore, in the present embodiment, the relationship between the movement amount ΔDf and the flow amount ΔD is experimentally obtained, registered in advance in the movement amount estimation unit 71 as a function equation or a data table, and the movement amount ΔDf is applied thereto. The flow amount ΔD is estimated.

  In step S34, the projected image generation unit 72 generates a projected image Fti-1 + Δd obtained by moving the previous image Fti-1 by the unit pixel Δd (for example, one pixel) in the x direction. In step S35, it is determined whether or not the generation of the projected image moved by the flow amount ΔD is completed. If not completed, the process returns to step S34, and a projected image Fti-1 + 2Δd is generated by moving the previous image Fti-1 further by the unit pixel Δd in the x direction. Thereafter, a projection image Fti-1 + 4Δd is generated, and if it is determined that the generation of the projection image (ΔD = 4Δd) moved by the flow amount ΔD is completed, the process proceeds to step S36.

  In step S36, the post-movement image estimation unit 73 adds the pixel values of the current image Fti and the projected images Fti-1 to Fti-1 + 4Δd for each corresponding pixel, and obtains an average value thereof. A post-movement estimated image Fti_s is calculated. The post-movement estimated image Fti_s obtained in this way is substantially equivalent to an image obtained by flowing the previous image Fti-1 by the flow amount ΔD.

  In step S37, the edge feature value calculation unit 74 calculates edge feature values Gxti and Gxti_s in the x direction of the current image Fti and the post-movement estimated image Fti_s. In step S38, the movement direction estimation unit 75 estimates the direction of movement from the previous time to the current time based on the relative position of the coordinate where the square error of the edge feature values Gxti and Gxti_s of each image is the lowest. That is, as shown in FIG. 9, if the post-movement estimated image Fti_s is located on the right side in the figure with respect to the current image Fti, it is estimated that the mobile phone 1 is tilted rightward (right-panned). Is done.

  When the movement amount ΔDf and the direction are estimated as described above, the control unit 13 moves the cutout position of the display image Edis cut out from the image information E according to the movement amount ΔD and the direction of the movement, The display image Edis is cut out from the moved area and sequentially output to the display unit 15. Therefore, the display unit 15 can display a region and a range that change according to the amount and orientation of the cellular phone 1 tilted.

  Alternatively, when it is detected that the mobile phone 1 is tilted, the display image Edis is sequentially output to the display unit 15 while moving the cutout position of the display image Edis cut out from the image information E at a predetermined speed. May be continued until a different tilt is detected.

  In the embodiment described above, when the mobile phone 1 is tilted in the up / down / left / right direction, the display image is also moved in the up / down / left / right direction in synchronization with this. However, the screen movement is performed as in, for example, Web browsing. Is mainly a scroll in the vertical direction, the tilt in the vertical direction may be associated with the scroll in the vertical direction, and the tilt in the horizontal direction may be allocated for enlargement / reduction.

  FIG. 10 and FIG. 11 are diagrams showing an example of an enlarged / reduced display. If the image information E is map information, the user tilts the mobile phone 1 to one of the left and right sides, so that FIG. The image can be enlarged as shown in FIG. If the image information E is three-dimensional map information, the user can enlarge the image in FIG. 11A as shown in FIG. 11B by tilting the mobile phone 1 in the horizontal direction or the vertical direction. As shown in FIG. 3C, the image can be an image in which the viewpoint (overhead angle) is moved, or can be further enlarged in that state to display the image shown in FIG.

  In the above-described embodiments, the present invention has been described by taking the application to a mobile phone as an example. However, any information terminal including an imaging unit can be similarly applied to a PDA or a portable computer.

It is a functional block diagram of a mobile phone to which the present invention is applied. FIG. 4 is a diagram schematically representing a relationship between image information E and a display image Edis. It is the functional block diagram which showed the structure of the motion detection part. It is the flowchart which showed operation | movement of the motion detection part. It is the figure which showed the relationship between a picked-up image and a differential image. It is the figure which showed the relationship between the picked-up image with a flow, and a differential image. It is the functional block diagram which showed the structure of the direction estimation part. It is the flowchart which showed operation | movement of the direction estimation part. It is the figure which represented typically operation | movement of the direction estimation part. It is a figure which shows the example of the image displayed on a display part. It is a figure which shows the other example of the image displayed on a display part.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Imaging part, 12 ... Estimation part, 13 ... Control part, 14 ... Memory | storage part, 15 ... Display part, 51, 52 ... Edge feature-value calculation part, 53, 54 ... Normalization part, 55, 56 ... Dispersion value calculation , 57... Motion detection unit, 58, 59... Previously distributed value storage unit, 71... Flow amount estimation unit, 72... Projected image generation unit, 73. Orientation estimation unit

Claims (8)

Photographing means for outputting an image photographed at a predetermined sampling period;
Storage means for holding image information;
Display means for displaying the image information;
An estimation unit that analyzes the captured image and estimates a change in a spatial positional relationship between the imaging unit and the subject;
Control means for controlling image information to be read from the storage means and displayed on the display means based on a change in the spatial positional relationship estimated by the estimation means;
The estimation means includes
Edge feature amount calculating means for calculating an edge feature amount with respect to a predetermined direction of the captured image;
A motion detection means for detecting movement of the captured image by comparing each edge feature amount of the current image captured at the current sampling time and the previous image captured at the previous sampling time;
An information terminal device that estimates a change in a spatial positional relationship between a photographing unit and a subject based on a detection result of the motion.   The information terminal apparatus according to claim 1, wherein the edge feature amount calculating unit calculates a differential image related to a predetermined direction of the captured image. The estimating means further comprises:
A quantitative value calculating means for calculating a quantitative value of the edge feature amount;
The information terminal apparatus according to claim 1, wherein the motion detection unit compares a quantitative value of each edge feature amount of the previous image and the current image.   The information terminal device according to claim 3, wherein the quantitative value calculating unit calculates a variance value of the edge feature amount.   The information terminal device according to claim 3, wherein the quantitative value calculating unit calculates an average value of the edge feature amount. A movement amount calculating means for calculating a movement amount from the previous image to the current image;
A flow amount estimating means for estimating a flow amount generated in the current image in response to a change in a spatial positional relationship between the photographing means and the subject during the current image shooting based on the movement amount;
Based on the previous image and the flow amount, a means for generating a post-movement estimated image equivalent to the case where the previous image is flowed by the flow amount;
6. The information terminal device according to claim 1, further comprising a direction estimating unit that estimates a direction of movement based on the current image and the estimated image after movement. The means for generating the post-movement estimated image is:
Means for projecting an image obtained by moving the previous image in the flow direction by a predetermined unit amount, and repeating this until the total movement amount reaches the flow amount;
The information terminal device according to claim 6, further comprising means for adding the projected images and averaging the corresponding projected pixels to generate a post-movement estimated image. The direction estimating means includes
Means for calculating an edge feature amount of the post-movement estimated image;
8. The information terminal device according to claim 6, further comprising means for estimating a direction of movement based on an edge feature amount of the current image and an edge feature amount of the post-movement estimated image.