JP5706204B2 - Display control apparatus and display control method - Google Patents

Description

  The present invention relates to a display control apparatus and a display control method for displaying a part of a display target that cannot be displayed on a display.

  There is a technique in which a space representing a geographic space or conceptual space is drawn by computer graphics, a user can freely move through the space through an input device, and the space can be further expanded or reduced (see, for example, Patent Document 1). . Within the space, in the case of geographic space, it is a line indicating a route, and in the case of a concept space, it is a line indicating a concept. In order for the user to see what is around the whole image or part of the line, an operation for viewing has been required.

  Here, it is assumed that there is an environment in which a user can freely move through an input device such as a touch panel, a mouse, or a stick device in a geographical space or a conceptual space drawn on the screen. If you want to follow a driving route drawn on a map or a conceptual line (a broken line, a curve, etc.) connecting one point to another point, the user can input through the input device, It is necessary to follow the line by repeatedly moving, enlarging, and reducing.

JP 2002-243489 A (summary)

  However, if the input is too strong (for example, scrolling vigorously and strongly), the route to be traced will go out of the screen, or if the input is too weak (for example, scrolling weakly and lightly), it will be easy to follow the line Or do not proceed. In addition, if the center of enlargement is not on the line, there is a problem that the line to be traced goes out of the screen and disappears.

  In view of the above problems, an object of the present invention is to provide a display control apparatus and a display control method capable of accurately tracking a route to be traced without going outside the screen.

  In other words, when a user operates a touch panel or a controller, a restriction is imposed so that scrolling of the map space or conceptual space can be performed only on a line such as a route (on the rail), and in addition, there is no restriction on the map. "Free scroll" mode that can be moved to and "Limited scroll" mode that can scroll only on a predetermined line or within a limited area, and switching between the two modes described above also presses a new button We propose an interface with a gesture recognition function that can be done with similar strokes and drags.

  Specifically, the line you want to restrict scrolling has a rail-like texture, bring a point of interest such as the cursor at the center of the screen near the rail, and trace it parallel to the rail. Entangles and scrolls only on the rail. Also, if the user pulls strongly in a direction perpendicular to the direction of the rail, the cursor is released from the rail, the cursor moves freely, and returns to the “free scroll” mode.

  To achieve the above object, according to the present invention, a route line indicating a predetermined route on a display for displaying a map is displayed on the display, and a drag operation on the display for scrolling by a user is performed. And a display control device that moves the route line in response to display other parts of the route line that are not displayed on the display, the drag speed and the drag operation when the drag operation is performed on the display. Detection means for detecting a dragged direction based on the point, and a point displayed on the display when the scrolling is started based on the detected drag speed as the magnitude of the detected vector of the direction Means for calculating the distance moved by the scroll, and indicates the position on the display In the case of limited scrolling in which the cursor is movable only on the route line, the detected direction vector having a size corresponding to the calculated distance is projected as a vector in a direction parallel to the route line. There is provided a display control apparatus comprising: projection means; and display control means for displaying the route line by moving the route line by the size of the projected vector and in a direction opposite to the projected vector. The With this configuration, the route to be traced does not protrude from the screen, and tracking along the route can be performed accurately. The route refers to, for example, a route from a certain point to a certain point (for example, a shortest distance route or a shortest time route calculated by inputting a departure point and an arrival point). In addition, here, the route line is a display target, but is not limited to the route line, and may be a concept line indicating a concept to be described later. Further, the route line described above corresponds to a scroll rail described later. Also, the projection here is equivalent to calculating the magnitude of the vector in the direction parallel to the route line, and if the magnitude of the vector in the direction parallel to the route line can be calculated without projecting, the projection is not allowed. Also good. In addition, when the drag operation is performed by a haptic device described later, the drag speed changes according to the angle at which the haptic device is tilted from a stationary state (an initial state in which no external force is applied), for example, and is tilted to the maximum. The maximum speed. When the tilting of the haptic device is stopped, if a frictional force is set as described later, the scrolling automatically stops after a certain amount of progress.

  Further, in the display control device of the present invention, when the vector indicating the inclination direction of the route line at the currently displayed display magnification is used as a representative vector, the drag operation of the user is predetermined with respect to the representative vector. Determining means for determining whether or not the first operation, and if it is determined that the predetermined first operation, the display control by the limited scroll is released, and the scroll is performed by moving the cursor. Switching means for switching to a free scroll that enables other than on the route line, and when the display control of the route line is the free scroll, the determination unit is configured to drag the user with respect to the representative vector. It is determined whether or not the operation is a predetermined second operation, and when it is determined that the operation is the predetermined second operation, the switching unit performs the scrolling operation. Switching to the restriction scroll from the free scrolling are preferred embodiments of the present invention. With this configuration, it can be used according to the application. Here, the inclination direction of the route line is a predetermined reference line (for example, a line indicating the horizontal direction at the currently displayed display magnification or a line indicating a certain azimuth direction (east-west direction, north-south direction, etc.)) Say the slope with respect to.

  Further, the display control apparatus of the present invention further comprises representative vector calculation means for calculating the representative vector, and the representative vector calculation means is configured such that when the current display control of the route line is based on the restricted scroll. The coordinate information of the point within the predetermined range on the route line from the cursor, the coordinate information of the point where the cursor is, and the information of the display magnification currently displayed are acquired, and the route at each point The representative vector is calculated by multiplying a minute vector indicating a line by a predetermined function value corresponding to the display magnification, and when the current display control of the route line is based on the free scroll, the cursor A point within the predetermined range on the route line from the reference point with the point on the route line closest to the reference point as a reference point The coordinate information, the coordinate information of the reference point, and the information of the currently displayed display magnification are acquired, and a minute vector indicating the route line at each point is multiplied by a predetermined function value corresponding to the display magnification. It is a preferred aspect of the present invention to calculate the representative vector together. With this configuration, an appropriate vector can be calculated.

  In the display control apparatus of the present invention, it is a preferable aspect of the present invention that the predetermined function value is a value by a window function and / or a value by a weight function. With this configuration, it is possible to perform efficient processing for calculating representative vectors.

  In the display control apparatus of the present invention, the predetermined first operation is an operation of dragging in a direction substantially perpendicular to the representative vector, and the predetermined second operation is performed on the representative vector. It is a preferable aspect of the present invention that it is an operation of dragging in a substantially parallel direction. With this configuration, switching between limited scrolling and free scrolling can be easily performed.

  In the display control apparatus of the present invention, when the display control of the route line is the limited scroll and the drag operation is performed using a predetermined input device, the input direction of the user via the input device and It is a preferable aspect of the present invention to further include device control means for applying vibration and / or repulsive force to the input device when the direction of the representative vector is in a predetermined relationship. With this configuration, switching between limited scrolling and free scrolling can be easily performed without gazing at the screen.

  Further, in the display control apparatus of the present invention, when the route line display control is the limited scroll and the drag operation is performed using a predetermined input device, the route at the currently displayed display magnification is used. When a vector indicating the inclination direction of the line is used as a representative vector, the projection unit calculates a difference between the vector in the user's input direction via the input device and the vector in the user's input direction before a predetermined time. When the calculated difference direction vector is projected onto the representative vector, and the value of the vector component obtained by subtracting the projected vector from the difference direction vector is larger than a predetermined value, the limited scrolling is performed, and the cursor is moved. It is a preferable aspect of the present invention that the apparatus further includes switching means for switching to free scrolling that is possible other than on the route line. That. With this configuration, even if the user defeats the controller strongly in the initial stage and changes the sharp curve (upward curve), the user does not derail from the route unless the controller is defeated relatively strongly within the given time Δt. You can scroll with confidence.

  Further, in the display control apparatus of the present invention, the switching means is a case where the display control of the route line is the free scrolling, and the speed of the cursor by the drag operation via the predetermined input device is predetermined. It is a preferable aspect of the present invention to switch the free scroll to the restricted scroll when the speed is lower than the speed and the distance between the cursor and the route line displayed on the display is shorter than a predetermined distance. With this configuration, switching from the free scroll mode to the restricted scroll mode can be facilitated.

  In the display control apparatus of the present invention, when the input direction of the user via the input device and the direction of the representative vector are in a predetermined relationship, vibration and / or repulsive force is applied to the input device. It is a preferable aspect of the present invention to further include device control means for providing With this configuration, it can be felt without derailment that the direction of the route has changed.

  According to the present invention, a route line indicating a predetermined route on a display for displaying a map is displayed on the display, and the route line is displayed according to a drag operation on the display for scrolling by a user. A display control method for moving and displaying another part of the route line that is not displayed on the display, the drag speed when the drag operation is performed on the display, and the dragged direction based on the drag operation And a point displayed on the display when the scroll is started is moved by the scroll based on the detected drag speed as a magnitude of the detected vector in the direction. A calculation step for calculating the distance, and a cursor indicating the position on the display In the case of limited scrolling that is movable only on the route line, a projection step of projecting the detected direction vector having a size corresponding to the calculated distance as a vector parallel to the route line And a display control step of displaying the route line by moving the route line by the size of the projected vector and in the direction opposite to the projected vector. With this configuration, the route to be traced does not protrude from the screen, and tracking along the route can be performed accurately.

  Further, in the display control method of the present invention, when the vector indicating the inclination direction of the route line at the currently displayed display magnification is used as a representative vector, the drag operation of the user is predetermined with respect to the representative vector. A determination step for determining whether or not the first operation is performed, and when it is determined that the first operation is the predetermined operation, display control by the limited scroll is canceled, and the scroll is performed by moving the cursor. Switching to a free scroll that enables other than on the route line, and when the display control of the route line is the free scroll, the drag operation of the user with respect to the representative vector It is determined whether or not the operation is a second operation, and when it is determined that the operation is the predetermined second operation, the scroll is changed from the free scroll. Switching to serial limiting scrolling is a preferred embodiment of the present invention. With this configuration, it can be used according to the application.

  The display control method of the present invention further includes a representative vector calculation step of calculating the representative vector, and when the display control of the current route line is based on the restricted scroll in the representative vector calculation step. The coordinate information of the point within the predetermined range on the route line from the cursor, the coordinate information of the point where the cursor is, and the information of the display magnification currently displayed are acquired, and the route at each point The representative vector is calculated by multiplying a minute vector indicating a line by a predetermined function value corresponding to the display magnification, and when the current display control of the route line is based on the free scroll, the cursor A point on the route line closest to the reference point is a reference point, and within a predetermined range on the route line from the reference point The coordinate information of the point and the coordinate information of the reference point, and the information of the display magnification currently displayed, and a predetermined function corresponding to the display magnification in a minute vector indicating the route line at each point It is a preferable aspect of the present invention to calculate the representative vector by multiplying values. With this configuration, an appropriate vector can be calculated.

  In the display control method of the present invention, it is a preferable aspect of the present invention that the predetermined function value is a value by a window function and / or a value by a weight function. With this configuration, it is possible to perform efficient processing for calculating representative vectors.

  In the display control method of the present invention, the predetermined first operation is an operation of dragging in a direction substantially perpendicular to the representative vector, and the predetermined second operation is performed on the representative vector. It is a preferable aspect of the present invention that it is an operation of dragging in a substantially parallel direction. With this configuration, switching between limited scrolling and free scrolling can be easily performed.

  In the display control method of the present invention, when the display control of the route line is the limited scroll and the drag operation is performed using a predetermined input device, the input direction of the user via the input device and It is a preferable aspect of the present invention that the method further includes a device control step of applying vibration and / or repulsive force to the input device when the direction of the representative vector is in a predetermined relationship. With this configuration, switching between limited scrolling and free scrolling can be easily performed without gazing at the screen.

  Further, in the display control method of the present invention, the route line display control is the limited scroll, and the drag operation is performed using a predetermined input device, and the route at the currently displayed display magnification is used. When a vector indicating the inclination direction of the line is used as a representative vector, a difference direction vector obtained by calculating a difference between the vector of the user's input direction via the input device and the vector of the user's input direction before a predetermined time Projecting onto the representative vector, and when the vector component value obtained by subtracting the projected vector from the difference direction vector is larger than a predetermined value, the limited scrolling is performed, and the cursor is moved along the path. It is a preferable aspect of the present invention to further include a switching step for switching to free scrolling that can be performed other than on the line. It is. With this configuration, even if the user defeats the controller strongly in the initial stage and changes the sharp curve (upward curve), the user does not derail from the route unless the controller is defeated relatively strongly within the given time Δt. You can scroll with confidence.

  Further, in the display control method of the present invention, the route line display control is the free scroll, and the speed of the cursor by the drag operation via the predetermined input device is lower than a predetermined speed, and When the distance between the cursor and the route line displayed on the display is shorter than a predetermined distance, switching the free scroll to the limited scroll is a preferred aspect of the present invention. With this configuration, switching from the free scroll mode to the restricted scroll mode can be facilitated.

  In the display control method of the present invention, when the input direction of the user via the input device and the direction of the representative vector are in a predetermined relationship, vibration and / or repulsive force is applied to the input device. It is a preferred embodiment of the present invention to further include a device control step that provides With this configuration, it can be felt without derailment that the direction of the route has changed.

  The display control apparatus and the display control method of the present invention have the above-described configuration, and the route to be traced does not protrude from the screen, and tracking along the route can be performed accurately. That is, the user can perform various operations without any action such as pressing a new button from the beginning to the end only by finger stroke, mouse drag, controller input, and the like. In other words, the map space or the concept space can be freely scrolled (free scrolling), or limited scrolling can be performed to scroll only on the route or curve. Also, switching between them (switching between free scrolling and limited scrolling) receives an intuitive interpretation (sensation) that the curve is like a rail and the screen is on it, tracing along the rail, It can be done by moving vertically to get off the rail.

  Furthermore, since the rail shape in the present invention differs depending on the enlargement / reduction value arbitrarily determined by the user, the “shape visible on the screen” is calculated as the current rail shape. In addition, the texture that runs along this rail can be applied to haptic devices, etc., and when you try to get off the rail, there is no need to press an extra button and the input device is directed toward the direction where the repulsive force is applied more. Can be done in an extremely intuitive way that release from the rail can be achieved.

It is a figure which shows a mode that the path | route is drawn in the certain geographical space in the 1st Embodiment of this invention. It is a figure which shows a mode that the map is moving in the geographic space by the part to which the user's finger | toe moved by dragging with the touch panel etc. in the 1st Embodiment of this invention. It is a figure which shows the initial state of the limited scroll before the user operates in the 1st Embodiment of this invention. It is a figure which shows the state which the user touches a certain point on the touchscreen in the 1st Embodiment of this invention, and is going to drag in the direction of the screen upper right. It is a figure which shows the vector when the vector of the direction of the upper right which is going to drag of FIG. 2b in the 1st Embodiment of this invention is projected on the direction vector of a scroll rail. It is a figure which shows the mode of the state where the new point of the finger | toe when a finger | toe is actually dragged from the state of FIG. 2b in the 1st Embodiment of this invention, and the screen scrolled. It is a figure which shows a mode that it continues moving on a scroll rail, after releasing the finger | toe in the 1st Embodiment of this invention. It is a figure which shows a mode that it scrolls along a scroll rail even if the direction of a scroll rail changes following FIG. 2e in the 1st Embodiment of this invention. It is a figure which shows the scroll rail in the 1st Embodiment of this invention. It is the figure which expanded FIG. 3a in the 1st Embodiment of this invention. FIG. 3B is a diagram showing the representative vector in FIG. 3A according to the first embodiment of the present invention. FIG. 3B is a diagram showing the representative vector of FIG. 3B in the first embodiment of the present invention. It is a figure which shows the line and curve of the scroll rail displayed on the screen in the 1st Embodiment of this invention. It is a figure which shows that the line | wire and curve in the 1st Embodiment of this invention actually consist of many points arrange | positioned at the distance of equal intervals along a line. It is a figure which shows that each point of FIG. 4b in the 1st Embodiment of this invention can express with many microvectors by taking the difference of the coordinate of adjacent. It is a figure which shows the scroll rail in the 1st Embodiment of this invention, the point of interest, and the periphery of the point of interest. It is a figure which shows the micro vector group of the scroll rail arranged vertically according to the distance along the scroll rail in the 1st Embodiment of this invention. It is a figure which shows the window function multiplied to the micro vector in the 1st Embodiment of this invention. It is a figure which shows the weight function multiplied to a minute vector in the 1st Embodiment of this invention. FIG. 5b is a diagram showing a representative vector of the scroll rail in FIG. 5a in the first embodiment of the present invention. It is another figure which shows the periphery of the scroll rail in the 1st Embodiment of this invention, the point of interest, and the point of interest. It is another figure which shows the micro vector group of the scroll rail arranged vertically according to the distance along the scroll rail in the 1st Embodiment of this invention. It is another figure which shows the window function multiplied to the micro vector in the 1st Embodiment of this invention. It is another figure which shows the weight function multiplied to the minute vector in the 1st Embodiment of this invention. It is a figure which shows the representative vector of the scroll rail in FIG. 6a in the 1st Embodiment of this invention. It is a flowchart for demonstrating the flow for calculating | requiring the representative vector in the 1st Embodiment of this invention. It is a figure which shows the state of the screen and scroll rail of the free scroll mode in the 1st Embodiment of this invention. It is a figure which shows the case where an attention point is brought near the scroll rail by the free scroll in the 1st Embodiment of this invention. It is a figure which shows the case where the attention point in the 1st Embodiment of this invention approaches the scroll rail further. It is a figure for demonstrating the gesture for switching to the restricted scroll mode in the 1st Embodiment of this invention. It is a figure which shows a mode that the attention point in the 1st Embodiment of this invention is attracted | sucked on a scroll rail, and switches to a restricted scroll mode. It is a flowchart for demonstrating the switching flow from the free scroll mode to the restriction | limiting scroll mode in the 1st Embodiment of this invention. It is a figure which shows the state in the restricted scroll mode of the 1st Embodiment of this invention, and shows a mode that the point of interest exists on a scroll rail. It is a figure which shows a mode that the finger | toe touched the touchscreen etc. in the 1st Embodiment of this invention. It is a figure which shows a mode that the direction vector which is going to drag in the 1st Embodiment of this invention was component-divided into the component projected on the representative vector, and the component perpendicular | vertical to it. It is a figure which shows a mode that the screen was moved along a scroll rail only by the component parallel to a representative vector by actually dragging from the state of FIG. 10c of the 1st Embodiment of this invention. It is a figure which shows a mode that the vector component projected on the axis | shaft perpendicular | vertical to a representative vector is strong although dragging of the 1st Embodiment of this invention was performed. It is a figure which shows a mode that it repeats to a positive direction and a negative direction in parallel with the axis | shaft perpendicular | vertical to the representative vector in the 1st Embodiment of this invention, and it performs the operation | movement which makes it violate several times. It is a figure which shows a mode that the point of interest is released from the scroll rail in the 1st Embodiment of this invention, and it switches to free scroll mode. It is a figure for demonstrating the switching flow from the restricted scroll mode in the 1st Embodiment of this invention to free scroll mode. It is a figure which shows the case where the scroll rail in the 1st Embodiment of this invention branches like a branch. It is a figure which shows the other case where the scroll rail in the 1st Embodiment of this invention branched like a branch. It is a figure which shows the stick type device of an example of the input device in the 1st Embodiment of this invention. It is a figure which shows the button type device of an example of the input device in the 1st Embodiment of this invention. It is a figure which shows the case where the representative vector in the 1st Embodiment of this invention is rising to the right. It is a figure which shows the repulsive force F when a user inputs in the arbitrary two-dimensional directions in the 1st Embodiment of this invention. It is a figure which shows the input from the user in the 1st Embodiment of this invention. It is a figure which shows an example of a structure of the display control apparatus which concerns on the 1st and 2nd embodiment of this invention. It is a flowchart which shows an example of the processing flow by the display control apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows the stick-type controller (haptic controller) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller in the 2nd Embodiment of this invention from right above. It is a figure which shows the stick-type controller which fell forward (front) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller which fell forward (front) in the 2nd Embodiment of this invention from right above. It is a figure which shows the stick-type controller which fell a little back (back) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller which fell down back (back) a little in the 2nd Embodiment of this invention from right above. It is a figure which shows the stick-type controller which fell down back (back) in the 2nd Embodiment of this invention. It is the figure which looked at the stick-type controller which fell down back (back) in the 2nd Embodiment of this invention from right above. It is a figure which shows the map of the path | route which faced the north in the 2nd Embodiment of this invention. It is a figure which shows the stick-type controller which fell forward (front) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller which fell forward (front) in the 2nd Embodiment of this invention from right above. It is a figure which shows the map of the path | route which faced the northeast in the 2nd Embodiment of this invention. It is a figure which shows the stick-type controller which fell forward (front) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller which fell forward (front) in the 2nd Embodiment of this invention from right above. It is a figure which shows the map of the path | route which faced the northeast in the 2nd Embodiment of this invention. It is a figure which shows the stick-type controller which fell down front right (right front) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller which fell down right front (right front) in the 2nd Embodiment of this invention from right above. It is a figure which shows the map of the path | route which faced the northeast in the 2nd Embodiment of this invention. It is a figure which shows the stick-type controller which fell forward (front) in the 2nd Embodiment of this invention. It is the figure which looked at the stick type controller which fell forward (front) in the 2nd Embodiment of this invention from right above. It is a figure which shows the difference with t second of the stick-type controller which fell forward (forward) in the 2nd Embodiment of this invention. It is the figure which looked at the difference from t seconds ago of the stick-type controller which fell forward (forward) in the 2nd Embodiment of this invention from right above. It is the figure which looked at the difference from t seconds ago of the stick-type controller which fell forward (forward) in the 2nd Embodiment of this invention from right above. It is a flowchart which shows an example of the flow for calculating the repulsion in the 2nd Embodiment of this invention. It is the figure which showed an example of the path | route which bends rapidly in the 2nd Embodiment of this invention. It is the figure which showed another example of the path | route which curves rapidly in the 2nd Embodiment of this invention. It is the figure which showed an example in which the user is going along the path | route in the path | route which curves rapidly in the 2nd Embodiment of this invention. It is the figure which showed an example in which the user is going off the path | route in the path | route which bends rapidly in the 2nd Embodiment of this invention. It is a flowchart which shows an example of the flow of the part which judges switching from the limited scroll in the 2nd Embodiment of this invention to a free scroll. It is a flowchart which shows an example of the whole flow for the switch from the limited scroll in the 2nd Embodiment of this invention to a free scroll. It is a figure which shows the state in which the cursor approached the path | route by the free scroll in the 2nd Embodiment of this invention. It is a figure which shows the state where the cursor approached the path | route by the free scroll in the 2nd Embodiment of this invention, and the path | route point on a path | route. It is a flowchart which shows an example of the whole flow for the switch from the free scroll to the limit scroll in the 2nd Embodiment of this invention.

<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described. Here, the terms used in the present invention are defined. A line, line segment, or curve indicating a route or concept is called a “scroll rail”. In the present invention, it is possible to move in a two-dimensional and three-dimensional space such as a geographic space and a conceptual space by a user input via a device such as a touch panel, a mouse, and a controller. The case where the user can freely move in the space is called “free scroll”, and the case where the user can move in a limited manner only on the scroll rail is called “restricted scroll”.

  FIG. 1a shows a route being drawn in a certain geographic space. A cursor is drawn at the center of the screen. FIG. 1b shows a state where the map moves in the geospace by the amount of the user's finger moved by dragging on the touch panel or the like. Since the user can freely scroll regardless of the scroll rail drawn in the geographic space, in this case, the free scroll mode (also simply referred to as free scroll) is set. The scrolling operation uses the existing technique of playing.

  The current position is scrolled by sampling the scrolling speed (also called the dragging speed) at regular intervals while dragging before playing, and the scrolling speed immediately before the finger leaves the touch panel. And keep scrolling. After that, a frictional force or the like is set, and the scrolling can be automatically stopped after a certain amount of progress.

  Another mode of limited scroll proposed by the present invention will be described with reference to FIGS. In FIGS. 2a to 2f, the cursor at the center of the screen is on a route drawn in the geospace. The vector in which the finger moves by dragging on the touch panel or the like moves only the component projected onto the vector in the path direction from the point on the path where the cursor at the center of the screen is located. FIG. 2a shows the initial state of limited scrolling before the user operates. The center of the screen is on the scroll rail.

  FIG. 2b shows a state where the user touches a certain point on the touch panel and tries to drag in the upper right direction of the screen. FIG. 2c shows a vector when the vector in the upper right direction to be dragged in FIG. 2b is projected onto the direction vector of the scroll rail. FIG. 2d shows a new point of the finger when the finger is actually dragged from the state of FIG. 2b and a state where the screen is scrolled. Thereby, it can be seen that the vector moved by the drag is moved in the opposite direction by the amount of the vector projected on the scroll rail.

  FIG. 2e shows how it continues to move along the scroll rails after the finger is released. FIG. 2f shows the state of scrolling along the scroll rail even if the orientation of the scroll rail changes, following FIG. 2e. As described above, each movement in the free scrolling and the limited scrolling is simply described.

  Next, switching from free scroll to limited scroll and switching from limited scroll to free scroll will be described. For this purpose, first, the “representative vector” defined in the present invention will be described. A scroll rail vector when the scroll rail is viewed in the range of the screen by enlargement / reduction (enlargement / reduction value) around a certain point on the scroll rail is called a representative vector.

  An example of the representative vector will be described with reference to two examples of FIGS. 3a and 3c and FIGS. 3b and 3d. First, the case of FIGS. 3a and 3c will be described. In FIG. 3c, the center point of the screen is specifically placed on the scroll rail. Since the scroll rail around the center of the screen rises to the right, the representative vector also rises to the right. On the other hand, in the case of FIGS. 3b and 3d, the scroll rail is exactly the same as in FIGS. 3a and 3c, and the center point is also exactly the same in FIGS. 3c and 3d. The only difference is that FIG. 3d is an enlargement of FIG. 3c (enlargement / reduction value), and the relationship is shown in FIGS. 3a and 3b. Therefore, in the case of FIG. 3B and FIG. 3D, the representative vector is also lowered to the right because the scroll rail around the center of the screen is lowered to the right.

  As described above, the representative vector depends on the given scroll list, the focused position, and the enlargement / reduction value. How the representative vector is actually calculated will be described in detail. Figures 4a to 4c show how the scroll rails showing the paths and conceptual lines are mathematically represented. FIG. 4a shows scroll rail lines and curves displayed on the screen. FIG. 4b shows that these lines and curves actually consist of a number of points arranged at equally spaced distances along the line. If each point is two-dimensional, it has coordinates according to the three-dimensional case.

  Note that when lines are actually stored as data, it is mainstream to have the coordinates of only the broken part of the line as data, but here, these points are generated with data arranged at equal intervals. I will explain it. FIG. 4c shows that each point in FIG. 4b can be expressed by a large number of minute vectors by taking the difference of the coordinates of the neighbors. A description will be given of how the scroll list represented by a large number of minute vectors described in FIGS. 4a to 4c is calculated as a representative vector with reference to FIGS. 5a to 5e, FIGS. 6a to 6e, and FIG. To do.

  5a to 5e describe the cases of FIGS. 3a and 3c, and FIGS. 6a to 6e describe the cases of FIGS. 3b and 3d. First, FIGS. 5a to 5e will be described. FIG. 5a shows a scroll rail, a point of interest (hereinafter also referred to as a point of interest), and the periphery of the point of interest. FIG. 5b shows a small group of scroll rail vectors arranged vertically according to the distance along the scroll rail. FIG. 5c shows the window function to multiply the small vector. FIG. 5d shows a weighting function to be applied to the minute vector. FIG. 5e shows a representative vector of the scroll rail in FIG. 5a.

  In FIG. 5a, a scroll rail is drawn, and in this case, a point of interest that is the center of the screen exists on the scroll rail. On the scroll rail, a number of minute vectors are schematically arranged vertically according to the distance along the scroll rail from the point of interest and displayed in FIG. 5b. In FIG. 5b, FIG. 5c, and FIG. 5d, the vertical axis means a distance having a sign along the scroll rail from the point of interest. A scroll rail is a curve, and from a point of interest on the curve, the distance away along a curve in a certain direction is defined as a positive distance in the positive direction of the vertical axis, and away from the above. It is arranged in the negative direction of the vertical axis as a negative distance. The portion of “0” on the vertical axis is the point of interest. A number of minute vectors existing on the scroll rail displayed in FIG. 5a are schematically drawn in FIG. 5b in accordance with the respective points.

The representative vector is a representation of the direction of the entire scroll rail within the range displayed on the screen corresponding to the enlargement / reduction value around the point of interest on the scroll rail. I want to consider a point of interest and a small vector only within a certain region. For this reason, since a minute vector located at a distant position is not taken into consideration, it is possible to delete the distantly present window function as shown in FIG. 5c. In other words, each minute vector can be processed by multiplying each minute vector shown in FIG. The window function is a general function used for signal processing. The window function W _i (x) returns 1 when x = 0 and 0 when it is away from x = 0 in the positive or negative direction. return. The window function is shown in Equation (1). width is the width of the window.

  The center x = 0 of the window function is the point of interest on the scroll rail of FIG. 5a, usually the center position of the screen. The width width of the window function depends on the scaling value determined by the user in the space in FIG. FIG. 5c and FIG. 6c described later have the same window function, but the width width is larger in FIG. 5c. This is because FIGS. 5a to 5e correspond to the scroll rail of FIG. 3a, and FIGS. 6a to 6e correspond to the scroll rail of FIG. That is, if the user enlarges the scroll rail, the width is reduced because the small part of the enlarged scroll rail is seen, and if the user is reduced, the width is increased because the large range of the scroll rail is seen. As the width increases, the number of minute vectors as shown in FIG. 4c increases enormously, so that a calculation method such as taking into account only minute vectors sampled at a certain period is possible.

Furthermore, when a weight (weight) is to be placed on a vector on the scroll rail near the point of interest, the maximum value 1 is returned at the point of interest as shown in FIG. The weight can be changed by multiplying W _e (x) by a minute vector on the scroll rail. Although the weighting function W _e can use any function as necessary, wherein using a Gaussian function as an example, it shows it to Equation (2).

  Where c is a constant and is related to the width of the Gaussian function. The value of c depends on how much the weight is increased. A vector obtained by adding all of a large number of minute vectors on the processed scroll rail through these processes becomes a representative vector as shown in FIG. 5e.

  6a to 6e also calculate representative vectors in the same manner as in FIGS. 5a to 5e. FIG. 6a shows the scroll rail, the point of interest, and the periphery of the point of interest. FIG. 6 b shows a small vector group of scroll rails arranged vertically according to the distance along the scroll rail. FIG. 6c shows the window function to multiply the small vector. FIG. 6d shows a weight function to be applied to the minute vector. FIG. 6e shows a representative vector of the scroll rail in FIG. 6a.

  In FIGS. 5a to 5e and FIGS. 6a to 6e, although the positions on the scroll rail for obtaining the representative vector are the same, the scaled values are different, and thus completely different representative vectors are obtained. This is because the representative vector is defined as the shape of the scroll rail that the user can “look on the screen”, so if the screen is enlarged or reduced, the approximate shape that can be seen will be different, so it is natural that the representative vector is also different. Become. The feature of the present invention is that the “apparent shape” of the scroll rail is calculated based on the idea of the user interface.

A procedure for obtaining the representative vector will be described with reference to FIG. The current coordinates on the scroll rail and the enlargement / reduction value necessary for determining the representative vector are acquired (step S701). The coordinate on the scroll rail used to determine the representative vector is brought to the center position of the window function, the width of the window function is changed according to the given scaling value, and the window function is assigned to each minute vector constituting the scroll rail. Multiply (step S702). The coordinates on the scroll rail used to determine the representative vector are brought to the center of the weight function, the width of the weight function is changed according to the given scaling value, and the weight function is assigned to each minute vector constituting the scroll rail. Multiply (step S703). A representative vector is calculated by adding the minute vectors subjected to these processes (step S704). Formula (3) shows how to calculate the representative vector. In Equation (3), a minute vector at a certain point x on the scroll rail is defined as a V _{minute vector} (x).

  The denominator is the length of a small vector and is being standardized. The representative vector of the scroll rail has been described above.

  Next, a method of switching from free scroll to limited scroll will be described with reference to FIGS. 8a to 8e and FIG. FIG. 8a shows the screen of the free scroll mode and the state of the scroll rail. Because of the free scroll mode, the center point of the screen, which is the point of interest (point of interest), is not on the scroll rail. FIG. 8b shows a case where the point of interest is brought near the scroll rail by free scrolling. A point on the scroll rail closest to the attention point is found, and a distance from the point to the attention point is defined as a distance d to the scroll rail.

  FIG. 8c shows a case where the attention point further approaches the scroll rail. Here, the representative vector of the scroll rail is obtained from the point on the scroll rail closest to the point of interest (the closest point) and the current enlargement / reduction value. As shown in FIG. 8d, by dragging the screen almost parallel to the representative vector obtained in FIG. 8c, a gesture for switching to the scroll restriction mode is performed as if the attention point is hooked on the scroll rail. As shown in FIG. 8e, if the gesture by dragging in the direction parallel to the representative vector is successful, the point of interest is attracted onto the scroll rail and gets on the scroll rail, and the restricted scroll mode (also simply called restricted scroll). Switch to

  8A to 8E, that is, how to change from the free scroll mode to the restricted scroll mode will be described with reference to FIG. First, a coordinate movement (movement to a new position) or an enlargement / reduction value change request is received from the user using a touch panel or a controller (step S901). It is determined whether the center point of the screen or an arbitrarily determined point of interest in the screen is close to the scroll rail (a predetermined distance) (step S902). The determination of whether or not they are close is performed by searching for a point on the scroll rail closest to the point of interest, and whether or not the distance between the point and the point of interest exceeds a predetermined threshold.

  If it is determined in step S902 that the scroll rail is farther than the predetermined threshold from the point of interest in the screen, the free scroll mode is moved to the requested new point as it is, and drawing is performed with the new scaling value ( Step S907). If the distance from the scroll rail to the attention point in the screen is smaller than the predetermined threshold value in step S902, the user may bring the attention point on the scroll rail and try to switch to the restricted scroll mode. Therefore, first, the point on the scroll rail closest to the attention point obtained previously is used as the attention point on the temporary scroll rail.

  That is, the coordinates of the point on the scroll rail closest to the point of interest is the current location, and a new representative vector is calculated using the current enlargement / reduction value (step S903). The method of obtaining the representative vector has been described with reference to FIGS. 5a to 5e and FIGS. 6a to 6e. The similarity between the representative vector and the vector in the drag direction input by the user is examined (step S904). Specifically, the vector component in the drag direction by the user input projected onto the representative vector is obtained. The larger the absolute value of this vector is, the closer it is to be parallel to the representative vector that represents the direction of the scroll rail.

  It is determined whether or not the length of the projected vector obtained in step S904, that is, the absolute value is larger than a predetermined value (step S905). If it is larger, the user is somewhat the same as the direction of the scroll rail. You can determine that you are dragging in the direction. Considering that there is a point of interest in the screen at a short distance from the scroll rail in step S902, the user finally brings the point of interest in the screen to the vicinity of the scroll rail in a direction close to the scroll rail. You can determine that you are dragging. This is determined to be a request based on a gesture for switching to the “restricted scroll” mode, and the mode is switched to the “restricted scroll” mode (step S906). Specifically, an animation or the like that attracts the attention point on the screen onto the scroll rail is reproduced.

  Next, a method of switching from the restricted scroll to the free scroll will be described with reference to FIGS. 10a to 10g and FIG. FIG. 10a shows the state in the restricted scroll mode, where the point of interest is on the scroll rail. A representative vector is calculated from the current scaling value and the coordinates of the point of interest on the scroll rail. FIG. 10b shows a state in which a finger touches the touch panel or the like. FIG. 10c shows a state in which a finger is dragged and the direction vector to be dragged is decomposed into a component projected onto the representative vector and a component perpendicular thereto.

  FIG. 10d shows a state in which the screen is moved along the scroll rail by a component parallel to the representative vector by actually dragging from the state of FIG. 10c. FIG. 10e shows that the vector component projected on the axis perpendicular to the representative vector is strong although dragging is performed as in FIG. 10d. If it is greater than the predetermined vector strength threshold, it is determined that the user is moving away from the scroll rail, and the point of interest is released from the scroll rail as shown in FIG. Is switched to free scroll mode. As a further contrivance, in order to prevent easy switching, as shown in FIG. 10f, in parallel with the axis perpendicular to the representative vector, it repeats in the positive direction and the negative direction, and it goes out several times. When such an operation is performed, it is possible to add a condition such as switching to free scrolling.

  The processing described in FIGS. 10a to 10g, that is, how to switch from limited scrolling to free scrolling will be described with reference to FIG. A coordinate movement or enlargement / reduction value change request is received from the user via a touch panel or a controller (step S1101). A representative vector is calculated from the requested coordinates and the enlarged / reduced value (step S1102). A vector input by a user is divided into a projection vector onto an axis parallel to the representative vector and a projection vector onto an axis perpendicular to the representative vector. The respective vectors are called “scroll vector” and “distortion vector”.

  It is determined whether or not an operation input is in progress such as the user touching the touch panel or the controller is tilted (step S1103). If the operation input is in progress, the user tries to escape from the limited scroll. Since there is a possibility of continuing input, the process proceeds to step S1104. Conversely, when the user releases his / her hand from the controller device, it is determined that the user is not trying to escape to the free scroll, and the process proceeds to step S1106, and the amount of the “scroll vector” is increased along the scroll rail. Move the screen with limited scrolling.

  In step S1104, it is determined whether or not the “distortion vector” is larger than a predetermined value (step S1104). If it is determined that the “distortion vector” is larger, the process proceeds to step S1105 to switch from restricted scrolling to free scrolling. . On the other hand, if the “distortion vector” is smaller than a certain value, the process proceeds to step S1106.

  As a further contrivance, the strength of the “distortion vector” can be set as a new condition in which the distortion in step S1104 is large and the scroll rail is moved away from the scroll rail. That is, it can be set that the absolute value is larger than the threshold value and the user's input is performed by switching between the positive direction and the negative direction. This means that the setting is made such that switching to free scrolling is performed only after the gesture described with reference to FIG. 10f that swings in a positive direction and a negative direction in the direction perpendicular to the representative vector is performed. With such a setting, it is possible to make it difficult to cause a malfunction that a point of interest easily deviates from the scroll rail.

  The present invention can be used even when the scroll rail is branched like a branch as shown in FIGS. 12a and 12b. For the representative vector, all the small vectors branched around the current location are calculated, and if there is a point of interest at the branch point unfortunately as shown in FIG. 12b, a condition such as not switching the scroll mode is imposed. That's fine.

  Next, a haptic operation device (hereinafter also referred to as a haptic device or device) applied to the present invention will be described. In the haptic device, repulsive force, repulsive force, and vibration can be generated in an arbitrary direction in response to user input. Examples of devices include a stick type device as shown in FIG. 13a and a button type device as shown in FIG. 13b. In the present invention, regardless of the shape of the device, if the space that can be scrolled is two-dimensional, it can be input in any two-dimensional direction, and if it is three-dimensional, it can be input in any three-dimensional direction. Consider a haptic device that brings repulsive force and vibration to an input.

  Consider a case where the representative vector is rising to the right as shown in FIG. 13c. FIG. 13d shows the repulsive force F when the user inputs in an arbitrary two-dimensional direction when the representative vector is rising to the right. In FIG. 13e, consider the case where an input is made by the user to move to the control device. Assume that the input force vector is a vector in the direction of the angle α with respect to the x axis from the origin. Here, the strength of the force is normalized to be 1. Further, if the standardized representative vector at that time is (Cos θ, Sin θ), the repulsive force vector F with respect to the user input vector is expressed by Equation (4).

  Naturally, if the direction angle θ of the representative vector is the same as the direction angle α of the input force, the repulsive force F in Expression (4) is zero. This is because the repulsive force F becomes 0 as the input is made in a direction closer to the parallel to the representative vector, and conversely, the repulsive force F is opposite to the direction to be input as the input is made in the direction perpendicular to the representative vector. Increases as repulsive force in the direction. As a result, the user can move along a scroll rail such as a route in the restricted scroll mode if he / she takes an input device such as a stick in a direction with less repulsive force without gazing at the screen.

  Also, if you want to switch to free scroll mode, if you dare put a force with a stick or the like in a direction with repulsive force, it will be in a direction that is almost perpendicular to the representative vector, so you will be off the scroll rail and switch to free scroll mode. Can do. In the case of a haptic device based on vibration instead of repulsive force, the absolute value of Equation (4) may be taken, and vibration may be performed according to the strength of the value.

  Furthermore, as an application example using the present invention, the function in the limited scroll can be stopped or reproduced by switching from the limited scroll to the free scroll. Specifically, for example, when the restricted scroll mode is entered, it is assumed that there is an automatic scroll function that automatically starts animation movement in which a map on the screen moves along the scroll rail. In particular, in the case of the haptic device described above, this is a function in which the device moves without permission and the screen automatically starts to move (scroll) along the scroll rail. To temporarily stop this automatic scrolling function, the user holds the device so that it does not move freely. To stop the automatic scrolling function, the user is perpendicular to the direction of the representative vector to be automatically scrolled. Move the finger on the touch panel in the direction (drag), or move it while feeling the repulsive force of the device, then move away from the scroll rail, enter the free scroll mode from the limited scroll, and the automatic scroll function stops.

  Here, an example of the configuration of the display control apparatus according to the embodiment of the present invention will be described with reference to FIG. As shown in FIG. 14, the display control apparatus 1400 includes a detection unit 1401, a calculation unit 1402, a projection unit 1403, a display control unit 1404, a determination unit 1405, a switching unit 1406, a representative vector calculation unit 1407, and a device control unit 1408. Has been. The detection unit 1401 detects the dragged direction based on the drag speed and the drag operation when the drag operation is performed on the display. As described above, when dragging and playing, the drag speed samples the drag speed at regular intervals while dragging before playing, and the drag speed immediately before the finger leaves the touch panel. Is the drag speed.

  Based on the detected drag speed, the calculation unit 1402 calculates the distance that the point displayed on the display when scrolling has moved by scrolling, as the magnitude of the vector in the detected direction. Specifically, the magnitude of the vector indicating the drag direction shown in FIG. 2c is calculated. In the case of limited scrolling in which the cursor indicating the position on the display is movable only on the route line, the projection unit 1403 uses the detected direction vector having a size corresponding to the calculated distance as the route line. Project as a parallel vector.

  The display control unit 1404 displays the route line by moving the route line in the direction opposite to the projected vector by the size of the projected vector. The determination unit 1405 determines whether or not the user's drag operation is a predetermined first operation with respect to the representative vector. The predetermined first operation is an operation of dragging in a direction substantially perpendicular to the representative vector. When it is determined that the operation is the predetermined first operation, the switching unit 1406 cancels the display control by the limited scroll and switches the user's scroll to the free scroll.

  If the representative vector calculation unit 1407 is based on the limited scroll, the coordinate information of the point within the predetermined range on the route line from the cursor, the coordinate information of the point where the cursor is, and the currently displayed display magnification Information, and a representative vector is calculated by multiplying a small vector indicating the route line at each point by a predetermined function value corresponding to the display magnification. Using the point on the route line at a close position as the reference point, obtain the coordinate information of the point within the specified range on the route line from the reference point, the coordinate information of the reference point, and the currently displayed display magnification information Then, the representative vector is calculated by multiplying the minute vector indicating the route line at each point by a predetermined function value corresponding to the display magnification.

  In the case of limited scrolling, when the device controller 1408 performs a drag operation using a predetermined input device (such as the device shown in FIG. 13), the input direction of the user via the input device and the direction of the representative vector Is given a vibration and / or repulsive force to the input device.

  Next, an example of a processing flow by the display control apparatus according to the embodiment of the present invention will be described with reference to FIG. As shown in FIG. 15, the detection unit 1401 detects the dragged direction based on the drag speed and the drag operation when the drag operation is performed on the display (step S1501). Based on the detected drag speed, the calculation unit 1402 calculates the distance that the point displayed on the display when the scroll is started is moved by scrolling as the magnitude of the vector in the detected direction (step S1502). ).

  In the case of limited scrolling in which the cursor indicating the position on the display is movable only on the route line, the projection unit 1403 uses the detected direction vector having a size corresponding to the calculated distance as the route line. Projection is performed as a vector in a parallel direction (step S1503). The display control unit 1404 displays the route line by moving the route line by the size of the projected vector and in the direction opposite to the projected vector (step S1504). Note that the processing flow for switching between limited scrolling and free scrolling by the display control device, the generation flow of the representative vector, and the like have been described above, and thus will be omitted.

<Second Embodiment>
In the second embodiment, a switching method from the limited scroll mode to the free scroll mode in the first embodiment, that is, a determination method developed from the determination method of whether or not to derail from the scroll rail, and the first embodiment A method for determining switching from the free scroll mode to the restricted scroll mode, which is simpler than the above-described form, will be described.

  First, switching from the restricted scroll mode to the free scroll mode will be described. In the second embodiment, a time difference vector of direction vectors is used instead of the direction vector itself for scrolling the map at the time of derailment determination. As a result, in the second embodiment, when the case that could not be covered in the first embodiment, that is, when the shape of the path is greatly bent, the user can accidentally derail from the scroll rail without being bent, and the user's Aims to prevent the case of free scrolling unintentionally.

  In describing the details of the second embodiment, the defined vectors will be described with reference to FIGS. 16a to 19b. First, FIGS. 16a, 16b, 17a, 17b, 18a, 18b, 19a, and 19b describe the definition of the “direction vector” of the controller when the controller is operated on a map. FIG. 16a shows the state where the controller is in the zero position. The zero position means a position of the controller (initial position) in a state where no force is applied from the user to the controller.

  Fig. 16a shows the appearance of the controller, Fig. 16b shows the controller of Fig. 16a seen from directly above, the controller's movable range is shown as a square, and the tip (tip) of the controller is seen from directly above. A projected image (black circle projected the tip of the controller) is shown. In this case, since no force is applied to the controller, the controller is stationary at the center (middle) of the movable range. 17a and 17b show a state in which the user applies a force from the zero position in FIG. 16b and tilts the controller forward (forward). FIG. 17a shows a state in which the controller is tilted, and FIG. 17b shows a state in which the previous position of the controller has moved forward.

  18a and 18b show how the controller is tilted in the opposite direction to that of FIGS. 17a and 17b, and FIG. 18a shows how the controller is tilted slightly, as opposed to FIG. 17a. Shows a state in which the previous projection of the controller moves in the opposite direction within the movable range. 19a and 19b show that the controller is tilted in the same direction as in FIGS. 18a and 18b, but the controller is tilted further than in FIGS. 18a and 18b.

Here, in the second embodiment, an index indicating how much the controller has been moved from the zero position is referred to as a “difference direction vector” and is defined as the following mathematical formula. If the controller direction vector is X (x, y) and the controller direction vector before time Δt is X _{Δt before} (x _{Δt before} , y _{Δt before} ), the differential direction vector is defined as The conditional expressions are defined as Expression 6 to Expression 9.

Formula 5: D (X, X _{before Δt} ) = ( _before xx _{Δt, before yy Δt} )
Formula 6: if (x ≧ 0 ≧ x _{Δt before} ) OR (x ≦ 0 ≦ x _{Δt before} ) x _{Δt before} = 0
Formula 7: if (x _{Δt before} ≧ x ≧ 0) OR (0 ≧ x ≧ x _{Δt before} ) x = 0, x _{Δt before} = 0,
Formula 8: if (y ≧ 0 ≧ y _{Δt before} ) OR (y ≦ 0 ≦ y _{Δt before} ) y _{Δt before} = 0
Formula 9: if (y _{Δt before} ≧ y ≧ 0) OR (0 ≧ y ≧ y _{Δt before} ) y = 0, y _{Δt before} = 0

  The intuitive interpretation of the difference direction vector is an amount obtained by examining the x component and the y component how much the controller is moved from the aforementioned zero position (center). Therefore, when the controller is simply returned from the outside of the square movable range area to the center, it is 0 (zero). When the controller is further advanced after returning to the center, the vector corresponding to the amount further advanced from the center is added. It becomes. This will be specifically described with reference to FIGS. 16a, 16b, 17a, 17b, 18a, 18b, 19a, and 19b.

  When the controller changes from the state shown in FIGS. 16a and 16b at the zero position to the state shown in FIGS. 17a and 17b, the difference direction vector becomes the value of the direction vector itself in FIG. 17b. When moving from the state where the controller is tilted forward as shown in FIGS. 17a and 17b to the state where it is tilted back as shown in FIGS. 18a and 18b, the amount of movement from the zero position of the controller is as shown in FIG. The direction vector itself shown in FIG. 18b is the difference direction vector because only the amount from the center position is added. When the controller moves from the state shown in FIGS. 18a and 18b to the state shown in FIGS. 19a and 19b, the difference direction vector is a value obtained by subtracting the direction vector of FIG. 18b from the direction vector shown in FIG. 19b.

  Next, the generation of repulsive force (also referred to as the repulsive force) applied to the haptic controller (corresponding to the haptic device described above and also simply referred to as the controller) described in the first embodiment will be described with reference to FIGS. This will be described with reference to FIGS. As described in the first embodiment, the representative vector is calculated according to the shape of the route on the map as shown in FIG. 20a. Note that the method for calculating the representative vector in the second embodiment is the same as that in the first embodiment, and thus the description thereof is omitted. As shown in FIG. 20b, if the controller is tilted in parallel along the path (along the representative vector), the map is scrolled along the path without any repulsive force. FIG. 20 c shows a state where the controller at that time is viewed from directly above.

  In FIG. 21a, since the path is inclined to the right side, when the controller is tilted forward as shown in FIG. 21b, a repulsive force is felt in the right direction. This is illustrated in FIG. 21c. 22a is the same as FIG. 21a and the path is tilted to the right. As shown in FIG. 22b, when the controller is tilted to the right and tilted forward as shown in FIG. The map can be scrolled along the representative vector.

  23A to 23F, a repulsive force calculation method will be described based on the example of FIGS. In FIG. 23a, the representative vector is raised to the right as in FIGS. 21a and 22a. FIG. 23b shows the controller tilted forward and the direction vector pointing forward. In FIG. 23c, the direction of the direction vector representing the position of the control and the direction of the representative vector representing the shape of the route are examined, and the direction vector is divided into a component parallel to the representative vector and a vertical component. "Is shown.

  The distortion vector means the vector that is trying to move the controller against the direction of the path. If the length of the vector is larger than a certain value, the direction of the distortion vector is the opposite direction. Apply repulsion to the haptic controller. As a result, when the controller is moved in a direction away from the route, it is possible to give the user a sense of hitting walls installed on both sides of the route through the sense of touch. The flow of calculating the distortion vector from the representative vector and the direction vector and applying the repulsive force is described in the first embodiment, and is also shown in FIG.

  FIG. 23d and FIG. 23e are for explaining the definition of “difference direction vector” and “difference distortion vector” newly introduced in the second embodiment. As will be described later, these are values used for switching determination (determination of switching from “restricted scroll” to “free scroll”) to derail from the scroll rail or to stay. In FIG. 23d, FIG. 23e, and FIG. 23f, two controllers are respectively drawn. They show the state of the controller at a certain moment and the state of the controller before Δt seconds.

FIG. 23f is an enlarged view of the state of FIG. 23e. The position of the controller in each case is assumed to be _before X and X _Δt . The difference direction vector is defined by Equation 5 described above as the difference between the position X where the tip of the controller is projected from directly above and the position X _{Δt before} Δt time. Further, in order to obtain the differential distortion vector, the projection of the differential direction vector of Equation 5 described above onto the representative vector P is considered, and the component vector S parallel to the representative vector is expressed as Equation 10.

Formula 10: S = (D (X, X _{Δt before} ) · P) × P
Here, the representative vector P is standardized, and “·” means an inner product of the vectors. Since the differential distortion vector is a vertical component of the projected vector, it is expressed as Equation 11.
Formula 11: D (X, X _{Δt before} ) −S
In calculating the difference distortion vector, in the above, the difference between the positions of the controllers is first taken as shown in Equation 5 and projected onto the representative vector. However, the distortion vectors are obtained by projecting the positions of the two controllers first, Even if the difference is calculated after obtaining the distortion vector, it is mathematically the same as equation (11).

  Here, the second embodiment will be described based on the above definition items. 25a and 25b show an example of a route such as a sharp curve or a broken line in which the shape of the scroll rail (route) changes abruptly. In such a route, when the user is scrolling the map along the route by dragging with the touch panel or the controller, the map is not observed in the sudden route shape (the direction of the route) and the map is moved along the same direction. In some cases, the user scrolls and derails (leaves) the route as it is against the user's intention.

  If the shape of the route suddenly changes, naturally, repulsive force also suddenly occurs in the manner described above. However, if the user has applied too much force to the controller with the previous scroll, the repulsive force will be generated at the sudden turn of the route. I get over the road and accidentally derail from the route. This is the same as, for example, when running on a high-speed car and the road suddenly bends, even if a repulsive force is felt, it cannot bend completely and deviates from the road unintentionally. Here, in the first embodiment, when determining whether or not to derail from the route, the value of the direction vector to be scrolled is simply compared with the value of the representative vector representing the shape of the route. This causes the above problems.

  In order to prevent this, in the second embodiment, a difference direction vector, which is a vector obtained by calculating a difference between the direction vector that the user tried to scroll the map and the previous direction vector by the time Δt, is used. By calculating and comparing with the representative vector of the route, it is possible to solve the erroneous determination described above to determine whether to derail from the route.

  Hereinafter, the reason why the time difference of the direction vectors (difference direction vector) in the second embodiment is a good sample for determination will be described with reference to a specific example of determination at a certain moment. The routes shown in FIGS. 26a and 26b are exactly the same route, and the controller is tilted to the right at the point E in both cases. However, their intentions are different. In FIG. 26a, the controller has been tilted to the right from point A and scrolled from left to right along the path. The user is unfortunately unaware that the shape of the route has suddenly changed from right to upward, leaving the controller still tilted to the right and the moment of passing through point E is shown in FIG. The user intends to scroll along the route.

  In FIG. 26b, the user has scrolled along the path from point A to point D. However, the user stopped scrolling on the way and wanted to leave the route at point D or point E and see the surroundings. Therefore, the user intentionally puts the controller in the direction perpendicular to the path, that is, in the right direction perpendicular to the direction of the upward path (direction of the representative vector) at the point E, to return the controller to the zero position and derail the path. This moment is shown in FIG. 26b.

  In the first embodiment, in order to see the state of the controller at the moment of being at the current point (for example, point E), which of the above two examples is going to derail from the route or whether it is going to stay on the route Cannot be distinguished. At point E, the route is pointing up, so the representative vector is pointing up. In both cases (FIGS. 26a and 26b), since the user is scrolling in the right direction (the direction vector is in the right direction), the first embodiment determines that both should derail from the route. .

  As a solution, it is necessary to look at the past process until the point E is reached, not the moment at the point E. In the second embodiment, a difference direction vector obtained by calculating a difference between a direction vector to be scrolled by a controller or a touch panel at a point to be determined and a past direction vector before time Δt seconds is calculated. Can be solved. If the differential direction vector is obtained, the component in the direction perpendicular to the representative vector (the component of the differential distortion vector) is calculated in comparison with the representative vector at the determination point. If the value of the component is greater than a certain threshold value, Judge that he is trying to derail from the route.

  In the point D of FIG. 26a, the difference direction vector between the point C and the point D is 0 (zero). In addition, at the point E 1 in FIG. 26a, the difference direction vector at the points D and E is 0 (zero). Therefore, derailment is not performed. On the other hand, at the point D in FIG. 26b, the difference direction vector between the point C and the point D is also 0 (zero) according to Equation 6. This is because it is only trying to return the controller to the zero position. In addition, at the point E in FIG. 26b, the difference direction vector at the point D and the point E becomes 1 because the controller is returned to the zero position at the point D and then moved rightward (moved by 1) at the point E. Therefore, derailment is performed at point E.

  By judging based on the difference within this time Δt, no matter how much the user strongly tilts the controller from the point A to the right and turns a sharp curve (upward curve) around the points D and E, As long as the controller is not tilted strongly to the right within a given time Δt, derailment from the route is not possible, so scrolling can be performed with peace of mind. Of course, as described in the first embodiment, in the case of the controller, the user feels the repulsive force defined above by the amount of the component perpendicular to the representative vector in the route among the direction vectors of the controller. You can feel that the direction has changed without accidental derailment.

  The user feels that the direction of the route has started to change while feeling repulsive force on the curved route, and can scroll the map along the curve. If you want to derail from the route and switch to free scroll mode, either defeat the controller more strongly in the direction of repulsion, or return the controller to the zero position and then defeat the controller in the direction of repulsion. Can be switched.

  Here, FIG. 27 shows an example of a part of the flow when the display control device determines whether to switch from the restricted scroll to the free scroll in the second embodiment. Here, a case of scrolling by a drag operation by a controller will be described, but the same can be considered when scrolling by a drag operation by a touch panel. The following processes are appropriately performed by each component of the display control device shown in FIG. 14, for example. As shown in FIG. 27, first, the display control apparatus acquires the position (x, y) of the controller and the position (xbefore, ybefore) of the controller before (time Δt) (step S2701). That is, each direction vector is acquired.

The difference direction vector is calculated by applying the above-described equations 6 to 9 to the acquired (x, y) and (xbefore, ybefore) (step S2702). The calculated difference direction vector is projected onto the representative vector, the projected projection vector (vector S) is obtained, and a vector obtained by subtracting the projection vector from the difference direction vector is set as the difference distortion vector. That is, a component perpendicular to the representative vector of the calculated difference direction vector is set as a difference distortion vector (step S2703). It is determined whether or not the value of the component of the differential distortion vector is greater than a certain value (step S2704). If it is larger than a certain value, switching is performed by a request for switching to free scrolling (step S2705).

  FIG. 28 shows an example of the overall flow for switching from limited scrolling to free scrolling by the display control device. Here, a case of scrolling by a drag operation by a controller will be described, but the same can be considered when scrolling by a drag operation by a touch panel. The following processes are appropriately performed by each component of the display control device shown in FIG. 14, for example. As shown in FIG. 28, the display control apparatus accepts a request to move to a new position and change the enlargement / reduction value (step S2801). After acceptance, a representative vector is calculated (step S2802).

Then, a new position of the controller is recorded (step S2803), a repulsive force is calculated, and a process for giving the calculated repulsive force to the controller (for example, a control signal for giving a repulsive force to the controller is generated). Transmission processing) is performed (step S2804). Thereafter, it is determined whether or not to switch from limited scrolling to free scrolling (step S2805: see FIG. 27). If it is determined that switching should be performed, the limited scroll is switched to the free scroll (step S2806). If it is determined that switching should not be performed, the map is moved along the scroll rail by the strength of the scroll vector (step S2807).

  Next, a simple switching from the free scroll mode to the restricted scroll mode will be described. In the second embodiment, as shown in FIG. 29a, the distance (distance L) between the cursor that is the point of interest when scrolling the map and the nearby route (distance L) is smaller than a certain value ( When the absolute value | V | of the speed V when the cursor is scrolled becomes smaller than a certain speed, the free scroll mode is switched to the restricted scroll mode. As a result, when the user freely scrolls the map and brings the cursor close to the route, and when the speed of the cursor is reduced or stopped around it, the cursor is attracted to the rail called the route and moves only along the route. Switch to the restricted scroll.

  The distance from the cursor to the path can be calculated by measuring the distance from the many sample points on the path to the cursor and using the path point (sample point) closest to the cursor, as shown in FIG. 29b. . Note that the distance between the path points on the path is fixed to a value several times larger than the displayed pixel, and does not depend on the absolute distance of the path to be enlarged or reduced.

  Here, FIG. 30 shows an example of a flow when the display control apparatus determines whether to switch from free scroll to limited scroll in the second embodiment. The following processes are appropriately performed by each component of the display control device shown in FIG. 14, for example. As shown in FIG. 30, the display control apparatus determines whether scrolling has been performed (step S3001). If it is determined that the map has been scrolled, it is determined whether or not the absolute value of the map scrolling speed is smaller than a predetermined value (predetermined value) determined in advance (step S3002). If it is determined that the value is smaller than a certain value, route data of a nearby block (area) is read from the map data (step S3003). A plurality of route points (sample points) are taken on the route according to the current enlargement / reduction ratio (step S3004). Then, the distance from each path point to the current cursor position is taken, and the path point having the minimum distance is found (step S3005). It is determined whether or not the minimum distance is smaller than a predetermined value (step S3006). If it is determined that the cursor is small, the cursor is attracted to the closest route point and the scroll is switched to the restricted scroll (step S3007).

  The display control apparatus and the display control method according to the present invention display a part of the display target that cannot be displayed on the display because the route to be traced does not protrude from the screen and the tracking along the route can be performed accurately. This is useful for a display control device, a display control method, and the like.

DESCRIPTION OF SYMBOLS 1400 Display control apparatus 1401 Detection means 1402 Calculation means 1403 Projection means 1404 Display control means 1405 Judgment means 1406 Switching means 1407 Representative vector calculation means 1408 Device control means

Claims (18)

A route line indicating a predetermined route on a display for displaying a map is displayed on the display, and the route line is moved according to a drag operation on the display for scrolling by a user, and is displayed on the display. A display control device for displaying other parts of the route line that are not,
Detecting means for detecting a drag speed when a drag operation is performed on the display and a drag direction based on the drag operation;
Calculating means for calculating a distance moved by the scroll at a point displayed on the display when the scroll is started based on the detected drag speed as the magnitude of the detected vector in the direction; ,
In the case of limited scrolling in which a cursor indicating a position on the display is movable only on the route line, the detected direction vector having a size corresponding to the calculated distance is used as the route line. Projection means for projecting as vectors in parallel directions;
Control means for displaying the route line by moving the route line along the route line by the size of the projected vector and in the opposite direction to the projected vector;
A display control device provided. The tilt direction of the path line of the display magnification that is currently displayed indicates a representative vector represented by the sum of the small vector group of the route line having the weight,
Determining means for determining whether the user's drag operation is a predetermined first operation with respect to the representative vector;
Switching means for releasing the display control by the limited scroll and switching the scroll to a free scroll that allows the cursor to move other than on the route line when it is determined that the predetermined first operation is performed; In addition,
When the display control of the route line is the free scroll, the determination unit determines whether the drag operation of the user is a predetermined second operation with respect to the representative vector, and If it is determined that this is the second operation,
The display control apparatus according to claim 1, wherein the switching unit switches the scroll from the free scroll to the limited scroll. A representative vector calculating means for calculating the representative vector;
The representative vector calculating means includes
When the current display control of the route line is based on the restricted scroll,
The coordinate information of the point within the predetermined range on the route line from the cursor, the coordinate information of the point where the cursor is, and the information of the currently displayed display magnification are obtained, and the route line at each point is acquired. Is multiplied by a predetermined function value corresponding to the display magnification to calculate a representative vector,
When the current display control of the route line is based on the free scroll,
The point on the route line closest to the cursor is a reference point, and the coordinate information of the point within the predetermined range on the route line from the reference point and the coordinate information of the reference point are currently displayed. 3. The display according to claim 2, wherein the display vector information is acquired and the representative vector is calculated by multiplying a minute vector indicating the route line at each point by a predetermined function value corresponding to the display magnification. Control device.   The display control apparatus according to claim 3, wherein the predetermined function value is a value based on a window function and / or a value based on a weight function.   The predetermined first operation is an operation of dragging in a direction substantially perpendicular to the representative vector, and the predetermined second operation is dragged in a direction substantially parallel to the representative vector. The display control apparatus according to claim 2, wherein the display control apparatus is an operation. When the display control of the route line is the limited scroll and the drag operation is performed using a predetermined input device,
The apparatus further comprises device control means for applying vibration and / or repulsive force to the input device when the input direction of the user via the input device and the direction of the representative vector are in a predetermined relationship. The display control apparatus according to any one of 2 to 5. In display control of the path line is the restriction scroll, if performing the drag operation using a predetermined input device,
A display magnification at which the projection unit is currently displaying a difference direction vector obtained by taking a difference between a vector of the user's input direction via the input device and a vector of the user's input direction a predetermined time ago. Indicating the direction of inclination of the route line at, and projecting it onto a representative vector represented by the sum of small vector groups of the route line having weights ,
When the value of the vector component obtained by subtracting the projected vector from the difference direction vector is larger than a predetermined value, the limited scroll is switched to a free scroll that allows the cursor to move other than on the route line. The display control apparatus according to claim 1, further comprising a switching unit.   The switching means is a case where the display control of the route line is the free scroll, and the speed of the cursor by the drag operation via the predetermined input device is lower than a predetermined speed, and the cursor and the display The display control apparatus according to claim 7, wherein the free scroll is switched to the limited scroll when a distance from the route line displayed above is shorter than a predetermined distance.   The apparatus further comprises device control means for applying vibration and / or repulsive force to the input device when the input direction of the user via the input device and the direction of the representative vector are in a predetermined relationship. 8. The display control device according to 7. A route line indicating a predetermined route on a display for displaying a map is displayed on the display, and the route line is moved according to a drag operation on the display for scrolling by a user, and is displayed on the display. A display control method for displaying other parts of the route line that are not,
A detection step of detecting a drag speed when a drag operation is performed on the display and a drag direction based on the drag operation;
A calculation step of calculating a distance moved by the scroll at a point displayed on the display when the scroll is started based on the detected drag speed as the magnitude of the detected vector in the direction; ,
In the case of limited scrolling in which a cursor indicating a position on the display is movable only on the route line, the detected direction vector having a size corresponding to the calculated distance is used as the route line. A projection step for projecting as vectors in parallel directions;
A display control step of displaying the route line by moving the route line along the route line by the size of the projected vector and in the opposite direction to the projected vector;
A display control method. After the display control step,
The tilt direction of the path line of the display magnification that is currently displayed indicates a representative vector represented by the sum of the small vector group of the route line having the weight,
A first determination step of determining whether or not the user's drag operation is a predetermined first operation with respect to the representative vector;
A free scroll switching step of canceling the display control by the limited scroll and switching the scroll to a free scroll that allows the cursor to move other than on the route line when it is determined that the operation is the predetermined first operation. When,
A second determination step of determining whether or not the user's drag operation is a predetermined second operation on the representative vector after switching to the free scroll ;
The display control method according to claim 10, further comprising a limited scroll switching step of switching the scroll from the free scroll to the limited scroll when it is determined that the predetermined second operation is performed. During the execution of the first determination step and the execution of the second determination step,
A representative vector calculating step of calculating the representative vector;
In the representative vector calculation step,
When the current display control of the route line is based on the restricted scroll,
The coordinate information of the point within the predetermined range on the route line from the cursor, the coordinate information of the point where the cursor is, and the information of the currently displayed display magnification are obtained, and the route line at each point is acquired. Is multiplied by a predetermined function value corresponding to the display magnification to calculate a representative vector,
When the current display control of the route line is based on the free scroll,
The point on the route line closest to the cursor is a reference point, and the coordinate information of the point within the predetermined range on the route line from the reference point and the coordinate information of the reference point are currently displayed. The display according to claim 11, wherein the display vector information is obtained and the representative vector is calculated by multiplying a minute vector indicating the route line at each point by a predetermined function value corresponding to the display magnification. Control method.   The display control method according to claim 12, wherein the predetermined function value is a value based on a window function and / or a value based on a weight function.   The predetermined first operation is an operation of dragging in a direction substantially perpendicular to the representative vector, and the predetermined second operation is dragged in a direction substantially parallel to the representative vector. The display control method according to claim 11, wherein the display control method is an operation. Before being switched to the free scroll by the free scroll switching step, or after being switched to the limited scroll by the limited scroll switching step,
When the display control of the route line is the limited scroll and the drag operation is performed using a predetermined input device,
The device control step of applying vibration and / or repulsive force to the input device when the input direction of the user through the input device and the direction of the representative vector are in a predetermined relationship. The display control method according to any one of 11 to 14. After the display control step, the display control of the path line is the restriction scroll, if performing the drag operation using a predetermined input device,
The route line at the currently displayed display magnification is obtained by calculating a difference direction vector obtained by taking a difference between the vector of the user input direction through the input device and the vector of the user input direction before a predetermined time. A projection step of projecting onto a representative vector represented by a sum of small vector groups of the route line having a weight ,
When the value of the vector component obtained by subtracting the projected vector from the difference direction vector is larger than a predetermined value, the limited scroll is switched to a free scroll that allows the cursor to move other than on the route line. The display control method according to claim 10, further comprising a switching step. After the switching step, when the display control of the route line is the free scrolling, the speed of the cursor by the drag operation via the predetermined input device is slower than a predetermined speed, and the cursor and the The display control method according to claim 16, wherein when the distance to the route line displayed on the display is shorter than a predetermined distance, the free scroll is switched to the limited scroll. Before switching to the free scroll by the switching step,
The device control step of applying vibration and / or repulsive force to the input device when the input direction of the user through the input device and the direction of the representative vector are in a predetermined relationship. 17. The display control method according to 16.