JP5225259B2 - Display control apparatus and display control method - Google Patents

Description

  The present invention relates to a display control device and a display control method for reading data related to an item displayed on a display and displaying an image or a character related to the item.

  When many items are arranged on a list (hereinafter also referred to as an item list) displayed on a display (hereinafter also referred to as a screen), the user can drag the item list with a finger stroke or a mouse drag. There is a technique in which when scrolling (moving), data such as an image or text relating to an item is read from a hard disk or the like and the image or text is displayed in accordance with the scrolling. When displaying an item arranged on an item list, it is necessary to read in advance data relating to the item (also referred to as item data), that is, data constituting an image, text, or the like from a hard disk or a net server.

  However, when the number of items on the item list is large, it takes time to read the item data. Therefore, when the number of items becomes 100, 1000, etc., it is difficult to implement with the conventional technology, which is realistic. is not. On the other hand, in the item list, only the items that have entered the display frame and become visible are requested to acquire item data, and the item data is displayed (non- (See Patent Document 1).

http://webdeveloperplus.com/jquery/create-a-dynamic-scrolling-content-box-using-ajax/

  However, as the graphic drawing hardware technology advances and the operability of the user interface develops in various ways, the item list operation method, display method, and presentation method also change. In particular, the present invention relates to recognition by the human eye. For example, when scrolling an item list, it has become necessary to execute an animation by rapidly scrolling from the first to the 800th item list of 1000 items.

  Although there is such a necessity, for example, when scrolling items from the first to the 800th at high speed, it is impossible to read data of 800 items from the hard disk or the like at high speed. On the other hand, it is possible to jump from the first to the 800th and switch the item list to display on the screen, but since there is no intermediate scroll animation in such a display, it moves from the first to the 800th Thus, it is impossible to visually convey to the user that the distance has come.

  Further, as an example of the production, there is a case where the item list is floating in the three-dimensional space in the screen, and approaches or moves away from the user's viewpoint. If the item list is far away and the items on the item list are small and invisible in the screen, and the item list is scrolled, the data of the items in the item list is read from the hard disk etc. There is also the question of whether it is necessary.

  In view of the above problems, the present invention relates to an item that crosses the screen when the user looks at the screen, and a display control apparatus and display that can read data finely only for items that can be visually recognized An object is to provide a control method. Conversely, for items that cannot be recognized because the movement is too fast or the items are too small, a template (texture image) with a motion blur generated in advance regardless of the individual items is appropriately pasted and displayed ( A display control apparatus and a display control method are provided that can produce an effect as if some item crossed at high speed. For example, in the judgment of recognition, one item is defined as a unit to be recognized, and the time from when one item appears until the next item appears is recognized as the recognition time. Determine if it is possible.

  In order to achieve the above-described object, according to the present invention, a part of an item list in which a plurality of frames of items composed of a predetermined frame and predetermined information displayed in the frame are arranged is displayed on a display. A display control device for displaying the predetermined information of the item corresponding to the frame displayed on the display in the frame, the data constituting the predetermined information displayed in the frame Is acquired from a predetermined storage area or an external server, based on the detected scroll speed, detection means for detecting a scroll speed when the item list is scrolled on the display by the user, The moving speed when the frame of the item is displayed on the display for each frame Calculated and generated on the display based on the generated moving speed information based on the calculated moving speed for each frame, the generated moving speed information, and a predetermined visual recognition limit speed Determination means for determining for each item whether or not the moving speed of the frame of the item exceeds the visual recognition limit speed, and an item determined not to exceed the visual recognition limit speed On the other hand, when the acquisition unit acquires data constituting predetermined information of the item and the frame of the item is displayed on the display, the predetermined information acquired in the displayed frame is displayed. For items that are determined to exceed the visual recognition limit speed, the frame of the item is displayed on the display. When it was, and a display control means for displaying a predetermined image in the frame that is displayed includes the display control device is provided. With this configuration, it is possible to scroll freely at high speed while minimizing the burden of reading a huge amount of data, and with high-speed scrolling and seamless animation production, the user has moved far away visually and is still near It is possible to perform operations with a “feeling of distance” such as being in a room. The predetermined visual recognition limit speed is a limit movement speed at which predetermined information on the frame of the moving item can be recognized by the user, and may be a speed by an individual user. It may be the obtained speed or the average speed of the obtained data.

  In the display control device of the present invention, it is a preferred aspect of the present invention that the visual recognition limit speed is calculated from a predetermined recognizable time and a predetermined distance between frames of the item. The predetermined recognizable time is a time required for the user to see and recognize the predetermined information, and may be a time by an individual user. It may be the average time of the data.

  In the display control device of the present invention, when the item list is arranged in a three-dimensional space, a frame of an item in the item list is projected onto a surface of the display, and the item on the projected display is displayed. It is a preferred aspect of the present invention that the predetermined recognizable time is set according to the size of the frame.

  In the display control apparatus of the present invention, it is a preferable aspect of the present invention that the predetermined image is an image having a motion blur effect.

  Further, according to the present invention, when a part of an item list in which a plurality of frames of an item including a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, A display control apparatus for displaying the predetermined information of an item corresponding to the frame displayed on a display in the frame, wherein data constituting the predetermined information displayed in the frame is stored in a predetermined storage area or An acquisition unit that acquires from an external server, a detection unit that detects a scroll speed when the item list is scrolled on the display by a user, and a frame of the item based on the detected scroll speed, The moving speed when displayed on the display is calculated for each frame, and calculated A generation unit that generates movement speed information based on the movement speed for each frame, and a movement time required to move a predetermined distance between items is calculated for each item based on the generated movement speed information. Determining means for determining for each item whether or not the calculated travel time exceeds a predetermined recognizable time; and an item determined to have the travel time exceeding the predetermined recognizable time. On the other hand, when the acquisition unit acquires data constituting predetermined information of the item and the frame of the item is displayed on the display, the predetermined information acquired in the displayed frame is displayed. Is displayed and the frame of the item is displayed on the display for an item for which the movement time is determined not to exceed the predetermined recognizable time. When displayed in a display control means for displaying a predetermined image in the frame that is displayed includes the display control device is provided. With this configuration, it is possible to scroll freely at high speed while minimizing the burden of reading a huge amount of data, and with high-speed scrolling and seamless animation production, the user has moved far away visually and is still near It is possible to perform operations with a “feeling of distance” such as being in a room. The predetermined recognizable time is a time required for the user to see and recognize the predetermined information, and may be a time by an individual user. May be the average time.

  In the display control device of the present invention, when the item list is arranged in a three-dimensional space, a frame of an item in the item list is projected onto a surface of the display, and the item on the projected display is displayed. It is a preferred aspect of the present invention that the predetermined recognizable time is set according to the size of the frame.

  In the display control apparatus of the present invention, it is a preferable aspect of the present invention that the predetermined image is an image having a motion blur effect.

  Further, according to the present invention, when a part of an item list in which a plurality of frames of an item including a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, A display control method by a display control device for displaying the predetermined information of an item corresponding to the frame displayed on a display in the frame, wherein scrolling is performed when the item list is scrolled on the display by a user. Based on the step of detecting speed and the detected scroll speed, the moving speed when the frame of the item is displayed on the display is calculated for each frame, and the calculated moving speed for each frame is calculated. And generating the moving speed information based on the generated moving speed information. And, for each item, determining whether a moving speed of the frame of the item when displayed on the display exceeds the visual recognition limit speed based on a predetermined visual recognition limit speed; For items determined not to exceed the visual recognition limit speed, data constituting predetermined information of the item is acquired from a predetermined storage area or an external server, and the frame of the item is When displayed on the display, the predetermined information acquired in the displayed frame is displayed, and for an item determined to exceed the visual recognition limit speed, the frame of the item is displayed. Displaying a predetermined image in the displayed frame when the image is displayed on the display. It is subjected. With this configuration, it is possible to scroll freely at high speed while minimizing the burden of reading a huge amount of data, and with high-speed scrolling and seamless animation production, the user has moved far away visually and is still near It is possible to perform operations with a “feeling of distance” such as being in a room. The predetermined visual recognition limit speed is a limit movement speed at which predetermined information in the frame of the moving item can be recognized by the user, and may be a speed by an individual user, and is determined empirically. Or the average speed of the obtained data.

  In the display control method of the present invention, it is a preferable aspect of the present invention that the visual recognition limit speed is calculated from a predetermined recognizable time and a predetermined distance between frames of the item. The predetermined recognizable time is a time required for the user to see and recognize the predetermined information, and may be a time by an individual user. It may be the average time of the data.

  In the display control method of the present invention, when the item list is arranged in a three-dimensional space, a frame of an item in the item list is projected onto a surface of the display, and the item on the projected display is displayed. It is a preferred aspect of the present invention that the predetermined recognizable time is set according to the size of the frame.

  In the display control method of the present invention, it is a preferable aspect of the present invention that the predetermined image is an image having a motion blur effect.

  Further, according to the present invention, when a part of an item list in which a plurality of frames of an item including a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, A display control method by a display control device for displaying the predetermined information of an item corresponding to the frame displayed on a display in the frame, wherein scrolling is performed when the item list is scrolled on the display by a user. Based on the step of detecting speed and the detected scroll speed, the moving speed when the frame of the item is displayed on the display is calculated for each frame, and the calculated moving speed for each frame is calculated. And generating the moving speed information based on the generated moving speed information. And calculating a moving time (scroll cycle) required to move the distance between items for each item, and determining for each item whether the calculated moving time exceeds a predetermined recognizable time. And for an item determined to have exceeded the predetermined recognizable time, the data constituting the predetermined information of the item is acquired from a predetermined storage area or an external server, When the frame of the item is displayed on the display, the predetermined information acquired in the displayed frame is displayed, and it is determined that the moving time does not exceed the predetermined recognizable time On the other hand, when the frame of the item is displayed on the display, a predetermined image is displayed in the displayed frame. And up, the display control method comprising is provided. With this configuration, it is possible to scroll freely at high speed while minimizing the burden of reading a huge amount of data, and with high-speed scrolling and seamless animation production, the user has moved far away visually and is still near It is possible to perform operations with a “feeling of distance” such as being in a room. The predetermined recognizable time is a time required for the user to see and recognize the predetermined information, and may be a time by an individual user. It may be the average time of the data.

  In the display control method of the present invention, when the item list is arranged in a three-dimensional space, a frame of an item in the item list is projected onto a surface of the display, and the item on the projected display is displayed. It is a preferred aspect of the present invention that the predetermined recognizable time is set according to the size of the frame.

  In the display control method of the present invention, it is a preferable aspect of the present invention that the predetermined image is an image having a motion blur effect.

  The display control device and the display control method of the present invention have the above-described configuration, and can scroll freely and at high speed while keeping the burden of reading a huge amount of data at the user interface at a high speed. With a simple animation effect, the user can perform an operation with a “distance” such as visually moving far away or still near.

It is a figure which shows an example of the item list | wrist in the form of the actual condition of this invention. It is a figure which shows an example of the list part of the item list in embodiment of this invention. It is a figure which shows an example of the item data in the actual form of this invention. It is a block diagram which shows an example of a structure of the display control apparatus which concerns on the actual form of this invention. It is a figure which shows an example of the positional relationship of the item list and screen frame in the actual condition form of this invention. It is a figure which shows an example of the positional relationship of the scrolled item list and screen frame in embodiment of this invention. It is a figure which shows an example of the item list of the stationary state in embodiment of this invention. It is a figure which shows an example of the mode of the item list of the state which is scrolling at high speed in embodiment of this invention. It is a figure which shows an example of the texture image which gave the strong motion blur effect in embodiment of this invention. It is a figure which shows an example of the texture image which gave the weak motion blur effect in embodiment of this invention. It is a figure which shows an example of a mode that the user is going to recognize the item which entered the screen in embodiment of this invention. It is a figure which shows an example of a mode that the user was able to recognize the item which entered the screen in embodiment of this invention. It is a figure which shows an example of a mode that the next item entered, without the user being able to recognize the item which entered the screen in embodiment of this invention. It is a figure which shows an example of a mode that the screen frame in embodiment of this invention is fixed, and an item list is scrolled. It is a figure which shows an example of the speed profile at the time of the state that the item list in embodiment of this invention is fixed and a screen frame is scrolled. It is a figure which shows another example of the speed profile in embodiment of this invention. It is a figure which shows an example at the time of the item list in embodiment of this invention being arrange | positioned in three-dimensional space. It is a figure which shows an example at the time of the item list in embodiment of this invention being projected on the display surface. It is a figure which shows an example of the distance and size between items at the time of projecting the item list in embodiment of this invention on a display surface. It is a figure which shows an example at the time of projecting an object in the three-dimensional space on the display surface in embodiment of this invention. It is a figure which shows an example of the recognition determination boundary for determination of the visual recognition in embodiment of this invention. It is a flowchart which shows an example of the flow of determination of the visual recognition in embodiment of this invention. It is a flowchart which shows an example of another flow of determination of the visual recognition in embodiment of this invention. It is a flowchart which shows an example of the flow of the drawing determination of the item in the screen in embodiment of this invention. It is a figure which shows an example of the stationary two-dimensional item list in embodiment of this invention. It is a figure which shows an example of a mode that the two-dimensional item list in embodiment of this invention scrolled to the lower right. It is a figure which shows an example of a mode that the finger | toe is dragged on the screen (touch panel) in embodiment of this invention. It is a figure which shows an example of a mode that the screen (touch panel) in embodiment of this invention flicked with the finger | toe.

  Hereinafter, embodiments of the present invention will be described. First, the definition of the item list handled in the present invention will be described. The item list is an item displayed as a list as shown in FIG. 1, and the item is composed of information (equivalent to the above-mentioned predetermined information) such as a title and an image (icon image) related to the item, and a frame. The The information shown in the frame of the item is a music song, e-mail, friend list, restaurant information, etc., and can be freely set by the user (programmer). It can be developed not only as a one-dimensional list but also as a two-dimensional or three-dimensional list.

  Describe how the data structure of the item list is. Since the item list may be a large list having an enormous number of items, the item list can be divided into list data that is a framework of the list and item data on which details of individual item portions are placed. This is shown in FIGS. 2a and 2b.

  FIG. 2a shows list data, in which ID numbers of individual items are arranged in the order in which the items should be arranged. That is, if the list data is known, it is possible to know how many items are in the list and in what order the items with which IDs are stored. FIG. 2b represents item data (corresponding to the predetermined information described above), and the item data is detailed data possessed by each item, and a title, an image (icon image), etc. are held for each item. In addition to text and images, videos and fine text may be included, and the present invention is not limited to this. In addition, when an item is displayed in a small size, only an icon image is displayed. When the item is enlarged, a function of switching to a plurality of detailed images or characters and displaying the item can be included.

  These list data and item data are stored in the hard disk 30 (corresponding to the predetermined storage area described above) or the Internet server 31 (corresponding to the external server described above) of the local computer (corresponding to the display control apparatus described above). Are read by the CPU 34 (corresponding to the acquisition means, detection means, generation means, determination means, and display control means described above) into the memory 32 of its own computer. This is shown in FIG. The data read into the memory 32 is displayed on the display 33 by the CPU 34 and recognized by the user's eyes. The user scrolls the item list or the like with the movement of the mouse or finger and requests to read new data.

  FIG. 4a shows how the item list is displayed on the screen, and FIG. 4b shows how a new item is displayed by scrolling the item list by the user. FIG. 4a shows a state where three items (ID numbers 11, 24, and 38) are displayed in the frame of the screen. In this state, since each item is stationary on the screen, a request for reading the item data is made and the item data is displayed.

  FIG. 4B is a diagram illustrating a state in which the item list is moved from right to left by mouse dragging or finger stroke. In FIG. 4b, the item with the ID number 43 (not displayed on the screen) outside the right frame of the screen frame (item frame) enters the screen, and the item is displayed to display the contents of the item. A request for data is made. On the other hand, the item (item frame) with ID number 11 that was on the left side of the screen frame (displayed on the screen) moves out of the screen frame (no longer displayed on the screen), so the item data is stored in the memory as appropriate. 32 is released (erased).

  As the user scrolls the item list, a new item (item frame) is displayed on the screen, and the item data must be newly read. On the contrary, item data of items that are out of the screen frame (no longer displayed) should be released as appropriate so as not to increase the size of the memory 32. The present invention deals with an item that enters the screen frame by scrolling the item list, but disappears outside the screen frame as it is, that is, an item data display candidate, but an item that is not displayed The item data is judged whether it is worth reading (obtaining) one by one. In particular, when high-speed scrolling is performed, a considerable number of items (item frames) simply cross the screen. The criterion for determining whether or not to read item data depends on whether or not the user who is viewing the display can visually recognize the item data.

  FIGS. 5a to 5d show how an item looks to the human eye when the item list is scrolled at high speed. FIG. 5a shows how the item looks when the item is stationary or scrolling at a slow speed. FIG. 5b shows how the item looks when the item list is scrolled at high speed and the contents of the item (item data) cannot be visually recognized. FIG. 5c shows a texture image (also referred to as blur texture) with a strong motion blur effect of the same size as the frame of the displayed item. FIG. 5d shows a texture image with a weaker motion blur effect of the same size as the frame of the displayed item. Here, the motion blur refers to, for example, giving a “blur” to a target object in a simulated manner when performing an animation.

  When the item list is moving at high speed as shown in FIG. 5b, the details of the item are not visible to the user looking at the screen as shown in FIG. 5a. Therefore, it can be understood that the user can be sufficiently cheated only by pasting and moving a pre-made texture image as shown in FIGS. 5c and 5d to an item list including a blank item frame without item data. .

  For a more realistic effect, prepare several different shapes, colors, patterns of strength of the motion blur effect, etc. in advance for the texture image of this motion blur effect, and use them in the item frame of the item list. Paste arbitrarily and move at high speed. When moving at a high speed, the one having a strong motion blur effect as shown in FIG. 5C is used, and when moving at a relatively slow speed, the one having a weak motion blur effect as shown in FIG. 5D is used. As a result, the user feels that many things have crossed in front of the user, and the item list can be scrolled while feeling the distance moved.

  Here, it will be described with reference to FIG. 6A to FIG. 6C how the user cannot view the scrolling item list. Here, the frame of the screen is treated as the range of the visual field that the user can see. FIG. 6 a shows a situation where the user is looking at the screen and the letter “A” scrolls (moves) from right to left on the screen. As shown in FIG. 6b, if the letter “A” moving to the user's field of view can be recognized within a predetermined time, the user can recognize that it is “A”. In FIG. 6 c, the character “A” disappears from the field of view until it is unfortunately recognized as “A”, and a new character “B” appears in the field of view. This is a state where the character string scrolls too quickly, so that the user knows that something has passed but does not know what has passed. In such a case, it is not necessary to display the texture image of the motion blur effect on the character portion and read the item data.

  In the present invention, the minimum time required for the user to visually recognize the item (item data) is called “visual recognition minimum time (corresponding to the predetermined recognizable time described above)”, The time from when one item enters the field of view until the next item comes to the same position in the field of view is called a “scroll cycle”. In order to be visually recognized, the following formula (1) must be satisfied.

  Minimum visual recognition time ≦ Scroll period (1)

  Otherwise, the next item will come from one to the next before the user knows what the item that came first. For example, when the distance between the user's eyes and the display is about 50 cm, the minimum visual recognition time is about 0.1 seconds based on an empirical rule.

  Specifically, an example of processing by the display control apparatus regarding how fast the item list is scrolled and which item data need not be read will be described with reference to FIGS. In FIGS. 7 and 8, it is assumed that there is an item list having 24 items (item frames), and some items in the item list within the frame of the screen are displayed.

  FIG. 7 shows that the item list is scrolled with a fixed frame of the screen. Here, the distance between items is defined as the distance from the center of the displayed item (item frame) to the center of the next displayed item (item frame). Here, the frame of the screen is supposed to be fixed and the item list should move, but for the sake of convenience, the description will be made assuming that the screen frame moves with the item list fixed, but the generality is not lost.

  As shown in FIG. 8, in order to explain in relation to the speed profile (the moving speed information described above or the moving speed information is graphed and shows the temporal change in the scroll speed of the item list). The item list is fixed, and the screen frame is described as moving. FIG. 8 shows the positional relationship between the screen frame and the item list when scrolling is performed by the user. The speed profile, that is, the horizontal axis represents time and the vertical axis represents the item list and screen. A graph plotting the relative speed with the frame is shown. In the time on the horizontal axis, 0 is set when the item list starts to move.

  In FIG. 8, at the initial point when the item list is stationary, items 2 to 6 are displayed on the screen, and the read item data is displayed. In particular, it is assumed that the fourth item located in the center of the screen frame is selected. Here, it is assumed that it is necessary to scroll to the 22nd item at high speed by a user request or the like. Specifically, the request includes a method in which the user plays the touch panel with a finger or presses a button for moving to the 22nd item. In addition, in order for the user to move to the 22nd item by flipping the touch panel with a finger, it is necessary to play the touch panel at a speed enough to move to the 22nd item.

  In the scrolling speed profile of the item list, the scrolling starts moving at a certain initial speed, in the case of FIG. 8, in a state of 0, and when it reaches a certain speed, the scrolling moves at a certain speed, to the target item. As it approaches, it begins to decelerate, and the scrolling stops statically so that the target item (No. 22) is at the center of the screen frame. In FIG. 8, in this series of scrolls, the number of items for which new item data is requested among 24 items is hatched. In this case, items for which item data is requested are item numbers 2 to 7 and 16 to 24.

  Here, the relationship between the speed profile and the item data request will be described. In the example of the speed profile shown in FIG. 8, the vehicle accelerates from an initial speed of 0 to a certain speed, decelerates near the destination point, and stops at the destination. The shape of such a speed profile is determined as part of an effect that the user feels smoothly and naturally in the animation.

  Using the distance between items defined in FIG. 7 and the above equation (1), the “visual recognition limit speed (corresponding to the above-mentioned visual recognition limit speed)” which is the lowest speed at which visual recognition cannot be performed is Calculated in (2).

  Visual recognition limit speed = distance between items / minimum visual recognition time (2)

  As shown in FIG. 8, the distance between items is also the scroll distance of one item, so the first item (item data) is displayed while the item list scrolls by that amount (scroll cycle). If the user cannot recognize what the item is, the user will not be able to recognize the item (item data) in the item list if the item appears one after another, that is, if scrolling is performed at a speed faster than the visual recognition limit speed.

  In FIG. 8, when the item list starts to accelerate from the initial speed 0, a new screen appears (displayed) while the visual recognition limit speed (unrecognizable speed), which is a certain speed, has not been reached. The item (item data) is perceived by the user, so it is necessary to read the item data. For this reason, the display control device (CPU 34) makes a request for reading item data with respect to item 7 (the item data is acquired). For item 8 and later, when entering (displayed) in the screen, the scroll speed (the moving speed of the item frame) has already exceeded the visual recognition limit speed, so there is no need to display the item data. The display control device (CPU 34) displays the texture image of the motion blur effect as shown in FIGS. 5c and 5d described above, and deceives it by scrolling at high speed.

  Since the scroll speed starts to decelerate from the 15th item, as shown in FIG. 8, the display control device (CPU 34) requests item data from item 16 whose scroll speed is lower than the visual recognition limit speed. Thereafter, the display control device (CPU 34) makes a request for item data corresponding to all items (item frames) appearing on the screen until the item No. 22 stops at the center of the screen. That is, when the 22nd item stops at the center of the screen, the 20th to 24th items are stationary within the frame of the screen and are therefore subject to requesting item data.

  As a result, item data to be newly read in the series of animations of moving from item 4 to item 22 is item data Nos. 7 and 16 to 24, and these newly read data are , Which is requested immediately after a request for movement is issued from the user (calculation can be started), and does not request item data at any time in conjunction with the progress of scrolling of the item list. .

  However, when the user suddenly requests to stop moving during scrolling, for example, when the user stops touching an item that scrolls with his finger, for example, when scrolling stops around the 12th time, etc. Then, interrupt the request to read the item data, and add the motion blur effect texture to the 12th plus or minus 2 items, that is, the items from 10th to 14th (item frame) You must stop displaying the image and make a request to read the item data.

  Here, a specific method for obtaining the speed profile will be described. Suppose that the item list is scrolled at a speed v0 with a finger and the finger is released as it is. In this case, the initial speed is v0 as it is. If it is assumed that the acceleration is decelerated by a constant value, the acceleration is a (a <0). The speed Vt after time t after the item list is hit is Vt = v0 + at. In this case, if the distance that the item list has moved (the distance that the position of the splashed point has moved) is Xt, Xt = v0 * t + t * t * a / 2.

If strictly calculated, Vt is smaller than the unrecognizable speed shown in FIG. 8, and the item displayed in the screen can be recognized when it is at the position of Xt. Therefore, data is loaded from the server (reading) It is necessary) In particular, in this case, since the acceleration a is a simple negative constant, if the unrecognizable speed is Vc, the time tc when decelerating to the unrecognizable speed is tc = (Vc−v0) / a. The position Xt of the item list at the time is Xt = v0 × (Vc−v0) / a + (Vc−V0) ² / (2 × a), and after Xt, the items in the item list can be recognized by decelerating. Therefore, it is necessary to load data from the server in advance for items lined up after Xt. In this way, a speed profile is generated based on the calculation. An example of the speed profile generated here is shown in FIG. In addition, it is necessary to read item data for items with hatched numbers in FIG.

  Next, as a more general example, as shown in FIG. 10a, there is a three-dimensional space by computer graphics (CG) in the display, in which an item list is placed in a suspended state, Is described as being viewed by the user through the display frame.

  Strictly speaking, it is necessary to know the distance between the position of the user's eyes and the screen of the display to know how much the object to be scrolled on the display is perceived by the user's eyes. This is because even if the same display is used, it looks different when viewed close up and when viewed remotely. Here, it is assumed that the difference in visibility due to being far from the display is considered in advance from the rule of thumb in the value of the minimum visual recognition time in Expression (2). Here, when the eyes and the display are 50 cm apart, it is assumed that the minimum visual recognition time is 0.1 second.

  Instead, when the item list is displayed in a floating state in the three-dimensional space of computer graphics, the depth distance between the screen and the item list is considered. The depth distance Z is defined as follows. That is, the depth distance Z is defined as the distance to the item list and the screen surface in the CG three-dimensional space.

  In order to show that even on the same item list, the appearance on the screen differs depending on the value of Z, FIG. 10B shows two identical item lists 1 in the CG three-dimensional space in the example of FIG. 2, the item list 1 is Z = 0 (close to the user's eyes when attached to the display surface), and the item list 2 is Z = z (z> 0 and a position far from the eyes). .

  Naturally, since the item list 2 is farther from the user than the item list 1, the item size appears to be small. This is shown in FIGS. 10b and 10c. Also, as shown in FIG. 10c, regarding the speed, the item scroll speed measured by the coordinate system of the item list is the local speed, and the moving speed on the surface projected on the screen is the projection speed. is there. Therefore, even if the item list 2 is scrolled at the same speed as the item list 1 locally, it appears to move slowly to the user's eyes because it is far away.

  In the present invention, the visual recognition limit speed and the distance between items described in the above formula (2) are the speed projected on the screen as shown in FIGS. 10b and 10c, and the distance when projected. Must be sought as. This is because the user is only looking at a two-dimensional screen, and local speed and distance are meaningless. Therefore, the following formula (3) must be satisfied instead of the formula (2).

  Projected visual recognition limit speed = distance between projected items / minimum visual recognition time (3)

  When an item list scroll animation is created by a program, an independent scroll calculation processing engine is created, and the speed is returned as a function as a standard object. Since the speed value returned by the scroll calculation processing engine is a local speed, it is necessary to obtain an expression for converting how fast it is moving on the projection surface onto the screen.

  As shown in FIG. 11, in general, when an object in a certain space is projected on a display surface that is a distance Z away from the object in a three-dimensional space of computer graphics, the size is expressed by the following equation: It is represented by (4).

Projected size D _projection = D _local × Z _{camera-screen} / (Z + Z _{camera-screen} ) (4)

Here, D _local is the size of the object itself, and Z _{camera-screen} is the distance between the camera and the screen in the three _- dimensional space of computer graphics. Z _{camera-screen} is a constant that is always defined when setting the camera when performing three-dimensional rendering in computer graphics. Therefore, according to equation (4), it can be seen that the projection speed is simply inversely proportional to Z from the local speed. This is shown in the following formula (5).

  Projected visual cognitive limit speed = visual cognitive limit speed × constant / (Z + constant) (5)

  Similarly, the distance between items is inversely proportional to Z. This is shown in equation (6).

  Distance between projected items = distance between items × constant / (Z + constant) (6)

  Substituting these equations (5) and (6) into equation (3) yields the following equation (7).

Visual recognition limit speed x constant / (Z + constant)
= Distance between items x constant / (Z + constant) / minimum visual recognition time (7)

  This equation (7) becomes the following equation (8) when the common term of the left side and the right side is omitted. This is the same as equation (2).

  Visual recognition limit speed = distance between items / minimum visual recognition time (8)

  Therefore, when considering an item list floating in a three-dimensional space, it is not necessary to consider the depth of the display. Simply measure the speed of the local item list, the distance between local items, and the distance between local items. Is divided by the local scrolling speed to obtain a scroll period. If the period is larger than the minimum visual recognition time, recognition is possible.

  Also, in equation (8), if the same unit is used for both the visual recognition limit speed and the distance between items, such as millimeters and centimeters, the relational equation of equation (8) Is satisfied.

  Another factor to consider is related to the size of the projected item. If the projected item is too small and visually difficult to recognize because the depth Z is too large, or the item (item frame size) is too large to fit in the user's field of view. It is something like that. When these are taken into consideration, it can be considered to make a two-dimensional graph as shown in FIG.

  In FIG. 12, the vertical axis represents the scroll period (distance between items divided by the scroll speed) (unit: seconds), and the horizontal axis represents the size of one item projected on the screen (unit: cm). To do. In order to obtain the projection size, it is necessary to convert how many pixels the projected item occupies on the screen, and to obtain the physical length from the pixel width.

  The cognitive judgment boundary is obtained from the rule of thumb by the subject. Although an item having an approximate size can be recognized in a recognition time of 0.1 seconds, the time required for recognition becomes slightly longer as the size of the visible item becomes smaller. Since the size of the item cannot be recognized as being too small or large, the range of the horizontal axis is set to 0.5 cm or more and 30 cm or less.

  The obtained time taken to scroll between items and the projection size of the item on the screen are plotted on a graph. If it is below the recognition determination boundary, it is determined that visual recognition is difficult, and the texture image of the motion blur effect is displayed without reading the item data. If it is above the recognition determination boundary, it is determined that visual recognition is possible, and the item data is read and displayed. In practice, it may be possible to reduce the burden of reading data on the hard disk by using a boundary that is looser than the recognition judgment boundary and can be easily recognized as a reference.

  An example of a flowchart when the display control apparatus (CPU 34) performs the procedure described in FIG. 12 is shown in FIGS. The flowchart shown in FIG. 13 determines whether or not to display a motion blur effect texture image by visual recognition determination. In step S1301, the user makes a request for scrolling the item list in some way, such as when the mouse is dragged, the finger is stroked on the touch panel, or the move button to the specified item is pressed (step S1301). Accept request).

  In step S1302, when the item list is scrolled, the display control device (CPU 34) predicts and calculates a landing point and a speed profile until reaching the landing point (generates a speed profile). In addition, the item (item frame) crossing the screen until the arrival point is examined (specified). Strictly speaking, since the user does not know in which direction the user is moving in the case of dragging, the current position of dragging is calculated as the landing point at any time. When a finger (mouse), which will be described later, is moved, and then the finger is released and the finger is released from the screen, the speed profile and arrival time until scrolling and decelerating are based on the speed at the time of the release. A point is calculated (generated).

  In step S1303, the display control device (CPU 34) obtains the item projection size and scroll period for all items (item frames) crossing the screen obtained in step S1302. In the present invention, since a single item is to be recognized, a time obtained by dividing the distance between items by the scroll speed is the scroll cycle. In step S1304, the projection size and the scroll period obtained in step S1303 are plotted in the diagram shown in FIG. 12, and visually recognized is not possible if it is below the boundary compared to the recognition determination boundary (visual recognition is impossible). If it is above, it can be visually recognized (visual recognition is possible).

  If visual recognition is possible, in step S1305, instead of displaying the texture image of the motion blur effect, the display control device (CPU 34) requests item data by raising a flag. In step S1306, since all items (item frames) crossing the screen are determined, if there is an item that has not been determined, the process returns to step S1303 and the same processing is performed.

  In step S1307, when all the determinations are completed, the display control device (CPU 34) reads data from the hard disk 30 or the server 31 using the structure shown in FIG. Let me. The display control device (CPU 34) displays the item data when an item (item frame) appears on the screen. For items for which no item data has been requested, the texture image of the motion blur effect is displayed on the frame by the display control device (CPU 34) when the item (item frame) appears in the screen. This completes the determination of whether or not a series of visual recognition is possible. Further, when the item list is scrolled by the user touching the finger on the screen, the user moving the mouse, or the like, or scrolled at another speed, the process is restarted from step S1301.

  FIG. 14 is an example of a processing flow (processing for determining whether or not to display a motion blur effect texture image) performed by the display control device (CPU 34), which is different from the processing flow shown in FIG. It demonstrates using the flowchart shown in FIG. In step S1401, the user makes a request to scroll the item list in some way, such as when the mouse is dragged, the finger is stroked on the touch panel, or the move button to the specified item is pressed (step S1401). Accept request).

  In step S1402, when the item list is scrolled, the display control device (CPU 34) generates a speed profile based on the scroll speed at the time of scrolling. When a finger (mouse), which will be described later, is moved and then the finger is released and then the finger is released from the screen, a speed profile is generated from the time of the release until it is scrolled and decelerated based on the speed at the time of release. Is done.

  In step S1403, the display control device (CPU 34) determines which of the items (item frame) crossing the screen is visually based on the speed profile obtained in step S1402 and the information on the unrecognizable speed. It is determined for each item whether or not recognition is possible (visual recognition is possible). When the item list is arranged in a three-dimensional space, the visual expression (2) used when calculating the unrecognizable speed according to the size of the item (item frame) when projected on the screen. The minimum recognition time may be set.

  If visual recognition is possible, in step S1404, instead of displaying the texture image of the motion blur effect, the display control device (CPU 34) requests item data by raising a flag. In step S1405, since all items (item frames) crossing the screen are determined, if there is an item that has not been determined, the process returns to step S1403 and the same processing is performed.

  In step S1406, when all determinations are completed, the display control device (CPU 34) reads data from the hard disk 30 or server 31 using the structure shown in FIG. Let me. The display control device (CPU 34) displays the item data when an item (item frame) appears on the screen. For items for which no item data has been requested, the texture image of the motion blur effect is displayed on the frame by the display control device (CPU 34) when the item (item frame) appears in the screen. This completes the determination of whether or not a series of visual recognition is possible. In addition, when the item list is scrolled by the user touching the finger on the screen, the user moving the mouse, or the like, or when scrolling at another speed, the process is restarted from step S1401.

  The flowchart shown in FIG. 15 determines whether to display item data by determining whether an item (item frame) is in the screen. In step S1501, the item list is moved from the stationary state by scrolling (the movement of the item list is detected). In step S1502, the display control device (CPU 34) sequentially extracts one item (item i) from all items in the item list. Then, a loop is repeatedly started to check the state.

  In step S1503, the display control device (CPU 34) determines whether or not the item i (the frame of the item i) is displayed on the screen. If it is not in the screen, the item data of item i is released according to the state of the memory, and the process returns to step S1502 to select another item. If it is within the screen, the process proceeds to step S1504. In step S1504, the display control device (CPU 34) determines whether there is a request for item data shown in the flowchart of FIG. If it is necessary to read, the process proceeds to step S1505. If it is not necessary to read, the process proceeds to step S1508.

  In step S1505, if the item data has been read, the process proceeds to step S1507. If there is a request, but the data has not been read, the process proceeds to step S1506. In step S1506, the display control device (CPU 34) displays an image of “currently loading data” on the screen because item data is being read. In this case, when data is read by a program or the like, a data loader object is prepared. When the data reading is completed, an image is displayed based on the read data.

  In step S1507, the display control device (CPU 34) displays the item data read from the item i. In step S1508, the display control device (CPU 34) displays a texture image of the motion blur effect on item i (on the frame of item i). In step S1509, when the display regarding the item i is finished and there is an item that has not been determined yet, the process returns to step S1502, and the same process is repeated with another item as the item i. The display ends when all items have been determined.

  A case where the method proposed by the present invention is used in two dimensions will be described with reference to FIGS. 16a and 16b. The same applies to the two-dimensional case, and the distance between items is obtained, and the time required to move by the distance is determined as the scroll period.

  FIG. 16A is a diagram illustrating a state when a two-dimensional item list is viewed through a screen. FIG. 16B is a diagram showing a state when scrolling toward the lower right. What is considered in the present invention is whether it is worth reading item data whose item data is just 4, 10, 11, 14, 15, 21 as the item data just traversing.

  Find the distance between items and the time it took to move the distance. The time and the projection size are plotted in FIG. 12, and it is determined whether or not it is visually recognizable. In the two-dimensional case, when the item list is scrolled, the number of newly appearing items (item frames) is larger than that in the one-dimensional case, so that it is difficult to recognize. It is also possible to slightly adjust the background at the recognition determination boundary (determination curve) shown in FIG.

  Lastly, a description will be given of a case in which the user requests to scroll the item list by flipping the screen (such as a touch panel) with a finger. FIG. 17A shows a state in which the touch panel is dragged with a finger, and FIG. 17B shows a state in which the finger is released by flicking the touch panel with a finger. While the finger is dragging on the touch panel in FIG. 17A, the above-described CPU 34 (detection means) obtains the speed from time to time based on the movement distance of the finger during the sampling time dt. As shown in FIG. 17b, when the user's finger leaves the screen for the first time, the previous speed immediately before leaving is the speed at which the item list should be scrolled. Processing from step S1302 or step S1402 starts at this speed.

  The display control device and the display control method according to the present invention can freely scroll at a high speed while keeping a burden of reading a huge amount of data at a user interface at a high speed. Users can operate with a sense of distance, such as visually moved far away or still nearby, so data related to items displayed on the display can be read and images and characters related to items can be read. This is useful for a display control device and a display control method for displaying the image.

30 Hard disk (predetermined storage area)
31 server (external server)
32 memory 33 display 34 CPU (acquisition means, detection means, generation means, determination means, display control means)

Claims (14)

When a part of an item list in which a plurality of frames of an item composed of a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, the frame displayed on the display A display control device for displaying the predetermined information of a corresponding item in the frame,
Obtaining means for obtaining data constituting the predetermined information to be displayed in the frame from a predetermined storage area or an external server;
Detecting means for detecting a scrolling speed when the item list is scrolled on the display by a user;
Based on the detected scroll speed, the moving speed when the frame of the item is displayed on the display is calculated for each frame, and the moving speed information is generated based on the calculated moving speed for each frame. Generating means for
Based on the generated moving speed information and a predetermined visual recognition limit speed, it is determined whether the moving speed of the frame of the item when displayed on the display exceeds the visual recognition limit speed. Judgment means to judge for each item,
For an item determined not to exceed the visual recognition speed limit, the acquisition unit acquires data constituting predetermined information of the item, and the frame of the item is displayed on the display. To display the predetermined information acquired in the displayed frame,
For an item determined to exceed the visual recognition limit speed, a display control means for displaying a predetermined image in the displayed frame when the frame of the item is displayed on the display And
A display control device provided.   The display control apparatus according to claim 1, wherein the visual recognition limit speed is calculated from a predetermined recognizable time and a predetermined distance between frames of the item.   When the item list is arranged in a three-dimensional space, an item frame of the item list is projected onto a surface of the display, and the predetermined frame is displayed according to a size of the item frame on the projected display. The display control apparatus according to claim 2, wherein a recognizable time is set.   The display control apparatus according to claim 1, wherein the predetermined image is an image having a motion blur effect. When a part of an item list in which a plurality of frames of an item composed of a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, the frame displayed on the display A display control device for displaying the predetermined information of a corresponding item in the frame,
Obtaining means for obtaining data constituting the predetermined information to be displayed in the frame from a predetermined storage area or an external server;
Detecting means for detecting a scrolling speed when the item list is scrolled on the display by a user;
Based on the detected scroll speed, the moving speed when the frame of the item is displayed on the display is calculated for each frame, and the moving speed information is generated based on the calculated moving speed for each frame. Generating means for
Based on the generated moving speed information, a moving time required to move a predetermined distance between items is calculated for each item, and whether the calculated moving time exceeds a predetermined recognizable time. A determination means for determining each item,
For an item for which it is determined that the movement time exceeds the predetermined recognizable time, the acquisition unit acquires data constituting predetermined information of the item, and the frame of the item is displayed on the display. When displayed, the predetermined information acquired in the displayed frame is displayed,
For an item for which the movement time is determined not to exceed the predetermined recognizable time, a predetermined image is displayed in the displayed frame when the frame of the item is displayed on the display. Display control means for
A display control device provided.   When the item list is arranged in a three-dimensional space, an item frame of the item list is projected onto a surface of the display, and the predetermined frame is displayed according to a size of the item frame on the projected display. The display control apparatus according to claim 5, wherein a recognizable time is set.   The display control apparatus according to claim 5, wherein the predetermined image is an image having a motion blur effect. When a part of an item list in which a plurality of frames of an item composed of a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, the frame displayed on the display A display control method by a display control device for displaying the predetermined information of a corresponding item in the frame,
Detecting a scrolling speed when the item list is scrolled on the display by a user;
Based on the detected scroll speed, the moving speed when the frame of the item is displayed on the display is calculated for each frame, and the moving speed information is generated based on the calculated moving speed for each frame. And steps to
Based on the generated moving speed information and a predetermined visual recognition limit speed, it is determined whether the moving speed of the frame of the item when displayed on the display exceeds the visual recognition limit speed. The step of judging for each item,
For an item determined not to exceed the visual recognition limit speed, data constituting predetermined information of the item is acquired from a predetermined storage area or an external server, and the frame of the item is displayed on the display. When displayed, the predetermined information acquired in the displayed frame is displayed,
For an item determined to exceed the visual recognition limit speed, when a frame of the item is displayed on the display, a predetermined image is displayed in the displayed frame. ,
A display control method.   The display control method according to claim 8, wherein the visual recognition limit speed is calculated from a predetermined recognizable time and a predetermined distance between frames of the item.   When the item list is arranged in a three-dimensional space, an item frame of the item list is projected onto a surface of the display, and the predetermined frame is displayed according to a size of the item frame on the projected display. The display control method according to claim 9, wherein a recognizable time is set.   The display control method according to claim 8, wherein the predetermined image is an image having a motion blur effect. When a part of an item list in which a plurality of frames of an item composed of a predetermined frame and predetermined information displayed in the frame are arranged is displayed on the display, the frame displayed on the display A display control method by a display control device for displaying the predetermined information of a corresponding item in the frame,
Detecting a scrolling speed when the item list is scrolled on the display by a user;
Based on the detected scroll speed, the moving speed when the frame of the item is displayed on the display is calculated for each frame, and the moving speed information is generated based on the calculated moving speed for each frame. And steps to
From the generated moving speed information, a moving time (scroll cycle) required to move the distance between items is calculated for each item, and whether the calculated moving time exceeds a predetermined recognizable time or not Determining for each item,
For an item for which the movement time is determined to exceed the predetermined recognizable time, data constituting predetermined information of the item is acquired from a predetermined storage area or an external server, and the item When the frame is displayed on the display, the predetermined information acquired in the displayed frame is displayed,
For an item for which the movement time is determined not to exceed the predetermined recognizable time, a predetermined image is displayed in the displayed frame when the frame of the item is displayed on the display. And the step of
A display control method.   When the item list is arranged in a three-dimensional space, an item frame of the item list is projected onto a surface of the display, and the predetermined frame is displayed according to a size of the item frame on the projected display. The display control method according to claim 12, wherein a recognizable time is set.   The display control method according to claim 12 or 13, wherein the predetermined image is an image having a motion blur effect.

Images