JP2012155506A - Information terminal and screen component selection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information terminal that makes it easy to find and select a desired screen component.SOLUTION: An information terminal that comprises: a display part 11 for displaying multiple thumbnail images 12; a non-contact detection device 14 for detecting that a finger 50 for determining the thumbnail images 12 approaches the inside of Z1 to the display part; and a three-dimensional visual recognition part 13 for drawing and arranging the thumbnail images associated with the thumbnail images 12 in rows so as to be seen at higher positions than the display part 11. When the finger enter Z2 again, one of the thumbnail images 12, which is located immediately below a position detected by the non-contact detection device 14, is selected.

Description

  The present invention relates to an information terminal, a screen component selection method, and the like.

  In recent years, information terminals such as PDAs, smartphones, tablet PCs, car navigation systems, and the like have become widespread. These information terminals generally employ a touch panel for inputting information by touching GUI (Graphical User Interface) screen components such as icons displayed on a display with a touch pen or a finger for miniaturization. . On the touch panel, screen parts including a plurality of icons are displayed on the display screen, which is determined by touching with a stylus or finger, launching an application program assigned to the icon, or playing back desired content To do. In addition, with the increase in storage medium capacity, it is possible to store a large amount of content in the information terminal, and it is necessary to select desired content from the large amount of stored content.

  An example of a means for displaying a large amount of stored content in an easy-to-see manner is Patent Document 1. FIG. 12 is a diagram illustrating a display screen of the information terminal disclosed in Patent Document 1. In FIG. 12, the vertical axis represents time, the horizontal axis represents day of the week, and the depth direction represents week. A thumbnail image 611 of a plurality of related contents in the three-dimensional image 610 shown in FIG. 12 is three-dimensionally displayed according to the date / time information of the contents, and the presence / absence of recorded content for each day is indicated by a mark 621 on another two-dimensional image 620. An information terminal is disclosed in which it is easy to recognize by displaying, and the foreground of the thumbnail image 611 can be switched by moving a frame 622. In the two-dimensional image 620, the vertical axis indicates the week and the horizontal axis indicates the day of the week. Therefore, the week in the depth direction of the three-dimensional image 610 is selected by moving the frame 622 up and down, and the thumbnail image corresponding to the content recorded in the selected week among the thumbnail images 611 is the foreground of the thumbnail image 611. Will be displayed.

JP 2008-193649 A

  However, the information terminal disclosed in Patent Document 1 has a problem that it is difficult to see because the three-dimensional display and the two-dimensional display are displayed on one display device.

  In addition, since there is a problem that the selection method is not intuitively easy to understand, particularly in the case of a small information terminal, it is further difficult to see and select.

  An object of the present invention is to provide an information terminal and a screen component selection method that are easy to find and select a desired screen component and content in consideration of the problems of the conventional information terminal.

  In order to achieve the above object, an information terminal according to the present invention integrates a display unit for displaying screen parts, pointing position detection means for detecting a pointing position in the display part, and a plurality of related screen parts. When it is determined that the screen component displayed on the display unit and the integrally displayed screen component is instructed by the instructed position detecting unit, the instructed position is displayed based on the movement locus of the instructed position thereafter. And a control unit for discretely displaying screen parts on the display unit.

  The display unit can display the screen component in a three-dimensional manner, and the control unit determines that the integrally displayed screen component is instructed by the instruction position detection unit. The integrally displayed screen parts are three-dimensionally displayed on the display unit.

  In order to achieve the above object, an information terminal according to the present invention includes a display unit that displays screen parts, a three-dimensional position detection unit that detects the position of an indicator, and a plurality of related screen parts. Display on the display unit, and when the indicator approaches the display unit within a predetermined distance by the three-dimensional position detection unit, the position of the indicator in a plane parallel to the display unit and the display unit Based on the integrally displayed position of the screen component, it is determined that the indicator indicates the integrally displayed screen component, and the indicator is displayed integrally by the three-dimensional position detection unit. If it is determined that the screen part is to be designated, the integrally displayed screen part is displayed on the display unit discretely based on the subsequent movement trajectory of the indicator obtained by the three-dimensional position detection unit. Let , Characterized in that it comprises a control unit.

  The display unit can three-dimensionally display the screen component, and the control unit is determined by the three-dimensional position detection unit to indicate that the indicator indicates the integrally displayed screen component. In this case, the integrally displayed screen parts are displayed three-dimensionally on the display unit.

The control unit determines that the position of the pointing object has not changed for a predetermined time by the three-dimensional position detection unit after the integrally displayed screen parts are displayed on the display unit in a three-dimensional manner. The display means is changed to change the arrangement order of the three-dimensionally displayed screen parts,
Can be characterized.

  When the detection area of the indicator detected by the three-dimensional position detector increases, the control unit displays the position of the indicator in a plane parallel to the display surface and the three-dimensional display on the display surface. It is possible to determine which one of the three-dimensionally displayed screen parts the instruction object indicates based on the position of the screen part.

  When the three-dimensional position detection unit determines that the indicator has approached the display surface, the control unit determines the position of the indicator in a plane parallel to the display surface and the three-dimensionally the display surface. Based on the position of the displayed screen component, it is possible to determine which of the three-dimensionally displayed screen components the pointing object indicates.

  When the three-dimensional position detection unit determines that the indicator has moved beyond a second predetermined distance that is greater than the predetermined distance, the control unit integrally integrates the three-dimensionally displayed screen components. To be displayed on the display unit.

  When the control unit determines that the indicator has moved beyond a second predetermined distance larger than the predetermined distance by the three-dimensional position detection unit, the control unit displays the three-dimensionally displayed screen component in the state. It can be characterized by fixing with.

  The control unit is configured to detect the position of the indicator in a plane parallel to the display unit when the indicator approaches the display unit within a predetermined distance by the three-dimensional position detection unit, and the solid in the display unit. It is possible to determine which one of the three-dimensionally displayed screen components is to be indicated by the indicator based on the position of the screen component displayed on the screen.

  In order to achieve the above object, a screen component selection method according to the present invention includes a first display step in which a plurality of related screen components are integrally displayed on a display unit, and an indication object is displayed on the display unit by a three-dimensional position detection unit. The indicator is integrated on the basis of a position of the indicator in a plane parallel to the display unit and a position of the integrally displayed screen component in the display unit when approaching within a predetermined distance from the display unit. A first determination step for determining whether or not to indicate the screen component displayed in a normal manner, and the screen component on which the indicator is displayed integrally by the three-dimensional position detection unit in the first determination step When it is determined that the display part is displayed in a three-dimensional manner on the display unit in a three-dimensional manner based on the subsequent movement trajectory of the indicator obtained by the three-dimensional position detection unit. A display step; a second determination step for determining whether the indicator indicates any of the three-dimensionally displayed screen parts by the three-dimensional position detection unit; and the tertiary in the second determination step. And a third determination step of determining that the indicated screen component is selected when the original position detection unit determines that the indicated item indicates any one of the three-dimensionally displayed screen components. It is characterized by.

  According to the present invention, it is possible to provide an information terminal and a screen component selection method that make it easy to find and select a desired screen component and content.

1 is a front configuration diagram of an information terminal according to Embodiment 1 of the present invention. Side view of the display unit, the stereoscopic viewing unit, and the non-contact input unit according to the first embodiment of the present invention. 1 is a perspective configuration diagram of a display unit, a stereoscopic viewing unit, and a non-contact input unit according to Embodiment 1 of the present invention. First control flow diagram of information terminal in Embodiment 1 according to the present invention 2nd control flow figure of information terminal in Embodiment 1 concerning the present invention 1st figure which shows the display surface for demonstrating control of the information terminal in Embodiment 1 concerning this invention. 2nd figure which shows the display surface for demonstrating control of the information terminal in Embodiment 1 concerning this invention. 3rd figure which shows the display surface for demonstrating control of the information terminal in Embodiment 1 concerning this invention. 1 is a configuration diagram in which an information terminal according to Embodiment 1 of the present invention is applied to a computer. Control flow chart of information terminal in embodiment 2 according to the present invention The figure which showed typically the side part of the display part of this Embodiment 2, a three-dimensional visual recognition part, and a non-contact input part. The figure which shows the display surface of the conventional information terminal

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment 1)
Below, the information terminal in Embodiment 1 concerning this invention is demonstrated.

  FIG. 1 is a front view of the information terminal according to Embodiment 1 of the present invention. As shown in FIG. 1, the information terminal 10 according to the first embodiment is provided with a display unit 11, and the display unit 11 displays thumbnail images 12 of a plurality of contents, which are examples of screen components. ing. The plurality of thumbnail images 12 are displayed vertically aligned on the display unit 11 in the figure. Examples of the display unit 11 include a liquid crystal display and an organic EL display. In the present embodiment, the representative thumbnail image 12 of the moving image content is taken as an example, but icons, music CD jacket images, reduced photo images, characters, character strings, and the like are collectively referred to as screen components. The screen parts can be configured to appear on the display unit 11.

  In FIG. 1, there are a plurality of representative thumbnail images 12 of the drama A. For example, the drama A is a continuous drama, and since the first to fifth broadcasts are recorded, there are five representative thumbnail images 12 of the drama A. The representative thumbnail image 12 of the drama A indicates that there are a plurality of representative thumbnail images 12 by displaying the three representative thumbnail images 12 out of the five in a slightly shifted state. At this time, the representative thumbnail image 12 displayed at the forefront is referred to as a representative thumbnail image 12A of the drama A group.

  Similarly, in the news C and the morning drama D, the representative thumbnail images 12 displayed in the foreground are respectively referred to as the news C group representative thumbnail image 12C and the morning drama D group representative thumbnail image 12D. Note that the representative thumbnail image 12 of the drama A, the representative thumbnail image 12 of the news C, and the representative thumbnail image 12 of the morning drama D are all displayed in a state where the three representative thumbnail images 12 are slightly shifted. This is for the convenience of drawing, and the number is not necessarily the same, and it is not necessary to limit to three. In short, it should be understood that a plurality of moving image contents are included in one group. Further, there is one representative thumbnail image 12 for each of the drama B and the movie E. This is because the drama B and the movie E each include only one moving image content.

  FIG. 2 is a side cross-sectional configuration diagram of the display unit 11 of the first embodiment and the stereoscopic viewing unit 13 and the non-contact detection device 14 disposed on the upper side thereof for stereoscopic viewing. FIG. 3 is a perspective configuration diagram of the information terminal 10 according to the first embodiment. As shown in FIGS. 2 and 3, the information terminal 10 according to the first embodiment is provided with a three-dimensional viewing unit 13 on the upper side of the display unit 11 so that a stereoscopic image can be viewed three-dimensionally with the naked eye. it can. In the first embodiment, a parallax barrier method is used as the stereoscopic viewing unit 13.

  A non-contact detection device 14 is provided on the upper side of the stereoscopic viewing unit 13, and the non-contact detection device 14 can detect three-dimensional position information when the finger 50 approaches the display unit 11. As the non-contact detection device 14, a capacitance method is used in the first embodiment.

  In the first embodiment, the position higher than Z2 from the display unit 11 is set as the non-detection region 17, and is a region that is not detected even if the finger 50 is present. An area within Z2 from the display unit 11 is set as a detection area, and the presence of the finger 50 is detected. This detection area is divided into two parts, a first detection area 15 from the display unit 11 to Z1, and a second detection area 16 from Z1 to Z2. As will be described in detail later, when the finger 50 moves from the second detection area 16 to the first detection area 15, the representative thumbnail image 12 displayed in a state of being slightly shifted immediately below the finger 50 is displayed in a plurality of representative thumbnails. It is separated into images 12 and becomes a target of stereoscopic viewing.

  In the first embodiment, the detection points 14 a are formed in a matrix on the non-contact detection device 14 on the upper side of the display unit 11. As the finger 50 approaches, the detection points 14 a near the finger 50 are electrostatically detected. The amount of change in capacity increases. Then, from the amount of change in capacitance at the detection point 14a where the maximum amount of change is detected, to what position (position in the Z-axis direction) the finger 50 approaches the detection point 14a is detected. . That is, it is possible to detect the entry / exit of the finger 50 between the non-detection region 17 and the second detection region 16 and between the second detection region 16 and the first detection region 15.

  Note that the second detection region 16 can detect the position of the finger 50 in the Z-axis direction further divided into n. Further, the position (XY coordinate) of the finger 50 on the plane parallel to the display unit 11 is detected by detecting the detection point 14a having the maximum capacitance change amount. The capacitance-type non-contact detection device 14 can detect whether the finger 50 is approaching or moving away by sampling the capacitance of the detection point 14a at a constant sampling period.

  In the first embodiment, the capacitive non-contact detection device 14 is used to detect the three-dimensional position of the finger 50, but an infrared non-contact detection device may be used. In that case, for example, a plurality of infrared irradiation units and light receiving units are provided at the end of the display unit 11, and the three-dimensional position of the finger is detected by detecting that the infrared ray is blocked by the finger.

  In the first embodiment, a plurality of slits are arranged as the three-dimensional visual recognition unit 13 on the upper side of the display unit 11, and the video is created in a three-dimensional manner with the naked eye by creating the video so that the pixels seen by the right eye and the left eye are different. Can see.

  In the first embodiment, the parallax barrier method is used as a method for stereoscopically viewing an image. However, a lenticular lens method may be used, and in this case, for example, on the upper portion of the display unit 11. By arranging the semi-cylindrical lenticular lenses and viewing the display unit 11 through the lenticular lenses, the right eye and the left eye cause an illusion and can be viewed as a stereoscopic image. Alternatively, an integral imaging system that can generate a three-dimensional image by emitting a large number of lights with different angles may be used. In addition, it may be drawn in a pseudo three-dimensional form without using a special device, but it is difficult to recognize the sense of distance in the height direction (Z-axis direction). It is desirable to use a method.

  Next, the operation of the information terminal 10 of the first embodiment will be described, and an example of the screen component selection method of the present invention will be described at the same time. In the first embodiment, the screen component is the representative thumbnail image 12 obtained by extracting one scene from the moving image content, but the screen component is not limited to this.

  4 and 5 are flowcharts showing control of the information terminal 10 according to the first embodiment. FIG. 4 is a flowchart for displaying the list screen shown in FIG. 1 on display unit 11 of information terminal 10 of the first embodiment. First, in S10, a moving image content list recorded in the information terminal 10 is extracted. Next, in S11, grouping is performed for each related video content. The related content is, for example, a program recorded at the same time on the same day of the week, a program including the same title character, a program in which the same artist appears, a program of the same genre such as a movie, and the like. Next, in S12, the representative thumbnail image 12 that represents the group is selected for each group. Examples of the method for selecting the representative thumbnail image 12 representing the group include a recently recorded one, a first recorded one, a one designated by the user, and the like. The timing for creating the representative thumbnail image 12 is considered when the program is recorded, when it is played for the first time, when the user is not using the information terminal 10 such as at midnight, or when the list screen as shown in FIG. 1 is displayed for the first time. It is done. When it is difficult to secure an area for storing the representative thumbnail image 12, the representative thumbnail image 12 may be created each time the list screen as shown in FIG. 1 is displayed. In S13, the representative thumbnail image 12 and the title list are displayed. In addition, like A, C, D and B, E in FIG. 1, a group (A, C, D) in which a plurality of related moving image contents exist and a group (B, E) that does not exist can be distinguished at a glance. Thus, in a group (A, C, D) in which a plurality of related moving image contents exist, it is desirable to display the representative thumbnail images 12 in a state of being slightly shifted.

  FIG. 5 is a flowchart for selecting the representative thumbnail image 12 as shown in FIG. 8 from the list screen as shown in FIG. First, in S20, when the finger 50 enters the first detection area 15 from the second detection area 16 in FIG. 2, the finger 50 is detected in the first detection area 16 at any position on the plane parallel to the display unit 11. It is detected whether the boundary with the region 15 has been passed. In the first embodiment, the finger 50 has entered the first detection area 15 from the second detection area 16 by the non-contact detection device 14 using the capacitance method, and the finger 50 has moved to the first detection area. 15, the position (XY coordinates) of the finger 50 on the plane parallel to the display unit 11 when entering 15 is detected at the same time. Note that the height of the first detection region 15, that is, the distance between the non-contact detection device 14 and Z1, may be zero. In this case, when the finger 50 enters the first detection region 15 from the second detection region 16, the finger 50 directly touches the non-contact detection device 14.

  Next, in S21, the representative thumbnail image 12 of the moving image content at the position (XY coordinate) of the finger 50 detected in S20 is specified. For example, FIG. 6A shows a representative of the drama A group at the position (XY coordinate) of the finger 50 when the finger 50 approaches the display unit 11 and enters the first detection area 15 from the second detection area 16. An example when the thumbnail image 12A is selected is shown.

  Next, in S22, it is determined whether or not there are a plurality of related video contents linked to the representative thumbnail image 12A of the selected drama A group. When there is only one moving image content linked to the selected representative thumbnail image 12 such as the representative thumbnail image 12B of the drama B and the representative thumbnail image 12E of the movie E shown in FIG. The moving image content is selected, and for example, reproduction of the moving image content is started, or a menu for operating the moving image content such as deletion or copying is displayed. In FIG. 5, “No” in S22 is described as “End”, but this means that the content selection process is ended, and after that, playback of the video content selected as described above is performed. The menu for operating the moving image content such as starting or deleting or copying is displayed.

  Next, in S23, when it is determined in S22 that there are a plurality of moving image contents (Yes in S22), it is detected that the finger 50 has moved from the first detection area 15 to the second detection area 16.

  At this time, if the finger 50 moves from the first detection area 15 to the second detection area 16 and then moves within the second detection area 16, in S24, the relation is related to the representative thumbnail image 12A of the selected drama A group. A plurality of representative thumbnail images 12 relating to the moving image content to be displayed are made to follow the movement locus of the finger 50 so as to appear three-dimensionally. For example, in FIG. 6B, the Z coordinate of the finger 50 is in the second detection region 16, and the position of the finger 50 (XY coordinate) is changed from the position of the finger 50 shown in FIG. It is an example at the time of detecting having moved to the position of the finger | toe 50 shown in FIG. At this time, the position of the finger 50 (XY coordinates) is repeatedly detected in a short cycle using a timer processing unit 443 described later, and the representative thumbnail images 12A, 12A-4, 12A are equally spaced with respect to the detected position of the finger 50. -3, 12A-2, and 12A-1 are desirably displayed in a three-dimensional manner. In FIG. 6B, the representative thumbnail image 12A of the drama A group is moved to the position of the finger 50 (XY coordinates), and the representative thumbnail images 12A-4, 12A-3, 12A-2, 12A-1 related thereto are moved. It is displayed so as to appear three-dimensionally at equal intervals. In the example of FIG. 6B, five representative thumbnail images 12 are displayed. However, the number of representative thumbnail images 12 may be other than that, and the representative thumbnail images of the selected group may be displayed. When there is a large amount of related video content, representative thumbnail images 12 related to several high-priority video content (for example, in descending order) may be selected and displayed. In the state of FIG. 6B, the drama B, the news C, the morning drama D, and the movie E are already out of the selection targets, so it is desirable to perform processing such as grayout. This makes it easier to see the representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, and 12A-1 displayed so as to appear three-dimensionally at regular intervals.

  In FIG. 6A, for the drama A group having five related moving image contents, the three representative thumbnail images 12 are displayed while being slightly shifted, but this is also for convenience of drawing creation. It is. For the drama A group, the five representative thumbnail images 12 may be displayed in a state of being slightly shifted. If only the fact that there are a plurality of related video contents is to be notified, the representative thumbnail images 12 are displayed in a state where the representative thumbnail images 12 are slightly shifted as shown in FIGS. The number of thumbnail images 12 displayed so as to appear three-dimensionally at equal intervals does not have to match.

  If the finger 50 moves in the second detection area 16 after the finger 50 moves from the first detection area 15 to the second detection area 16, in S24, it is related to the representative thumbnail image 12A of the selected drama A group. Although the plurality of representative thumbnail images 12 related to the moving image content are displayed so as to follow the movement locus of the finger 50 and appear three-dimensionally, the finger 50 is not necessarily displayed from the first detection region 15 to the second detection region 16. However, the present invention is not limited to the case where the finger 50 moves in the second detection region 16 after moving to the position. In short, after the representative thumbnail image 12 is selected and it is determined that there are a plurality of related moving image contents linked to the selected representative thumbnail image 12, a plurality of representatives related to the moving image content related to the representative thumbnail image 12 is displayed. The thumbnail image 12 may be displayed so as to follow the movement locus of the finger 50 so as to appear three-dimensionally. At this time, the finger 50 may move in the first detection area 15 or may move while going back and forth between the first detection area 15 and the second detection area 16.

  Next, in S25, when it is detected that the finger 50 has moved from the second detection region 16 to the non-detection region 17 (Yes in S25), it is determined that no moving image content has been selected, and the tertiary is performed in S26. The representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, and 12A-1 that are originally displayed so as to look three-dimensional are returned to their original positions. That is, as shown in FIG. 6B, the representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, and 12A-1 displayed so as to appear three-dimensionally as a three-dimensional image are displayed in the drama of FIG. It returns to the position of the representative thumbnail image 12A of the A group. At this time, it is better to reverse the change from FIG. 6B to FIG. 6A by high-speed animation in the reverse order of the change from FIG. 6A to FIG. 6B.

  In S27, the finger 50 does not move from the second detection area 16 to the non-detection area 17 (No in S25), and the position of the finger 50 is not changed from the previously detected position or within a certain threshold range. (Yes in S27), the arrangement order of the representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, 12A-1 is changed in S28. FIGS. 7A and 7B show examples in which the arrangement order of the representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, and 12A-1 is changed. In the example changed to (a), the representative thumbnail image 12A of the drama A group at the position of the finger 50 is returned to the position farthest from the finger 50, and the finger 50 is next to the representative thumbnail image 12A of the drama A. The representative thumbnail image 12A-4 is moved to the position of the finger 50. Further, when a certain time has passed, the arrangement order of the representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, 12A-1 is changed from FIG. 7A to FIG. is doing. In other words, the representative thumbnail image 12 at the position of the finger 50 is replaced with the representative thumbnail images 12A, 12A-4, 12A-3, 12A-2, 12A-1, again 12A, 12A-4, 12A-3, 12A-2, 12A-1,...

  In S29, it is determined whether or not the detection area near the finger 50 has increased. If the detection area near the finger 50 has increased (Yes in S29), in S30, the moving image content related to the representative thumbnail image 12 displayed at the position of the finger 50 has been selected. For example, the reproduction of the moving image content is started, or a menu for operating the moving image content such as deletion or copying is displayed. The example of FIG. 8 shows that when another finger 50-2 is attached to the position of the finger 50, the detection area near the finger 50 increases and the representative thumbnail image 12A-3 is selected. Instead of determining whether or not the detection area near the finger 50 has increased as in S29, there is no significant change in the position (XY coordinates) of the finger 50, and there is a change in the Z coordinate of the finger 50. If detected, the moving image content related to the representative thumbnail image 12 displayed at the position of the finger 50 may be selected. For example, the position (XY coordinate) of the finger 50 is not significantly changed, and the Z coordinate of the finger 50 is reduced, that is, the finger 50 is displayed at the position of the finger 50 when moving in a direction approaching the display unit 11. It is assumed that moving image content related to the representative thumbnail image 12 is selected. Similarly, there is no significant change in the position (XY coordinates) of the finger 50, and the representative thumbnail image 12 displayed at the position of the finger 50 when the finger 50 enters the first detection area 15 from the second detection area 16 is displayed. Related video content may be selected. The operation of moving the finger 50 toward the display unit 11 is natural as an operation for selecting the moving image content related to the representative thumbnail image 12 displayed at the position of the finger 50. The operation of the finger 50 for selecting the moving image content related to the representative thumbnail image 12 displayed at the position of the finger 50 is to attach another finger 50-2 to the position of the finger 50 or display the finger 50. In addition to moving in a direction approaching the section 11, various operations are conceivable.

  Note that the above process can be realized by a computer as an example, and can be realized, for example, as a configuration of an information terminal as shown in FIG.

  In the information terminal shown in FIG. 9, an output device 41, an input device 42, a video processing unit 43, a CPU processing unit 44, and a memory 45 are provided. The non-contact detection device 14 is used as the input device 42, but a contact input unit such as a power switch, a touch sensor, a key, or a trackball may be further provided. The display unit 11 is used as the output device 41, and the stereoscopic viewing unit 13 for displaying an image in three dimensions is also provided. Furthermore, an audio output unit 411 that outputs audio by performing volume change, equalizer setting, and the like is provided. Examples of the audio output unit 411 include a DAC, an amplifier, a speaker, and headphones. The processing unit 43 includes a decoding unit 431 for decoding compressed audio and video data, and a drawing processing unit 432 for displaying / moving the representative thumbnail image and rotating / enlarging / reducing the decoded video. The stereoscopic viewing unit 13 is controlled by the drawing processing unit 432. The CPU processing unit 44 includes a list extraction unit 441 that determines a related content list and a representative thumbnail image, a selection determination unit 442, and a timer processing unit 443. The selection determination unit 442 determines whether content related to the representative thumbnail image displayed at the position of the finger 50 has been selected. The timer processing unit 443 changes the arrangement order of the representative thumbnail images at a constant time period when the representative thumbnail images are displayed in a three-dimensional manner by following the movement locus of the finger 50. Used. The memory 45 includes a volatile area and a nonvolatile area, and specifically includes a volatile memory such as a DRAM (Dynamic Random Access Memory), a nonvolatile memory such as a flash memory, and a hard disk device. In the memory 45, a plurality of applications 451 for reproducing moving images and music, contents 452 such as moving images, music, and photos, and their representative thumbnail images 12, thumbnail images, icons, and the like are recorded. Here, the representative thumbnail image is a reduced image of one still image constituting the moving image content as an example, the thumbnail image is a reduced image of a still image such as a photographic content as an example, and the icon is an example in music content. A reduced image such as a CD jacket or a shortcut icon for starting an application.

(Embodiment 2)
Next, the information terminal in Embodiment 2 concerning this invention is demonstrated.

  The basic configuration of the information terminal of the second embodiment is the same as that of the first embodiment, but a thumbnail image (including representative thumbnail images, thumbnail images, icons, etc.) redrawing method and content selecting method. Is different. Therefore, this difference will be mainly described. In addition, the same code | symbol is attached | subjected about the structure similar to Embodiment 1. FIG.

  FIG. 10 is a flowchart showing control of the information terminal 10 according to the second embodiment. Steps S20 to S24 are the same as the flowchart of FIG. 5 in the first embodiment.

  If it is detected in S25 that the finger 50 has moved from the second detection area 16 to the non-detection area 17 (Yes in S25), it is determined in S31 that the drawing position of the thumbnail image has been fixed, and the subsequent thumbnail images Do not redraw. At this time, as shown in FIG. 8, the representative thumbnail image 12A-3 is moved and fixed to the position of the finger 50 (XY coordinates), and other representative thumbnail images 12A-2, 12A-1, 12A, 12A related thereto. -4 is displayed and fixed so as to appear three-dimensionally at equal intervals.

  When it is detected in S32 that the finger 50 has entered the second detection area 16 from the non-detection area 17 again (Yes in S32), the finger 50 enters the second detection area 16 from the non-detection area 17 again in S33. It is confirmed whether or not the position (XY coordinates) of the finger 50 coincides with the position of any thumbnail image. If it is determined that the position of the finger 50 (XY coordinate) matches the position of any thumbnail image (Yes in S33), the thumbnail image at the position that matches the position of the finger 50 (XY coordinate) in S34. For example, the reproduction of the content is started, or a menu for operating the content, such as deletion or copying, is displayed.

  In addition, by providing a new tilt sensor for detecting the tilt of the information terminal 10, even after the thumbnail image drawing position is solidified in S <b> 31, for example, the thumbnail image is redrawn with a larger interval in the direction in which the tilt is detected. Or the order of thumbnail images can be changed. Examples of tilt sensors include those that can detect the tilt angles of the X and Y axes with an acceleration sensor, those that can detect the rotation angle of the Z axis with a geomagnetic sensor, and rotational speeds of the X, Y, and Z axes with a gyro. It is desirable to be able to detect the inclination with high accuracy close to the actual movement, such as a combination of those capable of detecting.

  In the information terminal 10 according to the second embodiment, the content related to the thumbnail image at the position that matches the position (XY coordinate) of the finger 50 when the finger 50 enters the second detection area 16 from the non-detection area 17 again. However, it may be determined including the position of the finger 50 in the Z-axis direction. The example of FIG. 11 is a diagram schematically illustrating the side surfaces of the display unit 11, the stereoscopic viewing unit 13, and the non-contact input unit 14 of the information terminal 10 according to the second embodiment. The arrangement order of thumbnail images in FIG. 11 is the same as the arrangement order of thumbnail images in FIG. When the position of the finger in the Z-axis direction is 50 ', it is determined that the thumbnail image 12A-2 has been selected. If the position of the finger in the Z-axis direction is 50 ″, it is determined that the thumbnail image 12A-3 has been selected. Note that the thumbnail image 12A, the thumbnail image 12A-1, the thumbnail image 12A-2, and the thumbnail image 12A-3 are shown above the display unit 11 only in a pseudo floating manner by the stereoscopic viewing unit 13. Actual drawing is performed at the positions of the thumbnail image 12A-R, thumbnail image 12A-1R, thumbnail image 12A-2R, and thumbnail image 12A-3R on the display unit 11, respectively. The thumbnail images 12A-4R are displayed so as to be on the display unit 11. That is, the thumbnail images 12A-4R are not displayed so as to appear in a pseudo manner. In the example of FIG. 11, the position of the finger in the Z-axis direction and the position of the thumbnail image 12A-2 and the thumbnail image 12A-3 that appear to float in a pseudo manner completely coincide with each other. Alternatively, it may be determined that the finger position (XY coordinate) and the thumbnail image position (XY coordinate) coincide with each other.

  In the information terminal 10 according to the first and second embodiments, when the current function is a music playback function, an icon related to music content is displayed instead of the thumbnail image 12 displayed on the display unit 11. . In this case, as the icon, a reduced screen of a CD jacket or a photograph of an artist can be used. In addition, examples of a method for extracting a related content list include artist-specific, age-specific, and playlist-specific lists.

  In the information terminal 10 according to the first and second embodiments, when the current function is the home screen, a shortcut icon for starting the application is displayed instead of the thumbnail image 12 displayed on the display unit 11. Is displayed. In addition, as a method of extracting a related application list, genre such as game or work can be cited.

  Further, in the information terminal 10 according to the first and second embodiments, when the current function is the photo display function, the thumbnail image 12 displayed on the display unit 11 is a thumbnail image obtained by reducing the photo. Further, as a method for extracting a related photo list, there are a person-by-person, a shooting date-and-time, a shooting place-by-photographing place, and the like.

  An example of the indicator of the present invention corresponds to the finger 50 in the first and second embodiments, but is not limited thereto, and may be a pointing device such as a stylus.

  As described above, the configuration of the present invention may be realized in software or hardware.

(Other embodiments)
The information terminal 10 of Embodiments 1 and 2 was provided with a stereoscopic viewing unit 13 and a non-contact detection device 14 for stereoscopic viewing arranged above the display unit 11. However, the present invention can also be implemented in simpler information terminals.

  The present invention can also be implemented in an information terminal that does not include a stereoscopic viewing unit and a non-contact detection device above the display unit. At this time, the cursor displayed on the display unit corresponds to the finger 50 that is the indicator of the first and second embodiments. The cursor can be freely moved in the display unit by a four-way key or a trackball provided on the information terminal.

  It is assumed that the representative thumbnail image of the group at the cursor position is selected. Alternatively, the representative thumbnail image of the group at the cursor position is selected by moving a cursor to the position of the representative thumbnail image of the group and then pressing a specific button or the like.

  Next, it is determined whether or not there are a plurality of related contents linked to the representative thumbnail images of the selected group. If there is only one related content linked to the representative thumbnail image of the selected group, that content is selected. If there are a plurality of related contents linked to the representative thumbnail images of the selected group, it is then determined whether or not the cursor has moved within the display unit. When the cursor moves within the display unit, the representative thumbnail images of a plurality of related contents linked to the representative thumbnail images of the selected group are displayed on the display unit following the movement locus of the cursor. Thereafter, one of the representative thumbnail images of a plurality of related contents displayed on the display unit is selected by following the movement locus of the cursor by an appropriate method.

  Note that the information terminal may include a touch panel on the display unit. When the information terminal includes a touch panel on the display unit, the cursor can be moved by touching the touch panel, instead of moving the cursor by a four-way key or a trackball.

  In addition, this invention can be implemented also in the information terminal which equips the upper part of a display part with a three-dimensional visual recognition part, but does not have a non-contact detection device. In that case, when the cursor moves in the display section, the representative thumbnail images of a plurality of related contents linked to the representative thumbnail images of the selected group are made to follow the cursor movement locus, and the upper part of the cursor movement locus. Is displayed three-dimensionally.

  INDUSTRIAL APPLICABILITY According to the information terminal and the screen component selection method of the present invention, it has an effect that it is easy to find a desired screen component and easily select a desired content, and is useful as an information terminal such as a smartphone or a PDA and its screen component selection method. It is.

DESCRIPTION OF SYMBOLS 10 Information terminal 11 Display part 12 Thumbnail image 12A Thumbnail image 12A-1 Thumbnail image 12A-2 Thumbnail image 12A-3 Thumbnail image 12A-4 Thumbnail image 12A-R Thumbnail image (real image)
12A-1R Thumbnail image (real image)
12A-2R Thumbnail image (real image)
12A-3R Thumbnail image (real image)
12A-4R Thumbnail image (real image)
DESCRIPTION OF SYMBOLS 13 Stereoscopic visual recognition part 14 Non-contact detection device 15 1st detection area 16 2nd detection area 17 Out-of-detection area 41 Output device 411 Audio | voice output part 42 Input device 43 Video processing part 431 Decoding part 432 Drawing process part 44 CPU processing part 441 List Extraction unit 442 Selection determination unit 443 Timer processing unit 45 Memory 451 Application 452 Content 50 Finger 50 'Finger 50''Finger

Claims (11)

A display unit for displaying screen parts;
Indicated position detecting means for detecting an indicated position in the display unit;
A plurality of related screen parts are integrally displayed on the display unit,
When it is determined that the integrally displayed screen component is instructed by the indicated position detection means, the integrally displayed screen component is discretely described based on the movement locus of the indicated position thereafter. A control unit to be displayed on the display unit;
An information terminal comprising: The display unit
The screen component can be displayed in three dimensions,
The controller is
When it is determined that the integrally displayed screen component is instructed by the indicated position detection means, the integrally displayed screen component is displayed in a three-dimensional manner on the display unit.
The information terminal according to claim 1. A display unit for displaying screen parts;
A three-dimensional position detector for detecting the position of the pointing object;
A plurality of related screen parts are integrally displayed on the display unit,
The three-dimensional position detection unit integrally displays the position of the pointing object in a plane parallel to the display unit and the display unit when the pointing object approaches within a predetermined distance from the display unit. Based on the position of the screen part, it is determined that the indicator indicates the integrally displayed screen part,
When it is determined by the three-dimensional position detection unit that the indicator indicates the integrally displayed screen component, based on the movement trajectory of the subsequent indicator obtained by the three-dimensional position detection unit The screen parts displayed integrally are displayed on the display unit discretely.
A control unit;
An information terminal comprising: The display unit
The screen component can be displayed in three dimensions,
The controller is
When the three-dimensional position detection unit determines that the indicator indicates the integrally displayed screen component, the integrally displayed screen component is displayed on the display unit in a three-dimensional manner.
The information terminal according to claim 3. The controller is
When the three-dimensional position detection unit determines that the position of the indicator has not changed for a predetermined time after the integrally displayed screen parts are displayed on the display unit in three dimensions, Changing the order of the displayed screen parts to be displayed on the display means,
The information terminal according to claim 4. The controller is
When the detection area of the indicator detected by the three-dimensional position detector is increased, the position of the indicator in a plane parallel to the display surface and the position of the stereoscopically displayed screen component on the display surface Determining which of the three-dimensionally displayed screen parts the instruction object indicates based on
The information terminal according to claim 4. The controller is
When the three-dimensional position detector determines that the indicator has approached the display surface, the position of the indicator in a plane parallel to the display surface and the three-dimensionally displayed screen component on the display surface Determining which of the three-dimensionally displayed screen parts the indicator indicates based on the position of
The information terminal according to claim 4. The controller is
When the three-dimensional position detection unit determines that the indicator has moved beyond a second predetermined distance that is greater than the predetermined distance, the three-dimensionally displayed screen components are integrated with the display unit. Display,
The information terminal according to claim 4. The controller is
When the three-dimensional position detection unit determines that the indicator has moved beyond a second predetermined distance greater than the predetermined distance, the three-dimensionally displayed screen component is fixed in that state.
The information terminal according to claim 5. The controller is
The three-dimensional position detection unit displays the indicator in a three-dimensional manner on the display unit and the position of the indicator in a plane parallel to the display unit when the indicator approaches within a predetermined distance from the display unit. Determining which of the three-dimensionally displayed screen parts the instruction object indicates based on the position of the screen parts;
The information terminal according to claim 9. A first display step of integrally displaying a plurality of related screen parts on the display unit;
Position of the pointing object in a plane parallel to the display unit when the pointing object approaches within a predetermined distance from the display unit by the three-dimensional position detection unit, and the integrally displayed screen component on the display unit A first determination step of determining whether or not the pointing object indicates the integrally displayed screen component based on the position of
In the first determination step, when the three-dimensional position detector determines that the indicator indicates the integrally displayed screen part, the subsequent indicator obtained by the three-dimensional position detector A second display step of causing the display unit to display the integrally displayed screen parts in a three-dimensional manner based on a movement locus;
A second determination step of determining whether or not the three-dimensional position detection unit indicates one of the three-dimensionally displayed screen parts;
When it is determined in the second determination step that the three-dimensional position detection unit indicates that the pointing object indicates any one of the three-dimensionally displayed screen parts, it is determined that the specified screen part is selected. 3 judgment steps;
A screen component selection method comprising: