JP5533409B2 - Display control apparatus and program - Google Patents

Description

The present invention, Table示制control device, and relates to a program.

  For example, Patent Document 1 discloses an input device in which touch sensors are arranged in two vertical and horizontal directions.

JP 2002-333951 A

  In the input device described in Patent Document 1, for example, when selecting one of a plurality of items arranged in a matrix on the display screen, two touch sensors must be operated respectively. The operation was not intuitive.

The present invention has been made in view of the above point, the operation is intuitive, Table示制control apparatus, and aims to provide a program.

(1 ) A display control apparatus according to the first aspect of the present invention is:
A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a display control device for inputting the contact position and the orientation of the operation part output by a controller Because
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position for example Bei means,
The display screen includes a plurality of display elements that are elements on the display screen,
The display control means arranges the plurality of display elements in a different order depending on the direction of the operation unit, and changes the selection target according to a change in the contact position, thereby changing the selection target to the predetermined display image. As shown in the display position,
It is characterized by that.
(2) A display control device according to a second aspect of the present invention is:
A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a display control device for inputting the contact position and the orientation of the operation part output by a controller Because
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position Means,
A relative position change detecting means for detecting a change in relative position between the operation section and the display section;
With
The display screen includes a plurality of display elements that are elements of the display screen,
The display control means displays one of the plurality of display elements as a selection target,
The plurality of display elements are arranged for a plurality of groups,
The display control means selects one group among the plurality of groups according to the change in the relative position detected by the relative position change detection means, and changes the contact position in the selected group. By changing the selection target accordingly, the selection target is displayed at the display position as the predetermined display image.
It is characterized by that.
(3) A display control device according to a third aspect of the present invention is:
A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a display control device for inputting the contact position and the orientation of the operation part output by a controller Because
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position Means,
Distance detecting means for detecting a distance between the operation unit and the display unit;
With
The display control means changes the display content of the display screen with different degrees of change according to the distance detected by the distance detection means.
It is characterized by that.
( 4 ) A program according to the fourth aspect of the present invention is
A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a computer to which the contact position output by the controller and the orientation of the operation part are input.
Based on the orientation of the contact position and the operating unit, it specifies a display position on the display screen that the display unit displays, display control for displaying a predetermined display image is an element of the display screen on the display position specified Step,
It was carried out,
The display screen includes a plurality of display elements that are elements on the display screen,
In the display control step, the plurality of display elements are arranged in a different order depending on the direction of the operation unit, and the selection target is changed according to a change in the contact position, whereby the selection target is changed to the predetermined display image. As shown in the display position,
It is characterized by that.
(5) A program according to the fifth aspect of the present invention is:
A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a computer to which the contact position output by the controller and the orientation of the operation part are input.
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position Step,
A relative position change detecting step for detecting a change in relative position between the operation unit and the display unit;
Let
The display screen includes a plurality of display elements that are elements of the display screen,
The display control step displays one of the plurality of display elements as a selection target,
The plurality of display elements are arranged for a plurality of groups,
The display control step selects one group of the plurality of groups according to the change in the relative position detected in the relative position change detection step, and changes the contact position in the selected group. By changing the selection target accordingly, the selection target is displayed at the display position as the predetermined display image.
It is characterized by that.
(6) A program according to the sixth aspect of the present invention is:
A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a computer to which the contact position output by the controller and the orientation of the operation part are input.
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position Step,
A distance detecting step for detecting a distance between the operation unit and the display unit;
Let
The display control step changes the display content of the display screen with a different degree of change according to the distance detected by the distance detection step.
It is characterized by that.

According to the present invention, Table示制control device, and, according to the program, the user can perform an intuitive operation.

It is a figure for demonstrating the basic operation | movement of the display control system which concerns on one Embodiment of this invention. It is a figure which shows the structure of the controller which concerns on one Embodiment of this invention. It is a figure which shows the structure of the display control apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows the display control which the display control apparatus which concerns on one Embodiment of this invention performs. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention. It is a figure for demonstrating the relationship between the controller and display screen which concern on one Embodiment of this invention.

  An embodiment according to the present invention will be described with reference to the drawings. In addition, this invention is not limited by description of the following description and drawing. It goes without saying that changes (including deletion of components) can be added to the contents of the following description and drawings. Further, in the following description, in order to facilitate understanding of the present invention, descriptions of known technical matters are omitted as appropriate.

  First, the display control system 1 according to the present embodiment will be described with reference to FIG. The display control system 1 includes a rod-shaped controller 100 and a display control device 200 operated by the controller 100. Both can communicate wirelessly. When the user operates the controller 100, the display control device 200 changes the image (display screen) displayed on the display unit 250 in accordance with this operation.

  The user holds the controller 100 (housing 105) with the fingers 1 and 2, points the controller 100 in a desired direction (see arrows 5a and 5b), and uses the finger 3 to detect the detection region 120a (details will be described later). And move this finger 3 in the direction of the arrow 5c or 5d. This is a basic operation of the controller 100 performed by the user. The controller 100 detects the contact position of the finger 3 in the detection region 120a, the orientation of the controller 100, and the like with a predetermined sensor, and supplies the detected information (contact position information, orientation information, etc.) to the display control device 200. To do.

  In this embodiment, the orientation of the controller 100 is expressed by the inclination of the longitudinal direction (see the double arrow 7a) in the controller 100 with respect to the reference axis 6a. The reference axis 6a is an axis that passes through the center in the longitudinal direction of the controller 100 and is parallel to the direction in which the earth's gravity works.

  The display control device 200 sets a reference axis 6b (virtual orientation) parallel to the reference axis 6a on a display screen that displays on the display surface 240a. The display control device 200 acquires contact position information and orientation information from the controller 100 by communicating with the controller 100. Since the display control apparatus 200 sets the reference axis 6b on the display screen, the orientation corresponding to the orientation of the controller 100 with respect to the reference axis 6b on the display screen depends on the orientation of the controller 100 ascertained by the orientation information. (Here, the same direction (substantially including the same, the same applies to the same)) can be set on the display screen as the response direction of the contact operation (see the double arrow 7b).

  Here, the response direction is, for example, a direction in which the display element of the display screen changes in response to the contact operation. When the finger 3 is moved in the direction of the arrow 5c or 5d by the contact operation, the display control device 200 responds to the change in the contact position grasped by the contact position information, for example, along the response direction (both The display element (for example, cursor) of the display screen is moved in the same direction as the response direction and in the same direction as the changing contact position (see arrow 7b).

  A display element is an element that constitutes a display screen, and includes a cursor (pointer or the like), an icon, a menu item, a thumbnail image, and the like.

  As illustrated in FIG. 2, the controller 100 includes a housing 105, an output unit 110, a contact position detection unit 120, a direction detection unit 130, a position change detection unit 140, a distance detection unit 150, and an I / F unit. 160 and a battery 190. The output unit 110 includes a control device 111 and a communication unit 112. Each detection unit is configured using a known sensor or the like.

  The housing 105 has a rod-like outer shape. Here, the outer shape of the housing 105 is a rectangular parallelepiped shape, but may be a cylindrical shape or the like. The housing 105 houses the output unit 110, the contact position detection unit 120, the orientation detection unit 130, the position change detection unit 140, the distance detection unit 150, the I / F unit 160, and the battery 190. . The housing of the controller 100 may be composed of a rod-shaped housing corresponding to the housing 105 and other housings, and the respective units may be housed in these housings. The rod-shaped housing 105 and the other housing may be formed integrally or may be combined in separate housings.

  The contact position detection unit 120 is configured by a contact sensor. The contact position detection unit 120 has a strip-shaped detection region 120a (see FIG. 1). The detection region 120a is formed on a surface (side surface) extending along the longitudinal direction of the housing 105 (see the double arrow 7a). The longitudinal direction of the detection region 120a and the longitudinal direction of the housing 105 are the same direction. When a contact object such as the user's finger 3 comes into contact with the detection area 120a under the control of the control device 111, the contact position detection unit 120 detects a contact position with the contact object in the detection area 120a. The contact position detection unit 120 is configured by, for example, a capacitive one-dimensional touch sensor (detecting a contact position as a linear position) that outputs an electrical signal representing the contact position.

  The direction detection unit 130 detects the direction of the controller 100 in the longitudinal direction (see the double-headed arrow 7b in FIG. 1) under the control of the control device 111. Since the orientation detection unit 130 is housed in the housing 105 of the controller 100, the orientation detection unit 130 detects the orientation of the housing 105 in the longitudinal direction.

  The position change detection unit 140 detects a change in the position of the controller 100 (detection region 120a) under the control of the control device 111. Since the display control device 200 does not move during the operation of the control 100, this change in position is a change in the relative position with respect to the display control device 200.

  The direction detection unit 130 and the position change detection unit 140 are configured by, for example, one or more acceleration sensors that detect the direction in which gravity works. The acceleration sensor at least represents the direction of the controller 100 (in this embodiment, the inclination expressed by two predetermined axes with respect to the reference axis 6a) and the movement direction (for example, when the center of gravity of the controller 100 moves). Output a signal. In the present embodiment, the change in the relative position is grasped depending on the moving direction. As described above, the direction in which the reference axis 6a extends is parallel to the direction in which the earth's gravity works when the direction detection unit 130 is configured by an acceleration sensor. The direction in which the reference axis 6a extends differs depending on the device that constitutes the orientation detection unit 130.

  The distance detection unit 150 detects the distance to the display control device 200 under the control of the control device 111. The distance detection unit 150 is configured by a distance meter using a laser, an ultrasonic wave, or the like, for example. For example, the distance meter is disposed on the surface of the controller 100 opposite to the detection region 120a. When the user uses the controller 100 with this surface facing the display control device 200, the distance between the controller 100 and the display control device 200 is detected. The distance meter outputs an electrical signal representing this distance.

  The I / F unit 160 receives a user's mechanical operation (such as a pressing operation) and detects the operation content of this operation. The I / F unit 160 is configured by, for example, a user interface configured by a determination button or the like, and outputs an electrical signal representing the operation content of this mechanical operation. The I / F unit 160 is used, for example, for selecting and determining icons and thumbnail images.

  The output unit 110 acquires each detection result (contact position, orientation of the controller 100, change in position, distance, operation content of mechanical operation) detected by each unit 120 to 160, and information based on the acquired information ( Information on each detection result) is output. The detection result information includes contact position information (information indicating the contact position, information indicating the moving direction described later, etc.), and direction information (information indicating the direction, etc.) indicating the direction of the controller 100. ), Position change information (information indicating position change, etc.) that is information on changes in relative position, distance information (information showing distance, etc.) that is distance information, and operation details that are information on the operation contents of mechanical operations Information (information indicating operation contents, etc.).

  The output unit 110 includes a control device 111 and a communication unit 112, for example. The control device 111 is configured by a microcomputer (microcomputer) or the like. The control device 111 controls the entire controller 100. The control device 111 appropriately generates data representing information of each detection result based on the electrical signal supplied from each unit, and wirelessly transmits this data to the display control device 200 via the communication unit 112. The communication unit 112 includes, for example, a modulation unit and an antenna, modulates the data to a high frequency by the modulation unit, and transmits the high frequency modulated by the modulation unit from the antenna.

  The battery 190 supplies predetermined power to the control device 111 and the like.

  Note that the contact position detection unit 120 can detect the contact position with high resolution by performing detection about 50 times per second under the control of the control device 111. Further, the control device 111 performs history management by sequentially storing the contact positions detected by the contact position detection unit 120 in a memory. Thereby, the control device 111 detects a change in the time-series order of the contact position, and detects the moving direction and the moving speed, that the contact object is separated even for a moment. Based on the electrical signal supplied from the contact position detection unit 120, the control device 111, for example, obtains data (contact position information) indicating information such as the moving direction and moving speed, and that the contact object has left even for a moment. Generate and output via the communication unit 112. These data may be generated by the control unit 210 of the display control apparatus 200. That is, the output unit 110 may output information representing the detection result from each detection unit as it is as information on each detection result. And about these information, the control part 210 may perform a predetermined | prescribed process.

  As illustrated in FIG. 3, the display control device 200 includes a control unit 210, a storage unit 220, a reception unit 230, a display unit 240, and a sensor unit 250.

  The storage unit 220 is configured by a storage device such as a memory card connected to the display control device 200 via, for example, a hard disk, a flash memory, a ROM (Read Only Memory), a reading / writing device, and the like, and is used for the control unit 210. Stored programs, data, and the like.

  The receiving unit 230 receives information on each detection result supplied from the controller 100 and supplies the information to the control unit 210. The receiving unit 230 is incorporated in the housing of the table control device 200 (see FIG. 1). For example, the reception unit 230 includes an antenna and a demodulation unit, receives the high frequency by the antenna, and supplies data from the controller 100 from the high frequency by the demodulation unit (information data of each detection result). And the demodulated data is supplied to the control unit 210.

  The display unit 240 is configured by a display device such as a liquid crystal display or an EL (Electro-Luminescence) display. The control unit 210 controls the display unit 240 to display a predetermined image on the display unit 240 as a display screen.

  The sensor unit 250 detects the direction of the display control device 200 (the display surface 240a of the display unit 240), and supplies the control unit 210 with direction information indicating the detected direction. This orientation is represented by, for example, an inclination in the short direction (vertical direction in FIG. 1) of the display surface 240a of the display control device 200 with respect to an axis parallel to the reference axis 6a. This direction is the in-plane direction of display unit 240 (the direction of display surface 240a) (see arrow 8 in FIG. 1). The sensor unit 250 is configured by a sensor of the same type as that of at least the direction detection unit 130 of the controller 100. In the present embodiment, since the direction detection unit 130 is an acceleration sensor, the sensor unit 250 is configured by an acceleration sensor. For this reason, the said axis line is an axis line parallel to the direction where the gravity of the earth works. The sensor unit 250 only needs to detect the orientation of the display surface 240a. Since the sensor of the sensor unit 250 and the sensor constituting the orientation detection unit 130 are the same sensor, the reference axis 6a of the controller 100 and the reference axis 6b of the display control device 200 can be easily made parallel (setting of the reference axis 6b). Details will be described later).

  The control unit 210 controls the entire display control apparatus 200. The control unit 210 includes a CPU (Central Processing Unit) and a RAM (Random Access Memory). A program stored in the storage unit 220 is loaded into the RAM. The RAM functions as a main memory for the CPU. In the control unit 210, the CPU performs processing based on various data recorded in the storage unit 210, data supplied from the reception unit 230 (information on each detection result), and the like according to a program loaded in the RAM. The display control described later is performed. In particular, the control unit 210 displays a predetermined image on the display unit 240 as a display screen. In addition to the CPU, the control unit 210 may be at least partially configured by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or the like.

  Next, display control performed by the control unit 210 will be described with reference to FIG. In the display control, for example, the user operates the controller 100, an operation unit of the display control device 200 (not shown), and the display control device 200 displays a predetermined type of image on the display unit 240 as a display screen. It begins with time.

  The control unit 210 displays the display screen on the display surface 240a of the display unit 240 using various data recorded in the storage unit 220 in accordance with an operation from the user. This display screen is, for example, a menu screen including a cursor (see FIG. 5 and the like) and a selection screen for selecting a plurality of thumbnail-displayed images (see FIG. 7 and the like). Here, the display screen is the menu screen (see FIG. 5), and the user operates the controller 100 to move the cursor and perform a determination operation to display the contents of the icon. Shall.

  First, the control unit 210 receives orientation information from the sensor unit 250, and on the display screen displaying the reference axis 6b parallel to the reference axis 6a for the controller 100 on the display surface 240a based on the received orientation information. (Step S101).

  For example, the storage unit 250 stores a correspondence table in which the orientation information and the information on the direction of the reference axis 6b on the display screen are associated with each other. The control unit 210 receives the correspondence table from the sensor unit 250. Based on the orientation information, information on the direction of the reference axis 6b corresponding to the orientation information is acquired, and the reference axis 6b is set based on the acquired information. The orientation information correspondence table shows the correspondence between the two so that the reference axis 6b set on the display screen is parallel to the reference axis 6a when the display control apparatus 200 is oriented in the orientation of the orientation information. Show. Thus, the reference axis 6a and the reference axis 6b can be made parallel.

  As described above, the reference axis 6b is set on the display screen based on the information from the sensor unit 250. For example, the display control device 200 is changed from the vertical position to the horizontal position. Even if the orientation of the display (the orientation of the display unit 240) is changed, the reference axis 6b is set to be parallel to the reference axis 6a. Therefore, the operation on the controller 100 and the change in the display screen are related to the operation direction. Can be linked well, and the user can perform intuitive operations.

  Next, the control unit 210 performs display control to change the display content of the display screen displayed on the display surface 240a based on data of each detection result information received by the receiving unit 230 and supplied to the control unit 210. Perform (step S102).

  For example, it is assumed that the control unit 210 displays the display screen 10 including the cursor 19 (display element) on the display surface 240a (see FIG. 5). Then, it is assumed that the user holds the controller 100 so that the longitudinal direction 11 of the housing 105 is in the direction as shown in FIG. 5 and moves the finger 3 on the detection region 102 a along the longitudinal direction 11 of the housing 105. (Refer to the movement from the dotted finger 3 to the solid finger 3).

  In this case, the control unit 210 sets a response direction corresponding to the direction on the display screen based on the direction information received by the reception unit 230 and supplied to the control unit 210. As described above, the orientation information is expressed by an inclination with respect to the reference axis 6a (see FIG. 1). Since the reference axis 6b set above is parallel to the reference axis 6a, the extending direction of the axis inclined by the inclination of the orientation information from the reference axis 6b on the display screen corresponds to the longitudinal direction of the controller 100 (predetermined Parallel to the display screen). The control unit 210 sets this direction as the response direction 12.

  Further, the control unit 210 responds to the change of the contact position based on the contact position information received by the reception unit 230 and supplied to the control unit 210 (in the same direction as the changing contact position), and the response direction 12 The cursor 19 on the display screen is moved along the line (refer to the movement from the dotted line cursor 19 to the solid line cursor 19). The control unit 210 specifies a change in the contact position based on the contact position information. The change of the contact position is specified based on the time series change of the contact position represented by the contact position information, or based on the movement direction and moving speed of the contact position represented by the contact position information, the contact object being separated even for a moment, etc. The Here, since the finger 3 is moved from the position of the dotted finger 3 to the position of the solid finger 3, the moving direction is the same as the moving direction of the finger 3, toward FIG. 5 and in the longitudinal direction 11. In the left direction. The control unit 210 moves the cursor 19 in the same direction as the movement direction of the contact position, for example, in the left direction in FIG.

  Further, for example, when the user tilts from the state of FIG. 5 so that the longitudinal direction 11 of the housing 105 becomes a direction as shown in FIG. 6, the control unit 210 performs the same as the setting of the response direction 12 described above. Based on the orientation information, a response direction 12 having the same orientation as the orientation corresponding to the longitudinal direction 11 of the real space (the orientation indicated by the orientation information) is set on the display screen 10 (see FIG. 6).

  Next, the control unit 210 determines whether an instruction to switch the screen is given (step S103). For example, when the cursor 19 is positioned on the icon of the display screen 10, the user presses the I / F unit 160 of the controller 100 to display the content screen of the icon on the display surface 240 a, and the selection is determined. I do. Then, in response to this operation, the controller 100 supplies operation content information data to the display control device 200. The control unit 210 acquires operation content information data supplied from the receiving unit 230.

  When this data is supplied, the control unit 210 determines that the screen switching is instructed (step S103; YES), and displays the screen using various data recorded in the storage unit 220. The image is displayed (switched) on the display surface 240a (step S104), and this display control is ended once. If the image after switching is the image of the predetermined type, the control unit 210 performs display control again. Further, if the data is not supplied, the control unit 210 determines that the screen switching has not been instructed yet (step S103; NO), returns to the process of step S101, and returns to the reference axis 6b. Set up.

  Through the processing as described above, the control unit 210 sequentially uses the orientation information to display the response direction 12 corresponding to the orientation corresponding to the longitudinal direction 11 of the real space (the same orientation as the orientation described above) on the display screen 10. In response to the change in the contact position specified by the contact position information, the cursor 19 that is an element of the display screen 10 is moved along the set response direction 12. Thereby, the user who operates the controller 100 can perform intuitive operation.

  Note that the operation target, the screen, and the like of the operation performed by the controller 100 can be changed as appropriate. Other display control processing examples will be described below. Similarly to the above, the control unit 210 displays a predetermined screen on the display surface 240a of the display unit 240 using various data recorded in the storage unit 220.

(Example 1)
The control unit 210 may display the display screen 20 including a plurality of thumbnail images 29 (display elements) on the display surface 240a (FIGS. 7 and 8). The display screen 20 is used to select one of a plurality of thumbnail images 29. When the user makes a selection decision using the controller 100 and selects one thumbnail image, the control unit 210 selects the selected thumbnail image 29. The thumbnail image (original image) thus displayed is displayed on the display surface 240a. On the display screen 20, the thumbnail image 29a that is currently selected is highlighted, and the highlighted thumbnail image 29a is selected by the selection decision. Here, the highlighted display is an enlarged display. However, the highlighted display may be a display that can be distinguished from other thumbnail images, such as an instruction by a cursor, a color change, or shading.

  Even in the case of the display screen 20, the reference axis 6b is set as described above. The control unit 210 is supplied with orientation information, contact position information, and the like. The controller 210 sets the response direction 22 corresponding to the longitudinal direction 21 as described above. When the direction of the longitudinal direction 21 of the controller 100 changes from the state shown in FIG. 7 to the state shown in FIG. 8, the response direction 22 also changes to be the same direction as the longitudinal direction 21. In this case, the control unit 210 arranges and displays the thumbnail images 29 along the direction of the response direction 22. Then, the thumbnail image 29a to be highlighted is changed to another thumbnail image in accordance with the change (movement direction or the like) of the contact position specified by the contact position information (see FIG. 8).

  In Example 1, the display screen 20 includes a plurality of thumbnail images 29, and any one of the plurality of thumbnail images 29 (thumbnail image 29a) is displayed as a selection target. Since a plurality of thumbnail images 29 are arranged along the response direction 22 corresponding to the orientation to be changed and the selection target is changed according to the change of the contact position, an intuitive operation is possible.

(Example 2)
The control unit 210 may display the display screen 30 including a group of a plurality of thumbnail images 39 (display elements) and a group of a plurality of menu item icons 38 (display elements) on the display surface 240a (see FIG. 9 and FIG. 10). The display screen 30 is used to select any one of a plurality of thumbnail images 39 or one of a plurality of item icons 38. When the thumbnail image 39 or the item icon 38 is selected, the control unit 210 displays the image of the selected thumbnail image 39 or the content of the item icon 38 on the display surface 240a. On the display screen 30, the thumbnail image 39a that is currently selected is highlighted (enlarged display, see FIG. 9) or the item icon 38a is highlighted (instructed by the cursor, see FIG. 10). This highlighted thumbnail image 39a or item icon 38a is selected.

  Even in the case of the display screen 20, the reference axis 6b is set as described above. The control unit 210 is supplied with orientation information, contact position information, and the like. The controller 210 sets a response direction 32 corresponding to the longitudinal direction 31 as described above. When the longitudinal direction 31 of the controller 100 is horizontal (the same direction as the direction in which the thumbnail images 39 are arranged), the response direction 32 is set to the horizontal direction that is the same as the horizontal direction as shown in FIG. The control unit 210 changes the thumbnail image 39a to be highlighted to another thumbnail image 39 in accordance with the change in the contact position based on the contact position information. When the longitudinal direction 31 of the controller 100 is in the vertical direction (the same direction as the direction in which the item icons 38 are arranged), the response direction 32 is set to the vertical direction that is the same direction as the vertical direction as shown in FIG. The control unit 210 changes the item icon 38a to be highlighted to another item icon 38 according to the change in the contact position based on the contact position information.

  In Example 2, the display screen 30 includes a plurality of display elements (thumbnail image 39 and item icon 38), and one of the plurality of display elements (thumbnail image 39a or item icon 38a) is displayed as a selection target. The plurality of display elements are arranged in the vertical direction and the horizontal direction for each of the plurality of groups (for each thumbnail image 39 and for each item icon 38), and the control unit corresponds to the orientation in the plurality of groups (display element). In one group (in the same direction), the selection target is changed according to the change of the contact position. An intuitive operation can be performed for selecting a plurality of display elements for a plurality of groups.

(Example 3)
The control unit 210 may display the display screen 40 including a plurality of thumbnail images 49 (display elements) on the display surface 240a (FIGS. 11 and 12). The display screen 40 is used to select one of a plurality of thumbnail images 49. When the user makes a selection decision using the controller 100 and selects one thumbnail image 49, the control unit 210 selects the thumbnail image 49. The image of the selected thumbnail image 49 is displayed on the display surface 240a. On the display screen 40, the currently selected thumbnail image 49a is highlighted (enlarged display), and the highlighted thumbnail image 49a is selected by the selection decision.

  Even in the case of the display screen 40, the reference axis 6b is set as described above. The control unit 210 is supplied with orientation information, contact position information, and the like. The controller 210 sets a response direction 42 corresponding to the longitudinal direction 41 as described above. The thumbnail images 49 are arranged in a matrix (calendar). When the longitudinal direction 41 of the controller 100 is horizontal, as shown in FIG. 11, the response direction 42 is the horizontal direction that is the same direction as this horizontal direction, and a group of stages (in units of weeks) including the thumbnail images 49a to be selected. Set above. The control unit 210 changes the thumbnail image 49a to be highlighted to another thumbnail image 49 in the same stage (same week) according to the change in the contact position based on the contact position information. When the longitudinal direction 41 of the controller 100 is vertical, as shown in FIG. 12, the response direction 42 is the vertical direction that is the same direction as this vertical direction, and on the vertical column that includes the thumbnail images 49a to be selected. Set to The control unit 210 changes the thumbnail image 49a to be highlighted to another thumbnail image 49 on the same column (same day) according to the change of the contact position based on the contact position information.

  In Example 3, the display screen 400 includes a plurality of thumbnail images 49 arranged in a calendar shape, and any one of the plurality of thumbnail images 49 is displayed as a selection target (thumbnail image 49a). Changes the selection target according to the change of the contact position among the plurality of thumbnail images 49 arranged in the direction corresponding to the direction represented by the orientation information among the plurality of thumbnail images 49 on the display screen 40. To do. As a result, an intuitive operation can be performed for selecting a plurality of display elements.

(Example 4)
The control unit 210 may display the display screen 50 including a plurality of thumbnail images 59 (display elements) on the display surface 240a (FIGS. 13 and 14). The display screen 50 is used to select one of the plurality of thumbnail images 59. When the user makes a selection decision using the controller 100 and selects one thumbnail image 59, the control unit 210 selects the thumbnail image 59. The image of the selected thumbnail image 59 is displayed on the display surface 240a. On the display screen 50, the currently selected thumbnail image 59a is highlighted (enlarged display), and the highlighted thumbnail image 59a is selected by the selection decision.

  Even in the case of the display screen 50, the reference axis 6b is set as described above. The control unit 210 is supplied with orientation information, contact position information, and the like. The controller 210 sets the response direction 52 corresponding to the longitudinal direction 41 as described above. The thumbnail images 59 are arranged in a matrix (calendar). When the longitudinal direction 51 of the controller 100 is horizontal, as shown in FIG. 13, the response direction 52 is the horizontal direction that is the same direction as the horizontal direction, and the group of weeks (weeks) that includes the thumbnail image 59a to be selected. Set to The control unit 210 changes the thumbnail image 59a to be highlighted to another thumbnail image 59 on the same stage in accordance with the change in the contact position based on the contact position information. When the longitudinal direction 51 of the controller 100 is vertical, as shown in FIG. 14, the response direction 52 is the same vertical direction as the vertical direction and the same day in the vertical direction including the thumbnail image 59a to be selected. Is set in the direction in which. In this case, the thumbnail image 59 including the selection target is changed and selected on a weekly basis (refer to an area surrounded by a dotted line). The control unit 210 changes the group of the weekly thumbnail images 59a to be selected to another weekly group according to the change of the contact position based on the contact position information. That is, here, for example, first, the thumbnail image 59 is selected in units of weeks with the longitudinal direction 51 set to the vertical direction, and any one of the thumbnail images 59 in the circumference is set with the longitudinal direction 51 set to the horizontal direction. Can be selected.

  In Example 4, the display screen 50 includes a plurality of thumbnail images 59 arranged in a calendar shape, and any one of the plurality of thumbnail images 59 is displayed as a selection target (thumbnail image 59a). The elements are arranged for each of a plurality of groups (weekly), and when the direction of the longitudinal direction 51 is the first direction, the control unit uses the contact position for selection of the group (week), and the longitudinal direction When the direction of 51 is the second direction, the selection target is changed in accordance with the change of the contact position in the selected group (week). Thus, an intuitive operation can be performed for the selection operation.

(Example 5)
The control unit 210 may display the display screen 60 including a plurality of thumbnail images 69 (display elements) on the display surface 240a (FIGS. 15 and 16). The display screen 60 is used to select one of a plurality of thumbnail images 69. When the user makes a selection decision using the controller 100 and selects one thumbnail image, the control unit 210 selects the selected thumbnail image 69. The thumbnail image (original image) thus displayed is displayed on the display surface 240a. On the display screen 60, the currently selected thumbnail image 69a is highlighted (enlarged display), and the highlighted thumbnail image 69a is selected by the selection decision.

  Even in the case of the display screen 60, the reference axis 6b is set as described above. The control unit 210 is supplied with orientation information, contact position information, and the like. The controller 210 sets a response direction 62 corresponding to the longitudinal direction 61 as described above. However, even if the orientation of the longitudinal direction 61 of the controller 100 changes from the state shown in FIGS. 15 to 16, the response direction 62 does not change. In other words, the response direction is set to a predetermined direction corresponding to the longitudinal direction 61, but is basically unchanged even if the orientation of the longitudinal direction 61 is changed. Here, the control unit 210 changes the display order of the thumbnail images 69 based on the orientation information. For example, as shown in FIG. 15, when the longitudinal direction 61 is the horizontal direction, the control unit 210 arranges the thumbnail images 69 in order of shooting date and time (data indicating the shooting date and time is included in the image data of the thumbnail image 69. Shall be.) For example, as shown in FIG. 16, when the longitudinal direction 61 is the longitudinal direction, the control unit 210 arranges the thumbnail images 69 in descending order of the image data of the original image. Then, the thumbnail image 69a to be highlighted is changed to another thumbnail image in accordance with the change in the contact position specified by the contact position information. In this case, when the longitudinal direction 61 and the response direction 62 are not in the same direction, the thumbnail image 69a to be highlighted is changed to another thumbnail image according to a predetermined rule (for example, in FIG. When the contact position changes, the highlighted thumbnail image is changed in the right direction).

  In Example 5, the display screen 20 includes a plurality of thumbnail images 69, and the control unit 210 arranges the plurality of thumbnail images 69 in a different order depending on the direction of the longitudinal direction 61, and is selected according to a change in the contact position. Therefore, the arrangement order can be changed with a simple operation, and an intuitive operation becomes possible.

(Example 6)
The control unit 210 may display the display screen 70 including a plurality of thumbnail images 79 (display elements) on the display surface 240a (FIG. 17). The display screen 70 is used to select one of a plurality of thumbnail images 79. When the user makes a selection decision using the controller 100 and selects one thumbnail image 79, the control unit 210 selects the thumbnail image 79. The image of the selected thumbnail image 79 is displayed on the display surface 240a. On the display screen 70, the currently selected thumbnail image 79a is highlighted (enlarged display), and the highlighted thumbnail image 79a is selected by the selection decision.

  Even in the case of the display screen 70, the reference axis 6b is set as described above. The control unit 210 is supplied with orientation information, contact position information, position change information, and the like. The controller 210 sets the response direction 52 corresponding to the longitudinal direction 41 as described above. The thumbnail images 59 are arranged in a matrix (calendar). When the longitudinal direction 51 of the controller 100 is horizontal, as shown in FIG. 17, the response direction 72 is the horizontal direction that is the same direction as the horizontal direction, and the group (week) group that includes the thumbnail image 79a to be selected. Set to The control unit 210 changes the thumbnail image 79a to be highlighted to another thumbnail image 79 on the same stage in accordance with the change in the contact position based on the contact position information. Then, in accordance with the position change represented by the position change information, a plurality of thumbnail images 79 including the selection target are changed and selected on a weekly basis (refer to an area surrounded by a dotted line). As shown in FIG. 17, if the position of the controller 100 moves in the direction of the arrow 75, the plurality of thumbnail images 79 selected in units of weeks are also changed to other weeks in the direction of the arrow 76.

  In Example 6, the display screen 50 includes a plurality of thumbnail images 59 arranged in a calendar shape, and any one of the plurality of thumbnail images 59 is displayed as a selection target (thumbnail image 59a). Elements are arranged for each group (weekly), select one group among the plurality of groups according to the change in relative position, and within the selected group, the selection target according to the change in contact position To change. Thus, an intuitive operation can be performed for the selection operation.

  The operation target, the screen, and the like of the operation performed by the controller 100 can be changed as appropriate without being limited to the above example.

  The control unit 210 may change the display content with different degrees of change according to the distance represented by the distance information supplied from the controller 100. For example, if the distance between the controller 100 and the display control device 200 is long, the movement distance of the display element that moves according to the change in the contact position and the selection target are long, and it is difficult to change the change. If the distance between the controller 100 and the display control device 200 is short, the operation sensitivity may be improved by increasing the movement distance or making the change easy to change. As a result, the selection operation can be performed to realize the distance, and intuitive operation is possible. Similarly to the above, the control unit 210 may change the display contents with different degrees of change depending on the orientation of the controller 100 in the longitudinal direction. This also makes it possible to perform an operation that makes the user feel the distance, and an intuitive operation is possible. For example, the sensitivity may be improved if the longitudinal direction is vertical, and the sensitivity may be degraded if the longitudinal direction is horizontal. In this case, the response direction, the contact position, and the like are handled in the same manner as in Example 5, for example.

  Further, the distance detection unit 150 and the position conversion detection unit 140 may be provided in the display control device 200. Further, the display control device 200 may not include the display unit 240. The display control device 200 may control the external display unit 240. Further, the controller 100 and the display control device 200 may communicate with each other by wire. In addition, the controller 200 includes an imaging unit, and the distance detection unit 150 and the position conversion detection unit 140 analyze an image (an image obtained by capturing the display control device 200) supplied from the imaging unit, and change the distance or position. May be detected.

  Further, if the reference axis on the display screen is fixed, the display control device 200 may not include the sensor unit 250. Further, the direction of the controller 100 (the direction of the housing 105) may be expressed by a three-dimensional inclination by a three-axis acceleration sensor or the like. In this case, the display control apparatus 200 can set the response direction in three dimensions on a display screen or the like that represents the three dimensions. Further, the dimensions of the controller direction and the response direction can be appropriately changed and may include a time axis. The sensor unit 250 and the orientation detection unit 130 may be configured by, for example, a geomagnetic sensor or the like as long as the basic axis is fixed. In this case, for example, the basic axis of the real space is in the direction toward north, and the basic axis on the display screen is the upward direction on the display screen.

  In the above embodiment, since the controller 100 can output the orientation information and the contact position information, the information processing side can change the display content of the display screen according to the information, and the intuitive as described above. The user can feel the operation. As described above, when the display screen is a two-dimensional plane, it is possible to specify an icon or move a cursor or the like in an arbitrary direction of 360 degrees. If the display screen is a stereoscopic image, it is possible to specify an icon or move a cursor or the like in an arbitrary three-dimensional direction in the display space. Also, with such a controller, for example, the user does not have to touch the display screen like a touch panel, so the display screen is not soiled. In addition, it is possible to specify an icon or move a cursor or the like in multi-dimensions including a 3D image and a time axis that cannot be touched on the display screen.

  The program may be a program that causes a CPU or the like to perform display control in cooperation with an OS (Operation System). In this case, the OS is also recorded in the storage unit 220. The program is recorded on a portable storage medium (for example, CD-ROM (Compact Disk Read Only Memory), DVD-ROM (Digital Versatile Disk Read Only Memory)) and supplied (installed) to the display control device 200. May be. Further, the program may be supplied to the display control apparatus 200 via a network. In these cases, the storage unit 220 is configured by a flash memory or the like, and the control program is recorded in the flash memory.

  A ROM, a flash memory, or a portable storage medium in which a program is recorded becomes a computer-readable storage medium that stores a computer-readable program. The program may operate the display control device 200 in which at least a part of the functions is realized by a dedicated circuit. That is, the display control apparatus 200 may be anything that performs the above-described display control as a whole, and the control program only needs to operate such a display control apparatus 200.

1, 2, 3 ... finger, 6a, 6b ... reference axis, 100 ... controller, 105 ... casing, 110 ... output unit, 111 ... control device, 112 ... Communication unit 120 ... Contact position detection unit 120a ... Detection region 130 ... Direction detection unit 140 ... Position change detection unit 150 ... Distance detection unit 160 ... I / F part, 190 ... battery, 200 ... display control device, 210 ... control part, 220 ... storage part, 230 ... receiving part, 240 ... display part, 240a ... display Surface, 250... Sensor section

Claims (9)

A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a display control device for inputting the contact position and the orientation of the operation part output by a controller Because
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position for example Bei means,
The display screen includes a plurality of display elements that are elements on the display screen,
The display control means arranges the plurality of display elements in a different order depending on the direction of the operation unit, and changes the selection target according to a change in the contact position, thereby changing the selection target to the predetermined display image. As shown in the display position,
A display control device characterized by that. A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a display control device for inputting the contact position and the orientation of the operation part output by a controller Because
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position Means ,
A relative position change detecting means for detecting a change in relative position between the operation section and the display section;
Equipped with a,
The display screen includes a plurality of display elements that are elements of the display screen,
The display control means displays one of the plurality of display elements as a selection target,
The plurality of display elements are arranged for a plurality of groups,
The display control means selects one group among the plurality of groups according to the change in the relative position detected by the relative position change detection means, and changes the contact position in the selected group. By changing the selection target accordingly, the selection target is displayed at the display position as the predetermined display image.
A display control device characterized by that. A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a display control device for inputting the contact position and the orientation of the operation part output by a controller Because
Display control for specifying a display position on the display screen displayed by the display unit based on the contact position and the direction of the operation unit, and displaying a predetermined display image as an element of the display screen at the specified display position Means ,
Distance detecting means for detecting a distance between the operation unit and the display unit;
Equipped with a,
The display control means changes the display content of the display screen with different degrees of change according to the distance detected by the distance detection means.
A display control device characterized by that. The display control means specifies a display position corresponding to the contact position in a direction corresponding to the direction of the operation unit;
The display control apparatus according to any one of claim 1, wherein 3 of the. The display control device according to any one of 4 claims 1, characterized in that each of said operation portion and the display portion is provided in a separate housing. The display control means changes the display content of the display screen with different degrees of change according to the direction of the operation unit.
The display control device according to any one of claims 1 to 5, characterized in that. A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a computer to which the contact position output by the controller and the orientation of the operation part are input.
Based on the orientation of the contact position and the operating unit, it specifies a display position on the display screen that the display unit displays, display control for displaying a predetermined display image is an element of the display screen on the display position specified Step,
It was carried out,
The display screen includes a plurality of display elements that are elements on the display screen,
In the display control step, the plurality of display elements are arranged in a different order depending on the direction of the operation unit, and the selection target is changed according to a change in the contact position, whereby the selection target is changed to the predetermined display image. As shown in the display position,
A program characterized by that. A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a computer to which the contact position output by the controller and the orientation of the operation part are input.
Based on the orientation of the contact position and the operating unit, it specifies a display position on the display screen that the display unit displays, display control for displaying a predetermined display image is an element of the display screen on the display position specified Step,
A relative position change detecting step for detecting a change in relative position between the operation unit and the display unit;
It was carried out,
The display screen includes a plurality of display elements that are elements of the display screen,
The display control step displays one of the plurality of display elements as a selection target,
The plurality of display elements are arranged for a plurality of groups,
The display control step selects one group of the plurality of groups according to the change in the relative position detected in the relative position change detection step, and changes the contact position in the selected group. By changing the selection target accordingly, the selection target is displayed at the display position as the predetermined display image.
A program characterized by that. A contact position detection unit configured to detect a contact position with a contact object in the detection region; a direction detection unit configured to detect a direction of the operation unit; and the contact position detection. An output means for outputting the contact position detected by the means and the orientation of the operation unit detected by the orientation detection means; and a computer to which the contact position output by the controller and the orientation of the operation part are input.
Based on the orientation of the contact position and the operating unit, it specifies a display position on the display screen that the display unit displays, display control for displaying a predetermined display image is an element of the display screen on the display position specified Step,
A distance detecting step for detecting a distance between the operation unit and the display unit;
It was carried out,
The display control step changes the display content of the display screen with a different degree of change according to the distance detected by the distance detection step.
A program characterized by that.

Images