JP5466993B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus that outputs a user interface for performing screen transition when multi-touch is detected.

  Conventionally, an information processing apparatus, an image processing apparatus, and an image processing program that can change the position of the boundary of each screen displayed side by side without deteriorating the operability of operation buttons displayed on a touch panel arranged in a vehicle There has been an information processing apparatus that provides (see Patent Document 1, for example). When the information processing apparatus receives a request for changing a display range occupied by the navigation screen on the touch panel, an image generation unit that generates an image in which navigation operation buttons are arranged on a screen in which a navigation screen and a predetermined screen are arranged, and A boundary control unit that controls the image generation unit so that a boundary position between the navigation screen displayed on the touch panel and the predetermined screen is changed, and the image generation unit includes a navigation operation button on the display surface of the touch panel. Information processing that generates an image so that it is displayed in a predetermined area that delimits a part, and generates an image so that the position of the boundary is changed within a range in which the predetermined screen does not enter the predetermined area when a change request is received Device.

  There are also car navigation terminals equipped with touch panels, car audios, and the like. In such car navigation terminals and the like, the number of screens and screen hierarchies are dramatically increasing with the increase in functionality.

JP 2010-67139 A (first page, FIG. 1 etc.)

  However, in a conventional information processing apparatus, it is difficult for an information processing apparatus equipped with a touch panel to be operated in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  Further, in a car navigation terminal or the like equipped with a touch panel, the operation for screen transition is complicated in a situation where the number of screens and the screen hierarchy are dramatically increasing. In particular, an operation for screen transition is complicated for an environment where the user has to operate with a non-dominant hand, a handicapped person, and the like.

  The information processing apparatus according to the first aspect of the invention is information that constitutes a touch panel, a screen information storage unit that can store two or more pieces of screen information that constitutes a screen, and a user interface for performing screen transition. UI information storage unit capable of storing UI information, multi-touch accepting unit that accepts multi-touch that is two or more touches simultaneously instructed on the touch panel, and when the multi-touch accepting unit accepts multi-touch, the UI A UI output unit that outputs information, a screen transition instruction reception unit that receives a screen transition instruction that is an instruction for the UI information output by the UI output unit, and a screen transition instruction when the screen transition instruction reception unit receives the screen transition instruction Information that includes a screen transition unit that reads screen information corresponding to the screen information from the screen information storage unit and transitions to a screen corresponding to the screen information It is the location.

  With such a configuration, screen transition can be easily performed even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  In the information processing apparatus according to the second aspect of the invention, in contrast to the first aspect of the invention, the UI information includes information associating a direction identifier, which is information for identifying a direction on the screen, with the screen information. The instruction receiving unit receives continuous multi-touch, and the screen transition unit acquires a direction identifier indicating the direction of continuous multi-touch, reads out screen information corresponding to the direction identifier from the screen information storage unit, and outputs the information. Device.

  With such a configuration, screen transition can be easily performed even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  The information processing apparatus according to the third aspect of the invention is an information processing apparatus in which the UI output unit outputs UI information to an area on the screen corresponding to a continuous multi-touch direction. is there.

  With such a configuration, screen transition can be easily performed even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  Further, in the information processing apparatus according to the fourth aspect of the present invention, in contrast to the second or third aspect, the direction of continuous multi-touch is an information processing apparatus that is two or more of the four directions of up, down, left, and right It is.

  With such a configuration, screen transition can be easily performed even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  The information processing apparatus according to the fifth aspect of the invention is an information processing apparatus in which the screen information corresponding to the direction identifier indicating one of the up, down, left, and right directions is always the same screen information. is there.

  With such a configuration, screen transition can be easily performed even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  The information processing apparatus according to the sixth aspect of the present invention is an information processing apparatus having a user interface having a screen transition mode that is a screen transition mode and a normal mode that is not a screen transition mode, and a touch panel A screen information storage unit that can store two or more pieces of screen information that is information constituting the screen, a multi-touch receiving unit that receives multi-touch that is two or more touches simultaneously instructed to the touch panel, and screen transition When the screen transition instruction accepting unit that accepts instructions and the multi-touch accepting unit accepts multi-touch, the user interface mode is changed from the normal mode to the screen transition mode, and when the user interface mode is the screen transition mode, When the screen transition instruction reception unit receives a screen transition instruction, it corresponds to the screen transition instruction An information processing apparatus comprising a screen transition to transition to that screen.

  With such a configuration, screen transition can be easily performed even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

  Further, the information processing apparatus according to the seventh aspect of the present invention is a single-touch acceptance that accepts a single touch that is an instruction of one point, as compared with any one of the first to sixth aspects. And an operation unit that performs an operation in accordance with the position on the screen specified by the single touch when the single touch accepting unit accepts the single touch.

  With this configuration, even a driver in an environment that has to operate with a non-dominant hand can easily perform screen transition of the navigation terminal.

  According to the information processing apparatus of the present invention, it is possible to provide an easy-to-use user interface even in an environment in which the user has to operate with a non-dominant hand or a handicapped person.

Block diagram of information processing apparatus 1 according to Embodiment 1 Flow chart for explaining the operation of the information processing apparatus Flowchart explaining operation of same direction acquisition process Figure showing the same screen information management table The figure which shows the same UI information management table The figure which shows the output screen of the same information processing apparatus The figure which shows the output screen of the same information processing apparatus The figure which shows the output screen of the same information processing apparatus The figure which shows the output screen of the same information processing apparatus Figure showing the menu information The figure which shows the output screen of the same information processing apparatus Overview of the computer system Block diagram of the computer system

Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.
(Embodiment 1)

  In the present embodiment, an information processing apparatus 1 that outputs a user interface for performing screen transition when multi-touch is detected will be described.

  FIG. 1 is a block diagram of an information processing apparatus 1 in the present embodiment. The information processing apparatus 1 includes a touch panel 10, a screen information storage unit 11, a UI information storage unit 12, a reception unit 13, an operation unit 14, a UI output unit 15, and a screen transition unit 16.

  The reception unit 13 includes a single touch reception unit 131, a multi-touch reception unit 132, and a screen transition instruction reception unit 133.

  Here, the touch panel 10 is a touch panel that can recognize multi-touch. Multi-touch is two or more touches instructed simultaneously.

  The screen information storage unit 11 can store two or more pieces of screen information. Screen information is information constituting a screen. The screen information may have any structure such as HTML, a set of bitmaps and objects, a program written in a language such as 4GL, and the like.

  The screen information storage unit 11 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process in which screen information is memorize | stored in the screen information storage part 11 is not ask | required. For example, the screen information may be stored in the screen information storage unit 11 via a recording medium, and the screen information transmitted via a communication line or the like is stored in the screen information storage unit 11. Alternatively, the screen information input via the input device may be stored in the screen information storage unit 11.

  The UI information storage unit 12 can store UI information. UI information is information constituting a user interface for performing screen transition. Here, the screen transition may be considered as a transition to a screen that realizes a different function or application, or may be considered as a page movement when the displayed screen is a page having the concept of a page. . Note that it is preferable that the screen transition does not include page movement or page scrolling. The user interface may be any UI that realizes screen transition such as a set of buttons and a menu. The UI information may be anything such as a set of button information and a set of menu items.

  The UI information storage unit 12 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process of storing the UI information in the UI information storage unit 12 does not matter.

  The accepting unit 13 accepts an instruction or an instruction and data. The input means such as an instruction may be anything such as a touch panel, a keyboard, a mouse, or a menu screen. The accepting unit 13 can be realized by a device driver for input means such as a touch panel and a keyboard, control software for a menu screen, and the like.

  The single touch accepting unit 131 accepts a single touch that is an instruction of one point. The reception here is reception of a single touch input from the touch panel 10.

  The multi-touch receiving unit 132 receives multi-touch. The reception here is reception of multi-touch input from the touch panel 10.

  The screen transition instruction receiving unit 133 receives a screen transition instruction that is an instruction for the UI information output by the UI output unit 15. The instruction for the UI information is, for example, continuous multi-touch. However, the instruction for the UI information may be a single touch on a part of the area constituted by the UI information. A touch panel 10 is preferable as an instruction input unit for UI information.

  When the single touch accepting unit 131 accepts a single touch, the operation unit 14 performs an operation according to the position on the screen specified by the single touch. It is assumed that the operation unit 14 holds in advance a program and data for performing an operation according to a position on the screen specified by single touch. The operation may be anything.

  The operation unit 14 can be usually realized by an MPU, a memory, or the like. The processing procedure of the operation unit 14 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The UI output unit 15 outputs UI information when the receiving unit 13 receives multi-touch. Here, the output is a concept including display on a display, projection using a projector, transmission to an external device, and the like. Further, it is preferable that the UI output unit 15 outputs UI information to an area on the screen corresponding to continuous multi-touch directions. The continuous multi-touch directions are two or more directions among the four directions of up, down, left, and right.

  The UI output unit 15 may or may not include an output device such as a display. The UI output unit 15 can be implemented by output device driver software, or output device driver software and an output device.

  When the screen transition instruction receiving unit 133 receives a screen transition instruction, the screen transition unit 16 transitions to a screen corresponding to the screen transition instruction. The transition to the screen is preferably that the screen is switched, but it is not essential. As for the transition to the screen, a new screen may be output, and the display of the original screen may remain.

  Further, it is preferable that the screen transition unit 16 acquires a direction identifier indicating the direction of continuous multi-touch, reads screen information corresponding to the direction identifier from the screen information storage unit 11, and outputs the screen information.

The screen transition unit 16 can usually be realized by an MPU, a memory, or the like. The processing procedure of the screen transition unit 16 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
Next, the operation of the information processing apparatus 1 will be described using the flowchart of FIG. In this flowchart, it is assumed that the user interface of the information processing apparatus 1 has two modes, a normal mode and a screen transition mode. The initial value of the user interface mode is the normal mode.

  (Step S201) The receiving unit 13 determines whether an instruction or data has been received. If an instruction or the like is accepted, the process goes to step S202, and if not accepted, the process returns to step S201.

  (Step S202) The multi-touch receiving unit 132 determines whether or not the instruction received in step S201 is multi-touch. The multi-touch receiving unit 132 normally receives multi-touch when the coordinate information of two or more points at the same time is stored in a queue (a queue in which coordinate information written by the driver of the touch panel is stored). Judge. If multi-touch, go to step S203, otherwise go to step S214.

  (Step S203) The UI output unit 15 determines whether or not the current mode is the normal mode. If it is the normal mode, go to step S204, and if it is not the normal mode, go to step S207.

  (Step S204) The UI output unit 15 sets the current mode to the screen transition mode.

  (Step S205) The UI output unit 15 reads the UI information from the UI information storage unit 12.

  (Step S206) The UI output unit 15 outputs the UI information read in step S205. The process returns to step S201.

  (Step S207) The screen transition unit 16 performs a direction acquisition process. The direction acquisition process is a process of acquiring a direction identifier indicating the direction in which multi-touch has transitioned. The direction acquisition process will be described with reference to the flowchart of FIG.

  (Step S208) The screen transition unit 16 determines whether or not the direction identifier has been acquired in Step S207. If the direction identifier can be acquired, the process goes to step S209, and if not, the process goes to step S213.

  (Step S209) The screen transition unit 16 reads screen information corresponding to the acquired direction identifier from the screen information storage unit 11. The screen information to be read may be uniquely determined if the direction identifier is determined, or may be uniquely determined if two pieces of information, that is, the current screen screen information currently being output and the direction identifier are determined.

  (Step S210) The screen transition unit 16 outputs the screen information read out in step S209.

  (Step S211) The screen transition unit 16 deletes the output UI information from the screen.

  (Step S212) The screen transition unit 16 sets the current mode to the normal mode. The process returns to step S201.

  (Step S213) The screen transition unit 16 determines whether or not a predetermined time or more has elapsed since the UI information was output (whether or not a timeout has occurred). If timed out, the process goes to step S211, and if not timed out, the process returns to step S207.

  (Step S214) The single touch receiving unit 131 determines whether or not the instruction received in step S201 is multi-touch. Normally, the single touch accepting unit 131 determines that the accepted instruction or the like is a single touch when the coordinate information of only one point is stored in the queue. If it is a single touch, go to step S215, and if it is not a single touch, go to step S217. Here, when it is not single touch, it means that other instructions, data, and the like have been input.

  (Step S215) The screen transition unit 16 determines whether or not the current mode is the screen transition mode. If it is the screen transition mode, go to step S216, and if it is not the screen transition mode, go to step S211.

  (Step S216) The operation unit 14 performs an operation according to a single touch instruction. The operation in response to the single touch instruction is an operation in response to the single touch position on the screen (coordinate value) and corresponding to the position instruction.

  (Step S217) The operation unit 14 performs an operation according to other instructions, data, and the like.

  In the flowchart of FIG. 2, the process of outputting UI information (steps S205 and s06) may not be performed. In such a case, when the multi-touch is performed in the normal mode, the mode is only changed to the screen transition mode. In such a case, the process of deleting the UI information (step S211) is not necessary.

  In the flowchart of FIG. 2, the mode management and change need not be performed. In this case, if the direction identifier is acquired in the situation where the UI information is output, the screen transitions to a screen corresponding to the direction indicated by the direction identifier.

  Further, in the flowchart of FIG. 2, the processing is ended by powering off or interruption for aborting the processing.

  Next, the direction acquisition processing in step S207 will be described using the flowchart of FIG.

  (Step S301) The screen transition unit 16 determines whether two or more pieces of multi-touch information have been acquired from the queue. If two or more pieces of multi-touch information are acquired, the process goes to step S302, and if not acquired, the process goes to step S310.

  (Step S302) The screen transition unit 16 determines whether or not the x coordinate of coordinate values of two or more points (multi-touch) that changes with time increases with time, and the change of the y coordinate value is equal to or less than a threshold value. Determine whether. If this condition is met, the process goes to step S303, and if not, the process goes to step S304. Now, the multi-touch coordinate value at time t1 is (x1, y1) (x2, y2), and the multi-touch coordinate value at time t2 (t1 <t2) is (x3, y3) (x4, y4). Consider the case where the point designated by the finger 1 is (x1, y1) (x3, y3) and the point designated by the finger 2 is (x2, y2) (x4, y4). In this case, when x1 <x3 (and / or x2 <x4) and (y1-y3) <= threshold (and / or (y2-y4) <= threshold), such a condition is satisfied. Note that the condition of x1 <x3 may be x3-x1> = threshold. The determination in this step is a determination as to whether or not the multi-touch (two or more fingers) has moved from the left to the right (right direction) on the screen.

  (Step S303) The screen transition unit 16 assigns “right” to the direction identifier. Return to upper process.

  (Step S304) The screen transition unit 16 determines whether or not the x coordinate of two or more (multi-touch) coordinate values that change with time decreases with time, and the change of the y coordinate value is equal to or less than a threshold value. Determine whether. If this condition is met, the process goes to step S305, and if not, the process goes to step S306. The determination in this step is a determination as to whether or not the multi-touch (two or more fingers) has moved from the right to the left (left direction) on the screen.

  (Step S305) The screen transition unit 16 assigns “left” to the direction identifier. Return to upper process.

  (Step S306) The screen transition unit 16 determines whether or not the y coordinate of the coordinate value of two or more points (multi-touch) that changes with time increases with time, and whether the change of the x coordinate value is equal to or less than a threshold value. Determine whether. If this condition is met, the process goes to step S307, and if not, the process goes to step S308. Note that the determination in this step is a determination as to whether or not the multi-touch (two or more fingers) has moved from the bottom to the top (upward) on the screen.

  (Step S307) The screen transition unit 16 assigns “up” to the direction identifier. Return to upper process.

  (Step S308) The screen transition unit 16 determines whether or not the y coordinate of the coordinate value of two or more points (multi-touch) that changes with time decreases with the passage of time and the change of the x coordinate value is equal to or less than a threshold value. Determine whether. If this condition is met, the process goes to step S309, and if not, the process goes to step S310. The determination in this step is a determination as to whether or not the multi-touch (two or more fingers) has moved from the top to the bottom (downward) on the screen.

  (Step S309) The screen transition unit 16 assigns “down” to the direction identifier. Return to upper process.

  (Step S310) The screen transition unit 16 substitutes NULL for the direction identifier. Return to upper process.

  In the flowchart of FIG. 3, it is only necessary to obtain a direction identifier indicating the direction in which two or more fingers that are multi-touch moved, and how to use the transition of coordinate values touched by two or more fingers. Also good. The method of using the transition of the coordinate values is an example.

  Hereinafter, a specific operation of the information processing apparatus 1 in the present embodiment will be described. Here, it is assumed that the information processing apparatus 1 is a navigation terminal.

  Now, the screen information storage unit 11 holds the screen information management table shown in FIG. The screen information management table holds one or more records having “ID”, “screen identifier”, and “screen information”. For explanation, “screen”, which is an output image of screen information, is output in each record. The screen information is described in, for example, HTML, and when the HTML is interpreted and executed, a screen having an attribute value of “screen” is output. The design of the “screen information” file in FIG. 4 indicates that the file describes HTML. “ID” is information for identifying a record. “Screen identifier” is the name of the screen.

  The UI information storage unit 12 holds a UI information management table shown in FIG. The UI information management table holds one or more records having “ID”, “current screen identifier”, “direction identifier”, “output position”, “output figure”, and “transition screen identifier”. “ID” is information for identifying a record. The “current screen identifier” is information for identifying the screen being displayed. The “direction identifier” is information indicating a direction. “Output position” indicates the position on the screen where the graphic indicated by “output graphic” is output. Here, the “output position” is a coordinate value at the upper left of the “output figure”. Here, it is assumed that the upper left point of the screen is the origin (0, 0), the x coordinate value increases toward the right, and the y coordinate value decreases toward the bottom. The “output graphic” is a graphic output on the screen in the screen transition mode. The “output figure” may be considered as information constituting a so-called menu. The “transition screen identifier” is information for specifying a screen to be transitioned when a corresponding direction identifier can be acquired. In FIG. 5, when the screen identified by the screen identifier “HOME” is being displayed and the screen transition mode is entered, output graphics corresponding to the direction identifiers “down”, “left”, and “right” are output to the location of the output position. The For example, when the direction identifier “left” is acquired, it indicates that the screen changes to the screen of the screen identifier “periphery search” corresponding to the direction identifier “left”.

  In this case, it is assumed that the information processing apparatus 1 that is a navigation terminal is currently displaying the screen “HOME” as shown in FIG. 6. That is, the current screen identifier is “HOME”. In addition, it is assumed that the current screen mode is a normal mode which is an initial value. It is assumed that the information processing apparatus 1 holds map information in a map information storage unit (not shown) or a screen information storage unit 11. In addition, the data structure of map information is not ask | required. Further, since the map information of the navigation device is a known technique, the description thereof is omitted. In FIG. 6, a “HOME” screen and map information are displayed on the screen.

  In such a situation, it is assumed that the user (for example, a driver of a car) touches the screen of the information processing apparatus 1 with two or more fingers of the left hand that is not the dominant hand. That is, it is assumed that the user performs multi-touch on the screen of the information processing apparatus 1. Then, the driver of the touch panel 10 stores a set (x1, y1) (x2, y2) of touch coordinate values in a queue.

  Next, the multi-touch receiving unit 132 receives a multi-touch ((x1, y1) (x2, y2)) that is a set of touch coordinate values stored in the queue. Then, the UI output unit 15 determines that the current mode is the normal mode.

  Next, the UI output unit 15 sets the current mode to the screen transition mode. Then, the UI output unit 15 reads UI information (three records “ID = 1” in FIG. 5) corresponding to the current screen identifier “HOME” from the UI information management table in FIG. 5.

  Next, the UI output unit 15 outputs the read three output figures to the position indicated by the output position corresponding to the output figure. That is, the UI output unit 15 outputs the screen of FIG.

  Next, in this situation, it is assumed that the user moves the multi-touched finger to the left side while touching the screen. Then, the driver of the touch panel 10 performs a set of coordinate values “(x31, y31) (x41, y41), (x32, y32) (x42, y42), (x33, y33) (x43, y43), (x34). , Y34) (x44, y44), (x35, y35) (x45, y45) ".

  Next, the multi-touch receiving unit 132 receives the multi-touch “(x31, y31) (x41, y41), (x32, y32) (x42, y42), (x33, y33) (x43, y43), (x34, y34). ) (X44, y44), (x35, y35) (x45, y45) ". Then, the UI output unit 15 determines that the current mode is the screen transition mode (not the normal mode).

  Next, the screen transition unit 16 determines that two or more pieces of multi-touch information (here, five pieces of multi-touch information) have been acquired from the queue.

  Next, the screen transition unit 16 performs multi-touch “(x31, y31) (x41, y41), (x32, y32) (x42, y42), (x33, y33) (x43, y43), The x coordinate of the coordinate values of (x34, y34) (x44, y44), (x35, y35) (x45, y45) ”decreases with the passage of time, and the change of the y coordinate value is below the threshold value. Assume that you have made a decision.

  Then, the screen transition unit 16 substitutes “left” for the direction identifier.

  Next, the screen transition unit 16 reads the transition screen identifier “periphery search” corresponding to the current screen identifier “HOME” and the direction identifier “left” from the UI information management table of FIG. Then, the screen transition unit 16 reads the screen information of the transition screen identifier “peripheral search” from the screen information management table (FIG. 4).

  Next, the screen transition unit 16 outputs the read “peripheral search” screen information. Next, the screen transition unit 16 deletes the output UI information from the screen. Then, the screen transition unit 16 obtains the screen output shown in FIG.

  Next, the screen transition unit 16 sets the current mode to the normal mode. Next, it is assumed that the user has pressed the “gas station” area of the peripheral search screen by a single touch.

  Next, the screen transition unit 16 determines that the current mode is not the screen transition mode (the normal mode).

  Next, the operation unit 14 performs an operation according to a single touch instruction. That is, in accordance with pressing of “gas station” on the peripheral search screen, the operation unit 14 searches the map information for a gas station existing around the current location and outputs it.

  It is assumed that the user performs multi-touch while the screen of FIG. 8 is displayed. Then, the information processing apparatus 1 operates as follows.

  That is, the multi-touch receiving unit 132 receives multi-touch by the same operation as described above. Then, the UI output unit 15 determines that the current mode is the normal mode.

  Next, the UI output unit 15 sets the current mode to the screen transition mode. Then, the UI output unit 15 reads UI information (three records “ID = 3” in FIG. 5) corresponding to the current screen identifier “peripheral search” from the UI information management table in FIG. 5.

  Next, the UI output unit 15 outputs the three output figures to the positions indicated by the corresponding output positions. That is, the UI output unit 15 outputs the screen of FIG.

  Next, it is assumed that the user performs a single touch on the screen of FIG. Then, the screen transition unit 16 determines that the current mode is the screen transition mode. Then, the screen transition unit 16 deletes the output UI information from the screen. Next, the screen transition unit 16 sets the current mode to the normal mode. Then, the screen of the information processing apparatus 1 returns to FIG.

  As described above, according to the present embodiment, it is possible to provide an easy-to-use user interface even in an environment in which the user has to operate with a non-dominant hand or a handicapped person. More specifically, a user interface that is very easy to use can be provided when performing screen transition.

  Also, in this embodiment, multi-touch is a user interface that is very easy to use by distinguishing between operations for screen transitions and single touches for selecting and executing functions on the screen. Can be realized. In particular, it is possible to provide an easy-to-use user interface even in an environment where the user has to operate with a non-dominant hand or a handicapped person.

  According to the specific example of the present embodiment, the UI information is one or more figures. However, menu information constituting a menu as shown in FIG. 10 may be used. In such a case, when outputting UI information, the UI output unit 15 outputs a menu item excluding the menu item corresponding to the screen identified by the current screen identifier from the menu information. That is, for example, when the current screen identifier is “HOME” and in the normal mode, when the user inputs multi-touch, the information processing apparatus 1 operates as follows. That is, the multi-touch receiving unit 132 receives multi-touch. Next, the UI output unit 15 reads the menu information from the UI information storage unit 12 and deletes “HOME” of the menu item corresponding to the current screen identifier from the menu information. Then, the menu is output on the screen “HOME” as shown in FIG. When selecting a menu item from the menu of FIG. 11, only multi-touch may be enabled or single touch may be enabled.

  Note that, according to the specific example of the present embodiment, when UI information is output, the screen transitions to the next screen by acquiring the direction identifier. However, when UI information is output, if it is detected that multi-touch is performed on the output figure or menu item, or if single touch is detected, the next screen is displayed. May be transitioned.

  In the present embodiment, it is preferable that the direction of continuous multi-touch is two or more of the four directions of up, down, left, and right. Further, it is preferable that the screen information corresponding to the direction identifier indicating one of the up, down, left, and right directions is always the same screen information. For example, it is preferable that the screen information corresponding to the direction identifier indicating the upward direction is always “HOME” screen information.

  In the present embodiment, the screen mode may not exist. Then, UI information is output by multi-touch, and after the UI information is output, one item included in the UI information (in FIG. 7, “point search”, “surround search”, or “OPTION MENU”) If is selected, a transition may be made to a screen corresponding to the selected item. In this case, the information processing apparatus 1 includes a touch panel, a screen information storage unit that can store two or more pieces of screen information that is information constituting a screen, and UI information that is information that constitutes a user interface for performing screen transition. A UI information storage unit that can store a multi-touch, a multi-touch accepting unit that accepts multi-touch that is two or more touches simultaneously instructed on the touch panel, and a multi-touch accepting unit that accepts multi-touch, When a UI output unit that outputs UI information, a screen transition instruction reception unit that receives a screen transition instruction that is an instruction for the UI information output by the UI output unit, and the screen transition instruction reception unit receives a screen transition instruction, An information processing apparatus comprising: a screen transition unit that transitions to a screen corresponding to the screen transition instruction.

  Further, in the present embodiment, the UI information may not be output only by changing from the normal mode to the screen transition mode by multi-touch. In such a case, in the information processing apparatus 1, the UI information storage unit 12 and the UI output unit 15 are not necessary. The information processing apparatus 1 is an information processing apparatus having a user interface having a screen transition mode that is a screen transition mode and a normal mode that is not the screen transition mode, and includes a touch panel and a screen. Screen information storage unit that can store two or more screen information, which is information to be performed, a multi-touch accepting unit that accepts multi-touch that is two or more touches simultaneously instructed to the touch panel, and a screen transition instruction When the screen transition instruction accepting unit and the multi-touch accepting unit accept multi-touch, the user interface mode is changed from the normal mode to the screen transition mode, and when the user interface mode is the screen transition mode, the screen When the transition instruction reception unit receives a screen transition instruction, the screen transition An information processing apparatus comprising a screen transition for transition to a screen corresponding to the shown.

  Furthermore, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded and distributed on a recording medium such as a CD-ROM. This also applies to other embodiments in this specification. Note that the software that implements the information processing apparatus according to the present embodiment is the following program. That is, this program stores two or more pieces of screen information, which is information constituting a screen, and UI information, which is information constituting a user interface for performing screen transition, in the storage medium, A multi-touch accepting unit that accepts multi-touch, which is two or more touches simultaneously instructed to the touch panel, and a UI output unit that outputs the UI information when the multi-touch accepting unit accepts multi-touch And a screen transition instruction receiving unit that receives a screen transition instruction that is an instruction for the UI information output by the UI output unit, and a screen corresponding to the screen transition instruction when the screen transition instruction receiving unit receives the screen transition instruction. A program for reading out information and functioning as a screen transition unit that transitions to a screen corresponding to the screen information, A.

  In the above program, the UI information includes information associating a direction identifier, which is information for identifying a direction on a screen, with screen information, and the screen transition instruction receiving unit receives continuous multi-touch, The screen transition unit preferably obtains a direction identifier indicating the direction of the continuous multi-touch, reads out the screen information corresponding to the direction identifier from the screen information storage unit, and outputs the screen information. is there.

  In the above program, it is preferable that the UI output unit causes the computer to function as outputting the UI information to an area on the screen corresponding to the continuous multi-touch direction.

  In the above program, it is preferable that the direction of the continuous multi-touch is two or more directions among four directions of up, down, left, and right.

  In the above program, it is preferable that the screen information corresponding to the direction identifier indicating one of the up, down, left, and right directions is always the same screen information.

  In the above program, when the single touch accepting unit accepts a single touch that is an instruction of one point, and the single touch accepting unit accepts a single touch, it corresponds to the position on the screen specified by the single touch. It is preferable to make a computer function as what further has an operation | movement part which performs operation | movement.

  FIG. 12 shows the external appearance of a computer that executes the program described in this specification and realizes the information processing apparatus and the like of the above-described embodiment. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 12 is an overview diagram of the computer system 340, and FIG. 13 is a diagram showing an internal configuration of the computer system 340. As shown in FIG.

  In FIG. 13, the computer system 340 includes a computer 341 including an FD drive 3411 and a CD-ROM drive 3412, a keyboard 342, a mouse 343, and a monitor 344.

  In FIG. 14, in addition to the FD drive 3411 and the CD-ROM drive 3412, the computer 341 stores an MPU 3413, a bus 3414 connected to the CD-ROM drive 3412 and the FD drive 3411, and a program such as a bootup program. A RAM 3416 for temporarily storing application program instructions and providing a temporary storage space; and a hard disk 3417 for storing application programs, system programs, and data. Although not shown here, the computer 341 may further include a network card that provides connection to the LAN.

  A program that causes the computer system 340 to execute the functions of the information processing apparatus and the like of the above-described embodiment is stored in the CD-ROM 3501 or the FD 3502, inserted into the CD-ROM drive 3412 or the FD drive 3411, and further the hard disk 3417. May be transferred to. Alternatively, the program may be transmitted to the computer 341 via a network (not shown) and stored in the hard disk 3417. The program is loaded into the RAM 3416 at the time of execution. The program may be loaded directly from the CD-ROM 3501, the FD 3502, or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 341 to execute the functions of the information processing apparatus according to the above-described embodiment. The program only needs to include an instruction portion that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 340 operates is well known and will not be described in detail.

  Further, the computer that executes the program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.
The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the information processing apparatus according to the present invention has an effect that an easy-to-use user interface can be provided even in an environment where the user has to operate with a non-dominant hand, a handicapped person, or the like. It is useful as a navigation terminal.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 10 Touch panel 11 Screen information storage part 12 UI information storage part 13 Acceptance part 14 Operation part 15 UI output part 16 Screen transition part 131 Single touch acceptance part 132 Multi-touch acceptance part 133 Screen transition instruction | indication acceptance part

Claims (7)

A touch panel;
A screen information storage unit capable of storing two or more pieces of screen information which is information constituting the screen;
A UI information storage unit capable of storing UI information which is information constituting a user interface for performing screen transition;
A multi-touch accepting unit that accepts multi-touch that is two or more touches instructed simultaneously on the touch panel;
A UI output unit that outputs the UI information when the multi-touch receiving unit receives a multi-touch;
A screen transition instruction receiving unit that receives a screen transition instruction that is an instruction for the UI information output by the UI output unit;
A screen transition unit that reads screen information corresponding to the screen transition instruction from the screen information storage unit and transitions to a screen corresponding to the screen information when the screen transition instruction reception unit receives the screen transition instruction; ,
The UI information is
It has information that associates a direction identifier that is information for identifying a direction on the screen and screen information,
The screen transition instruction receiving unit
Accepts continuous multi-touch,
The UI output unit includes:
Regardless of the position of the multi-touch when outputting the UI information, the UI information is output to a fixed area on the screen corresponding to the continuous multi-touch direction.
The screen transition part
An information processing apparatus that acquires a direction identifier indicating a direction of the continuous multi-touch, reads screen information corresponding to the direction identifier from the screen information storage unit, and outputs the information .
The information processing apparatus, wherein the continuous multi-touch directions are two or more directions among four directions of up, down, left, and right . The UI output unit includes:
The information processing apparatus according to claim 1 , wherein the UI information is output to an area close to two or more of the four sides of the rectangular screen. The information processing apparatus according to claim 2 , wherein screen information corresponding to a direction identifier indicating one of the up, down, left, and right directions is always the same screen information. An information processing apparatus having a user interface having a screen transition mode that is a mode for transitioning a screen and a normal mode that is not the screen transition mode,
A touch panel;
A screen information storage unit capable of storing two or more pieces of screen information which is information constituting the screen;
A multi-touch accepting unit that accepts multi-touch that is two or more touches instructed simultaneously on the touch panel;
A screen transition instruction receiving unit for receiving a screen transition instruction;
When the multi-touch accepting unit accepts multi-touch, the user interface mode is changed from the normal mode to the screen transition mode, and when the user interface mode is the screen transition mode, the screen transition instruction accepting unit changes the screen. A screen transition unit that transitions to a screen corresponding to the screen transition instruction when the instruction is received;
The screen transition instruction receiving unit
Accepts continuous multi-touch,
The screen transition part
When the user interface mode is the screen transition mode, and a continuous multi-touch is received, a direction identifier indicating the direction of the continuous multi-touch is acquired, and information processing is performed for transition to a screen corresponding to the direction identifier. A device ,
The information processing apparatus, wherein the continuous multi-touch directions are two or more directions among four directions of up, down, left, and right . The information processing apparatus includes:
Navigation terminal,
A single touch accepting unit that accepts a single touch that is an instruction of one point;
5. The information processing according to claim 1, further comprising: an operation unit that performs an operation in accordance with a position on the screen specified by the single touch when the single touch reception unit receives a single touch. apparatus. On the storage medium,
2 or more pieces of screen information that is information constituting the screen is stored, and
Stores UI information, which is the information that constitutes the user interface for screen transition,
An information processing method realized by a multi-touch receiving unit, a UI output unit, a screen transition instruction receiving unit, and a screen transition unit,
A multi-touch receiving step in which the multi-touch receiving unit receives a multi-touch that is two or more touches simultaneously instructed to the touch panel;
A UI output step for outputting the UI information when the UI output unit receives a multi-touch in the multi-touch reception step;
A screen transition instruction receiving step in which the screen transition instruction receiving unit receives a screen transition instruction that is an instruction for the UI information output in the UI output step;
When the screen transition unit receives a screen transition instruction in the screen transition instruction reception step, the screen transition unit reads screen information corresponding to the screen transition instruction and includes a screen transition step for transitioning to a screen corresponding to the screen information. ,
The UI information is
It has information that associates a direction identifier that is information for identifying a direction on the screen and screen information,
The screen transition instruction receiving unit
Accepts continuous multi-touch,
In the UI output step,
Regardless of the position of the multi-touch when outputting the UI information, the UI information is output to a fixed area on the screen corresponding to the continuous multi-touch direction.
In the screen transition step,
An information processing method for acquiring a direction identifier indicating a direction of the continuous multi-touch, reading out screen information corresponding to the direction identifier from the storage medium, and outputting the screen information .
The information processing method, wherein the continuous multi-touch directions are two or more directions among four directions of up, down, left, and right . On the storage medium,
2 or more pieces of screen information that is information constituting the screen is stored, and
Stores UI information, which is the information that constitutes the user interface for screen transition,
Computer
A multi-touch accepting unit that accepts multi-touch that is two or more touches simultaneously instructed to the touch panel;
A UI output unit that outputs the UI information when the multi-touch receiving unit receives a multi-touch;
A screen transition instruction receiving unit that receives a screen transition instruction that is an instruction for the UI information output by the UI output unit;
When the screen transition instruction accepting unit accepts a screen transition instruction, a program for reading screen information corresponding to the screen transition instruction from the storage medium and causing it to function as a screen transition unit that transitions to a screen corresponding to the screen information Because
The UI information is
It has information that associates a direction identifier that is information for identifying a direction on the screen and screen information,
The screen transition instruction receiving unit
Accepts continuous multi-touch,
The UI output unit includes:
Regardless of the position of the multi-touch when outputting the UI information, the UI information is output to a fixed area on the screen corresponding to the continuous multi-touch direction.
The screen transition part
A program for causing a computer to function as a device that acquires a direction identifier indicating a direction of the continuous multi-touch, reads out and outputs screen information corresponding to the direction identifier from the storage medium , and
The continuous multi-touch direction is a program that is two or more directions among four directions of up, down, left, and right .