JP5637404B2 - Terminal device and program - Google Patents

Description

The present invention relates to a terminal device that displays screen information .

  In general, in the SBC system, a key output signal, a mouse output signal, or the like corresponding to a user operation of a client device is transmitted to the server device as an event signal each time the signal is generated. Then, the server device executes an application program corresponding to the event signal from the client device, and transfers the display drawing data generated along with the application program to the client device for display every time the drawing is updated.

  Thus, in the SBC system, every time a user operation is performed on the client device, the event signal is transmitted to the server device. For this reason, in the server device that processes event signals from a large number of client devices, the load of the event processing becomes very large, and the operation response viewed from the client device is reduced.

  Therefore, in the conventional SBC system, by providing the client device with a kana-kanji conversion emulator function, processing up to the determination of the character to be input at the time of text input is performed inside the client device, and an event in the server device is performed. The thing which reduced the load of the process is considered (for example, refer patent document 1).

  In addition, in communication between a server device and a client device in a conventional SBC system, a command is defined for each component of a GUI (Graphic User Interface), and a command indicating a property value of the GUI component and a user operation on the GUI component It is considered that the communication data amount is reduced to realize a quick GUI response (see, for example, Patent Document 2).

JP 2003-323402 A JP 2005-228227 A

  In the conventional SBC system, the event processing load on the server device and the communication data amount between the server device and the client device are reduced on the server device side in any case. A part of the processing is performed on the client device side. For this reason, there is a problem that a large load is applied to the processing on the client device side and the original function as the SBC system is impaired.

The present invention aims to execute the processing for the object area included in the screen information, or the movement of the pointer displayed on the allow the easy easy.

Claim 1 is a terminal device that displays screen information, and includes an acquisition unit that acquires position information indicating a position of an object area included in the screen information, and the object area included in the screen information. discriminating means for discriminating whether the direction instruction operation by the user to indicate the presence direction of the position of the object area to be the instruction target, when it is determined the direction instruction operation chromatic by the judgment means is included in the screen information among the object region, and identifying means for identifying the position information of the object region existing position in the direction indicated by the direction instruction operation, with respect to the object region at the position of the position information specified by said specifying means And a processing means for executing the processing.

Claim 4 is a terminal device that displays screen information, an acquisition unit that acquires position information of an object area included in the screen information, and a position that arbitrarily designates a desired position in the screen information by a user operation an instruction unit, a discriminating means for discriminating whether the direction instruction operation for instructing the presence direction of the position of the object region in the screen information by the user, when it is determined the direction instruction operation chromatic by the determination means, The position of the object area existing at the position in the direction indicated by the direction indicating operation with reference to the indicated position instructed by the position indicating means in the screen information in the object area included in the screen information specifying means for specifying information, a pointer display indicating the indicated position by the position indicating means, identified in the identifying means A pointer display means for displaying moving to the position of the object area at the position of the location information, characterized by comprising a.

According to the present invention, it is possible to perform the processing for the object area included in the screen information, or the movement of the pointer displayed on the easy easy.

1 is a block diagram showing a configuration of an SBC (Server Based Computing) system according to an embodiment of the present invention. The block diagram which shows the circuit structure of the server apparatus 10 in the said SBC system. The block diagram which shows the circuit structure of the client apparatus 20 in the said SBC system. The figure which shows an example of the drawing data G which are produced | generated in the server apparatus 10 in the said SBC system, transmitted and transferred to the client apparatus 20, and are displayed. The figure which shows the format of the effective object area | region notification information CE transmitted to the client apparatus 20 with the drawing data G for the display produced | generated in the server apparatus 10 in the said SBC system. The flowchart which shows the server process of the server apparatus 10 in the said SBC system. The flowchart which shows the input corresponding | compatible process accompanying the server process of the server apparatus 10 in the said SBC system. The flowchart which shows the client process of the client apparatus 20 in the said SBC system. The flowchart which shows the data reception process accompanying the client process of the client apparatus 20 in the said SBC system. The flowchart which shows the operation determination process accompanying the client process of the client apparatus 20 in the said SBC system. The flowchart which shows the data transmission process accompanying the client process of the client apparatus 20 in the said SBC system.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an SBC (Server Based Computing) system according to an embodiment of the present invention.

  This SBC system includes a server device 10 and a plurality of client devices (Thin clients) 20 connected to a network N composed of a LAN (Local Area Network) or a WAN (Wide Area Network).

  The server device 10 has a plurality of application programs such as a document creation processing program, a spreadsheet processing program, a presentation material creation program, a mail processing program, an Internet connection processing program, and a Web display program, and is connected to the server device 10. It is activated in response to an operation input (input event) signal from the client device 20,.

  In the server device 10, the display output drawing data G generated on the client frame buffer RAM 14a (see FIG. 2) in accordance with the execution of the application program according to the operation input signal from the client device 20,. After being compressed, it is transmitted (transferred) to the client device 20 of the access source.

  In the client devices 20,..., The drawing data G transferred from the server device 10 is decompressed and expanded in the frame buffer 25 (see FIG. 3) and displayed on the display device 26.

  That is, each client device (Thin client) 20 in the SBC system has an input function corresponding to a user operation such as a keyboard and a mouse and an output function to an LCD display unit and a printer as main functions. The server device 10 does not have at least various application functions and data file management functions.

  And the data file produced | generated with the various processes started and performed in the server apparatus 10 according to the operation input (input event) signal from the client apparatus 20 ... is fundamentally in the said server apparatus 10. Alternatively, it is stored and stored for each user account or as a shared file in a storage device such as a magnetic disk managed and managed by the server device 10.

  FIG. 2 is a block diagram showing a circuit configuration of the server device 10 in the SBC system.

  The server device 10 includes a CPU 11 as a computer, and a ROM 13, a RAM 14, a frame buffer RAM 15, and a display device 16 are connected to the CPU 11 via a bus 12.

  Further, the CPU 11 is connected to an input device 17 such as a keyboard and a mouse, an external storage device 18a, an auxiliary storage device 18b, a client device 20,...

  The CPU 11 controls the operation of each part of the circuit using the RAM 14 as a working memory in accordance with a system program or various application programs stored in advance in the ROM 13, and via a key input signal from the input device 17 or a communication I / F 19. The various programs are activated and executed in response to a processing command (input event) signal corresponding to a user operation from the client device 20 received.

  In this server device 10, various data generated in accordance with an application program that is activated and executed in response to an input event signal from the client device 20 is stored in the external storage device 18a in association with the user ID, for example. . The drawing data G for client display is generated using the client frame buffer RAM 14 a in the RAM 14, and after being compressed, is transferred from the communication I / F 19 to the client device 20 for display output.

  When the drawing data G for display is generated in the client frame buffer RAM 14a, the effective object areas E1, E2,... That can be operated such as check boxes and link destination instruction buttons included in the drawing data G (see FIG. 4). ) Area information (E1), (E2)... Is acquired based on the application program that generated the drawing data G, and the client apparatus 20 together with the drawing data G as effective object area notification information CE (see FIG. 5) described later. Forwarded to

  Note that drawing data to be displayed on the display device 16 of the server device 10 itself is generated on the frame buffer RAM 15.

  FIG. 3 is a block diagram showing a circuit configuration of the client device 20 in the SBC system.

  The client device 20 includes a CPU 21 as a computer, and a ROM 23, a RAM 24, and a frame buffer RAM 25 are connected to the CPU 21 via a bus 22. The drawing data G written in the frame buffer RAM 25 is output to the display device 26 and displayed.

  Further, the CPU 21 has an input device 27 such as a keyboard, a mouse, a microphone, and an optical sensor, an external storage device 28a, an auxiliary storage device 28b, and a communication I / F (interface) 29 with the server device 10 via the bus 22. Connected.

  The CPU 21 controls the operation of each part of the circuit using the RAM 24 as a working memory in accordance with a system program stored in the ROM 23 in advance. The CPU 21 receives a key input signal from the input device 27, a mouse movement signal, and the communication I / F 29. The system program is activated and executed in response to an application response signal, transfer drawing data G, and the like from the server apparatus 10 to be executed.

  In the client device 20, various data generated by executing the application program in the server device 10 is appropriately read and stored in the external storage device 28a, and the generated drawing data G for transfer is The compressed data is decompressed, written in the frame buffer RAM 25, and displayed on the display device 26.

  The RAM 24 functioning as the working memory has operable object areas E1, E2,... That can be operated such as check boxes and link destination instruction buttons included in the display drawing data G written in the frame buffer RAM 25. An operable object area DB (Data Base) 24a describing the area information (E1), (E2)... (See FIG. 4) is generated. The operable object area DB 24a is updated according to later-described effective object area notification information CE (see FIG. 5) transferred together with the display drawing data G generated by the server device 10.

  FIG. 4 is a diagram illustrating an example of the drawing data G generated by the server device 10 in the SBC system, transmitted and transferred to the client device 20, and displayed.

  The drawing data G displayed on the client device 20 includes effective object areas E1, E2,... That can be operated, such as check boxes and link destination instruction buttons. These effective object areas E1, E2,... Can be activated by moving the pointer P displayed on the display screen to the object areas E1, E2,. That is, in the state where the pointer P exists in an area other than the operable effective object areas E1, E2,.

  FIG. 5 is a diagram showing a format of the effective object area notification information CE transmitted to the client apparatus 20 together with the display drawing data G generated by the server apparatus 10 in the SBC system.

  In the valid object area notification information CE, identifiers “event ID” C and “data size” D of the valid object area notification information CE are described in the header portion. In the data portion, the operable effective object areas E1, E2,... Included in the generated display drawing data G include area information (E1) (E2). It is described as a combination of the start coordinates and end coordinates of the area En, and the attribute information E1i, E2i,..., Eni associated with each area information (E1) (E2). It is described as addition or deletion of the area En to the display drawing data G (i-1) at the time of update. The number N of area information (E1) (E2)... (En) corresponding to the drawing data G is described at the head of the data portion.

  Next, the operation of the SBC system configured as described above will be described.

  FIG. 6 is a flowchart showing server processing of the server device 10 in the SBC system.

  In a state of waiting for data reception from the client device 20 by the communication I / F 19 (step S1), when data is received (step S2), whether or not the content of the received data is an event signal requesting login. Is determined (step S3).

  If it is determined that an event signal requesting login from the client device 20 has been received (step S3 (Yes)), the login processing of the client device 20 that is the login request transmission source is executed, and user authentication processing, An initialization process of the client frame buffer RAM 14a is performed (step S4).

  On the other hand, when data is received from the client device 20 that has already been logged in (steps S1 and S2), if it is determined that an input event signal associated with a user operation of the client device 20 has been received (step S3 ( No) → S5 (Yes)), the process proceeds to the input corresponding process in FIG. 7 (step SA).

  When data from the client device 20 is received (steps S1 and S2), if it is determined that the content of the received data is neither an event signal for login request nor an event signal for user input (step S1). S3 (No) → S5 (No)), and another process corresponding to the content of the received data is executed (step S6).

  FIG. 7 is a flowchart showing an input handling process accompanying the server process of the server apparatus 10 in the SBC system.

  In this input correspondence processing, first, the content of the input event signal received from the client device 20 is analyzed (step A1), and an event for the application program to be executed is issued according to the content of the analyzed event signal. (Step A2).

  Then, with the execution of the application program according to the input event signal, it is determined whether or not the display drawing data G generation process is included (step A3). If it is determined that the process for generating the display drawing data G is included (step A3 (Yes)), the drawing data G is drawn and generated in the client frame buffer RAM 14a (step A4). .

  Then, for the application program that has generated the drawing data G for display, whether the drawing data G includes valid object areas E1, E2,... That can be operated by the user, such as check boxes and link destination instruction buttons. An inquiry is made to determine whether or not (steps A5 and A6).

  Here, as shown in FIG. 4, when it is determined that the displayable drawing data G includes valid object areas E1, E2,... That can be operated by the user (step A6 (Yes)), Area information (E1), (E2)... Consisting of the start coordinates that are the upper left coordinates and the end coordinates that are the lower right coordinates are acquired (step A7).

  Then, as shown in FIG. 5, the identifiers “event ID” C and “data size” D are in the header part, and the valid object areas E1, E2,..., En acquired in step A7 are in the data part. Region information (E1) (E2)... (En) and the attribute information E1i, E2i,..., Eni are generated, and valid object region notification information CE is generated (step A8).

  Then, the display drawing data G drawn and generated in the client frame buffer RAM 14a in the step A4, and the valid object area notification information CE generated in the step A8 corresponding to the drawing data G are: It is transmitted to the client device 20 that is the transmission source of the input event signal (step A9).

  As a result, the server apparatus 10 generates valid object area notification information CE corresponding to the drawing data G each time the display drawing data G corresponding to the input event signal received from the client apparatus 20 is generated. A response is transmitted to the client device 20.

  FIG. 8 is a flowchart showing client processing of the client device 20 in the SBC system.

  When the client device 20 is powered on, communication with the server device 10 is started and a login request is transmitted (step B1), and connection establishment with the server device 10 including user authentication processing and memory initialization processing is established. Is performed (step B2).

  Then, the data reception standby state from the server device 10 is entered (step B3), and the data received from the server device 10 is analyzed (step B4), so that the connection with the server device 10 associated with the login request is established. It is determined whether it has been established (step B5).

  If it is determined that the connection with the server device 10 has been established (step B5 (Yes)), the occurrence of an input event associated with the user operation of the client device 20 itself or the occurrence of a received event associated with data reception from the server device 10 A state is reached (step B6).

  If it is determined that a reception event associated with data reception from the client device 10 has occurred in this event generation standby state (step B7 (Yes)), the process proceeds to a data reception process in FIG. 9 (step BC).

  FIG. 9 is a flowchart showing data reception processing accompanying client processing of the client device 20 in the SBC system.

  In this data reception process, it is first determined whether or not the content of the reception event associated with the data reception from the server device 10 is a drawing event that has received display drawing data G (step C1).

  Here, if it is determined that the content of the reception event associated with data reception from the server device 10 is a drawing event that has received the drawing data G for display (see FIG. 4) (step C1 (Yes)), The received drawing data G is written into the frame buffer RAM 25, and drawing processing for the display device 26 is executed (step C2).

  Then, it is determined whether or not the valid object area notification information CE (see FIG. 5) corresponding to the drawing data G has been received in response to the reception of the drawing data G for display from the server device 10 (step 5). C3).

  When it is determined that the effective object area notification information CE is received together with the display drawing data G (step C3 (Yes)), the effective object area notification information CE is temporarily stored in the RAM 24. Each area information in the operable object area DB 24a stored in is updated (step C4).

  Here, the update process of the operable object region DB 24a will be described.

  First, in the manipulable object area DB 24a in the RAM 24, area information (E1) (E2) of the effective object areas E1, E2,... Are stored in the effective object area notification information CE corresponding to the drawing data G (see FIG. 4) newly received this time and written in the frame buffer RAM 25 for the operable object area DB 24a. Area information (En) having additional attribute information Eni is additionally stored, and area information (En) having deletion attribute information Eni is deleted (step C4).

  That is, the drawing data G generated by the server device 10 in response to an input event from the client device 20 in the SBC system is, for example, a one-screen drawing already displayed on the client device 20 in response to the previous input event. Compared with the data, the image is generated as the drawing data G of the rectangular area including the updated portion. Therefore, in the operable object area DB 24a in the RAM 24, the drawing data corresponding to the drawing data in the range where the drawing is not updated. Each valid object area information (En) is maintained as it is, and only each valid object area information (En) corresponding to the drawing data G in the drawing updated range is valid object area notification information corresponding to the drawing data G. Additional saved or deleted according to CE.

  This eliminates the need to update all area information (En) in the operable object area DB 24a corresponding to the entire screen each time the display drawing data G is updated. .. For all the operable object areas E1, E2,... Included in the drawing data G of one screen being displayed on the client device 20, the area information (E1), (E2),. Can be stored and managed.

  On the other hand, when it is determined that a specific input event (special operation event) associated with the user operation has occurred in the event occurrence standby state in step B6 (step B8 (Yes)), the process proceeds to the operation determination process in FIG. (Step BD).

  The specific input event (special operation event) is a desired effective event that the user should indicate to the current position of the pointer P, for example, when an arbitrary valid object area En is specified by the pointer P on the display screen. When the object area En is in the upper direction in the screen, this indicates a key operation event using “shift + cursor [↑]”, and the desired valid to be indicated by the user for the current position of the pointer P When the object area En is in the downward direction in the screen, this indicates a key operation event using “shift + cursor [↓]”, and the desired valid to be indicated by the user for the current position of the pointer P When the object area En is on the right side of the screen, it indicates a key operation event using “shift + cursor [→]”, and the point If the desired effective object region En user should indicate the current position of P is in the screen in the left direction indicates a key operation events using "shift + cursor [←]".

  FIG. 10 is a flowchart showing an operation determination process accompanying the client process of the client apparatus 20 in the SBC system.

  In this operation determination process, first, the coordinates of the current position of the mouse pointer P displayed on the screen of the display device 26 are acquired (step D1). Then, the moving direction of the pointer P according to the special operation is determined (step D2).

  Then, from the operable object area DB 24a of the RAM 24, the effective object area En existing in the direction in which the pointer P should be moved in accordance with the operation of the cursor key in the drawing data G (for example, see FIG. 4) currently displayed The area information (En) is acquired (step D3), and the instruction by the pointer P of the effective object area En is determined, whereby the coordinate information (= En) of the position to which the pointer P should move is extracted ( Step D4).

  Even when the pointer P is moved by a normal mouse operation, the coordinate information (= En) corresponding to the effective object area En is obtained only when the instruction of the effective object area En by the pointer P is determined. Extracted (step D4).

  Then, the coordinate information (= En) of the position to which the pointer P to be moved, which is extracted by the operation determination process (steps D1 to D4), is any valid object area in the currently displayed drawing data G. It is determined whether or not a specific input event (special operation event) accompanying the user operation is valid depending on whether or not it corresponds to En (step B9).

  If it is determined that a specific input event accompanying the user operation is valid (step B9 (Yes)), the process proceeds to the data transmission process in FIG. 11 (step BF).

  FIG. 11 is a flowchart showing data transmission processing accompanying client processing of the client device 20 in the SBC system.

  In this data transmission process, input is performed from the coordinate information (En) of the effective object area En associated with the movement operation of the pointer P in the drawing data G currently displayed and extracted by the operation determination process (step BD). The type of event is determined (step F1).

  Then, transmission data including the coordinate information of the position to which the pointer P should move together with the event signal corresponding to the input event determined as the type is generated (step F2) and transmitted to the server device 10 (step S2). F3).

  At this time, the client device 20 does not need to repeatedly transmit, for example, coordinate information that changes sequentially in accordance with the movement operation of the mouse, for example, according to the movement operation of the mouse, to the server device 10, and the pointer P should move. Since only the coordinate information (En) of one effective object area En and its event type need to be transmitted, the communication load from the client device 20 to the server device 10 is greatly reduced.

  Then, in the server device 10, the pointer P is moved to the one effective object area En to be moved by the input corresponding process (step S 5 → SA) according to the input event input determination from the client device 20. The display drawing data G is updated and generated (steps A1 to A4), and the effective object area notification information CE corresponding to the drawing data G is acquired together with the display drawing data G and transmitted to the client device 11 (step A5). ~ A9).

  Thereby, in the client device 20, the pointer P has moved to the one valid object area En to be moved by the data reception process (step B7 → BC) according to the determination of the data reception event from the server device 10. The drawing data G for display is drawn and displayed (steps C1 and C2).

  Here, for example, when a specific input operation using “shift + cursor [→]” is performed, the pointer P is immediately moved to the effective object area En desired by the user and displayed. Even when the display screen of the display device 26 is very small, the effective object area En can be designated easily and reliably, and accurate user input is possible.

  On the other hand, when it is determined that another input event accompanying the user operation has occurred in the event occurrence standby state in step B6 (step B10 (Yes)), the process proceeds to the data transmission process shown in FIG. Then (step BF), event transmission to the server device 10 is executed according to the type of other input event accompanying the user operation (steps F1 to F3).

  Therefore, according to the SBC system having the above-described configuration, when an input event signal is received from the client device 20 to the server device 10, the server device 10 activates an application program corresponding to the input event to display a client display. Drawing data G is generated. At the same time, area information (E1) (E2)... Of valid object areas E1, E2,... That can be operated by the user, such as check boxes and link destination instruction buttons included in the drawing data G, is acquired and the effective object area notification information is acquired. CE is generated and transmitted to the client device 20 together with the drawing data G. When the client device 20 moves the pointer P to the effective object area En included in the drawing data G in a state where the drawing data G corresponding to the input event is received and displayed, the effective object area notification information Only the area information (En) of the effective object area En indicated by the movement of the pointer P based on the CE is transmitted to the server apparatus 10.

  Therefore, with the movement operation of the pointer P in the client device 20, not all of the screen coordinate information in the middle of the movement is transmitted to the server device 10 one by one, and the movement operation position of the pointer P becomes the effective object area En. Since the area information (En) is transmitted to the server apparatus 10 only when it is at a position corresponding to the area information (En), the communication load from the client apparatus 20 to the server apparatus 10 can be greatly reduced, and the client apparatus The operation response seen from 20 can be improved. In addition, when the pointer P is located at a position other than the position indicated by the area information (En) of the valid object area En, an input event is not transmitted even if the pointer P is moved, so that an erroneous input is performed. It is possible to eliminate an event transmission and a malfunction in the server device 10 associated therewith.

  Note that each processing method by the SBC system described in the embodiment, that is, server processing by the server device 10 shown in the flowchart of FIG. 6, input corresponding processing accompanying the server processing shown in the flowchart of FIG. 7, flowchart of FIG. The client device 20 shown in FIG. 9, the data reception process accompanying the client process shown in the flowchart of FIG. 9, the operation determination process accompanying the client process shown in the flowchart of FIG. 10, and the client process shown in the flowchart of FIG. Each method such as data transmission processing is a program that can be executed by a computer, such as a memory card (ROM card, RAM card, etc.), magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM). DVD, etc.), an external recording device 18a such as a semiconductor memory can be distributed and stored on a medium 28a. Then, the computers (CPUs 11 and 21) of the server device 10 and the client device 20 read the programs stored in the media of the external recording devices 18a and 28a into the storage devices (flash ROMs 13 and 23 and RAMs 14 and 24) and read them. By controlling the operation by the program, the event generation processing function based on the user-operable area information (En) included in the drawing data G described in the above embodiment is realized, and similar processing by the above-described method is performed. Can be executed.

  Further, program data for realizing each of the above methods can be transmitted on the communication network (N) in the form of a program code, and from a computer device (program server) connected to the communication network (N). The program data is fetched and stored in a storage device (flash ROM 13, 23 or RAM 14, 24), and an event generation processing function based on user-operable area information (En) included in the drawing data G described above is realized. You can also.

  Note that the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment or some constituent requirements are combined in different forms, the problems described in the column of the problem to be solved by the invention are not solved. When the effects described in the column “Effects of the Invention” can be obtained, a configuration in which these constituent requirements are deleted or combined can be extracted as an invention.

DESCRIPTION OF SYMBOLS 10 ... Server apparatus 20 ... Terminal apparatus 11, 21 ... CPU
12, 22 ... Bus 13, 23 ... ROM
14, 24 ... RAM
14a: Client frame buffer RAM
24a ... Operable object area DB (Data Base)
15, 25 ... Frame buffer RAM
16, 26 ... Display device 17, 27 ... Input device 18a, 28a ... External storage device 18b, 28b ... Auxiliary storage device 19, 29 ... Communication I / F
N: Communication network CE: Effective object area notification information G: Display drawing data

Claims (8)

A terminal device that displays screen information,
Acquisition means for acquiring position information indicating a position of an object area included in the screen information;
A discriminating means for discriminating the presence / absence of a direction indicating operation instructing a position in a direction in which an object region desired to be specified by the user exists among the object regions included in the screen information;
When it is determined the direction instruction operation chromatic by the determining means, among the object area included in the screen information, specifying the position information of the object region existing position in the direction indicated by the direction instruction operation Specific means,
Processing means for executing processing on the object area existing at the position of the position information specified by the specifying means;
A terminal device comprising: Object area location information specified in the specifying means, a second determination means for determining whether an operable object area,
Further comprising
The processing means, when the it is judged that operable object region in said second discrimination means executes the processing based on the operable object area,
Terminal device according to claim 1, characterized in that. Position indicating means for arbitrarily specifying a desired position in the screen information by a user operation;
Pointer display means for displaying the position in the screen information instructed by the position instruction means with a pointer;
Further comprising
The pointer display means moves and displays the position pointer indicated by the position indication means to a position where the object area exists when the direction indication operation is determined by the determination means.
Terminal device according to claim 1 or 2, characterized in that. A terminal device that displays screen information,
Obtaining means for obtaining position information of an object area included in the screen information;
Position indicating means for arbitrarily specifying a desired position in the screen information by a user operation;
A discriminating means for discriminating whether or not there is a direction indicating operation that indicates a position in a direction in which the object area exists in the screen information by the user;
Wherein when it is determined the direction instruction operation chromatic by determining means, said among the object area included in the screen information, the direction indication with respect to the designated designated position by the position indicating means within the screen information A specifying means for specifying the position information of the object area existing at the position in the direction instructed by the operation;
Pointer display means for moving and displaying the pointer display indicating the position instructed by the position instruction means to the position of the object area existing at the position of the position information specified by the specifying means;
A terminal device comprising: Object area location information specified in the specifying means, a second determination means for determining whether an operable object area,
Further comprising
It said pointer display means, when the it is judged that operable object region in the second discriminating means, said pointer display displays moved to a position to the operable object area,
The terminal device according to claim 4 . Processing means for executing processing on the object area specified by the specifying means and indicated by the pointer display means;
Further terminal device according to claim 4 or 5, wherein the equipped. A program for controlling a computer of a terminal device that displays screen information,
The computer,
Acquisition means for acquiring position information indicating a position of an object area included in the screen information;
A determination unit that determines the presence / absence of a direction instruction operation that indicates a position in a direction in which an object area that the user wants to indicate is included in the object area included in the screen information;
When it is determined the direction instruction operation chromatic by the determining means, among the object area included in the screen information, specifying the position information of the object region existing position in the direction indicated by the direction instruction operation Specific means,
Processing means for executing processing on the object area existing at the position of the position information specified by the specifying means;
A computer-readable program designed to function as a computer. A program for controlling a computer of a terminal device that displays screen information,
The computer,
Acquisition means for acquiring position information of an object area included in the screen information;
Position indicating means for arbitrarily specifying a desired position in the screen information by a user operation ;
A discriminating means for discriminating whether or not there is a direction indicating operation for indicating a position in a direction in which the object area exists in the screen information by the user;
Wherein when it is determined the direction instruction operation chromatic by determining means, said among the object area included in the screen information, the direction indication with respect to the designated designated position by the position indicating means within the screen information A specifying means for specifying the position information of the object area existing at the position in the direction instructed by the operation ;
Pointer display means for moving and displaying the pointer display indicating the position instructed by the position instruction means to the position of the object area existing at the position of the position information specified by the specifying means;
A computer-readable program designed to function as a computer.

Images