JP2005056286A - Display enlarging method and display enlarging program in web browser - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an enlarging function suitable for a touch panel environment while maintaining a browser function. <P>SOLUTION: When a browser application is started in use of the Internet, a hook procedure is installed inside a hook chain. When an enlargement instruction is given during display of a screen in a terminal, information used for coordinate conversion is set to a hook function DLL, and the display screen is divided into a standard display screen and an enlarged display screen and enlargement objective area information is maintained. The browser application checks whether the standard screen is touched once every fixed time. If the standard screen is touched, the enlargement objective area is decided and the enlargement objective area information is maintained while an enlarged screen is displayed. When the display screen is touched, an OS notifies the hook procedure of a mouse event. The hook function DLL checks whether the touch is made inside the enlarged display screen from the coordinate information advised to the hook procedure to convert the touch into mouse coordinates. The hook function DLL moves the touch on the display screen to the mouse coordinates. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an enlarged display in a web browser when browsing the Internet.

  The general homepage is often designed on the premise of mouse operation on a personal computer, and the detailed notation is difficult for the elderly to see. Further, it is often difficult to select fine buttons with a finger on the touch panel.

  As a conventional technique for solving this type of problem, a portion of the text displayed on the screen is extracted as a bitmap, and the link text is enlarged and displayed while maintaining the browser function on the enlarged display screen. It is known that easy notation is also easy to see (see, for example, Patent Document 1).

JP 2002-373043 (pages 1-11, FIG. 1)

  However, the above-described prior art is mainly intended to make a small display easy to see, and the enlarged screen simply displays an enlarged bitmap. Therefore, since the contents of the enlarged display are not updated, the display contents are not updated or changed on the enlarged display screen. For this reason, for example, in an environment where a mouse cannot be used on a terminal or the like as in the street, when browsing the Internet, the operation cannot be performed even if a check box, radio button, or other control is touched on the enlarged screen. Also, there is a problem that the contents of the opened menu are not displayed in the pull-down menu.

  An object of the present invention is to provide an enlarged display method in a web browser that realizes an enlargement function suitable for a touch panel environment while maintaining the browser function.

  The enlarged display method in the web browser of the present invention includes a stage in which a browser application, which is an enlarged display application of the web browser, and a hook function DLL are stored in the terminal together with the OS and the web browser, and the browser application is activated when the Internet is used. Then, when a hook procedure which is a procedure in the hook function DLL is installed in the hook chain, and when an enlargement instruction is displayed while the screen is displayed on the terminal by the web browser application, the web browser application enters the hook function DLL. Set the enlargement screen coordinates, standard screen coordinates, enlargement ratio, and base point type to be used for coordinate conversion, and divide the display screen into the standard display screen and the enlargement display screen according to the standard screen coordinates and the enlargement screen coordinates. The stage to start the timer by holding the enlargement target area information determined by the type of point, and when the timer starts, the browser application checks if there is a touch within the standard screen at regular intervals, and if so, the enlargement rate When the display screen is touched, the OS notifies the mouse event to the hook procedure. The step of the hook function DLL confirms whether the touch is an enlarged display screen based on the coordinate information notified to the hook procedure, and converts the touch to the mouse coordinate. The hook function DLL converts the touch of the display screen to the mouse coordinate. And moving.

  According to the present invention, enlargement display area information is held during enlargement display, coordinate conversion between the enlargement display screen and the standard display screen is performed, and the enlargement display screen is updated with the enlargement target area information after the coordinate conversion is performed. By redisplaying, it is possible to reflect the update or change of the display contents on the enlarged display screen, so the radio buttons, check boxes, check boxes, etc. in the enlarged display that could not be used before can be used. The effect of becoming can be obtained.

  In the enlarged display method in the web browser of the present invention, first, a browser application which is an enlarged display application of the web browser and a hook function DLL are stored together with the OS and the web browser in a terminal which can be connected to the Internet. When the browser application is activated when the Internet is used in the terminal, a hook procedure that is a procedure in the hook function DLL is installed in the hook chain.

  When an enlarged display instruction is given while the screen is displayed on the terminal by the web browser application, the enlarged display function is executed as follows. The browser application sets the enlarged screen coordinates, standard screen coordinates, magnification rate, and base point type used for coordinate conversion to the hook function DLL, and the display screen is displayed in accordance with the standard screen coordinates and the enlarged screen coordinates. The screen is divided into screens, the area information to be enlarged determined by the enlargement ratio and the type of the base point is held, and the timer is started.

  When the timer starts, the browser application checks whether there is a touch within the standard screen at regular intervals, and if so, determines the enlargement target area based on the enlargement rate and base point, and the enlargement target area information including the existing ones Hold and zoom in on the screen.

  When the display screen is touched, the OS notifies the mouse event to the hook procedure. The hook function DLL confirms whether the touch is an enlarged display screen based on the coordinate information notified to the hook procedure, and moves the touch on the display screen to the mouse coordinates.

  FIG. 1 shows a system configuration for carrying out an enlarged display method in a web browser of the present invention. In FIG. 1, a terminal 10 is a personal computer, for example, and the Internet 20 can be used. A memory 11 provided in the terminal 10 stores an operating system (OS) 12, a web browser 13, a browser application 14 using a web browser control, and a hook function DLL 15.

  The OS 12 is, for example, “Windows (registered trademark) 2000”, and the web browser 13 is, for example, “Internet Explorer” (registered trademark). The browser application 14 is an application having an enlarged display function as well as a function equivalent to that of the web browser by using a control capable of using the function of the web browser 13. The hook function DLL 15 is a dynamic link library for executing a hook function, that is, a monitoring function for system messages such as mouse events.

  As shown in FIG. 2, the browser application 14 has a function of dividing the display screen 30 of the terminal 10 into a standard display screen (screen with an enlargement ratio of 1) 31 and an enlarged display screen 32. The control panel 33 is for performing various controls on the display screen 30.

  FIG. 3 shows the relationship between the standard display screen 31 and the two types of enlarged display screens 32. As shown in FIG. 3A, the standard display screen 31 has a coordinate system with the upper left corner as the origin, and is shown in FIG. 3B with the touched position (x, y) indicated by a black dot as a base point. The enlarged display screen 32 or the enlarged display screen 32 shown in FIG. The enlarged display screen 32 in FIG. 3B is a pattern in which the standard display screen 31 is cut out as a bitmap from the center, and the enlarged display screen 32 in FIG. The standard display screen 31 is enlarged and displayed in a pattern cut out as a map.

  After the enlarged display, the browser application 14 updates the enlarged display screen 32 by redisplaying the designated area with the designated magnification at regular time intervals by a timer. For example, when the configuration or size of the display screen is changed, such as when a new software keyboard is displayed, or when the image is updated by a scroll operation, the enlarged display screen 32 is redisplayed at regular time intervals. Update.

  Further, the browser application 14 performs re-display when the base point moves. When the base point moves, the standard display screen 31 is touched directly, or the enlarged display screen 32 is touched to perform coordinate transformation, and as a result, the standard display screen 31 is touched as described later. When it comes to it.

  At the time of redisplay, the standard display screen 31 and the enlarged display screen 32 have five pieces of information notified from the browser application 14 to the hook function DLL 15, that is, enlarged screen coordinates, standard screen coordinates, base point position, enlargement rate, and base point. Coordinate conversion is performed by the hook function DLL 15 based on the type (upper left corner or center), and the standard display screen 31 and the enlarged display screen 32 are associated with each other.

  The enlarged screen coordinates are coordinates that specify the range of the enlarged display screen 32, the standard screen coordinates are coordinates that specify the range of the standard display screen 31, and the enlargement ratio is the magnification from the standard display screen 31 on the enlarged display screen 32. The rate is indicated by the control panel 33 together with the enlargement instruction and the type of the base point. Further, the position of the base point is specified by being touched on the display screen 30.

  FIG. 4 is a diagram showing an image of the coordinate conversion described above. When a certain position on the enlarged display screen 32 is touched, a mouse event is notified from the OS 12 to the hook procedure, and coordinate conversion is executed by the browser application 14 and the hook function DLL 15. Thus, a mouse event that has occurred on the enlarged display screen 32 is actually processed on the standard display screen 31, and an event that occurs there is also developed on the enlarged display screen 32. Therefore, an event that occurs on the standard display screen 31 seems to have been processed on the enlarged display screen 32.

  Hereinafter, the processing flow will be described in detail with reference to the flowcharts shown in FIGS.

  When the use of the Internet 20 is started, when the browser application 14 is activated, a hook procedure (procedure in the hook function DLL 15) is installed in the hook chain (step A1 in FIG. 5).

  When an enlargement display instruction is given on the control panel 33 while the display screen 30 is being displayed on the terminal 10 by the web browser application 14 (step K in FIG. 5), enlargement display is performed. The enlargement display instruction is accompanied by enlargement screen coordinates, standard screen coordinates, enlargement ratio, and type of base point.

  The browser application 14 sets the enlarged screen coordinates, standard screen coordinates, enlargement ratio, and base point type used for coordinate conversion to the hook function DLL 15 (step A2).

  Next, as shown in FIG. 2, the browser application 14 divides the display screen 30 into the standard display screen 31 and the enlarged display screen 32 according to the standard screen coordinates and the enlarged screen coordinates (step A3). Then, the enlargement target area information determined by the enlargement rate and the type of the base point is held (step A4), and the timer is started (step A5). The display screen 30 always displays the standard display screen 31 and the enlarged display screen 32 until an instruction to end the enlarged display is given.

  FIG. 6 shows the processing of the browser application 14 when the timer is started. This process is repeated at regular time intervals. The browser application 14 confirms whether there is a touch in the standard display screen 31 (step B1 in FIG. 6). As a result, if there is a touch (YES in step B1) and the type of the base point is the center (YES in step B2), the enlargement target area is determined based on the enlargement rate with the center as the base point (step B3). If the type of the base point is the upper left corner (NO in step B2), the enlargement target area is determined based on the enlargement ratio using the upper left corner as the base point based on the enlargement target area information (step B4).

  Information on the enlargement target area determined in step B3 or step B4 is held (step B5). Then, the screen is redisplayed by performing enlarged display based on the enlargement target area information held in step B5 (step B6). As a result, the enlarged display screen 32 can be updated within a time interval in which the process shown in FIG. 6 is repeated, for example, when a new software keyboard is displayed or when an image is updated by a scroll operation. .

  If there is no touch in the standard display screen 31 (NO in step B1), the screen is redisplayed by performing enlarged display using the enlargement target area information held in step A4 in FIG. 5 ( Step B6). However, if the standard display screen 31 is touched when another timer is activated (YES in step B1), the information on the enlargement target area determined in step B3 or step B4 is retained (step B5), and the content is displayed on the screen. Is displayed again (step B6).

  FIG. 7 shows processing when there are various types of instructions from the user during enlarged display. The user can use the control panel 33 to give instructions for changing the enlargement ratio, changing the screen division method, and ending.

  When there is an instruction to change the enlargement ratio (YES in step C1 in FIG. 7), the browser application 14 changes the enlargement target area information (step C2). The changed enlargement target area information is held (step A4 in FIG. 5 and step B5 in FIG. 6), and the screen is redisplayed based on this (step B6 in FIG. 6).

  If there is a change in the screen division method (YES in step C3), the browser application 14 subdivides the screen (step C4) and changes the enlargement target area information (step C2).

  When there is an instruction to end the enlarged display (YES in step C5), the browser application 14 performs the end process shown in FIG. 9 (step C6).

  FIG. 8 shows processing when the standard display screen 31 or the enlarged display screen 32 is touched during enlarged display. As described above, when there is an enlarged display instruction, the hook procedure is installed in the hook chain (step A1 in FIG. 5). As a result, mouse events associated with all threads in the OS 12 are monitored. When a mouse event occurs on the enlarged display screen 32, the mouse event is notified from the OS 12 to the hook procedure. (Step D1 in FIG. 8).

  Based on the coordinate information notified from the browser application 14, the hook function DLL 15 checks whether the place where the mouse event has occurred is in the enlarged display screen 32 (step D2). As a result, if it is not within the enlarged display screen (NO in step D2), it is not necessary to perform coordinate conversion, and thus this processing ends. On the other hand, if it is within the enlarged display screen (YES in step D2), the coordinate conversion of the image shown in FIG. 4 is performed.

  First, based on the set coordinate conversion information (step A4 in FIG. 5), it is confirmed whether the base point is the center or the upper left corner (step D3). The hook function DLL 15 performs coordinate conversion based on the result (step D4), and converts it into mouse coordinates (step D5). As the mouse coordinates, for example, pixels with a screen resolution of 512 × 128 are represented by mouse coordinates 65,535 × 65,535. Next, the hook function DLL 15 moves the mouse pointer to the mouse coordinates (step D6), and generates a mouse left button down (step D7) and mouse left button up (step D8) event that simulates an actual mouse operation.

  Then, the process ends without notifying other message procedures. This is because, for example, when the pull-down menu is open, when the end of processing is notified, the pull-down menu is closed to prevent the menu from being selected in the list box.

  FIG. 9 shows processing at the end of the enlarged display. The browser application 14 restores the display screen 30 divided into the standard display screen 31 and the enlarged display screen 32 as shown in FIG. 2 (step E1 in FIG. 9), and ends the timer process shown in FIG. (Step E2).

The figure which shows the system configuration for enforcing the enlarged display method in the web browser of this invention Diagram of display screen divided into standard display screen and enlarged display screen by web browser application The figure which shows the relationship between the standard display screen 31 and two types of expansion display screens 32 by the difference in a base point. The figure which shows the image of coordinate conversion of an enlarged display screen and a standard display screen Flow chart showing processing when there is an enlarged display instruction Flow chart showing processing when timer is started Flowchart showing processing when there are various types of instructions from the user during enlarged display A flowchart showing processing when the standard display screen 31 or the enlarged display screen 32 is touched during enlarged display. The flowchart which shows a process when there exists an enlarged display termination instruction

Explanation of symbols

10 terminal 11 memory 12 OS
13 Web browser 14 Browser application 15 Hook function DLL
20 Internet 30 Display Screen 31 Standard Display Screen 32 Enlarged Display Screen 33 Control Panel

Claims (2)

A stage in which a browser application that is an enlarged display application of the web browser and a hook function DLL are stored in the terminal together with the OS and the web browser;
When a browser application is activated when using the Internet, installing a hook procedure that is a procedure in the hook function DLL in the hook chain;
When an enlargement instruction is given while the screen is displayed on the terminal by the web browser application, the web browser application sets the enlargement screen coordinates, standard screen coordinates, enlargement ratio, and base point type used for coordinate conversion to the hook function DLL Then, the display screen is divided into the standard display screen and the enlarged display screen according to the standard screen coordinates and the enlarged screen coordinates, and the timer is started by holding the enlargement target area information determined by the enlargement ratio and the type of the base point,
When the timer starts, the browser application checks whether there is a touch in the standard screen at regular intervals, and if so, determines the enlargement target area based on the enlargement rate and the base point, and enlarges the existing ones. Hold the target area information and enlarge the screen,
When the display screen is touched, the OS notifies the hook procedure of a mouse event;
The hook function DLL confirms whether the touch is an enlarged display screen based on the coordinate information notified to the hook procedure, and converts it into mouse coordinates;
A method of enlarging display in a web browser, wherein the hook function DLL includes a step of moving a touch on the display screen to mouse coordinates. An expansion display program in a terminal storing a browser application and a hook function DLL, which are an expansion display application of a web browser, together with an OS and a web browser
When a browser application is activated when using the Internet, a hook procedure which is a procedure in the hook function DLL is installed in the hook chain;
When an enlargement instruction is given while the screen is displayed on the terminal by the web browser application, the web browser application sets the enlargement screen coordinates, standard screen coordinates, enlargement ratio, and base point type used for coordinate conversion to the hook function DLL Then, dividing the display screen into a standard display screen and an enlarged display screen according to the standard screen coordinates and the enlarged screen coordinates, holding the enlargement target area information determined by the enlargement ratio and the type of the base point, and starting a timer;
When the timer starts, the browser application checks whether there is a touch in the standard screen at regular intervals, and if so, determines the enlargement target area based on the enlargement rate and the base point, and enlarges the existing ones. Holding target area information and enlarging the screen;
When the display screen is touched, the OS notifies the hook procedure of a mouse event;
The hook function DLL confirms whether the touch is an enlarged display screen based on the coordinate information notified to the hook procedure, and converts it into mouse coordinates;
And a step of moving the touch on the display screen to a mouse coordinate by the hook function DLL.

Images