JP7328771B2 - Display device, display control program and display control method - Google Patents

Description

TECHNICAL FIELD Embodiments of the present invention relate to a display device, a display control program, and a display control method.

In recent years, portable terminal devices such as smart phones, smart watches, tablets, and mobile phones can display various information on their screens. When various information is displayed on the screen, for example, senior users may find it difficult to read the characters displayed on the screen. As a technique for making display contents such as characters displayed on the screen easier for such a user to read, a technique is known in which display contents are enlarged when an enlargement operation is received from the user.

JP-A-11-86014 JP 2011-118659 A

The operation methods that are usually prepared to accept the operation to enlarge the display content include, for example, the operation of touching the screen, the operation of pressing a push button type mechanical switch, and the operation of realizing various functions such as the fingerprint authentication function. For example, an operation of touching a sensor is included. Enlargement operations performed by touching the screen include, for example, pinching out to widen the distance between two fingertips while they are in contact with the screen, double-tapping by tapping the screen repeatedly, and long-tapping by pressing and holding the screen with the fingertips. etc. Usually, the user performs these operations so that the display content to be enlarged does not protrude from the screen. Sometimes it doesn't fit. For example, if the enlarged display content is a sentence with line breaks of a certain length, and the beginning or end of each line of the sentence enlarged and displayed on the screen protrudes from the screen, the user can read the sentence. Secondly, while reading one line, the screen is slid or the display content is reduced.

Accordingly, one aspect of the technology disclosed herein aims to provide a display technology capable of easily performing enlarged display while maintaining browsability.

One aspect of the disclosed technology is exemplified by the following display device. This display device has a detection unit that detects a touch operation on the display screen of the display unit, and a state in which there are a plurality of display blocks extracted based on the color difference from the background color in the content displayed on the display screen. When a touch operation on any one of a plurality of blocks is detected, the center of the block on which the touch operation is performed is set within the display screen in at least one of the up-down direction and the left-right direction. a display processing unit that arranges the block so as to be in the center of the display area, and displays at least part of the block in the display area at a predetermined magnification.

This display device can easily perform enlarged display while maintaining browsability.

FIG. 1 is a block diagram of a functional configuration example of an information processing apparatus according to an embodiment; FIG. 2 is a flowchart showing an operation example of the information processing device 1 according to the embodiment. FIG. 3 is a flowchart illustrating an example of screen update confirmation processing. FIG. 4 is a diagram explaining the presence/absence of screen updating. FIG. 5 is a diagram explaining the detection target area. FIG. 6 is a flowchart illustrating an example of background color detection processing. FIG. 7 is a diagram explaining the processing for detecting a displayed object. FIG. 8 is a diagram showing an example of pixels determined to have a contrast ratio equal to or higher than a predetermined ratio. FIG. 9 is a diagram explaining the display object area. FIG. 10 is the first diagram explaining the block detection process. FIG. 11 is a second diagram illustrating block detection processing. FIG. 12 is a diagram explaining a method of detecting the writing direction. FIG. 13 is a flowchart illustrating an example of processing for detecting characteristics of the entire screen. FIG. 14 is a flowchart illustrating an example of preprocessing for icon presentation. FIG. 15 is a diagram showing an example of a screen on which icons are displayed. FIG. 16 is a first flowchart showing processing for enlarged display. FIG. 17 is a second flowchart showing processing for enlarged display. FIG. 18 is a third flowchart showing processing for enlarged display. FIG. 19 is a diagram illustrating a first example of enlarged display realized by the information processing apparatus according to the embodiment; FIG. 20 is a diagram showing a second example of enlarged display realized by the information processing apparatus according to the embodiment. FIG. 21 is a diagram illustrating a third example of enlarged display realized by the information processing apparatus according to the embodiment;

A display device, a display control program, and a display control method according to embodiments will be described below with reference to the drawings. Configurations having the same functions in the embodiments are denoted by the same reference numerals, and overlapping descriptions are omitted. Note that the display device, display control program, and display control method described in the following embodiments are merely examples, and do not limit the embodiments. Moreover, each of the following embodiments may be appropriately combined within a non-contradictory range.

FIG. 1 is a block diagram of a functional configuration example of an information processing apparatus according to an embodiment; As shown in FIG. 1 , the information processing apparatus 1 has a control section 10 , a communication section 11 , an audio input/output section 12 , a storage section 13 , an operation section 14 and a display section 15 . The information processing device 1 is an example of a display device, and for example, a smart phone, a tablet terminal, or the like can be applied. In this embodiment, the information processing device 1 is assumed to be a smart phone as an example.

The control unit 10 is a processing unit, such as a CPU (Central Processing Unit), which controls the processing of the entire information processing apparatus 1, reads the program 13A from the storage unit 13, and executes the process. By executing the process, the control unit 10 realizes the functional configuration of the detection unit 10A and the display processing unit 10B, and realizes display control for causing the display unit 15 to perform display, for example.

Under the control of the control unit 10, the communication unit 11 uses the antenna 11A to perform wireless communication with other mobile devices and base station devices. Specifically, the communication unit 11 uses a communication method such as LTE (Long Term Evolution) communication or WiFi (registered trademark, Wireless Fidelity) communication,
Performs wireless communication with other mobile units and base station equipment. For example, under the control of the control unit 10, the communication unit 11 transmits and receives information on a website selected by a selection operation on the web browser via LTE communication or WiFi communication.

The voice input/output unit 12 outputs the voice input from the control unit 10 from the speaker 12A. Also, the voice input/output unit 12 collects voice from the microphone 12B and outputs the voice to the control unit 10 .

The storage unit 13 is a storage device such as a memory or an SSD (Solid State Drive). The storage unit 13 stores a program 13A and definition information 13B. The definition information 13B is information indicating various definition contents read when the program 13A executes a process. The contents of the definition information 13B are registered in advance by a user or the like. For example, the definition information 13B includes detection target area information indicating the detection target area set for each application, enlargement availability information indicating whether enlargement display is allowed, display magnification (large, medium, small) set by user operation. setting information, etc.

The operation unit 14 includes operation keys, a touch panel that is superimposed on the display screen of the display unit 15 , and the like. The display unit 15 is a liquid crystal screen or the like, and displays various information on the display screen under the control of the control unit 10 .

The detection unit 10</b>A detects an operation on the display screen of the display unit 15 based on the user's operation performed on the operation unit 14 . Specifically, the detection unit 10</b>A detects a user's touch operation from a touch panel superimposed on the display screen of the display unit 15 . For example, the control unit 10 detects an operation for enlarging the display screen by a user's operation.

The display processing unit 10B receives an operation on the display screen of the display unit 15 based on the detection result of the detection unit 10A, and performs display control on the display screen of the display unit 15, such as performing display according to the received operation. display control processing is performed. For example, the display processing unit 10B performs display control on a web screen that displays a website on a web browser.

When the detection unit 10A detects an enlargement operation on the display screen, the display processing unit 10B enlarges and displays a display object that is distinguished from the background in the content displayed on the display screen, that is, a photograph, characters, and the like. Details of the enlarged display in the display processing unit 10B will be described below. FIG. 2 is a flowchart showing an operation example of the information processing device 1 according to the embodiment.

As shown in FIG. 2, when the process is started, the display processing unit 10B performs screen display of content on the display unit 15 by an application such as a web browser (S1). When the content is displayed on the display unit 15, the user can read displayed objects such as characters and pictures in the content.

Next, the display processing unit 10B monitors the update state of the screen displayed on the display screen 150, and determines to stop updating the screen (S2). Monitoring the update state of the screen is to determine whether or not there is a change in the display state of the content displayed on the display unit 15 . In order to enlarge and display the content displayed on the display unit 15, the information processing apparatus 1 performs various processes (S3 to S12) for analyzing the image data of the content displayed on the display unit 15 and performing the enlarged display. Execute. Therefore, in step S2, the display processing unit 10B monitors whether or not the screen displayed on the display unit 15 is in the process of being temporally changed by scrolling or rotating the screen. This prevents unnecessary processing for the screen that is being updated.

FIG. 3 is a flowchart illustrating an example of screen update confirmation processing. That is, the display processing unit 10B first captures the screen (referred to as "image A") displayed on the display unit 15 (S2A). Next, the display processing unit 10B waits until a preset time (for example, several milliseconds to several hundred milliseconds) has passed (S2B). Then, the display processing unit 10B captures the screen (referred to as "image B") displayed on the display unit 15 (S2C).

Next, the display processing unit 10B compares the two captured screens and verifies their identity. That is, the display processing unit 10B performs the process (S2F) of comparing the RGB values of each pixel of the two captured screens vertically and horizontally (S2D, S2E, S2G, S2H). When the display processing unit 10B makes a negative determination in the process of step S2F, the screen (image A) captured in step S2A is replaced with the screen (image B) captured in step S2C (S2I). If the RGB values of the pixels of the screen captured in step S2A (image A) and the screen captured in step S2C (image B) are all the same, when the comparison of all pixels is completed, steps from step S2D to step S2D are performed. Since the series of loop processing up to S2H is completed, the display processing unit 10B terminates the series of processing from step S2A to step S2H, that is, the processing of step S2.

FIG. 4 is a diagram explaining the presence/absence of screen updating. For example, as shown in FIG. 4A, when a finger H in contact with the screen is performing a flicking operation of sliding, the screen captured in step S2A (image A) and the screen captured in step S2C ( Comparing with image B), the RGB values change depending on whether the pixel at a specific position represents the character color or the background color. Therefore, the display processing unit 10B makes a negative determination in step S2F. On the other hand, for example, as shown in FIG. 4B, when no operation is performed on the screen, the RGB values of the pixel do not change. Therefore, the display processing unit 10B makes an affirmative determination in step S2F, and when the comparison of the RGB values of all pixels is completed, the process of step S2 is terminated.

When a user performs a flick operation on a screen in which a displayed object can be scrolled like a web browser, the scrolling of the content displayed on the screen continues for a while even after the user lifts his/her finger. While scrolling continues, the display content of the screen continues to change. Therefore, while scrolling continues, the display processing unit 10B makes a negative determination in step S2F. Then, when the scrolling stops, the display processing unit 10B makes an affirmative determination in step S2F, and when the comparison of the RGB values of all pixels is completed, the process of step S2 ends. That is, the display processing unit 10B can determine that the screen is no longer updated.

It should be noted that the determination of whether or not the screen has been updated is not limited to the form of comparing the entire screen. As shown in FIG. 4C, the screen may be divided into a plurality of areas and a specific area may be targeted for determining whether or not the screen has been updated. Alternatively, whether or not the screen has been updated may be determined for each of a plurality of divided regions, and whether or not the entire screen has been updated may be determined from the ratio of the updated regions. For example, when a moving image, animation display, or scrolling display is performed in a specific area of the screen, if the determination of whether or not the screen has been updated is performed for an area other than the specific area, the screen in the determination target area It becomes possible to determine whether or not there is an update.

Further, the determination of whether or not the screen has been updated is not limited to the comparison of RGB values. The determination as to whether or not the screen has been updated may be made using, for example, the brightness of pixels.

Description will be made along the flowchart of FIG. 2 again. The display processing unit 10B performs subsequent processing using the screen (image B) captured in step S2C, but may use the screen (image A) captured in step S2A.

After completing the process of step S2, the display processing unit 10B next sets a detection target area (S3). That is, the display processing unit 10B refers to the definition information 13B, and detects, from the detection target area information set for each application, the information of the area to be enlarged and displayed on the display unit 15 when the enlargement operation is performed. Get region of interest information. Specifically, the display processing unit 10B acquires the information of the application being displayed on the screen on the display unit 15 as a foreground process, and selects the application corresponding to the application being displayed on the screen from the detection target area information in the definition information 13B. to get

FIG. 5 is a diagram explaining the detection target area. For example, as shown in the upper diagram of FIG. 5, when a web browser is displayed on the screen of the display unit 15, the screen of the display unit 15 includes a display area for displaying content on the Internet, as well as a display area for displaying content on the Internet. There is a scroll bar for scrolling the contents of the area, a menu display, and a display area for displaying operation buttons. A scroll bar, a menu display, and an operation button are not subject to enlarged display in the present embodiment because they are not content that the user browses. Therefore, by acquiring the detection target area information, the display processing unit 10B detects, as shown in the lower diagram in FIG. Set as region.

In FIG. 5, the horizontal direction of the screen of the display unit 15 is x, the vertical direction is y, and the pixel coordinates are (x, y). Then, as the detection target area information acquired by the display processing unit 10B, information indicating the position and shape in the coordinate system, that is, the coordinates (x0, y0) of the upper left corner of the detection target area, the width (Width), the height ( or vertical width) (Height) is exemplified. However, the detection target area is not limited to a rectangular shape. The detection target area may be, for example, circular, trapezoidal, or other shapes.

Description will be made along the flowchart of FIG. 2 again. After completing the process of step S3, the display processing unit 10B next captures the screen of the detection target area, and detects the background color corresponding to the background portion in the detection target area from the image data acquired by the screen capture ( S4). FIG. 6 is a flowchart illustrating an example of background color detection processing. As shown in FIG. 6, when the background color detection process is started, the display processing unit 10B performs a vertical loop (y=0, Height-1, 1) process for processing each pixel in the vertical direction ( S4A-S4E).

In the vertical loop processing, the display processing unit 10B performs horizontal loop (x=0, Width-1, 1) processing for processing each pixel in the horizontal direction (S4B to S4D). Thereby, the display processing unit 10B acquires the color information of each pixel in the detection target area (S4C).

After S4E, the display processing unit 10B determines the color that occupies the largest proportion of the detection target area as the background color based on the obtained color information of each pixel (S4F), and ends the process.

Specifically, the display processing unit 10B calculates a histogram of all types of colors (R, G, B) included in the detection target area, and calculates the percentage of each color used. It should be noted that the width of the colors when calculating the histogram may have a predetermined width.

Next, the display processing unit 10B extracts colors whose calculated ratio is equal to or higher than a predetermined value (e.g., 8% or higher), and sets the color having the highest ratio among the extracted colors as the background color.

For example, assume that the color ratios are as follows.
(R, G, B) = (255, 255, 255): 61%
(R, G, B) = (101, 121, 110): 12%
(R, G, B) = (051, 051, 051): 5%
(R, G, B) = (000, 108, 204): 1%

In this case, the display processing unit 10B extracts colors of (R, G, B)=(255, 255, 255), (101, 121, 110) as 8% or more colors. Next, the display processing unit 10B sets (R, G, B)=(255, 255, 255), which has the highest ratio of 8% or more, as the background color.

Description will be made along the flowchart of FIG. 2 again. After finishing the processing of step S4, the display processing unit 10B next detects a displayed object (S5). A display object constitutes content and is distinguished from the background, and includes, for example, characters, pictures, photographs, marks, and the like.

FIG. 7 is a diagram explaining the processing for detecting a displayed object. With the upper left corner of the screen of the detection target area as the origin, the horizontal direction as x, and the vertical direction as y, the pixel colors are determined in order from the leftmost pixel (x=0) to the right in the row of y=0. is compared with the background color, and the leftmost pixel (where x is the smallest) that matches the background color is set as the background pixel with y=0. If there is no pixel matching the background color even in the rightmost pixel in the row of y=0, the leftmost pixel (x=0) in the row of y=0 is set as the background pixel. Next, the contrast ratio with the background pixel is calculated in order from the pixel to the right of the background pixel to the rightmost pixel, and it is determined whether the contrast ratio is a predetermined ratio or more (for example, 3:1 or more). This processing is performed for all y (from the upper end to the lower end of the screen of the detection target area). FIG. 8 is a diagram showing an example of pixels determined to have a contrast ratio equal to or higher than a predetermined ratio. Since the contrast ratio is calculated for each pixel, if the pixels determined to have a contrast ratio equal to or greater than a predetermined ratio are represented in an image, for example, as shown in FIG. be.

Next, the display processing unit 10B extracts pixels that are adjacent to each other among pixels whose contrast ratio is equal to or greater than a predetermined ratio, and in each of the extracted pixel groups, the pixels are defined by the outermost pixels in the upper, lower, left, and right sides of the adjacent pixels. The area within the range is set as the display object area. Then, the display processing unit 10B obtains the coordinates (x0, y0) of the upper left corner of the display object region, the width (Width), the height ( or vertical width) (Height) is stored in the storage unit 13 . FIG. 9 is a diagram explaining the display object area. For example, if six hiragana characters exist in the detection target area, the display processing unit 10B sets six display object areas in the detection target area, as shown in FIG. Then, the display processing unit 10B stores in the storage unit 13 display object region information indicating the positions and shapes of the six display object regions. Note that here, an area in which hiragana characters are displayed is set as the display object area, but the display object set as the display object area may be other than characters such as a picture or a photograph. In addition, in FIG. 9, a boundary line indicating the boundary of the display object area is illustrated. No screen display.

Description will be made along the flowchart of FIG. 2 again. After completing the processing of step S5, the display processing unit 10B next detects blocks (S6). A block is an area in which one or more display objects are gathered, and includes, for example, a text block composed of character strings and a non-text block composed of pictures, photographs, and the like.

The display processing unit 10B combines adjacent display object areas based on the distance between the display object areas in the detection target area, and sets a range defined by the outermost pixels in the top, bottom, left, and right as a block. Then, the display processing unit 10B uses the coordinates (x0, y0) of the upper left corner of the block, the width (Width), and the height (or vertical width) ( Height) is stored in the storage unit 13 . FIG. 10 is the first diagram explaining the block detection process.

For example, as shown in the upper part of the detection target region in FIG. 10, when a character string exists in the detection target region, the display processing unit 10B determines that the display object regions are close to each other due to the character string. The display object areas of the characters in the text are combined with each other, and the range determined by the outermost pixels on the top, bottom, left, and right of the combination is set as a block (hereinafter referred to as a "text block"). Then, the display processing unit 10B uses the coordinates (x0, y0) of the upper left corner of the block, the width (Width), the height (or the vertical width) as block area information indicating the position and shape of the text block in the coordinate system of the screen. ) (Height) is stored in the storage unit 13 .

Further, for example, as shown in the lower part of the detection target region in FIG. Based on the ratio of the background color in the area, the photograph is treated as a single display object, and the area defined by the outermost pixels on the top, bottom, left, and right of the single display object is defined as a block (hereinafter referred to as "non-text block"). set. Then, the display processing unit 10B uses the coordinates (x0, y0) of the upper left corner of the block, the width (Width), the height (or the height) as block area information indicating the position and shape of the non-text block in the coordinate system of the screen. width) (Height) is stored in the storage unit 13 .

In FIG. 10, boundary lines indicating boundaries between blocks are illustrated, but the boundary lines are imaginary lines shown for explaining the present embodiment, and the boundary lines are displayed on the display unit 15 on the screen. not. Also, FIG. 10 illustrates a state in which two text blocks composed of character strings and non-text blocks composed of photographs are set in the detection target area. In some cases, two or more sentence blocks composed of displayed objects are set in the detection target area. In some cases, the display processing unit 10B sets two or more non-text blocks composed of display objects other than characters, such as photographs, as the detection target area.

FIG. 11 is a second diagram illustrating block detection processing. For example, as shown in the upper part and the lower part of the detection target area in FIG. Based on the distance between the characters, display object areas of characters that are close to each other due to the character strings are combined, and the area defined by the outermost pixels on the top, bottom, left, and right of the combination is set as a sentence block. Therefore, as shown in the upper part and the lower part of the detection target area in FIG. Display object areas of characters are not combined but set as separate text blocks. Then, the display processing unit 10B obtains the coordinates (x0, y0) of the upper left corner of each block, the width (Width), and the height (or (Height) is stored in the storage unit 13 .

Description will be made along the flowchart of FIG. 2 again. After completing the process of step S6, the display processing unit 10B next detects the writing direction of each of the one or more text blocks detected in step S6 (S7). The display processing unit 10B calculates the interval between adjacent display object areas in each text block (hereinafter referred to as "character spacing"), and determines the writing direction of the text block as vertical writing based on the calculated character spacing. Detect whether it is horizontal writing.

FIG. 12 is a diagram explaining a method of detecting the writing direction. The display processing unit 10B calculates the interval between adjacent display object areas in each text block. Intervals (w00, w01, . Alternatively, it may be calculated from the difference in each coordinate between other parts. Also, the intervals (h00, h01, h02, . It may be calculated from the difference from the Y coordinate of the corner, or from the difference between the coordinates of other parts.

Next, the display processing unit 10B calculates the average value (W _ave ) of the interval between display object regions adjacent to each other in the horizontal direction in the text block, and Compare with the average value of the interval ( _have ). Then, if the average value ( _have ) is larger than the average value ( _Wave ), the display processing unit 10B determines that the writing direction of the sentence block is horizontal writing, and the average value ( _Wave ) is equal to the average value ( _have ). If it is larger, the writing direction of the text block is determined to be vertical writing. The display processing unit 10B adds the determination result to the block area information in the storage unit 13. FIG.

Description will be made along the flowchart of FIG. 2 again. After completing the process of step S7, the display processing unit 10B next detects the characteristics of the entire screen (S8). The characteristics of the entire screen quantitatively represent the degree of legibility felt by the user when content is displayed on the screen, and are used to determine the enlargement ratio in enlarged display, which will be described later. The display processing unit 10B acquires attribute information (for example, character size, spacing, density (contrast), writing direction, etc.) of each display object area described above, and displays the screen from this information. Capture the characteristics of the visibility of

FIG. 13 is a flowchart illustrating an example of processing for detecting characteristics of the entire screen. In the feature detection processing of the entire screen, as shown in FIG. 13, the display processing unit 10B acquires display object region information (S8A). Display object region information such as coordinates (x0, y0) of the upper left corner of each display object region, width (Width), height (or vertical width) (Height), etc. is stored in the storage unit 13 in step S5. Obtained by referencing. Next, the display processing unit 10B initializes a variable (total height) used for calculation (S8B). Then, the display processing unit 10B sums up the total height of each display object area in each block, such as text blocks and non-text blocks, while multiplying the height of each display object by an appropriate weight. Loop processing is performed (S8C to S8E).

Next, the display processing unit 10B uses the values obtained in the above loop processing (S8C to S8E) to calculate the visibility degree (S8F). Specifically, the display processing unit 10B divides the total weighted height of each display object region in each block by the number of display object regions in the block, thereby obtaining the number of display object regions in the block. Compute the weighted average height. Then, the display processing unit 10B sets the value obtained by dividing the total value of the average values of each block by the number of blocks as the visibility degree.

Description will be made along the flowchart of FIG. 2 again. After finishing the processing of step S8, the display processing unit 10B next performs preprocessing for icon presentation (S9). The pre-processing for presenting an icon involves determining the enlargement method for enlarged display, whether or not to present an icon, and the type of icon to be presented, based on the overall screen characteristics (degree of viewability) detected in step S8. It is a process to

FIG. 14 is a flowchart illustrating an example of preprocessing for icon presentation. When the pre-processing for icon presentation is started, as shown in FIG. 14, the display processing unit 10B refers to the definition information 13B and acquires enlargement availability information regarding the application being displayed on the screen of the display unit 15 (S9A). ). Next, the display processing unit 10B determines whether or not the application being displayed on the screen of the display unit 15 is compatible with enlarged display based on the obtained enlargement availability information (S9B). Next, the display processing unit 10B acquires the number of enlargements (S9C). If the screen of the display unit 15 is already in the enlarged display state when step S9C is executed, the display processing unit 10B acquires the value of the number of times the enlargement operation, which will be described later, has been performed. Next, the display processing unit 10B acquires the visibility degree calculated in step S8 (S9D). Next, the display processing unit 10B
determines the screen enlargement method (vertical/horizontal enlargement ratio, display center, enlargement operation method) and the types and positions of icons to be presented on the screen, based on the number of enlargements and the degree of legibility (S9E). The vertical and horizontal enlargement ratios are determined based on the display magnification (large/medium/small) setting information set in the definition information 13B and the standard enlargement ratio predetermined at the time of design. The display processing unit 10B causes the storage unit 13 to store information on the determined enlargement method, icon type, and position.

Description will be made along the flowchart of FIG. 2 again. After completing the processing of step S9, the display processing unit 10B presents the icon determined in step S9 on the screen of the display unit 15 (S10). FIG. 15 is a diagram showing an example of a screen on which icons are displayed. The display processing unit 10B performs the screen display as shown in FIG. 15A in the process of step S1, and executes a series of processes from step S2 to step S9 to display an icon 151 as shown in FIG. 15B. is presented on the display screen 150 of the display unit 15 .

Then, when a tap operation (an example of a “touch operation” and an operation of pressing the screen only once) is performed on the icon 151 by executing a process described later, the display processing unit 10B performs the operation shown in FIG. As shown in (C), the grayed-out icon 151 indicating that the enlarged display function is disabled and inactive is changed to a clearly displayed icon that indicates that the enlarged display function is enabled and active. 152 and enlarges the content displayed on the display screen 150 . Further, when any portion of the content is tapped on the screen of FIG. 15(C), the display processing unit 10B displays the icon 152 as shown in FIG. The icon 153 is changed to indicate that it is possible, and the block corresponding to the site where the tap operation was performed is enlarged and displayed. The enlargement ratio of the block to be enlarged and displayed is the enlargement ratio determined in step S9E.

An icon 152 indicates that the content displayed on the display screen 150 can be enlarged and displayed. As an example of a design indicating that an enlarged display is possible, the icon 152 employs a design having a letter (“A”) and a plurality of lines extending radially from the letter above the letter. With such a design, the user can intuitively understand that the enlarged display is possible because the design reminds the user of enlarged display of the characters. When a tap operation is performed on this icon 152, the display processing unit 10B returns the screen display 150 to the state in which the enlarged display function is cancelled, that is, the state of the screen shown in FIG. 15(A).

The icon 153 indicates that the position of the portion of the content to be enlarged and displayed can be changed in block units. As an example of a design indicating that a position change operation can be performed on a block-by-block basis, the icon 153 adopts a design having four corners forming a substantially rectangular shape. With such a design, the user can intuitively understand that the position change operation can be performed on a block-by-block basis because the user can recall the blocks from the design. Note that the icon 153 indicates that a position change operation can be performed in block units, but is not a button for accepting a position change operation in block units. When a tap operation is performed on the icon 153, the display processing unit 10B restores the screen display 150 to the state before enlarging the block, that is, the state of the screen shown in FIG. 15(C).

Description will be made along the flowchart of FIG. 2 again. When the icon 151 is pressed by the user operation after the process of step S10, the display processing unit 10B enlarges and displays the content, and the upper and lower edges and the left and right edges of all displayed objects in the content are positioned at the edges of the display screen 150. The display of the content is enlarged in the horizontal direction and the vertical direction respectively so as to (fit) (see FIG. 15(C)). Then, when the display processing unit 10B detects a tap operation on any portion of the content displayed on the display screen 150 (S11), the display processing unit 10B performs the following processing to perform the tap operation on the portion corresponding to the tap operation. Enlarged display of the block to be displayed (Fig. 15 (D)
).

FIG. 16 is a first flowchart showing processing for enlarged display. The display processing unit 10B acquires the position (coordinates) where the tap operation in step S11 was performed (S12A). Next, the display processing unit 10B refers to the block area information stored in the storage unit 13 by the process of step S6, and determines whether the position of the tap operation acquired in step S12A is within the range set as the sentence block. It is determined whether or not (S12B). Then, when the position of the tap operation is the sentence block, the display processing unit 10B executes a display information calculation process after making an affirmative decision in step S12B.

FIG. 17 is a second flowchart showing processing for enlarged display. After making an affirmative determination in step S12B, the display processing unit 10B refers to the block area information stored in the storage unit 13 in step S6 (S12CA). Next, the display processing unit 10B determines the writing direction of the text block based on the referenced block area information (S12CB).

When the display processing unit 10B determines that the writing direction of the text block is vertical writing in the processing of step S12CB, it sets the division direction of the text block to the horizontal direction (S12CC). Here, the division of the text block means that when the text block does not fit on the screen when the text block is enlarged and displayed, the text block is divided into a plurality of text blocks in order to improve the visibility of the enlarged text block. This is a process for dividing and displaying.

After setting the division direction to the horizontal direction, the display processing unit 10B acquires the enlargement ratio determined in step S9E from the storage unit 13 (S12CD). Then, the display processing unit 10B divides the horizontal width of the text block enlarged by the magnification ratio by the horizontal width of the screen to calculate the number of divisions (S12CE). Then, the display processing unit 10B calculates the coordinates and size of each divided area when the sentence block is divided by the calculated number of divisions, and stores the calculation result in the storage unit 13 (S12CF).

Further, when the display processing unit 10B determines in the process of step S12CB that the writing direction of the text block is horizontal writing, the display processing unit 10B sets the division direction of the text block to the vertical direction (S12CG). Then, the display processing unit 10B acquires the enlargement ratio determined in step S9E from the storage unit 13 (S12CH). Then, the display processing unit 10B divides the height (vertical width) of the sentence block enlarged at the enlargement ratio by the height (vertical width) of the screen to calculate the number of divisions (S12CI). Then, the display processing unit 10B calculates the coordinates and size of each divided area when the sentence block is divided by the calculated number of divisions, and stores the calculation result in the storage unit 13 (S12CJ).

Description will be made along the flowchart of FIG. 16 again. The display processing unit 10B acquires the number of divisions calculated in step S12CE (S12D). Then, the display processing unit 10B determines whether or not the division number is 2 or more (S12E). Then, if the division number is 2 or more, the display processing unit 10B acquires the tap position in the sentence block based on the tap position information acquired in step S12A (S12F). Then, the display processing unit 10B identifies the divided area corresponding to the tapped position among the divided areas calculated in step S12CJ based on the tapped position in the text block. Then, the display processing unit 10B arranges the center of the identified divided area at the center of the screen, and displays it on the screen at the enlargement ratio acquired in step S12CH (S12G). Next, the display processing unit 10B performs display switching processing (S12H).

FIG. 18 is a third flowchart showing processing for enlarged display. The display processing unit 10B
Based on the division direction information set in step S12CC or S12CG, the division direction of the sentence block enlarged and displayed in step S12G is determined (S12HA).

When the display processing unit 10B determines in the process of step S12HA that the text block is divided in the horizontal direction, the display processing unit 10B next uses the coordinate and size information of each divided area stored in the storage unit 13 in the process of step S12CJ. Next, it is determined whether or not another divided area of the text block exists on the left side of the divided area displayed on the screen in step S12G (S12HB). When the display processing unit 10B makes an affirmative determination in the process of step S12HB, the display processing unit 10B displays the left scroll button 154 shown in FIG. 15(D) on the screen (S12HC). Next, the display processing unit 10B determines whether or not another divided area of the text block exists on the right side of the divided area displayed on the screen in step S12G (S12HD). When the display processing unit 10B makes an affirmative determination in the process of step S12HD, the display processing unit 10B displays the right scroll button 155 shown in FIG. 15(D) on the screen (S12HE). Then, when these scroll buttons are tapped, the display processing unit 10B slides the text block left or right so that the divided area tapped appears on the screen.

Further, when the display processing unit 10B determines in the process of step S12HA that the text block is divided in the vertical direction, in the process of step S12CJ, the display processing unit 10B displays the coordinates and size information of each divided area stored in the storage unit 13. Based on this, it is determined whether or not another divided area of the text block exists above the divided area displayed on the screen in step S12G (S12HF). Then, when the display processing unit 10B makes an affirmative determination in the process of step S12HF, the display processing unit 10B displays an upward scroll button on the screen (S12HG). Next, the display processing unit 10B determines whether or not another divided area of the text block exists below the divided area displayed on the screen in step S12G (S12HH). When the process of step S12HH makes an affirmative determination, the display processing unit 10B displays a downward scroll button on the screen (S12HI). Then, when these scroll buttons are tapped, the display processing unit 10B slides the text block upward or downward so that the divided area tapped appears on the screen.

Description will be made along the flowchart of FIG. 16 again. When the display processing unit 10B makes a negative determination in the process of step S12B, that is, when the tap operation is performed on a non-text block, the display processing unit 10B moves the non-text block to the tap position in the non-text block on the screen. It is placed in the center and displayed on the screen at the magnification determined in step S9E (S12I). Further, when the display processing unit 10B makes a negative determination in the process of step S12E, that is, when the tap operation is performed for a text block and the size is not divided, the text block is changed to the non-text block. is placed at the center of the screen, and displayed on the screen at the magnification determined in step S9E (S12J).

In the information processing apparatus 1 of the present embodiment, the following enlarged display is realized by executing the above-described series of processes (S1 to S12) every time content is displayed on the display unit 15. FIG.

FIG. 19 is a diagram showing a first example of enlarged display realized by the information processing apparatus 1 of this embodiment. For example, as shown in FIG. 19A, it is assumed that there is a text block B1 written vertically on the display screen 150, and that the width of the text block B1 is large enough to fit on the screen even if the text block B1 is enlarged and displayed. In FIG. 19A, the rectangular dashed line indicating the sentence block B1 is a virtual line added for convenience of explanation, and is not actually displayed on the display screen 150. FIG. When such a text block B1 is tapped with the finger H, the display processing unit 10B executes the process of step S12J, and displays the entire text block B1 as shown in FIG. 19B. The image is displayed enlarged to a size that can fit on the screen 150. - 特許庁

FIG. 20 is a diagram showing a second example of enlarged display realized by the information processing apparatus 1 of this embodiment. For example, as shown in FIG. 20, it is assumed that there is a text block B2 written horizontally on the display screen 150, and that when the text block B2 is enlarged and displayed, the vertical width does not fit on the screen.

In such text block B2, as shown in FIG. 20A1, when a tap operation is performed with the finger H near the upper end of the text block B2, the display processing unit 10B performs the process of step S12G. Then, as shown in FIG. 20(B1), the divided block near the upper end of the text block B2 is displayed enlarged to fit within the display screen 150. FIG. Further, the display processing unit 10B executes the process of step S12HI to display the downward scroll button 157 near the bottom end of the display screen 150. FIG.

Further, in such text block B2, as shown in FIG. 20A2, when a tap operation is performed with the finger H on the vicinity of the central portion of the text block B2, the display processing unit 10B performs step S12G. 20B2, the divided blocks near the center of the text block B2 are enlarged and displayed to fit within the display screen 150. As shown in FIG. Further, the display processing unit 10B executes the processes of steps S12HG and S12HI to display the up scroll button 156 near the upper end of the display screen 150 and the down scroll button 157 near the lower end of the display screen 150. FIG.

Further, in such a text block B2, as shown in FIG. 20A3, when a tap operation is performed with the finger H near the lower end of the text block B2, the display processing unit 10B performs a step S12G. The processing is executed, and as shown in FIG. 20B3, the divided block near the lower end of the sentence block B2 is enlarged and displayed to fit within the display screen 150. FIG. Further, the display processing unit 10B executes the process of step S12HG to display the up scroll button 156 near the upper end of the display screen 150. FIG.

FIG. 21 is a diagram showing a third example of enlarged display realized by the information processing apparatus 1 of this embodiment. For example, as shown in FIG. 21, it is assumed that there is a text block B3 written vertically on the display screen 150, and the width of the text block B3 is too large to fit on the screen when the text block B3 is enlarged and displayed.

In such text block B3, as shown in FIG. 21A1, when a tap operation is performed with the finger H on the vicinity of the left end of the text block B3, the display processing unit 10B performs the process of step S12G. Then, as shown in FIG. 21B1, the divided block near the left end of the text block B3 is displayed enlarged to fit within the display screen 150. FIG. Further, the display processing unit 10B executes the process of step S12HE to display the right scroll button 155 near the right end of the display screen 150. FIG.

Further, in such a text block B3, as shown in FIG. 21A2, when a tap operation is performed with the finger H on the vicinity of the central portion of the text block B3, the display processing unit 10B performs step S12G. , and the divided blocks near the central portion of the sentence block B3 are enlarged and displayed to fit within the display screen 150, as shown in FIG. 21B2. Further, the display processing unit 10B executes the processes of steps S12HC and S12HE to display the left scroll button 154 near the left end of the display screen 150 and the right scroll button 155 near the right end of the display screen 150. FIG.

Further, in such a text block B3, as shown in FIG. 21A3, when a tap operation is performed with the finger H near the right end of the text block B3, the display processing unit 10B performs a step S12G. 21B3, the divided block near the right end of the text block B3 is enlarged and displayed so as to fit within the display screen 150. Then, as shown in FIG. Further, the display processing unit 10B executes the process of step S12HC to display the left scroll button 154 near the left end of the display screen 150. FIG.

With the information processing apparatus 1 of the present embodiment, when the content displayed on the screen can be enlarged and displayed while maintaining the listability, an icon indicating that the enlarged display is possible is displayed. Is displayed. Then, the user, who has learned that the enlarged display is enabled by the icon, can read the enlarged and displayed sentences in a state where both ends of each line fit within the screen by performing a tap operation on the part of the sentences. That is, the head or tail of each line of the magnified and displayed sentence does not protrude from the screen, and the magnified display is performed in a state in which the browsability is maintained. Therefore, in order to read the sentence, the user can read the enlarged sentence without sliding the screen while reading one line or reducing the display content. .

In mobile devices such as smartphones, smartwatches, tablets, and mobile phones, when enlarging the information on the display screen to make it easier to see, with conventional enlarging methods, the information after enlarging does not fit within the screen, and continuous sentences are interrupted. However, there is a problem that a part of the image becomes invisible. On the other hand, in the information processing apparatus 1 of the above-described embodiment, in order to achieve both improvement in viewability and at-a-glance information, as described above, a captured image of the display screen is acquired, and a histogram of colors included in the image is obtained. is calculated to specify the background color, and then the sentence block is detected from the change in contrast with respect to the background color, thereby enlarging and displaying the sentence block specified by the user by tapping while maintaining the browsability. Also, depending on the attributes in the text block (block size, direction of text writing (vertical writing/horizontal writing), column width/line height), the screen enlargement ratio and the number of split display of the text block are determined. By dividing the block display into times or multiple times, it is possible to achieve both visibility and browsability.

In the information processing device 1 of the present embodiment, when the text block is divided into a plurality of divided areas, the display processing unit 10B expands the divided area corresponding to the tap position among the divided areas in the process of step S12G. was displaying. However, even when the text block is divided into a plurality of divided areas, the display processing unit 10B displays the divided block in which the first line of the text of the relevant text block is located in each of the divided areas in the process of step S12G. You may make it In the case of such a modification, for example, if the text block is written vertically, the display processing unit 10B displays the rightmost divided block in the text block among the divided areas in the process of step S12G. Further, for example, if the text block is written horizontally, the display processing unit 10B displays the uppermost divided block in the text block among the divided areas in the process of step S12G. With such a modified example, the user can immediately read the text of the text block enlarged and displayed by performing the tap operation from the first line.

Further, in the above-described embodiment, a tap operation was exemplified as an example of an operation on text blocks and non-text blocks, but operations on text blocks and non-text blocks are not limited to tap operations. Operations on sentence blocks and non-text blocks are, for example, non-touch operations, that is, selection operations by mechanical switches prepared separately from the touch panel, click operations by pointing devices such as mice, and other operations. good.

Further, in the above-described embodiment, a block is enlarged and displayed with the center of the block placed at the center of the display screen 150. The block may be enlarged and displayed within the display area with the center of the block positioned at the center of the displayed area.

Also, in the above embodiment, the icon is arranged at the lower right of the display screen 150, but the icon can be changed to an appropriate position by the user's setting operation or the like.

Further, in the above-described embodiment, the icon 152 is illustrated in FIG. 15C as an example of a design indicating that enlarged display is possible, but the design indicating that enlarged display is possible is not limited to this. The icon 152 may have, for example, a letter other than "A" and a plurality of lines radiating from the letter, or may have other designs.

In the above-described embodiment, the icon 153 is illustrated in FIG. 15D as an example of a design indicating that the position change operation can be performed in block units. is not limited to this. The icon 153 may have a design other than, for example, a design having four corners forming a substantially rectangular shape.

Further, in the above-described embodiment, the screen scrolls when the four types of scroll buttons 154 to 157 are pressed. Scrolling may be performed when the vicinity of the button is tapped.

Also, each constituent element of each part illustrated does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each part is not limited to the one shown in the figure, and all or part of it can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. can be configured as

Various processing functions performed by the information processing apparatus 1 may be executed in whole or in part on a CPU (or a microcomputer such as an MPU or MCU (Micro Controller Unit)). Also, various processing functions may be executed in whole or in part on a program analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware based on wired logic. It goes without saying that it is good.

Further, the program 13a of the storage unit 13 does not have to be stored in the storage unit 13 from the beginning. For example, the program 13a is stored in a "portable physical medium" such as a flexible disk inserted into the information processing apparatus 1, so-called FD, CD-ROM, DVD disk, magneto-optical disk, IC card, or the like. Then, the information processing apparatus 1 may acquire and execute the program 13a from these portable physical media. Alternatively, the program 13a may be stored in another computer or server device connected to the information processing apparatus 1 via a public line, the Internet, a LAN, a WAN, etc., and the information processing apparatus 1 may acquire the program 13a from these. You can also run

In addition, the present application discloses the following additional matters.
(Appendix 1)
a detection unit that detects a touch operation on the display screen of the display unit;
In a state where the content displayed on the display screen includes a plurality of blocks of a display object extracted based on a color difference from a background color, when a touch operation on one of the plurality of blocks is detected, the touch operation is performed. The operated block is arranged so that the center of the block in at least one of the vertical direction and the horizontal direction is the center of the display area set in the display screen, and at least a part of the block a display processing unit that displays in the display area at a predetermined magnification,
display device.
(Appendix 2)
The display processing unit
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the left and right of the text block arranging the center in the direction to be the center of the display area, and displaying at least a part of the text block on the display screen at the predetermined enlargement ratio at which the width of the text block fits within the width of the display area;
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Arrange so that the center in the vertical direction is the center of the display area, and at least part of the text block is displayed on the display screen at the predetermined enlargement ratio so that the vertical width of the text block fits within the vertical width of the display area. to display
The display device according to appendix 1.
(Appendix 3)
The display processing unit
if the block on which the touch operation is performed is of a size that can fit in the display area when displayed at the predetermined magnification, displaying the entire area of the block in the display area at the predetermined magnification;
If the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the block is divided into sizes that can be displayed in the display area at the predetermined magnification. displaying one of the plurality of divided areas in the display area at the predetermined magnification;
3. The display device according to appendix 1 or 2.
(Appendix 4)
When the block on which the touch operation is performed has a size that cannot be displayed in the display area when displayed at the predetermined magnification, the display processing unit has a size that can be displayed in the display area at the predetermined magnification. Displaying a divided area corresponding to a position within the block where the touch operation is performed, out of a plurality of divided areas obtained by dividing the block, in the display area at the predetermined magnification;
The display device according to appendix 3.
(Appendix 5)
When the block on which the touch operation is performed has a size that cannot be displayed in the display area when displayed at the predetermined enlargement rate, the display processing unit enlarges the divided area to the display area at the predetermined enlargement rate. displaying, and displaying on the display screen a sign suggesting movement for moving the display to another divided area adjacent to the divided area;
5. The display device according to appendix 3 or 4.
(Appendix 6)
When the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification, the display processing unit
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block is displayed in the display area at the predetermined enlargement ratio that fits within the width of the display area, and a vertical movement sign indicating a vertical direction to another divided area adjacent to the divided area is displayed on the display screen display, scroll to the touched side of the screen area,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Displaying the divided area in the display area at the predetermined enlargement ratio at which the vertical width fits within the vertical width of the display area, and displaying a horizontal movement sign indicating a horizontal direction to another divided area adjacent to the divided area. Display on the display screen and scroll to the touched side of the screen area,
6. The display device according to any one of appendices 3 to 5.
(Appendix 7)
When the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification, the display processing unit
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block display the uppermost divided area among the plurality of divided areas in the display area at the predetermined enlargement ratio so that the block fits within the horizontal width of the display area, and the block on which the touch operation is performed has a color difference from the background color. If the display object is a text block that is estimated to be a vertically written character string from the arrangement of the display object extracted based on the predetermined enlargement ratio, the vertical width of the text block fits within the vertical width of the display area. to display the rightmost divided area among the plurality of divided areas in the display area;
The display device according to appendix 3.
(Appendix 8)
When the block touched by the touch operation is a text block in which the display object is estimated to be a character string from the arrangement of the display object extracted based on the color difference from the background color, the display processing unit calculating the predetermined enlargement ratio based on attribute information about the text block;
8. The display device according to any one of appendices 1 to 7.
(Appendix 9)
a detection process for detecting a touch operation on the display screen of the display unit;
In a state where the content displayed on the display screen includes a plurality of blocks of a display object extracted based on a color difference from a background color, when a touch operation on one of the plurality of blocks is detected, the touch operation is performed. The operated block is arranged so that the center of the block in at least one of the vertical direction and the horizontal direction is the center of the display area set in the display screen, and at least a part of the block causing a computer to execute a display process for displaying in the display area at a predetermined magnification,
Display control program.
(Appendix 10)
In the display process,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the left and right of the text block arranging the center in the direction to be the center of the display area, and displaying at least a part of the text block on the display screen at the predetermined enlargement ratio at which the width of the text block fits within the width of the display area;
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Arrange so that the center in the vertical direction is the center of the display area, and at least part of the text block is displayed on the display screen at the predetermined enlargement ratio so that the vertical width of the text block fits within the vertical width of the display area. to display
The display control program according to appendix 9.
(Appendix 11)
In the display process,
if the block on which the touch operation is performed is of a size that can fit in the display area when displayed at the predetermined magnification, displaying the entire area of the block in the display area at the predetermined magnification;
If the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the block is divided into sizes that can be displayed in the display area at the predetermined magnification. displaying one of the plurality of divided areas in the display area at the predetermined magnification;
11. The display control program according to appendix 9 or 10.
(Appendix 12)
In the display process, if the block on which the touch operation is performed is of a size that cannot be displayed in the display area when displayed at the predetermined magnification, the block is displayed in a size that can be displayed in the display area at the predetermined magnification. Displaying a divided area corresponding to a position within the block where the touch operation is performed, out of a plurality of divided areas obtained by dividing the block, in the display area at the predetermined enlargement ratio;
The display control program according to appendix 11.
(Appendix 13)
In the display processing, if the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the divided area is displayed in the display area at the predetermined magnification. and causing the display screen to display a sign suggesting movement for moving the display to another divided area adjacent to the divided area.
13. The display control program according to appendix 11 or 12.
(Appendix 14)
In the display process, if the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block is displayed in the display area at the predetermined enlargement ratio that fits within the width of the display area, and a vertical movement sign indicating a vertical direction to another divided area adjacent to the divided area is displayed on the display screen display and scroll to the touched side of the screen area,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Displaying the divided area in the display area at the predetermined enlargement ratio at which the vertical width fits within the vertical width of the display area, and displaying a horizontal movement sign indicating a horizontal direction to another divided area adjacent to the divided area. Display on the display screen and scroll to the touched side of the screen area,
14. The display control program according to any one of appendices 11 to 13.
(Appendix 15)
In the display process, if the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block display the uppermost divided area among the plurality of divided areas in the display area at the predetermined enlargement ratio so that the block fits within the horizontal width of the display area, and the block on which the touch operation is performed has a color difference from the background color. If the display object is a text block that is estimated to be a vertically written character string from the arrangement of the display object extracted based on the predetermined enlargement ratio, the vertical width of the text block fits within the vertical width of the display area. to display the rightmost divided area among the plurality of divided areas in the display area;
The display control program according to appendix 11.
(Appendix 16)
In the display process, if the block to which the touch operation is performed is a text block whose display object is estimated to be a character string from the arrangement of the display object extracted based on the color difference from the background color, the text calculating the predetermined enlargement ratio based on attribute information about the block;
16. The display control program according to any one of Appendices 9 to 15.
(Appendix 17)
a detection process for detecting a touch operation on the display screen of the display unit;
In a state where the content displayed on the display screen includes a plurality of blocks of a display object extracted based on a color difference from a background color, when a touch operation on one of the plurality of blocks is detected, the touch operation is performed. The operated block is arranged so that the center of the block in at least one of the vertical direction and the horizontal direction is the center of the display area set in the display screen, and at least a part of the block A computer executes a display process for displaying in the display area at a predetermined magnification,
Display control method.
(Appendix 18)
In the display process,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the left and right of the text block arranging the center in the direction to be the center of the display area, and displaying at least a part of the text block on the display screen at the predetermined enlargement rate at which the width of the text block fits within the width of the display area;
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Arrange so that the center in the vertical direction is the center of the display area, and at least part of the text block is displayed on the display screen at the predetermined enlargement ratio so that the vertical width of the text block fits within the vertical width of the display area. indicate,
17. The display control method according to appendix 17.
(Appendix 19)
In the display process,
if the block on which the touch operation is performed is of a size that fits in the display area when displayed at the predetermined magnification, displaying the entire area of the block in the display area at the predetermined magnification;
If the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the block is divided into sizes that can be displayed in the display area at the predetermined magnification. displaying one of the plurality of divided regions in the display region at the predetermined magnification;
19. The display control method according to appendix 17 or 18.
(Appendix 20)
In the display process, if the block on which the touch operation is performed is of a size that cannot be displayed in the display area when displayed at the predetermined magnification, the block is displayed in a size that can be displayed in the display area at the predetermined magnification. Displaying a divided area corresponding to a position within the block where the touch operation is performed, out of a plurality of divided areas obtained by dividing the block, in the display area at the predetermined magnification;
19. The display control method according to appendix 19.
(Appendix 21)
In the display processing, if the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the divided area is displayed in the display area at the predetermined magnification. and displaying on the display screen a sign suggesting movement for moving the display to another divided area adjacent to the divided area.
21. The display control method according to appendix 19 or 20.
(Appendix 22)
In the display process, if the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block is displayed in the display area at the predetermined enlargement ratio that fits within the width of the display area, and a vertical movement sign indicating a vertical direction to another divided area adjacent to the divided area is displayed on the display screen display, scroll to the touched side of the screen area,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Displaying the divided area in the display area at the predetermined enlargement ratio at which the vertical width fits within the vertical width of the display area, and displaying a horizontal movement sign indicating a horizontal direction to another divided area adjacent to the divided area. Display on the display screen and scroll to the touched side of the screen area,
22. The display control method according to any one of appendices 19 to 21.
(Appendix 23)
In the display process, if the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block displays the uppermost divided area among the plurality of divided areas in the display area at the predetermined enlargement ratio that fits within the horizontal width of the display area; If the display object is a text block that is estimated to be a vertically written character string from the arrangement of the display object extracted based on the predetermined enlargement ratio, the vertical width of the text block fits within the vertical width of the display area. to display the rightmost divided area among the plurality of divided areas in the display area;
19. The display control method according to appendix 19.
(Appendix 24)
In the display process, if the block to which the touch operation is performed is a text block whose display object is estimated to be a character string from the arrangement of the display object extracted based on the color difference from the background color, the text calculating the predetermined enlargement ratio based on attribute information about the block;
24. The display control method according to any one of appendices 17 to 23.

1 information processing apparatus 10 control unit 10A detection unit 10B display processing unit 11 communication unit 11A antenna 12 audio input/output unit 12A speaker 12B microphone 13 storage Section 13A Program 13B Definition information 14 Operation section 15 Display section 150 Display screen 151 Icon 152 Icon 153 Icon 154 Left scroll button 155 Right scroll button 156 ..Up scroll button 157..Down scroll button B1..Text block B2..Text block B3..Text block H..Finger

Claims (8)

a detection unit that detects a touch operation on the display screen of the display unit;
In a state where the content displayed on the display screen includes a plurality of blocks of a display object extracted based on a color difference from a background color, when a touch operation on one of the plurality of blocks is detected, the touch operation is performed. The operated block is arranged so that the center of the block in at least one of the vertical direction and the horizontal direction is the center of the display area set in the display screen, and at least a part of the block a display processing unit that displays in the display area at a predetermined magnification ,
The display processing unit
if the block on which the touch operation is performed is of a size that can fit in the display area when displayed at the predetermined magnification, displaying the entire area of the block in the display area at the predetermined magnification;
If the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the block is divided into sizes that can be displayed in the display area at the predetermined magnification. Any one of the plurality of divided regions is displayed in the display region at the predetermined magnification, and a sign suggesting movement for moving the display to another divided region adjacent to the divided region is displayed. display on the display screen;
display device. The display processing unit
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the left and right of the text block arranging the center in the direction to be the center of the display area, and displaying at least a part of the text block on the display screen at the predetermined enlargement ratio at which the width of the text block fits within the width of the display area;
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Arrange so that the center in the vertical direction is the center of the display area, and at least part of the text block is displayed on the display screen at the predetermined enlargement ratio so that the vertical width of the text block fits within the vertical width of the display area. to display
The display device according to claim 1. When the block on which the touch operation is performed has a size that cannot be displayed in the display area when displayed at the predetermined magnification, the display processing unit has a size that can be displayed in the display area at the predetermined magnification. Displaying a divided area corresponding to a position within the block where the touch operation is performed, out of a plurality of divided areas obtained by dividing the block, in the display area at the predetermined magnification;
The display device according to claim 1 or 2 . When the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification, the display processing unit
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block is displayed in the display area at the predetermined enlargement ratio that fits within the width of the display area, and a vertical movement sign indicating a vertical direction to another divided area adjacent to the divided area is displayed on the display screen display, scroll to the touched side of the screen area,
If the block on which the touch operation is performed is a text block whose display object is estimated to be a vertically written character string from the arrangement of the display object extracted based on the color difference from the background color, the text block Displaying the divided area in the display area at the predetermined enlargement ratio at which the vertical width fits within the vertical width of the display area, and displaying a horizontal movement sign indicating a horizontal direction to another divided area adjacent to the divided area. Display on the display screen and scroll to the touched side of the screen area,
The display device according to any one of claims 1 to 3 . When the block on which the touch operation is performed has a size that does not fit in the display area when displayed at the predetermined magnification, the display processing unit
If the block on which the touch operation is performed is a text block whose display object is estimated to be a horizontally written character string from the arrangement of the display object extracted based on the color difference from the background color, the width of the text block display the uppermost divided area among the plurality of divided areas in the display area at the predetermined enlargement ratio so that the block fits within the horizontal width of the display area, and the block on which the touch operation is performed has a color difference from the background color. If the display object is a text block that is estimated to be a vertically written character string from the arrangement of the display object extracted based on the predetermined enlargement ratio, the vertical width of the text block fits within the vertical width of the display area. to display the rightmost divided area among the plurality of divided areas in the display area;
The display device according to claim 1 . When the block touched by the touch operation is a text block in which the display object is estimated to be a character string from the arrangement of the display object extracted based on the color difference from the background color, the display processing unit calculating the predetermined enlargement ratio based on attribute information about the text block;
The display device according to any one of claims 1 to 5 . a detection process for detecting a touch operation on the display screen of the display unit;
In a state where the content displayed on the display screen includes a plurality of blocks of a display object extracted based on a color difference from a background color, when a touch operation on one of the plurality of blocks is detected, the touch operation is performed. The operated block is arranged so that the center of the block in at least one of the vertical direction and the horizontal direction is the center of the display area set in the display screen, and at least a part of the block Display processing for displaying in the display area at a predetermined magnification, and causing a computer to execute
In the display process,
If the block on which the touch operation is performed is of a size that fits within the display area when displayed at the predetermined magnification, the entire area of the block is displayed in the display area at the predetermined magnification.
height,
If the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the block is divided into sizes that can be displayed in the display area at the predetermined magnification. Any one of the plurality of divided regions is displayed in the display region at the predetermined magnification, and a sign suggesting movement for moving the display to another divided region adjacent to the divided region is displayed. display on the display screen;
Display control program. a detection process for detecting a touch operation on the display screen of the display unit;
In a state where the content displayed on the display screen includes a plurality of blocks of a display object extracted based on a color difference from a background color, when a touch operation on one of the plurality of blocks is detected, the touch operation is performed. The operated block is arranged so that the center of the block in at least one of the vertical direction and the horizontal direction is the center of the display area set in the display screen, and at least a part of the block is displayed in the display area at a predetermined magnification, and
In the display process,
if the block on which the touch operation is performed is of a size that can fit in the display area when displayed at the predetermined magnification, displaying the entire area of the block in the display area at the predetermined magnification;
If the block touched by the touch operation is too large to fit in the display area when displayed at the predetermined magnification, the block is divided into sizes that can be displayed in the display area at the predetermined magnification. Any one of the plurality of divided regions is displayed in the display region at the predetermined magnification, and a sign suggesting movement for moving the display to another divided region adjacent to the divided region is displayed. display on the display screen;
Display control method.

Images