JP2023018832A - Display method and display device - Google Patents

Abstract

To reduce the labor of switching a display mode when displaying page images of a document.SOLUTION: A display method includes: a detection step of causing a display device 1 to detect a display size when multiple page images PG are displayed in a document display area 201 arranged on a display screen 141; and a selection step of selecting a display mode in the document display area 201. The detection step includes detecting a difference length BD. The selection step includes causing to select, when the difference length BD is equal to or greater than a display setting value, a multiple page display mode for displaying a plurality of page images PG side by side, or when the difference length BD is less than the display setting value, a single page display mode for displaying one of the page images PG.SELECTED DRAWING: Figure 3

Description

The present invention relates to a display method and a display device.

2. Description of the Related Art Conventionally, a technique for displaying pages of a document on a display device such as a smart phone is known. A display device described in Patent Document 1 displays a thumbnail image of each page of an electronic book or an electronic photograph. In addition, according to the user's operation of selecting a thumbnail image, two pages of images corresponding to the selected thumbnail image are displayed side by side.

Japanese Patent Application Laid-Open No. 2020-71500

A display mode in which images of a plurality of pages are displayed side by side, as described in Patent Document 1, is useful because a large amount of information can be viewed at the same time. Also, as a display mode for displaying pages of a document, displaying an image of one page is also conceivable. This display mode has the advantage that the page is displayed in a large size. As described above, there are a plurality of document display modes, and each display mode has advantages. However, when switching between these display modes, it takes time and effort to perform the switching operation. Therefore, there is a need to reduce the time and effort required for switching display modes.

One aspect of solving the above problem is a display method for displaying a document on a display device having a display screen, wherein a page image, which is an image of a page constituting the document, is displayed in a document display area arranged on the display screen. and a selection step of selecting a display mode in the document display area based on the detection result of the detection step. detecting a difference length, which is a difference in the direction along the first axis of the document display area, between the length of the entire image formed by arranging the page images of and the length of the document display area; When the difference length is equal to or greater than the display setting value, a multiple page display mode in which a plurality of the page images are displayed side by side is selected, and when the difference length is smaller than the display setting value, one page image is displayed. This display method allows selection of a one-page display mode to be displayed.

Another aspect of solving the above problem relates to a display unit having a display screen and a display size when displaying a plurality of page images, which are images of pages constituting a document, in a document display area arranged on the display screen. a detection unit that performs detection; a selection unit that selects a display mode in the document display area based on the detection result of the detection unit; is displayed in the document display area, and the detection unit determines the length of the entire image formed by arranging the plurality of page images and the length of the document display area. A difference length that is a difference in a direction along the first axis is detected, and the selection unit selects a multiple page display mode in which the plurality of page images are displayed side by side when the difference length is equal to or greater than a display setting value. and selecting a one-page display mode for displaying one page image when the difference length is smaller than the display set value.

1 is a configuration diagram of a printing system according to an embodiment; FIG. FIG. 11 is a screen diagram showing an example of a preview screen when the one-page display mode is executed; FIG. 11 is a screen diagram showing an example of a preview screen when the two-page display mode is executed; FIG. 11 is a screen diagram showing an example of a preview screen when the two-page display mode is executed; 4 is a flowchart showing processing of a control unit of a smartphone; 4 is a flowchart showing processing of a control unit of a smartphone; 4 is a flowchart showing processing of a control unit of a smartphone; FIG. 11 is a screen diagram showing an example of a preview screen when the two-page display mode is executed; FIG. 3 is an external view of a display device as another application example;

Hereinafter, this embodiment will be described with reference to the drawings.

A printing system 100 according to this embodiment will be described.
FIG. 1 is a diagram showing an example of the configuration of a printing system 100 and a smartphone 1. As shown in FIG.

A printing system 100 includes a smartphone 1 and a printer 2 .
The smartphone 1 and the printer 2 are communicably connected by short-range wireless communication such as Bluetooth (registered trademark) or NFC (Near Field Communication). Also, the smartphone 1 and the printer 2 are communicably connected by wireless communication such as Wi-Fi (registered trademark). Wireless communication using Wi-Fi enables high-speed communication compared to short-range wireless communication such as NFC.

The smartphone 1 selects a print target based on an operation from the user, and transmits print instruction information CM instructing printing of the selected print target. The smartphone 1 may directly transmit the print instruction information CM to the printer 2 or may transmit it to the printer 2 via a server device or the like.
The printer 2 prints the print target on a print medium such as print paper based on the print instruction information CM from the smartphone 1 .

The smartphone 1 is communicably connected to a personal computer or server device (not shown) through wireless communication such as Wi-Fi. The smartphone 1 acquires document information DC from a personal computer or server device.

The smartphone 1 includes a control unit 11 , a touch panel 14 , an orientation sensor 15 and a communication interface 16 .
The control unit 11 controls each unit of the smartphone 1 .
The touch panel 14 receives operations from the user and displays various images. The touch panel includes a display 141 such as an LCD (Liquid Crystal Display) and a touch sensor 142 .

Display 141 displays various images according to instructions from control unit 11 .
The touch sensor 142 is formed integrally with the display surface of the display 141 and receives touch operations from the user. The touch sensor 142 is configured by, for example, a capacitive sensor or a pressure-sensitive sensor. A touch operation is an operation in which an indicator such as a user's finger or a pen for touch input is brought into contact with the surface of the display 141 . The touch sensor 142 generates an operation signal including a touch position when a touch operation is performed. The touch sensor 142 outputs an operation signal to the control section 11 . The touch sensor 142 may be configured to detect a multi-touch operation in which multiple positions on the touch sensor 142 are touched simultaneously. The display 141 corresponds to an example of a "display screen". The touch sensor 142 can be called an "input unit." The touch panel 14 corresponds to an example of a "display unit".

Modes of user operation on the touch sensor 142 include, for example, a long touch operation, a swipe operation, and a pinch operation, in addition to a touch operation in which an indicator is brought into contact with the surface of the display 141 . A long-touch operation is an operation in which an indicator that is in contact with the display 141 is kept in contact with the touch sensor 142 for a predetermined time or longer without being separated from the touch sensor 142 . A swipe operation is also called a flick operation. A swipe operation is an operation of bringing an indicator into contact with the display 141 and moving the indicator while maintaining the contact. A pinch operation is an operation of bringing a plurality of pointers into contact with the touch sensor 142 and changing the distance between the pointers while keeping the pointers in contact with the touch sensor 142 . The touch sensor 142 may be configured to determine these operation modes and output an operation signal indicating the operation mode to the control unit 11 . Alternatively, the touch sensor 142 may be configured to generate an operation signal indicating the contact position at a preset sampling period. In this case, the control unit 11 may be configured to determine the mode of operation performed by the user based on the operation signal input from the touch sensor 142 .

The orientation sensor 15 is a sensor that detects the orientation of the smartphone 1 . The attitude sensor 15 is configured by an acceleration sensor, a gyro sensor, a magnetic sensor, or a combination thereof. These sensors may be triaxial sensors. The orientation sensor 15 may be a sensor unit that integrates multiple sensors. Specifically, the attitude sensor 15 may be an inertial measurement unit (IMU) having a 3-axis acceleration sensor and a 3-axis gyro sensor.

The communication interface 16 includes a wireless communication interface circuit including an antenna, an RF (Radio Frequency) circuit, an encoder, a decoder, and the like.
The communication interface 16 communicates with the printer 2 by short-range wireless communication using Bluetooth or NFC according to instructions from the control unit 11 . The communication interface 16 communicates with a server device (not shown) and the printer 2 by wireless communication such as Wi-Fi. The smartphone 1 corresponds to an example of a "display device".

In this embodiment, the communication interface 16 communicates with the printer 2 by short-range wireless communication such as Bluetooth or NFC, but is not limited to this. The communication interface 16 may communicate with the printer 2 by performing other wireless communication such as Wi-Fi. The communication interface 16 may perform wired communication with the printer 2 according to the Ethernet (registered trademark) standard or the like.

The control unit 11 is a controller that includes a processor 12 and memory 13 .
The memory 13 is a storage device that stores programs and data executed by the processor 12 in a non-volatile manner. The memory 13 is a magnetic storage device such as a HDD (Hard Disk Drive), a semiconductor storage device such as an SSD (Solid State Drive), a semiconductor storage device such as a flash ROM (Read Only Memory), or other types of non-volatile storage. Constructed by the device. The memory 13 may include a RAM (Random Access Memory) forming a work area of the processor 12 . The memory 13 stores data processed by the control unit 11 and programs executed by the processor 12 .

The memory 13 stores an OS (operating system) 131 and an APP (application program) 132 as programs to be executed by the processor 12 . OS131 is a control program which implement|achieves the basic function of the smart phone 1, and provides a platform to APP132. The OS 131 is, for example, an Android (registered trademark) OS, a Windows (registered trademark) OS, or an iOS (registered trademark), but may be another OS.

The APP 132 is a program that implements specific functions of the smart phone 1 . APP132 of this embodiment has the function to display an image based on document data. When the power is turned on, the smartphone 1 loads and executes the OS 131, and transitions to a state in which the APP 132 can be executed. The smartphone 1 activates the APP 132 according to the user's operation or the like. Here, the smartphone 1 may be configured to be capable of executing not only the APP 132 but also a plurality of application programs. That is, the memory 13 may be configured to store a plurality of application programs, but the description of these configurations will be omitted.

The memory 13 stores setting values 135 . The set values 135 include reference values and set values that are referred to in processing executed by the processor 12 .

The processor 12 may be composed of a single processor, or may be configured such that multiple processors function as the processor 12 . The processor 12 executes programs stored in the memory 13 to control each part of the smartphone 1 .

In this embodiment, the processor 12 controls each unit of the smartphone 1 by executing the OS 131 and APP 132, but the control unit 11 may be ASIC (Application Specific Integrated Circuit). The ASIC may perform processing depending on the implemented functions. The control unit 11 may be a signal processing circuit. The signal processing circuit may perform signal processing to perform processing.

The control unit 11 includes a display control unit 121, a detection unit 122, a selection unit 123, and a reception unit 124 as functional blocks.

By executing the APP 132 by the processor 12, the processor 12 functions as a display control unit 121, a detection unit 122, a selection unit 123, and a reception unit 124. The processor 12 causes the memory 13 to function as a document information storage unit 133 and an image information storage unit 134 by executing the APP 132 .

The document information storage unit 133 stores document information DC. The document information DC is data having a document format such as a PDF (Portable Document Format) format or a JPEG (Joint Photographic Experts Group) format. The document information storage unit 133 stores at least one piece of document information DC for one document. The document information DC includes various information regarding the page number, arrangement order, size, page shape, etc. of the pages constituting the document. The document information storage unit 133 may be capable of storing a plurality of pieces of document information DC. The smartphone 1 , for example, acquires the document information DC from a personal computer or a server device through the communication interface 16 and stores it in the document information storage unit 133 .

The image information storage unit 134 stores various images and screens displayed on the display 141 . The image information storage unit 134 stores print images PP, thumbnail images PS, and button images BT. The print image PP constitutes the page image PG displayed on the display 141 . That is, the smartphone 1 displays the page image PG based on the print image PP. Also, the thumbnail image PS and the button image BT constitute the preview screen 200 . The button image BT is an operation image for switching display modes, which will be described later, when the user performs a touch operation. The page image PG, thumbnail image PS, and button image BT will be further described with reference to FIG.

The display control unit 121 controls the display 141 to display on the display 141 a screen including information regarding the operating state of the smartphone 1 and execution of the APP 132 . For example, the display control section 121 generates display data for displaying the preview screen 200 . Display control unit 121 causes display 141 to display preview screen 200 by outputting display data to display 141 .

The preview screen 200 is a screen for the user to visually confirm the state of the printed material that the smartphone 1 causes the printer 2 to print before printing. The preview screen 200 is displayed when the APP 132 is activated by user's operation. Therefore, the user can display the preview screen 200 for viewing the document even when the printer 2 does not print. For this reason, the preview screen 200 can be called a viewing screen for viewing documents.

The detection unit 122 detects the display size when displaying the document to be displayed on the preview screen 200 . A document to be displayed is selected from documents stored in the document information storage unit 133 . For example, when the APP 132 is activated, the document displayed when the APP 132 was activated immediately before may be selected as the document to be displayed. Alternatively, the document to be displayed may be selected according to the user's operation after the APP 132 is activated. The detection unit 122 detects the display size when the page images PG of the pages constituting the document to be displayed are displayed on the preview screen 200 . Details of the detection performed by the detection unit 122 will be described later.

Selection unit 123 selects a display mode of preview screen 200 . As the display mode of the preview screen 200, either one of a one-page display mode in which one page image PG is displayed and a multi-page display mode in which a plurality of page images PG are displayed side by side on the preview screen 200 is selected. In this embodiment, the two-page display mode will be described as an example of the multiple-page display mode. The two-page display mode is a display mode in which two page images PG are displayed side by side on the preview screen 200 . When the two-page display mode is executed, the contents of two pages of the document are displayed side by side on the preview screen 200 .

The accepting unit 124 accepts an operation on the smartphone 1 performed by the user. Accepting unit 124 accepts an operation performed by the user based on an operation signal input from touch sensor 142 . The accepting unit 124 has at least a function of accepting a touch operation. The reception unit 124 may have, for example, a function of identifying the above-described long-touch operation, swipe operation, and pinch operation. The reception unit 124 identifies the content of the operation performed by the user based on the operation position on the display 141 . For example, the reception unit 124 identifies an operation on the button image BT, an operation on the thumbnail image PS, and the like.

FIG. 2 is a screen diagram showing an example of a preview screen 200 when the one-page display mode is executed.
FIG. 2 shows the main body 10 of the smartphone 1. As shown in FIG. A display 141 is arranged on the front surface of the main body 10 of the smartphone 1 . Almost the entire portion of the display 141 exposed on the front surface of the main body 10 is the display area of the display 141 .

A preview screen 200 includes a document display area 201 and a thumbnail display area 202 . 2 and FIGS. 3, 4, and 8, which will be described later, show an example in which the preview screen 200 is displayed in the entire display area of the display 141. However, the preview screen 200 is displayed only in part of the display area of the display 141. may be displayed. In these figures, the document display area 201 is arranged in the upper part of the preview screen 200, the thumbnail display area 202 is arranged in the lower part of the preview screen 200, and the document display area 201 and the thumbnail display area 202 do not overlap each other. indicates In each figure, there is a gap between the document display area 201 and the thumbnail display area 202, but this is a modification for easier understanding of the figure. In the preview screen 200, the document display area 201 and the thumbnail display area 202 may be arranged without a gap. Also, the display area of the display 141 and the preview screen 200 may completely match.

FIG. 2 and FIGS. 3, 4, and 8, which will be described later, show the X-axis and the Y-axis as references for directions on the preview screen 200. FIG. The X axis is an axis parallel to the horizontal direction of the preview screen 200 . The Y-axis is orthogonal to the X-axis and parallel to the vertical direction of the preview screen 200 . The X-axis corresponds to an example of the first axis, and the Y-axis corresponds to an example of the second axis.

In addition, directions R and L along the X-axis direction are shown in the drawing. Direction R corresponds to the right direction on preview screen 200 . Direction L corresponds to the left direction on preview screen 200 . Similarly, directions UP and DW along the Y-axis are shown in the figure. Direction UP corresponds to the upward direction on preview screen 200 . Direction DW corresponds to the downward direction on preview screen 200 . These respective directions are referred to as a right direction R, a left direction L, an upward direction UP, and a downward direction DW in the following description.

In each figure, the size of the document display area 201 in the direction along the X-axis is defined as the display area width WD, and the size of the document display area 201 in the direction along the Y-axis is defined as the display area height LD. The display area width WD can be called the size of the document display area 201 in the horizontal direction, and the display area height LD can be called the size of the document display area 201 in the vertical direction.

A page image PG is arranged in the document display area 201 . The page image PG is an image of a page that constitutes a document, and is an image generated from the print image PP as described above.

In the one-page display mode, one page image PG is arranged in the center of the document display area 201 . The display control unit 121 adjusts the display size of the page image PG to match the size of the document display area 201 . In a typical example, the size of the page image PG in the direction along the X-axis is equal to or smaller than the display area width WD, and the size of the page image PG in the direction along the Y-axis is equal to or smaller than the display area height LD. It is expanded so that it may become the maximum in a certain range below. Here, the display control unit 121 enlarges the page image PG while maintaining the aspect ratio of the page image PG. Therefore, when the page image PG is a vertically long image that is long in the vertical direction, as shown in FIG. PG is displayed. On the other hand, when the page image PG is a horizontally long image, the page image PG is displayed so that the size of the page image PG in the direction along the X axis matches the display area width WD.

In the example shown in FIG. 2, in the document display area 201, blank areas B are generated in the left direction L and right direction R of the page image PG. A blank area B positioned in the left direction L of the page image PG is defined as a blank area B1, and a blank area B positioned in the right direction R of the page image PG is defined as a blank area B2. The blank area B1 and the blank area B2 are referred to as a blank area B when not distinguished from each other. The sizes of the blank areas B1 and B2 in the direction along the X axis are blank sizes BD1 and BD2, respectively.

In the thumbnail display area 202, a thumbnail image group SG including thumbnail images PS of each page included in the document to be displayed is displayed. The thumbnail image group SG includes thumbnail images PS corresponding to at least some of the pages included in the document to be displayed, and may include thumbnail images PS of all pages. In the thumbnail display area 202, the thumbnail image PS shows the content of the page of the document in an oblique state. At the center of the thumbnail display area 202 along the X-axis, the thumbnail image PS is displayed enlarged to the extent that its contents can be identified, and at both ends a large number of thumbnail images PS are displayed in an overlapping state. The display control unit 121 moves the thumbnail images PS in the thumbnail display area 202 according to the user's operation. When accepting unit 124 accepts a swipe operation to move thumbnail image PS in left direction L or right direction R, display control unit 121 moves thumbnail image PS according to the direction of the swipe operation. Thereby, the user can move the thumbnail image PS of the desired page to the center of the thumbnail display area 202 .

When accepting unit 124 accepts an operation to select any one thumbnail image PS in thumbnail display area 202, display control unit 121 identifies the page corresponding to the touch-operated thumbnail image PS. The display control unit 121 displays the page image PG of the identified page in the document display area 201 . This operation is, for example, a touch operation on one thumbnail image PS or an operation of swiping the thumbnail image PS upward.

In this manner, while the preview screen 200 is displayed, the user can select a page of the document while looking at the thumbnail image PS in the thumbnail display area 202, and the page image PG of the selected page is displayed in the document display area. 201 is enlarged and displayed.

A button image BT is displayed on the preview screen 200 . A button image BT is arranged in the document display area 201 . The button image BT is a so-called floating button. Therefore, the display control unit 121 can arrange the button image BT both at a position overlapping the page image PG and at a position not overlapping the page image PG. For example, the display control unit 121 moves the display position of the button image BT according to the user's flick operation. The button image BT corresponds to an example of a "switch button".

The button image BT is a button for instructing switching of the display mode of the preview screen 200. When the accepting unit 124 accepts a touch operation on the button image BT, the display control unit 121 switches between the one-page display mode and the two-page display mode. switch between modes.

FIG. 3 is a screen diagram showing an example of the preview screen 200 when the two-page display mode is executed.
In FIG. 3, two page images PG are assumed to be page images PG1 and PG2, respectively. The page image PG1 and the page image PG2 are images of different pages. For example, the page image PG2 is an image of the page next to the page image PG1 in the document to be displayed. When these are not distinguished, they are written as page image PG. Also, the page image PG1 and the page image PG2 are collectively referred to as a whole image TG. Also, let the size of the entire image TG in the direction along the X-axis be the entire image width WP. In the entire image TG, the page image PG1 and the page image PG2 are not overlapped with each other and are arranged side by side without a gap. The direction in which the page image PG1 and the page image PG2 are arranged is determined based on the document information DC. Specifically, the display control unit 121 determines the arrangement direction of the page images PG1 and PG2 according to the arrangement of pages in the document to be displayed. For example, when the document to be displayed is a document in which pages are arranged in the horizontal direction, the page image PG1 and the page image PG2 are arranged in the horizontal direction.

In the example of FIG. 3, the size of the entire image TG matches the display area height LD in the direction along the Y axis. That is, the entire image TG is maximized in the document display area 201 . In this example, since the page images PG1 and PG2 are vertically long page images, a blank area B1 is generated in the left direction L of the overall image TG, and a blank area B2 is generated in the right direction R of the overall image TG. .

The display control unit 121 may enlarge the entire image TG larger than the state shown in FIG. In this case, the display control unit 121 can enlarge the entire image TG within a range in which the text MC of the page images PG1 and PG2 does not protrude from the display area width WD of the document display area 201 . The body MC is characters and images included in the document to be displayed. The outside of the body MC in the page images PG1 and PG2 indicates the margins included in the page of the document. The display control unit 121 enlarges the entire image TG so that the size of the text MC is equal to or less than the display area height LD and the display area width WD or less. The margins of the page images PG1 and PG2 that protrude from the document display area 201 are not displayed.

FIG. 4 is a screen diagram showing an example of the preview screen 200 when the two-page display mode is executed, and particularly shows an example in which the pages included in the document to be displayed are horizontally long.
In the example of FIG. 4, the page images PG1 and PG2 are horizontally long page images. Therefore, the overall image TG has a shape elongated in the horizontal direction as a whole. By enlarging the whole image TG according to the size of the document display area 201, the whole image width WP matches the display area width WD, and the vertical size of the whole image TG is smaller than the display area height LD.

As shown in FIGS. 2 and 3, when the document to be displayed includes vertically long pages, the display size of the page image PG in the one-page display mode and the display size of the page image PG1 in the two-page display mode are significantly different. do not have. The same applies to the page image PG2. Therefore, the user can clearly see the content of the page image PG in both the one-page display mode and the two-page display mode. Also, the two-page display mode shown in FIG. 3 is convenient because the user can view the contents of a plurality of page images PG1 and PG2 at the same time. Therefore, when displaying the documents illustrated in FIGS. 2 and 3, the two-page display mode is preferable.

On the other hand, as shown in FIG. 4, when a document to be displayed includes horizontally long pages, the page image PG1 can be enlarged and displayed more greatly in the one-page display mode than in the two-page display mode. The same applies to the page image PG2. Therefore, when displaying the document illustrated in FIG. 4, the one-page display mode is preferable.

When displaying the preview screen 200 by executing the APP 132, the smart phone 1 has a function of selecting the one-page display mode or the two-page display mode as the display mode of the preview screen 200 according to the document to be displayed. . When executing this function, the detection unit 122 detects the blank size BD when executing the two-page display mode.

For example, when displaying the document illustrated in FIG. 3, the detection unit 122 detects the sizes of the margin sizes BD1 and BD2. The detection unit 122 determines the display size of the entire image TG based on the aspect ratio of the print image PP and the display area width WD and display area height LD of the document display area 201 .

In this case, the detection unit 122 determines the display size of the overall image TG so that the size of the overall image TG in the vertical direction is equal to the display area height LD, as described above. Therefore, the display size of the entire image TG in the direction along the Y-axis of the display 141 matches the display area height LD. The total image width WP may exceed the display area width WD. That is, it includes a state in which the entire image TG protrudes in the horizontal direction of the document display area 201 .

The detection unit 122 detects the margin size BD, which is the difference between the entire image width WP and the display area width WD, by subtracting the entire image width WP from the display area width WD, as shown in the following formula (1). . The margin size BD is the sum of the margin size BD1 and the margin size BD2. In the example described here, the margin size BD can also be negative.
BD=WD-WP (1)

The selection unit 123 compares the value of the blank size BD calculated by the detection unit 122 with a preset value. This value is used as the display setting value. The display setting value is included in the setting value 135 and stored in the memory 13 . The value of the margin size BD and the display setting value are values in units of 1 dot or 1 pixel of the display resolution of the display 141, for example. The value of the margin size BD and the display setting value may be values obtained by converting the display size into millimeters.

The selection unit 123 selects the two-page display mode when the blank size BD is equal to or larger than the display setting value. The selection unit 123 selects the one-page display mode when the blank size BD is smaller than the display setting value. The display setting value may be zero. In this case, the selection unit 123 selects the two-page display mode when the entire image width WP matches the display area width WD.

The display setting value may be a negative value. In this case, in the two-page display mode, the entire image TG is displayed in the document display area 201 with a portion of the entire image TG protruding from the document display area 201 . The display setting value in this case is preferably a value such that the text MC of the page images PG1 and PG2 does not protrude from the document display area 201. FIG.

That the blank size BD is equal to or greater than the display setting value means that the display sizes of the page images PG1 and PG2 in the two-page display mode are the same as or similar to those in the one-page display mode. In such a case, the visibility of the contents of the page images PG1 and PG2 in the two-page display mode is not inferior to that in the one-page display mode. Therefore, it is preferable to display in the two-page display mode.

In the above process, the detection unit 122 may detect the size of the margin based on the body MC of the page images PG1 and PG2.
That is, the detection unit 122 may calculate the content blank width ND instead of the blank size BD. The content margin width ND is the difference between the width of the text MC included in the entire image TG and the display area width WD. The width of the body MC is the size in the direction along the X-axis of the area containing the body MC in the entire image TG, and is the body width WMC shown in the drawing. The size of the body MC and the body width WMC are included in the document information DC as, for example, a ratio to the page size.

The detection unit 122 determines the display size of the entire image TG so that the vertical size of the text MC is equal to the display area height LD. In other words, the detection unit 122 determines the display size of the entire image TG so that the body MC is fully enlarged in the document display area 201 in the vertical direction. Therefore, the display size of the text MC in the direction along the Y-axis of the display 141 matches the display area height LD.

The detection unit 122 detects the content margin width ND by subtracting the body width WMC from the display area width WD, as shown by the following formula (2). The content margin width ND is the sum of the content margin width ND1 in the left direction L of the body MC and the content margin width ND2 in the right direction R of the body MC. The selection unit 123 compares the content margin width ND with the display setting value, and selects the two-page display mode when the content margin width ND is equal to or greater than the display setting value. When the detection unit 122 detects the content margin width ND, the display setting value is set so as not to include negative values. That is, the display setting value is a value belonging to a range including 0 and positive values.
ND=WD-WMC (2)

5, 6, and 7 are flowcharts showing processing of the control unit 11 of the smartphone 1. FIG. 6 and 7 detail a portion of the process shown in FIG.
In step S<b>1 , the control unit 11 loads the APP 132 and activates the APP 132 according to the user's operation.

In step S<b>2 , the control unit 11 causes the detection unit 122 to perform detection processing. Details of the detection process executed in step S2 are shown in FIG.

In step S<b>21 , the detection unit 122 identifies the size of the document display area 201 . Specifically, the detector 122 identifies the display area width WD and the display area height LD.
In step S22, the detection unit 122 identifies the shape of the page included in the document to be displayed. The shape of the page is specifically the aspect ratio of the page, which is the ratio of the length of the page in the direction along the X-axis to the length of the page in the direction along the Y-axis. The shape of the page may be portrait or landscape. Further, in step S22, the detection unit 122 may specify the standard size and orientation of the page. For example, the detection unit 122 identifies that the page is a standard A6 size vertical page. The shape of the page defines the shape of the page image PG.

In step S22, if the document to be displayed includes pages of different shapes, the detection unit 122 identifies the shape of one of the pages.
As a first method, the detection unit 122 identifies the shape of the page positioned at the top of the document, and uses the identified page shape as the page shape of the document to be displayed. A document to be displayed has a configuration in which a plurality of pages are arranged in order. According to the first method, by specifying the shape of the first page, the detection unit 122 can specify the shape of the pages of the document to be displayed without determining the shapes of the pages after the second page.

As a second method, the detection unit 122 may specify the shapes of all pages of the document to be displayed, and determine the shape corresponding to the most pages as the shape of the pages of the document to be displayed. According to the second method, processing is performed according to the shape of a large number of pages included in the document to be displayed. In other words, the processing is performed in accordance with the shape that occupies a large percentage of the document to be displayed.

In step S23, the detection unit 122 calculates the aspect ratio of the entire image TG when the page image PG having the shape specified in step S22 is displayed in the two-page display mode.
In step S24, the detection unit 122 calculates the size of the whole image TG based on the display area width WD, the display area height LD, and the aspect ratio of the whole image TG calculated in step S23. When the detection unit 122 performs processing based on the whole image TG, the size of the whole image TG calculated in step S24 is the whole image width WP. Further, when the detection unit 122 performs processing based on the text MC, the size of the entire image TG calculated in step S24 is the text width WMC.

In step S25, the detection unit 122 performs the processing shown in the above formula (1) or (2) to calculate the difference length. The difference length is the margin size BD or the content margin width ND.

Returning to FIG. 5, the control unit 11 causes the selection unit 123 to perform selection processing in step S3. Details of the selection process executed in step S3 are shown in FIG.

In step S31, the selection unit 123 compares the difference length calculated in step S25 with the display set value. In step S32, the selection unit 123 determines whether or not the difference length is equal to or greater than the display set value.

When the selection unit 123 determines that the difference length is equal to or greater than the display set value (step S32; YES), the process proceeds to step S33 and selects the two-page display mode. When the selection unit 123 determines that the difference length is not equal to or greater than the display set value (step S32; NO), that is, when it determines that the difference length is smaller than the display set value, the process proceeds to step S34, and one page is displayed. Select a display mode.

Returning to FIG. 5, the control unit 11 causes the display control unit 121 to display the preview screen 200 according to the display mode selected by the selection unit 123 in step S4.

By the processing of steps S1 to S4, the display mode of the page image PG displayed on the display 141 when the APP 132 is activated is automatically selected from the one-page display mode and the two-page display mode.

In step S<b>5 , the control unit 11 determines whether or not the display area of the preview screen 200 has been changed by the display control unit 121 .
Several examples are given when the display area of the preview screen 200 is changed. A first example is when the OS 131 changes the shape and size of the display area used by the APP 132 when the user starts executing an application program different from the APP 132 . In the first example, the trigger is that the user operates the smartphone 1 to issue an instruction to execute an application program, or that an application program that has been reserved for execution is activated.

A second example is a case where the display size of the preview screen 200 is changed according to the orientation of the main body 10 by the function of the OS 131 when the orientation sensor 15 detects a change in the orientation of the main body 10 by the control unit 11 . is. A second example occurs, for example, when the body 10 is rotated in the direction indicated by symbol R in FIG.

When determining that the display area has been changed (step S5; YES), the control section 11 returns to step S2.

When determining that the display area has not been changed (step S5; NO), the control unit 11 proceeds to step S6. In step S<b>6 , the control unit 11 determines whether or not the button image BT has been operated by the reception unit 124 . If it is determined that the button image BT has been operated (step S6; YES), the control section 11 proceeds to step S7.

In step S<b>7 , the control unit 11 selects a display mode different from the currently selected display mode using the selection unit 123 . For example, when the button image BT is operated while displaying in the one-page display mode, the selection unit 123 selects the two-page display mode in step S7.

In step S8, the control unit 11 causes the display control unit 121 to update the display of the preview screen 200 with the display mode selected in step S7. After that, the control unit 11 returns to step S5.

When it is determined in step S6 that the button image BT has not been operated (step S6; NO), the control section 11 proceeds to step S9. In step S<b>9 , the control unit 11 determines whether or not an operation for selecting a thumbnail image PS in the thumbnail display area 202 has been performed by the reception unit 124 .

If it is determined that the user has performed an operation to select the thumbnail image PS (step S9; YES), the control section 11 proceeds to step S10. At step S10, the control unit 11 identifies the page image PG corresponding to the thumbnail image PS selected by the user's operation. In step S11, the control unit 11 causes the display control unit 121 to display the page image PG specified in step S10 on the preview screen 200 in the one-page display mode. After that, the control unit 11 returns to step S5.

When it is determined that the user's operation to select the thumbnail image PS has not been performed (step S9; NO), the control section 11 proceeds to step S12. At step S<b>12 , the control unit 11 determines whether or not to end the display of the preview screen 200 .
If it is determined not to end the display (step S12; NO), the control section 11 returns to step S5. When it is determined to end the display (step S12; YES), the control unit 11 ends the display of the preview screen 200 and stops the execution of the APP132.

In the above process, step S2 corresponds to an example of a "detection step", and step S3 corresponds to an example of a "selection step". Step S4 corresponds to an example of a "display step". Step S11 corresponds to an example of a "selected page display step".

In the above processing, in step S22, the display mode may be selected based on the determination result of determining the shape of the page included in the document to be displayed. For example, in step S22, if the shape of the first page among the pages that make up the document is horizontally long, steps S23-S25 may not be executed, and the single-page display mode may be selected in step S3. . Further, for example, when the proportion of vertically long pages among all pages constituting a document is smaller than the criterion, the one-page display mode may be selected in step S3 without executing steps S23-S25. .

In these cases, the display mode can be determined without executing steps S23-S25. The case where the page shape of the document to be displayed is horizontally long means the case where the horizontal width of the page is longer than the vertical length of the page. In this case, there is a high possibility that the difference length calculated in steps S23-S25 is smaller than the display set value. Therefore, there is an advantage that the display mode can be appropriately selected with less processing.

In the above configuration, the document display area 201 may be enlarged when displaying the page image PG in the two-page display mode. FIG. 8 is a screen diagram showing still another example of the two-page display mode.

In the example shown in FIG. 8, the display area height LD is enlarged by the length AD compared to the example in FIG. The display control unit 121 expands the document display area 201 as shown in FIG. 8, for example, when starting the display in the two-page display mode in step S4. Thereby, the visibility of the page image PG when executing the two-page display mode can be further improved. In the two-page display mode, the entire image width WP or the text width WMC is often smaller than the display area width WD. Therefore, by enlarging the display area height LD, the entire image width WP and the body width WMC can be enlarged, and the entire image TG can be enlarged as a whole. In this case, the display control unit 121 does not enlarge the document display area 201 when displaying the page image PG in the one-page display mode. and

In the example shown in FIG. 8, in order to expand the document display area 201, the thumbnail display area 202 is reduced. Specifically, the size of the thumbnail display area 202 in the direction along the Y-axis is reduced. In the thumbnail display area 202, since the display size of the thumbnail image PS is not changed when the thumbnail display area 202 is reduced, the lower portion of the thumbnail image PS is out of the thumbnail display area 202 and is not displayed. However, since the upper portion of the thumbnail image PS is visible in the thumbnail display area 202, the user can determine the contents of the pages forming the document based on part of the thumbnail image PS. In other words, the thumbnail image PS functions even if part of the thumbnail image PS is hidden. Therefore, the display mode of the two-page display mode shown in FIG. 8 is useful.

FIG. 9 is an external view of a display device 6 as another application example. The display device 6 is an electronic device configured by connecting two housings 61 and 62 so that they can be opened and closed. The display device 6 has the configuration of the smartphone 1 shown in FIG.

A display screen 63 is arranged on the housing 61 and a display screen 64 is arranged on the housing 62 . The display screens 63 and 64 may have the same configuration as the touch panel 14, for example.

The display device 6 can be opened and closed by moving the housings 61 and 62 in the direction indicated by the symbol FL and in the opposite direction. By opening the housings 61 and 62 , the display device 6 displays an image in one large display area formed by connecting the display screens 63 and 64 .

When the display method executed by the smartphone 1 is applied to the display device 6, the operation of opening the housings 61 and 62 corresponds to the operation of changing the display area in step S5.

As described above, the display method described in the present embodiment is applicable not only to the smartphone 1 but also to various devices having a display screen and a function of changing the display area.

As described above, the display method according to the embodiment causes the smartphone 1 having the display 141 to display a document. This display method includes a detection step of detecting a display size when a plurality of page images PG, which are images of pages constituting a document, are displayed in the document display area 201 arranged on the display screen. This display method includes a selection step of causing the smartphone 1 to select a display mode in the document display area 201 based on the detection result of the detection step. In the detection step, the X-axis of the document display area 201 is defined by the entire image width WP, which is the length of the entire image TG formed by arranging a plurality of page images PG, and the display area width WD, which is the length of the document display area 201. Let the difference length be detected which is the difference in the direction along . In the selection step, if the difference length is equal to or greater than the display setting value, the two-page display mode in which a plurality of page images PG are displayed side by side is selected. In the selection step, when the difference length is smaller than the display set value, the display method selects a one-page display mode in which one page image PG is displayed. Here, the difference length corresponds to the margin size BD or the content margin width ND.

The smartphone 1 has a touch panel 14 with a display 141 . The smartphone 1 includes a detection unit 122 that detects a display size when displaying a plurality of page images PG, which are images of pages constituting a document, in the document display area 201 arranged on the display 141 . The smartphone 1 includes a selection unit 123 that selects a display mode in the document display area 201 based on the detection result of the detection unit 122 . The smartphone 1 includes a display control unit 121 that causes the touch panel 14 to display the page image PG in the document display area 201 in the display mode selected by the selection unit 123 . The detection unit 122 detects the difference between the entire image width WP, which is the length of the entire image TG formed by arranging a plurality of page images PG, and the display area width WD, which is the length of the document display area 201, in the direction along the X axis. Detect the difference length, which is the difference. The selection unit 123 selects a two-page display mode in which a plurality of page images PG are displayed side by side when the difference length is equal to or greater than the display setting value, and selects one page image when the difference length is smaller than the display setting value. Select the one-page display mode to display the PG.

According to the display method and the smartphone 1 that executes the display method, based on the difference length between the entire image TG and the display area width WD when the page images PG of a plurality of pages of the document are displayed side by side, , you can select the display mode. As a result, when displaying a page image of a document, a display mode that matches the shape of the page of the document is selected.

In the above display method, in the detection step, the difference length is detected when the length of the entire image TG in the direction along the Y axis is matched with the display area height LD, which is the length of the document display area 201 . As a result, the differential length in the direction along the X-axis when the entire image TG is arranged in the document display area 201 in the largest possible size can be obtained. Therefore, the display mode can be appropriately selected on the premise that the visibility of the page image PG is maximized in the two-page display mode.

In the above display method, in the detection step, the text width WMC, which is the length of the entire image TG excluding the page margins, and the display area width WD, which is the length of the document display area 201, are detected in the direction along the X axis. The content margin width ND, which is the difference between , is detected as the difference length. As a result, the display mode can be appropriately selected on the assumption that the visibility of the text MC is given priority in the two-page display mode. It is particularly useful for users who want to give priority to recognizing the body MC contained in the document.

The display setting value is a value corresponding to the case where the blank area B is generated between the document display area 201 and the entire image TG, and the blank size BD that is the length of the blank area B in the direction along the X axis is It is a value indicating that it is of a predetermined length. In this case, since the display mode is selected based on the blank size BD, which is the size of the blank area B, the display mode can be appropriately selected on the assumption that the entire image TG does not protrude from the document display area 201 .

The display setting value is set when the display area width WD, which is the length of the document display area 201, and the entire image width WP, which is the length of the entire image TG, match, and when the width between the document display area 201 and the entire image TG is This value corresponds to the case where a blank area B of a predetermined length or longer occurs in the . In this case, the display mode is selected based on the blank size BD, which is the size of the blank area B. FIG. As a result, the display mode can be appropriately selected on the assumption that the entire image TG does not protrude from the document display area 201 and that the entire image TG is displayed as large as possible in the document display area 201 . Therefore, it is possible to ensure the visibility of the page image PG in the two-page display mode. For example, it is possible to avoid a situation in which the page image PG is difficult to see when the two-page display mode is selected.

The display method includes a display step of displaying the page image PG in the document display area 201 in the display mode selected in the selection step. When the 2-page display mode is selected in the selection step, the display step displays a switch button for instructing switching between the 2-page display mode and the 1-page display mode in the document display area 201 . Thereby, the display mode selected in the detection step and the selection step can be switched by the user's operation. Therefore, it is possible to enhance the user's convenience in switching the display mode.

In the above display method, the two-page display mode is selected in the selection step when the shape of the first page among the pages constituting the document is vertically long and the differential length is equal to or greater than the display setting value. Let If the shape of the top page is horizontally long, the one-page display mode is selected even if the differential length is equal to or greater than the display set value. In this case, it is possible to easily identify the shape of the pages included in the document. Furthermore, since the display mode is selected based on the shape of the page, the display mode suitable for the document can be quickly selected.

In the above display method, in the selection step, when the ratio of vertically long pages among all pages constituting a document is equal to or greater than the criterion and when the differential length is equal to or greater than the display setting value, a two-page display mode is selected. be selected. If the proportion of vertically long pages among all pages constituting the document is smaller than the criterion, the one-page display mode is selected even if the differential length is equal to or greater than the display set value. In this case, the shape of the pages included in the document can be specified more accurately. Furthermore, since the display mode is selected based on the shape of the page, the display mode suitable for the document can be quickly selected.

In the display method described above, a document display area 201 and a thumbnail display area 202 in which thumbnail images PS of a plurality of pages are displayed side by side are arranged on the display 141 . As a result, the thumbnail images PS corresponding to the pages of the document and the page images PG representing the contents of the pages are arranged on the preview screen 200. FIG. Accordingly, the user can confirm the contents of the entire document in the thumbnail display area 202 and browse the contents of individual pages in the document display area 201 .

The display method includes a selected page display step. The selected page display step displays the page image PG of the page corresponding to the selected thumbnail image PS in the one-page display mode when an operation to select one of the thumbnail images displayed in the thumbnail display area 202 is received. Display it in the document display area 201 . Therefore, the user can select a page in the thumbnail display area 202 and view the content of the selected page using the page image PG.

This embodiment shows one aspect, and can be arbitrarily modified and applied without departing from the scope of the invention.

In this embodiment, a case where the "display device" is the smartphone 1 will be described, but the present invention is not limited to this. A “display device” may include the processor 12 , the memory 13 and the touch panel 14 . A “display device” may be configured by a tablet terminal.

In the present embodiment, the two-page display mode including two page images PG is shown as an example of the multiple-page display mode. good. For example, the multiple page display mode may be a display mode in which three page images PG are arranged side by side in the direction along the X axis.

The shape of the button image BT and the shapes of the document display area 201 and thumbnail display area 202 shown in this embodiment can be changed as appropriate. For example, the button image BT may be rectangular or elliptical. The document display area 201 and the thumbnail display area 202 may be vertically elongated in the direction along the Y-axis.

In this embodiment, an example in which the preview screen 200 is displayed on the entire display 141 has been shown, but the present invention is not limited to this. A configuration in which the preview screen 200 and a screen displayed by another application program are arranged side by side on the display 141 may be employed. Alternatively, the preview screen 200 may be arranged on a part of the home screen displayed by the OS 131 .

Although the present embodiment describes a display method implemented by the processor 12 of the smartphone 1 executing the OS 131 and the APP 132 stored in the memory 13, this is an example. The program executed by the processor 12 to realize this display method can be configured in the form of a computer-readable recording medium or a transmission medium for transmitting the program. Here, a magnetic or optical recording medium or a semiconductor memory device can be used as the recording medium. Recording media include flexible disks, HDDs, CD-ROMs (Compact Disk Read Only Memory), DVDs (Digital Versatile Disks), Blu-ray (registered trademark) Discs, magneto-optical disks, flash memories, card-type recording media, etc. Examples include portable or fixed recording media. The recording medium may be a non-volatile storage device such as RAM, ROM, HDD, etc., which is an internal storage device provided in a server device configured to be able to communicate with the smartphone 1 . In this case, the smartphone 1 downloads the program from the server device.

The functions of the control unit 11 may be realized by one or more processors or semiconductor chips. The control unit 11 may further include a co-processor such as SoC (System-on-a-Chip), MCU (Micro Control Unit), and FPGA (Field-Programmable Gate Array). . The control unit 11 may cooperate with both the CPU and the sub-processing device, or selectively use one of them to perform various controls.

The processing units of the flowcharts shown in FIGS. 5, 6 and 7 are divided according to the main processing contents in order to facilitate understanding of the processing of the control unit 11. It is not limited by name. The processing unit of the flowchart may be divided into more processing units according to the processing content. One processing unit may be divided to include more processing. The order of processing may be changed as appropriate within a scope that does not interfere with the purpose.

Each functional unit shown in FIG. 1 shows a functional configuration, and a specific implementation form is not particularly limited. It is not always necessary to implement hardware corresponding to each functional unit individually, and it is also possible to adopt a configuration in which one processor executes a program to realize the functions of a plurality of functional units. Some of the functions implemented by software in the above-described embodiments may be implemented by hardware, or some of the functions implemented by hardware may be implemented by software. In addition, the specific detailed configurations of other parts of the smartphone 1 can be arbitrarily changed without departing from the scope.

DESCRIPTION OF SYMBOLS 1... Smartphone (display device), 2... Printer, 6... Display device, 10... Main body, 11... Control part, 12... Processor, 13... Memory, 14... Touch panel (display part), 15... Attitude sensor, 16... Communication Interface 61, 62 Housing 100 Printing system 121 Display control unit 122 Detecting unit 123 Selecting unit 124 Receiving unit 131 Operating system 132 Application program 133 Document information storage Unit 134 Image information storage unit 135 Setting value 141 Display (display screen) 142 Touch sensor 200 Preview screen 201 Document display area 202 Thumbnail display area B, B1, B2... Blank area, BD, BD1, BD2... Blank size (difference length), BT... Button image (switching button), DC... Document information, LD... Display area height, MC... Text, ND, ND1, ND2... Content margin Width (difference length), PG, PG1, PG2...page image, PP...print image, PS...thumbnail image, SG...thumbnail image group, TG...whole image, WD...display area width, WMC...text width, WP... Overall image width.

Claims (11)

A display method for displaying a document on a display device having a display screen,
a detection step of detecting a display size when a plurality of page images, which are images of pages constituting the document, are displayed in a document display area arranged on the display screen;
a selection step of selecting a display mode in the document display area based on the detection result of the detection step;
In the detecting step, a difference length, which is a difference in a direction along the first axis of the document display area, between a length of the entire image formed by arranging the plurality of page images and a length of the document display area is detected. ,
In the selecting step, if the difference length is equal to or greater than the display setting value, a multi-page display mode in which a plurality of the page images are displayed side by side is selected, and if the difference length is smaller than the display setting value, 1 A display method, wherein a one-page display mode for displaying two said page images is selected. 3. In the detection step, detecting the difference length when the length of the entire image in a direction along a second axis orthogonal to the first axis is made to match the length of the document display area. 1. The display method described in 1. 2. In said detection step, a difference in a direction along said first axis between a length of said entire image excluding a margin portion of said page and a length of said document display area is detected as said differential length. Or the display method described in 2. The display setting value is a value corresponding to a case where a blank area is generated between the document display area and the entire image, and the length of the blank area in the direction along the first axis is a predetermined length. 3. The display method according to claim 1 or 2, wherein the value is a value indicating that the height is high. The display setting value is set when the length of the document display area and the length of the entire image are the same, and when there is a blank area of a predetermined length or more between the document display area and the entire image. 3. The display method according to claim 1, wherein the value corresponds to . a display step of displaying the page image in the document display area in the display mode selected in the selection step;
When the multiple page display mode is selected in the selecting step, in the displaying step, a switching button for instructing switching between the multiple page display mode and the one page display mode is displayed in the document display area. The display method according to any one of claims 1 to 5. In the selecting step,
causing the multiple page display mode to be selected when the shape of the page positioned at the top of the pages constituting the document is vertically long and the difference length is equal to or greater than the display setting value;
7. The method according to any one of claims 1 to 6, wherein when the top page has a horizontally long shape, the one-page display mode is selected even when the differential length is equal to or greater than the display set value. or the display method described in 1. In the selecting step,
selecting the multi-page display mode when the ratio of vertically long pages among all the pages constituting the document is equal to or greater than a criterion and the differential length is equal to or greater than the display setting value;
selecting the one-page display mode even if the difference length is equal to or greater than the display setting value when the proportion of vertically long pages among all the pages constituting the document is less than a criterion; The display method according to any one of claims 1 to 6. 9. The display method according to any one of claims 1 to 8, wherein a thumbnail display area in which thumbnail images of a plurality of pages are displayed side by side and the document display area are arranged on the display screen. displaying the page image of the page corresponding to the selected thumbnail image in the one-page display mode when an operation to select one of the thumbnail images displayed in the thumbnail display area is received; 10. The display method according to claim 9, comprising a selection page display step of causing the area to display. a display unit having a display screen;
a detection unit for detecting a display size when a plurality of page images, which are images of pages constituting a document, are displayed in a document display area arranged on the display screen;
a selection unit that selects a display mode in the document display area based on the detection result of the detection unit;
a display control unit that causes the display unit to display the page image in the document display area in the display mode selected by the selection unit;
The detection unit detects a difference length, which is a difference in a direction along a first axis of the document display area, between a length of the entire image formed by arranging the plurality of page images and a length of the document display area. ,
The selection unit selects a multi-page display mode in which the plurality of page images are displayed side by side when the difference length is equal to or greater than the display setting value, and selects 1 when the difference length is smaller than the display setting value. A display device for selecting a one-page display mode for displaying two said page images.

Images