JP2012083500A - Display control apparatus and display control method, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control technique for reducing load associated with display processing and reducing burden of work associated with display control.SOLUTION: A display control apparatus includes acquisition means for acquiring a document image, detection means for detecting whether the document image is written vertically or horizontally, and display control means for displaying the document image on a display device. The display control means differently sets a position of a reference point to enlarge the document image according to an enlargement instruction of the document image depending on the case where the document image is detected being written vertically or horizontally by the detection means.

Description

  The present invention relates to a display control technique for displaying a document image.

  2. Description of the Related Art Conventionally, a system for reading original paper or the like and projecting it on a projector or the like has been used in a meeting or the like. Patent Document 1 describes a technique for reading an image, transferring it to a display device, and displaying it. .

JP 2001-186302 A

  In a conventional system, in order to display a read document image in a suitable state, it is necessary to perform operations such as enlargement using the enlargement function of the projector and alignment of the display center with a portion to be referred to. For example, when displaying a vertically written document image in an enlarged manner, the start point of the document is at the upper right, and the user needs to perform an enlargement operation with the position at the upper right as the reference point. In the case of a horizontally written document image, since the start point of the document is at the upper left, it is necessary to perform an enlargement operation using the upper left position as a reference point.

  Further, when the entire read image is displayed, the characters become small and difficult to read. Therefore, it is necessary to enlarge and display the image to an appropriate size. Even in such a case, the user needs to appropriately perform an enlargement operation and a display position movement operation so that the start point of the document can be displayed.

  The present invention has been made in view of the above problems, and an object of the present invention is to realize a display control technique that reduces the troublesome work of enlarging and displaying a document image.

  In order to solve the above problems and achieve the object, the display control apparatus of the present invention includes an acquisition unit that acquires a document image, a detection unit that detects whether the document image is written vertically or horizontally, and the document image. Display control means for displaying the image on a display device, and the display control means vertically writes the position of a reference point for enlarging the document image by the detection means in response to an instruction to enlarge the document image. It is made different depending on whether it is detected as being horizontal and when it is detected as horizontal writing.

  According to the present invention, it is possible to reduce the troublesome work of enlarging and displaying a document image.

1A is a configuration example (a) of a display control system according to an embodiment of the present invention, and FIG. FIG. 2 is a block diagram of a projector and a scanner that constitute the display control system of the present embodiment. 5 is a flowchart illustrating document image determination processing according to the first embodiment. FIG. 6A is a diagram illustrating a document image including a figure and its cumulative histogram in the horizontal direction and the vertical direction, and FIG. 10B is a diagram illustrating a document image not including the figure and a cumulative histogram in the horizontal direction and the vertical direction thereof. A diagram (a) illustrating a horizontal cumulative histogram of a document image and a tracking result, a diagram (b) illustrating a horizontal tracking result of the document image, and a method for determining punctuation from the horizontal tracking result of the document image. The figure (c) illustrated. The figure which illustrates the tracking result of the horizontal direction in the document image upside down (a), the figure which illustrates the tracking result of the horizontal direction in the document image rotated 90 degrees, and the document image rotated by 90 degrees (C) which illustrates the discrimination method of a punctuation mark from the horizontal tracking result in FIG. The figure which illustrates the accumulation histogram of a perpendicular direction, tracking result, and punctuation mark discrimination | determination result of a vertical writing document image. The figure which shows the accumulation histogram of a perpendicular direction, the tracking result, and the punctuation mark discrimination | determination result of the vertically written document image rotated 90 degree | times. The flowchart (a) which shows the document image display process of Embodiment 1, and the figure (b) which illustrate the display process according to the determination result in a document image display process. FIG. 4 is a diagram illustrating an enlarged display mode of the first embodiment. FIG. 4 is a diagram illustrating an enlarged display mode of the first embodiment. 9 is a flowchart illustrating document image determination processing according to the second embodiment. FIG. 6 is a block diagram of a digital camera and a projector that constitute a display control system of a third embodiment. 9 is a flowchart (a) illustrating a photographing process of the digital camera according to the third embodiment and a flowchart (b) illustrating a projection process by a projector. The block diagram (a) of PC and projector which comprise the display control system of Embodiment 4, and the figure which illustrates the display mode of Embodiment 4 (b). 10 is a flowchart illustrating table ruled line determination processing by the projector according to the fifth embodiment. FIG. 10 is a diagram illustrating a ruled line discrimination result of a table document according to Embodiment 5. FIG. 7A is a diagram illustrating information held from ruled line discrimination results of a table document according to the fifth embodiment, and FIG. 6B is a diagram illustrating a horizontal cumulative histogram of a document image including a table. The figure which illustrates the ruled line discrimination | determination result of the diagonal table | surface in Embodiment 5. 10 is a flowchart illustrating display processing by a projector according to a fifth embodiment. The figure which illustrates the initial display mode (a), enlarged display mode (b), and movement display mode (c) in Embodiment 5. In Embodiment 5, the figure which illustrates the display mode (a) when a some image is included in a document image, and the display mode (b) when a some figure or photograph is included.

  Hereinafter, embodiments for carrying out the present invention will be described in detail. The embodiment described below is an example for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment. Moreover, you may comprise combining suitably one part of each embodiment mentioned later.

  [Embodiment 1] The display control system of Embodiment 1 will be described below. In FIG. 1A, the projector 100 is connected to a scanner 110, a digital camera 120, and a personal computer (PC) 130 by cables 101, 102, and 103. Each of the cables 101 to 103 is a USB cable, a LAN cable, a VGA cable, or the like, but external input to the projector 100 is not limited to these.

  Further, in the remote control 140 shown in FIG. 1B, 141 is a power button, 142 is an output video aspect ratio switching button, 143 is a focus button, 144 is a cross button used for menu and other selection control, and 145 is a key. Stone control button. Reference numerals 146 and 147 denote digital zoom buttons, and reference numeral 148 denotes a freeze button that freezes the video. Reference numeral 149 denotes an output mode switching button for video with different color processing. Reference numeral 150 denotes an external input switching button of the projector 100. Reference numeral 151 denotes an automatic setting button for automatically performing input signal setting, focus, keystone, and wall color correction. Reference numeral 152 denotes an analog input automatic setting button for adjusting the sampling timing with respect to the analog input. Reference numeral 153 denotes an optical zoom button, reference numeral 154 denotes a menu determination button, and reference numeral 155 denotes a menu display button. Reference numerals 156 and 157 denote volume adjustment buttons, 158 an audio output pause button, 159 a lamp light quantity switching button, 160 a video output pause button, and 16 a timer display button.

  Hereinafter, a case where the scanner 110 and the projector 100 are connected by a VGA cable and the present invention is realized by the projector 100 will be described.

  <Configuration of Scanner and Projector> The electrical configuration of the projector 100 and the scanner 110 will be described with reference to FIG.

  In the projector 100 of FIG. 2, reference numeral 201 denotes a projection optical system including a lens, and focus and zoom control is performed by the optical system control unit 204. Reference numeral 202 denotes a display screen unit having a display screen such as a liquid crystal panel, and a projection image is output by the screen driving unit 205. A light source 203 includes a lamp such as a mercury lamp, and the light amount is controlled by the light source control unit 206. An image processing unit 207 performs necessary image processing to output an image on the display screen unit 202. A display control unit 208 generates a GUI such as a menu. Reference numeral 209 denotes a main control unit that controls each unit of the projector 100. A communication unit 210 such as a USB or LAN communicates with an external device such as the digital camera 120 or a USB memory. Reference numeral 211 denotes a non-volatile storage device such as a flash memory for storing programs executed on the main control unit 209 and other necessary information. Reference numeral 212 denotes a memory such as an SDRAM that temporarily stores programs executed by the main control unit 209 and other information. Reference numeral 213 denotes a video signal input unit for inputting an external video. An operation control unit 214 performs processing according to a user operation input via switches (not illustrated), the remote controller 140, or the like.

  Next, in the scanner 110 of FIG. 2, reference numeral 221 denotes an operation control unit that performs processing in accordance with a user operation input through switches (not shown). A video signal output unit 222 outputs video. An image processing unit 223 performs processing of the read image and processing of the output image. A display control unit 224 generates a GUI such as a menu. A main control unit 225 controls each unit of the scanner 110. An image scanning control unit 226 reads an image by the image scanning sensor 228. A light source control unit 227 controls the amount of light of the light source 229 that is turned on when an image is read. Reference numeral 230 denotes a memory such as an SDRAM that temporarily stores a program executed by the main control unit 225 and other information. Reference numeral 231 denotes a non-volatile storage device such as a flash memory for storing programs executed by the main control unit 225 and other necessary information. A communication unit 232 such as a USB or a LAN communicates with an external device such as the digital camera 120 or a USB memory.

  <Description of Basic Operation> Next, the basic operation of the display control system of this embodiment will be described.

  In the scanner 110, when a user issues a document scan instruction via the operation control unit 221, a notification from the operation control unit 221 is generated in the main control unit 225. The main control unit 225 scans the original image inserted into the scanner 110 by controlling the light source 229 with the light source control unit 227 and controlling the image scanning sensor 228 with the image scanning control unit 226. The main control unit 225 performs predetermined processing by the image processing unit 223 on the image data read by scanning, and stores the image data in the memory 230. The main control unit 225 converts the image data stored in the memory 230 into a video format that can be transmitted to the projector 100 by the image processing unit 223, and outputs the video data via the VGA cable 101 by the video signal output unit 222.

  In the projector 100, when the main control unit 209 detects that video is input to the video signal input unit 213, the main control unit 209 records the input video data in the memory 212 at a cycle corresponding to the input video format. The main control unit 209 performs predetermined image processing on the video data recorded in the memory 212 by the image processing unit 207 and records it in the memory 212. The main control unit 209 controls the light source 203, the display screen unit 202, and the projection optical system 201 by the light source control unit 206, the screen drive unit 205, and the optical system control unit 204, so that the video data recorded in the memory 212 is recorded. Project.

  <Image Determination Processing> Next, the image determination processing of the first embodiment will be described with reference to FIG. The processing shown in FIG. 3 is executed by the main control unit 209 developing the program recorded in the nonvolatile storage device 211 in the memory 212 when the projector 100 is turned on.

  In FIG. 3, in step S301, the main control unit 209 sets the variable group, scan direction mode, up / down rotation flag, document mode, and document display mode used in this process to initial values. The initial values are horizontal scan, OFF (0), horizontal writing, and non-document mode, respectively. Each variable is held in the memory 212.

  In step S <b> 302, the main control unit 209 performs binarization processing of the input image data recorded in the memory 212 by the image processing unit 207, and records it in the memory 212. The binarization here uses a discriminant analysis method. In the case of a general document image, the margin area and the document area can be divided by this method.

  In step S303, the main control unit 209 creates a histogram (hereinafter, horizontal histogram) in the horizontal direction (left and right in the figure) for the image binarized in step S302. Reference numeral 401 in FIG. 4B denotes binarized image data recorded in the memory 212. When a cumulative histogram in the horizontal direction is taken with respect to the binarized image 401, 402 is obtained.

  In step S304, it is determined whether or not the histogram created in step S303 appears periodically. The main control unit 209 performs black and white tracking in the vertical direction as indicated by a line 405 in FIG. The periodicity is determined while shifting this tracking in the horizontal direction. For example, vertical tracking is performed at each position in the horizontal direction, and it is determined whether or not black intervals are 8 dots or more and at least two rows are evenly arranged across a white space. The reason why the black interval is set to 8 dots or more is that it becomes difficult to visually recognize if the number of dots expressing the character is too small. If data having such a period is detected in eight or more horizontal lines, it is determined that there is periodicity.

  In step S305, it is determined whether the image data recorded in the memory 212, that is, the image data input by the video signal input unit 213 is a document image. The main control unit 209 can distinguish different feature regions 403 and 404 in the histogram 402 according to the determination result in step S304. In the feature area 404, white and black are periodically inverted. Therefore, the main control unit 209 determines that an image having such an area is a document image.

  If the main control unit 209 determines in step S305 that the image data input by the video signal input unit 213 is a document image, the process proceeds to step S306.

  In step S306, the main control unit 209 sets the scan direction mode used in the subsequent processing to horizontal scan, and proceeds to step S312.

  On the other hand, if the main control unit 209 determines in step S305 that the image data input by the video signal input unit 213 is not a document image, the process proceeds to step S307.

  In step S307, the main control unit 209 creates a histogram (hereinafter, vertical histogram) in the vertical direction (vertical direction in the figure) for the image binarized in step S302. The reason why this processing is necessary is as follows. In FIG. 4B, reference numeral 4406 denotes an example in which image data of a vertically written document is input to the video signal input unit 213. This input image is binarized and recorded in the memory 212. Through the processing so far, the main control unit 209 creates a horizontal histogram in step S303. The cumulative histogram in the horizontal direction of the image 406 is as shown by 407. In the case of the horizontal histogram 407, the main control unit 209 determines that it is not a document image in step S305 from the periodicity determination result in step S304. However, the cumulative histogram in the vertical direction created by the main control unit 209 in step S307 is as indicated by 408, and periodicity can be confirmed. That is, in order to determine whether or not the document image, it is necessary to create cumulative histograms in the horizontal direction and the vertical direction, so the processing in step S307 is necessary.

  In step S308, the main control unit 209 performs a periodicity determination process similar to that in step S304.

  In step S309, the main control unit 209 uses the determination result in step S308 to determine whether the image data input from the video signal input unit 213 is a document image as in step S305. If the main control unit 209 determines in step S309 that the document image is a document image, the process proceeds to step S311. If not, the input image is finally determined not to be a document image, and the process ends.

  In step S311, the main control unit 209 sets the scan direction mode used in the subsequent processing to vertical scan, and proceeds to step S312.

  In step S312, the main control unit 209 sets the document display mode to the document mode.

  In step S313, the main control unit 209 extracts a document area in order to perform processing for determining whether the document image input by the video signal input unit 213 is vertical writing or horizontal writing. Here, the main control unit 209 identifies the area determined to be periodic in step S304 or S308 as a document area. For example, in the case of the image 401 in FIG. 4A, the main control unit 209 recognizes and extracts the regions of the horizontal histograms 402 to 404 as document regions, and records them in the memory 212.

  In step S314, the main control unit 209 tracks the document area image data extracted in step S313 and recorded in the memory 212 according to the scan direction mode set in the processing so far. Reference numeral 501 in FIG. 5A denotes a document area image extracted by the main control unit 209 in step S313 and recorded in the memory 212. Reference numeral 502 denotes a cumulative histogram in the horizontal direction, and it is assumed that the scan direction mode is set as horizontal scan in the processing so far. The main control unit 209 determines the lowest points 508 to 511 of the rows 504 to 507 in the horizontal histogram 502 as tracking points. Reference numeral 503 denotes a result of tracking each line of the document area image 501 by the main control unit 209 tracking the uppermost point in each line.

  In step S315, the main control unit 209 estimates the character width. Specifically, the main control unit 209 measures the vertical width of 504 to 507 in the horizontal histogram 502, and sets the average value as the character width.

  In step S316, the main control unit 209 detects whether or not there is a space in the character. Reference numeral 512 in FIG. 5B denotes a part of each row tracked in step S314. Here, as in 513, if the vertical data is not detected at a certain interval, specifically, if the interval is more than half the character width estimated in step S315, the main control unit 209 determines that portion. Recognize as a blank part.

  In step S317, the main control unit 209 detects whether or not there is a punctuation mark near the blank detected in step S316. Reference numeral 514 in FIG. 5C shows an enlarged blank portion detected in step S316. When there is data of 1/3 or less with respect to the character width (height) as in 515, the main control unit 209 identifies that part as a punctuation mark. This identification process is performed for all rows of the image 501, but may be terminated when a predetermined amount is detected to reduce the processing time.

  In step S318, the main control unit 209 determines whether or not a punctuation mark is identified from the result of step S317. If a punctuation mark is identified, the process proceeds to step S323. If the punctuation mark has not been identified, the main control unit 209 proceeds to step S319.

  In the case of the document area image 501 in FIG. 5A, the main control unit 209 determines that there is a punctuation mark in step S318, and proceeds to step S323.

  Here, a case where the image data recorded in the memory 212 is different from the mode of the image 501 will be described. For example, when the image 501 is scanned upside down by the scanner 110, it is recorded in the memory 212 on the projector 100 side in the state of the image 601 in FIG. In this case, if the main control unit 209 performs horizontal tracking in step S314, the row 602 becomes 603. In step S316, the results of the main control unit 209 searching for blank portions are 604, 605, and 606. However, in this case, the main control unit 209 cannot identify a punctuation mark even if a punctuation mark search is performed in step S317. In this case, in step S318, it is determined that there is no punctuation mark, and the process proceeds to step S319.

  In step S319, the main control unit 209 sets the up / down rotation flag to ON (1).

  In step S320, the main control unit 209 rotates the image 601 up and down and performs horizontal tracking in the same manner as in step S314. That is, in this case, the processing is the same as that for the image 501.

  In step S321, the main control unit 209 performs a punctuation search as in step S316. That is, in this case, 515 punctuation marks are searched.

  In step S322, the main control unit 209 determines whether or not a punctuation mark is identified from the search result in step S321. If a punctuation mark is identified, the process proceeds to step S323. If the main control unit 209 determines that there are no punctuation marks, the process proceeds to step S324.

  Here, returning to the processing of the image 501 in FIG. In step S323, it is determined whether the position of the punctuation mark is on the left or right of the blank part. In step S323, the main control unit 209 identifies that the punctuation mark is on the left side of the blank portion 513 as shown in step S317 (or from the determination result in step S322) and 515 in FIG. In this case, the main control unit 209 transitions to step S325, and sets the document mode to horizontal writing. The reason for determining horizontal writing is that the punctuation mark in horizontal writing is generally placed right next to the character and is followed by a blank portion.

  On the other hand, if the main control unit 209 determines in step S323 that the punctuation mark is on the right, the process proceeds to step S326, and the document mode is set to vertical writing. Here, a case where vertical writing is determined will be described with reference to FIGS. 6B and 6C. An image 611 shows a state in which a vertically written image is recorded in the memory 212 of the projector 100 when the scanner 110 scans in the horizontal direction. When the main control unit 209 performs horizontal tracking in step S314 in FIG. 3, the row 612 becomes 613. In step S316, when the main control unit 209 searches for a blank portion, 614, 615, and 616 are detected. In step S317, the main control unit 209 performs a punctuation search, and as a result, punctuation marks are identified in 614 and 616. 621 in FIG. 6C shows a state where 614 is enlarged. The main control unit 209 identifies that 622 is a punctuation mark placed on the right side of the blank portion 614. In the case of a vertically written document, the punctuation mark is generally placed right below the character, followed by a blank part. When a vertically written sentence is rotated 90 degrees to the right and scanned horizontally, this punctuation mark is placed on the right side of the blank part. Therefore, a punctuation mark is placed on the right side of the blank part 614 as in 622. If it is, the main control unit 209 determines vertical writing.

  In step S324, since no punctuation is found, the main control unit 209 sets the document mode as the default, in this case, horizontal writing.

  Finally, in step S327, the main control unit 209 generates an icon indicating whether the document mode is vertical writing or horizontal writing by the display control unit 208, and displays the icon superimposed on the display screen unit 202. The process ends.

  The above description is an example when the document is scanned horizontally, but here, as a supplement, a case where the document is scanned vertically will be described.

  Reference numeral 701 in FIG. 7 indicates a state of an image recorded in the memory 212 via the video signal input unit 213 of the projector 100 when a vertically written document is vertically scanned by the scanner 110. Since the cumulative histogram in the vertical direction of the image is as indicated by 703, the main control unit 209 sets the scan direction mode to vertical scan for the image 701 in step S311. As a result of the main control unit 209 performing vertical tracking on the image 701 in step S314, the portion 702 becomes 704. In step S316, the main control unit 209 identifies the blank portion 705. Reference numeral 706 denotes an enlarged blank portion 705, and reference numeral 707 is identified as a punctuation mark by the main control unit 209 in step S317. As a result, in step S323, the main control unit 209 determines that the punctuation mark is on the top, and determines that it is vertical writing. Even if the image is upside down, in step S320, the same processing is performed by rotating up and down, so that it can be similarly identified as vertical writing.

  8 indicates the state of an image recorded in the memory 212 via the video signal input unit 213 of the projector 100 when a horizontally written document is vertically scanned by the scanner 110. Since the cumulative histogram in the vertical direction of this image is as indicated by 803, the main control unit 209 sets the scan direction mode to vertical scan for this image 801 in step S311. As a result of the main control unit 209 performing vertical tracking on the image 801 in step S314, the portion 802 becomes 804. In step S316, the main control unit 209 identifies the blank portion 805. Reference numeral 806 is an enlargement of the blank portion 805, and reference numeral 807 is identified as a punctuation mark by the main control unit 209 in step S317. As a result, in step S323, the main control unit 209 determines that the punctuation mark is below, and determines that it is horizontal writing. In the case of vertical writing, there is no punctuation mark at this position, and when it is rotated 90 degrees to the right, this punctuation mark is right next to the character and is followed by a blank part, so that it can be determined as horizontal writing. Even if this image is upside down, it can be identified as horizontal writing in the same manner because it is rotated up and down and the same processing is performed in step S320.

  According to the processing described above, it is possible to realize recognition of a document image and determination of whether it is a vertically written document or a horizontally written document regardless of the scanning direction.

  The above process is executed when there is a change in the input to the video signal input unit 213 of the projector 100. For example, it is executed when there is a difference between a previous image recorded in the memory 212 and a new input image. However, if a difference occurs for each frame, the process is not executed because it is not an input of an application target image.

  In addition, a dedicated button may be provided on the remote controller 140 so that the main control unit 209 executes it according to a user instruction.

  <Description of Display Processing> Next, display processing corresponding to the processing result of FIG. 3 will be described with reference to the flowchart of FIG. The process shown in FIG. 9A is executed by the main control unit 209 when the process of FIG.

  9A, in step S901, the main control unit 209 determines whether the image data input from the video signal input unit 213 and recorded in the memory 212 is a document image or a non-document image. This is determined by the document display mode. In step S901, the main control unit 209 transitions to step S903 if the document display mode is the document mode, and transitions to step S902 if the document display mode is the non-document mode.

  In step S <b> 902, the main control unit 209 displays the image data input from the video signal input unit 213 recorded in the memory 212 and recorded in the memory 212 on a full screen, and ends this processing.

  In step S903, the main control unit 209 determines whether the document image to be displayed is vertical writing or horizontal writing according to the document mode in the processing of FIG. If the document mode is horizontal writing, the main control unit 209 proceeds to step S904. If the document mode is vertical writing, the main control unit 209 proceeds to step S905.

  In step S904, the main control unit 209 causes the image processing unit 207 to process the image data input from the video signal input unit 213 and recorded in the memory 212 in accordance with the processing result of FIG. 3 (FIG. 9B). . Here, processing performed by the main control unit 209 by the image processing unit 207 will be described below. In FIG. 9B, the processing results in FIG. 3 are a scan direction mode (921), a document mode (922), and an up / down rotation flag (923), and 924 is a rotation process performed by combining the results. Show. Specifically, as shown in 801 in FIG. 8, in the case of scanning in the vertical direction by horizontal writing, the scanning direction mode (921) is vertical scanning, the document mode (922) is horizontal writing, and the vertical rotation flag (923) is OFF. (0). Based on this result, the main control unit 209 rotates 90 degrees to the right by the image processing unit 207 and records it in the memory 212.

  Next, in step S <b> 906, the main control unit 209 causes the image processing unit 207 to store the image recorded in the memory 212 as the processing result of step S <b> 904 so that the vertical character string fits in the vertical direction of the display screen unit 202. Enlarge and display. For example, in FIG. 10A, the main control unit 209 controls the image processing unit 207 so that the portion 1001 of the document image 501 fits in the display screen unit 202. Here, the main control unit 209 can identify the area 1001 based on the processing results of steps S304 and S308 in FIG. As a result, the portion 1001 is projected by the projector 100 as projection data.

  In steps S905 and S907, the main control unit 209 performs the same processing as that in steps S904 and S906 on the vertically written image.

  In step S908, the main control unit 209 sets an enlargement base point. Specifically, in the case of FIG. 10A, since the image is a horizontally written document image, the enlargement base point is set as 1002 in the upper left of the image and recorded in the memory 212.

  Here, a supplementary description of document images other than the document image 501 will be given. 111 in FIG. 11A is a horizontally written document. In this case, although horizontal writing is used, since the vertical length is longer than the horizontal length, the main control unit 209 controls the image processing unit 207 so that the portion 1102 fits on the display screen unit 202 in step S906. In step S <b> 908, the main control unit 209 sets the position of a reference point (hereinafter referred to as an enlargement base point) for enlargement to the upper left, here, the uppermost left 1103 from the center of the document image, and records it in the memory 212.

  In FIG. 11B, reference numeral 1104 denotes a vertically written document. In this case, although the vertical writing is performed, the horizontal is longer than the vertical, so in step S907, the main control unit 209 controls the image processing unit 207 so that the entire image 1101 can be accommodated on the display screen unit 202. To do. In step S908, the main control unit 209 sets the position of the enlargement base point to the upper right, here the upper right 1105 from the center of the document image, and records it in the memory 212. In this example, since the image of 1101 and the aspect ratio of the display screen unit 202 are the same, the entire image of 1101 is displayed.

  11C in FIG. 11C is a vertically written document. In this case, although vertical writing is performed, since the vertical length is longer than the horizontal length, in step S907, the main control unit 209 controls the image processing unit 207 so that the entire image 1106 fits on the display screen unit 202. To do. That is, when the display screen unit 202 has a horizontally long and short aspect ratio, the display area 1107 is displayed in a layout as shown in FIG. In step S908, the main control unit 209 sets the position of the enlargement base point to the upper right, here the upper right 1108 from the center of the document image, and records it in the memory 212.

  Returning to the description of FIG. 9A, a process corresponding to an operation instruction from the user in a state where the process of step S908 is completed will be described. In step S909, the main control unit 209 waits for a notification from the operation control unit 214. When an input from the operation control unit 214 is generated, the main control unit 209 determines, by the operation control unit 214, whether the user input is a display correction button, an enlargement button, or a display screen movement button.

  Here, when the document display mode is the document mode, the determination button 154 of the remote controller 140 functions as a display correction button. The digital zoom buttons 146 and 147 of the remote controller 140 function as an enlargement display button, and the cross button 144 functions as a display screen movement button.

  In step S909, when the main control unit 209 determines that the user has pressed the display correction button by the operation control unit 214, the process proceeds to step S911.

  In step S911, the main control unit 209 executes processing similar to that in steps S904 and S906, or S905 and S907. In step S912, the main control unit 209 executes processing similar to that in step S908.

  In step S909, when the main control unit 209 determines that the user has pressed the enlarge display button by the operation control unit 214, the process proceeds to step S914.

  In step S <b> 914, the main control unit 209 reads the expansion base point determined in step S <b> 908 or step S <b> 912 and recorded in the memory 212.

  In step S915, the main control unit 209 performs enlargement processing according to the enlargement base point read in step S914. In the case of FIG. 10A, the expansion base point is set as 1002. Accordingly, the main control unit 209 enlarges the portion 1003 so that the upper right is the base point by the image processing unit 207, and displays it on the display screen unit 202 by the screen driving unit 205. The size of 1003 is an arbitrary size determined by the enlargement magnification. Although only the enlargement is shown in the present process, it is needless to say that the reduction process is performed using the same base point as the above as the starting point for the reduction.

  In step S909, when the main control unit 209 determines that the user has pressed the display surface movement button by the operation control unit 214, the process proceeds to step S917.

  In step S917, the main control unit 209 moves the display surface. In FIG. 10A, the portion 1001 is displayed on the display screen unit 202, but the main control unit 209 displays the portion 1004 in FIG. 10B according to the pressing of the display screen movement button. The display portion is changed by the image processing unit 207. Alternatively, the main control unit 209 changes the display portion by the image processing unit 207 so that a portion 1006 in FIG.

  In step S918, the main control unit 209 resets the enlargement base point according to the displayed portion and records it in the memory 212. Specifically, the main control unit 209 sets 1005 as an enlargement base point in FIG. 10B and 1007 in FIG. As a result, appropriate enlargement is possible even if the display surface moves.

  As described above, according to the present embodiment, a display control technique suitable for the user can be realized according to each of the vertically written document and the horizontally written document.

  In the present embodiment, the configuration in which the scanner 110 and the projector 100 are connected by the VGA cable has been described. However, the present invention can also be applied as a configuration in which the digital camera 120 and the projector 100 are connected by the VGA cable. Further, the present invention can be applied to a configuration in which the PC 130 and the projector 100 are connected by a VGA cable. Further, the connection form is not limited to the connection via the VGA cable. Further, the apparatus on the image supply side is not limited to the scanner 110 or the like, and any apparatus can be used as long as the image can be supplied to the display device.

  Further, the specific vertical / horizontal detection method described in the present embodiment is not limited thereto, and other methods may be used. For example, vertical and horizontal detection can be performed by character pattern matching.

  Furthermore, in the present embodiment, a projector is described as an example, but the present invention can be applied to other display devices, and similar effects can be obtained.

  [Embodiment 2] Next, as Embodiment 2, a case will be described in which vertical and horizontal detection is performed on the scanner 110 side and notification is made to the projector 100 side.

  In the first embodiment described above, the projector 100 performs processing on the input image from the scanner 110 in the system configuration of FIG. On the other hand, in the present embodiment, the processing is executed on the scanner 110 side on the assumption that the projector 100 and the scanner 110 are connected by the VGA cable, as in the first embodiment.

  The projector 100 and the scanner 110 in the present embodiment are the same as the configuration described in FIG. 2 of the first embodiment, and the basic processing for outputting an image scanned by the scanner 110, inputting the image to the projector 100, and projecting the image. The same applies to the flow.

  Hereinafter, operations of the projector 100 and the scanner 110 according to the present embodiment will be described with reference to FIGS. The process shown in FIG. 12B is a program that operates on the memory 230 of the scanner 110 and is executed by the main control unit 225. The process shown in FIG. 12A is executed by the main control unit 209 of the projector 100.

  In FIG. 12B, in step S <b> 1201, the main control unit 225 of the scanner 110 detects the presence / absence of an image scan by the operation control unit 221. If the scan instruction notification from the operation control unit 221 has not been generated, the main control unit 225 directly waits for a scan in step S1201. If there is a scan instruction notification from the operation control unit 221, the main control unit 225 proceeds to step S1202.

  In step S <b> 1202, the main control unit 225 performs document vertical / horizontal determination processing of the scanned image recorded in the memory 230. Here, the document determination process executed by the main control unit 225 is the same process as that in FIG. 3 of the first embodiment.

  In step S1203, the main control unit 225 transmits the determination result in step S1202 as an image determination result notification to the projector 100 via the communication unit 232. The image determination result notification includes information indicating whether the scanned and output image is a vertical document, a horizontal document, or a non-document image. Specifically, information is transmitted from the communication unit 232 of the scanner 110 to the projector 100. This transmission means may be anything such as USB, LAN, RS232C, or wireless.

  Here, processing on the projector 100 side will be described.

  In FIG. 12A, in step S1211, the main control unit 209 of the projector 100 determines whether an image determination result notification from the scanner 110 has been received. When the communication unit 210 of the projector 100 receives the packet, it notifies the main control unit 209. The main control unit 209 determines whether or not the received packet is the image determination result notification. It is also determined whether or not the device that transmitted the image determination result notification is the device that is inputting the current video. Here, when the main control unit 209 recognizes that the received packet is output as a result of the image determination result notification from the device that is inputting the video, the process proceeds to step S1213. Otherwise, the main control unit 209 transitions to step S1212 and processes the input from the user according to the normal operation system.

  In step S1213, the main control unit 209 detects whether or not the digital zoom button 147 of the remote controller 140 has been pressed by the operation control unit 214. When the main control unit 209 detects that the digital zoom button 147 has been pressed, the process proceeds to step S1214. When the main control unit 209 detects that other buttons have been pressed, the main control unit 209 executes the processing described in the first embodiment.

  In step S <b> 1214, the main control unit 209 transmits an enlargement instruction command to the scanner 110 through a USB interface (not shown) connected to the communication unit 210. The communication interface at this time is not limited to LAN, RS232C, or wireless as described above.

  Returning to the description on the scanner 110 side, in step S1204, the main control unit 225 causes the video signal output unit 222 to output the scan image recorded in the memory 230.

  In step S1205, the main control unit 225 detects whether there is an enlargement instruction. Here, the enlargement instruction is notified from the operation control unit 221 to the main control unit 225 when the user operates switches such as a remote controller of the scanner 110 or a touch panel. When the operation control unit 221 detects that there is an enlargement instruction, the main control unit 225 proceeds to step S1207, and if not detected, the main control unit 225 proceeds to step S1206.

  In step S1206, the main control unit 225 detects whether there is an enlargement instruction from the outside. Here, the specific external enlargement instruction is reception of an enlargement instruction command from the projector 100 as described above. When the main control unit 225 detects that the packet received by the communication unit 232 is the enlargement instruction command, the main control unit 225 proceeds to step S1207.

  In step S1207, the main control unit 225 performs an enlargement process on the scanned image recorded in the memory 230 by the image processing unit 223 based on the determination result in step S1202, and records it as an output image in the memory 230. The enlargement process here is the same process as in FIG. 9A of the first embodiment.

  According to the second embodiment described above, the display control technique of the present invention can be realized in another aspect, and it is possible to reduce the burden of work related to display control.

  Further, in this embodiment, the image determination processing for the vertical document and the horizontal document is performed on the scanner 110 side, as described in the first embodiment, and is performed on the projector 100 side, and the enlargement processing is realized on the scanner 110 side. It is also possible to do. According to this aspect, when an image is scanned on the scanner 110 side, an image without deterioration can be output even when there is an enlargement instruction by scanning at a high resolution. There is also.

  In this embodiment, an example in which the scanner 110 is connected to the scanner 110 using a VGA cable has been described. However, the image transmission device such as the digital camera 120 and the PC 130 and the connection form may be used. Further, the apparatus on the image supply side is not limited to the scanner 110 or the like, and any apparatus can be used as long as the image can be supplied to the display device.

  [Third Embodiment] Next, as a third embodiment, processing on the projector 100 side when the digital camera 120 is connected to the projector 100 via the USB cable 102 will be described.

  The configuration of the projector 100 in the present embodiment is the same as that in the first and second embodiments, and the configuration of the digital camera 120 is as shown in FIG.

  In FIG. 13, reference numeral 1301 denotes a main control unit that controls each unit of the digital camera 120. An operation control unit 1302 performs processing according to a user operation. An image processing unit 1303 performs predetermined processing on the image acquired by the imaging system 1309. A communication unit 1304 communicates with an external device, and is a USB interface in this embodiment. Reference numeral 1305 denotes a non-volatile storage device that stores programs and the like that operate on the main control unit 1301. Reference numeral 1306 denotes a work memory for programs and data. Reference numeral 1307 denotes a detachable recording unit that records a photographed image. An imaging control unit 1308 drives the imaging system 1309 to control imaging processing.

  The operation of the digital camera 120 of this embodiment will be described with reference to the flowchart of FIG. The process shown in FIG. 14A is executed when the main control unit 1301 expands the program recorded in the nonvolatile storage device 1305 of the digital camera 120 in the memory 1306.

  In FIG. 14A, in step S1401, the main control unit 1301 confirms with the operation control unit 1302 whether or not a shooting request has occurred.

  In step S1401, the main control unit 1301 transitions to step S1402 when a shooting request is generated.

  In step S1402, the main control unit 1301 performs shooting processing. A detailed description of the shooting process of the digital camera 120 is omitted.

  In step S1403, the main control unit 1301 determines whether the captured image is a text image or a non-text image, and if the captured image is a text image, determines whether it is vertical writing or horizontal writing. This process is the same as that in FIG. 3 of the first embodiment.

  In step S1404, the main control unit 1301 records the determination result in step S1403 in the memory 1306 as a part of the EXIF header in the header area of the captured image. Specifically, information for identifying whether or not the photographed image is a text image, and in the case of a document image, information indicating whether it is vertical writing or horizontal writing is included. The file format has been described by taking EXIF as an example, but is not limited to a specific format, and a generally recognizable format is preferable.

  In step S1405, the main control unit 1301 records the captured image and the header generated in step S1404 as one file in the removable recording unit 1307.

  Next, the operation of the projector 100 according to the present embodiment will be described with reference to FIG. The process shown in FIG. 14B is executed by the main control unit 209 of the projector 100. As a premise, the process shown in FIG. 14B is executed when the user requests data capture from the digital camera 120 and projection while the projector 100 and the digital camera 120 are connected by the USB cable 102. Shall.

  In FIG.14 (b), in step S1411, the main control part 209 determines whether the file read request | requirement generate | occur | produced from the user with the operation control part 214, and when a request generate | occur | produces, it transfers to step S1412. To do.

  In step S <b> 1412, the main control unit 209 reads an image file from the removable recording unit 1307 of the digital camera 120 through the communication unit 210. In the present embodiment, it is assumed that the main control unit 209 reads the image files in the order of the file generation date and time by USB using the mass storage protocol.

  In step S1413, the main control unit 209 expands the compressed image file read in step S1412 and records it in the memory 212 as a raster image.

  In step S1414, the main control unit 209 indicates the sentence image / non-document image and the vertical / horizontal writing document image added in step S1404 of FIG. 14A to the header of the image file read from the digital camera 120. Read information.

  In step S1415, the main control unit 209 converts information indicating whether the image is a document image or a non-document image and information indicating whether the image is vertical writing or horizontal writing from the information read in step S1414 into the read image. It is determined whether or not it has been added. When the main control unit 209 determines that these pieces of information are not added, the process proceeds to step S1416. When the main control unit 209 determines that these pieces of information are added, the process proceeds to step S1417.

  In step S1416, the main control unit 209 determines whether the image read from the digital camera 120 is a document image or a non-document image, and if the image is a document image, the image is vertically written or horizontally written. This determination processing is the same processing as FIG. 3 of the first embodiment.

  In step S1417, the main control unit 209 performs display according to the document image information added to the image file in advance or determined in step S1416. The display process here is the same process as in FIG. 9A of the first embodiment.

  According to the embodiment described above, the display control technique of the present invention can be realized in other modes, and the troublesomeness of work related to display control can be reduced.

  In the present embodiment, the document image discrimination information is added to the header of the file, but the digital camera 120 may notify the projector 100 by communication.

  Furthermore, in the present embodiment, the projector 100 and the digital camera 120 are connected. However, the digital camera 120 may be an external storage device such as a USB memory, or may be a scanner 110 or a PC 130. The protocol is also a mass storage protocol, but other protocols such as PTP may be used. The interface is not limited to USB. Furthermore, the display device may be a display device other than the projector.

  [Fourth Embodiment] Next, as the fourth embodiment, processing on the PC 130 side (application) will be described.

  The configuration of the projector 100 in the present embodiment is the same as that in the first to third embodiments, and the configuration of the PC 130 is as shown in FIG.

  In FIG. 15A, the main control unit 1502 of the PC 130 controls each unit. The display control unit 1503 generates display data to be output to the monitor, and outputs the display data from the video signal output unit 1501 to an external monitor. A communication unit 1504 communicates with an external device. The nonvolatile storage device 1505 holds programs and data and executes them on the memory 1506. The operation control unit 1507 accepts input from a mouse (not shown) or a keyboard (not shown).

  In FIG. 15B, reference numeral 1511 denotes a screen generated and displayed by the display control unit 1503 of the PC 130. The main control unit 1502 causes the display control unit 1503 to generate and display individual windows 1512 and 1513 according to the program to be executed.

  Here, data displayed in the windows 1512 and 1513 is data read from the nonvolatile storage device 1505 by the main control unit 1502 or data acquired from the outside via the communication unit 1504.

  The user can execute an operation on each window displayed on the screen 1511 with a mouse (not shown) or a keyboard (not shown). The operation control unit 1507 notifies the input from the mouse or keyboard to the main control unit 1502, and the main control unit 1502 executes processing and changes the mode of the screen 1511 in response to the notification.

  Each window is accompanied by a control menu and a right-click pop-up menu. Reference numeral 1514 denotes a pop-up menu that is displayed and displayed to the main control unit 1502 via the operation control unit 1507 when the user right-clicks the window 1513 with the mouse. In this menu, a determination menu 1515 for determining whether or not the image displayed in the window 1513 is a document image is displayed. Further, an enlargement menu 1516 and a reduction menu 1517 that can support whether to enlarge or reduce according to the determination result are displayed. These menus may be assigned shortcut keys so that they can be controlled with a keyboard.

  When the discrimination menu 1515 is selected, the main control unit 1502 executes the same processing as that in FIG. 3 of the first embodiment, and whether the image is a document image or a non-document image. Determine whether the writing is horizontal or horizontal. Further, when the data displayed in the window 1513 includes the information, the information is determined.

  Next, the main control unit 1502 performs processing according to FIG. 9A and changes the display of the pop-up menu 1514. When the user selects the enlarge menu 1516 and the reduce menu 1517, the process of FIG. 9A is executed in the same manner, and the display mode of the pop-up menu 1514 is changed.

  According to the embodiment described above, the present invention can also be applied to the application of the PC 130, and the display control technique of the present invention can be realized in other modes.

  Further, in the present embodiment, it has been described that the user can request execution of this processing by the pop-up menu 1514. On the other hand, for example, when there is a menu for rotating and displaying the image data displayed in the window 1513, when an image rotation request is generated by the menu, the processing of FIG. 3 is executed, and according to the result. The display process may be performed according to FIG.

  Further, the main control unit 1502 may execute the processes of FIGS. 3 and 9A at a timing when another display mode change request is generated from the user.

  In addition, the above processing may always be executed when an image is displayed regardless of a user instruction. Specifically, when data received via the communication unit 1504 or data recorded in the nonvolatile storage device 1505 is read and displayed by a predetermined program, the main control unit 1502 3 may always be executed.

  [Embodiment 5] Next, as Embodiment 5, ruled line discrimination processing when a table is included in a document image will be described.

  The present embodiment is realized by the projector 100, and the configuration of the projector 100 is the same as that of the first to fourth embodiments.

  The operation of the projector 100 according to the present embodiment will be described with reference to the flowchart of FIG. The process shown in FIG. 16 is executed when the main control unit 209 expands the program recorded in the nonvolatile storage device 211 of the projector 100 in the memory 212.

  In FIG. 16, in step S1601, the main control unit 209 initializes information held in the memory 212 such as a table determination flag, a cell size, and the number of ruled lines.

  In step S1602, the main control unit 209 executes binarization processing on the image data input from the video signal input unit 213 and recorded in the memory 212.

  In step S1603, the main control unit 209 extracts a non-document area from the image data binarized in step S1602. Specifically, the document area is extracted from the cumulative histograms in the vertical direction and the horizontal direction in the same manner as the processing of FIG. 3 of the first embodiment, and the rest are extracted as non-document areas. For example, in the document image 1811 in FIG. 18B, the main control unit 209 identifies that the feature value 1813 of the cumulative histogram 1812 in the horizontal direction is a document area, and estimates the area 1814 as a non-document area. .

  In step S1604, the main control unit 209 determines whether or not a non-document area has been extracted from the extraction result of step S1603. If it is determined that a non-document area has been extracted, the process proceeds to step S1605; The process ends.

  In step S1605, the main control unit 209 performs ruled line tracking. Ruled line tracking refers to tracking data that forms a straight line on binarized image data. For example, in FIG. 17, when processing is performed on the table 1701, 1702 is detected as a vertical ruled line and 1703 is detected as a horizontal ruled line.

  In step S1606, the main control unit 209 determines whether or not it is a ruled line of the table from the result of step S1605. Whether or not it is a ruled line is determined to be a ruled line in the table when three or more lines having the same inclination and length are detected. If it is not determined as a ruled line, the process ends.

  In step S1607, the main control unit 209 determines whether or not the table is a single table from the length of the ruled line and the distance between the ruled lines, performs ruled line grouping, and calculates the presence or absence of a plurality of tables. The information is recorded in the memory 212.

  In step S1608, the main control unit 209 calculates the inclination of the image. For example, when the image is slightly inclined as in 1901 in FIG. At this time, the main control unit 209 calculates the rotation angle of the image by obtaining the inclination of the ruled line 1903 and records it in the memory 212.

  In step S1609, the main control unit 209 searches for the horizontal size 1801, vertical size 1802, and ruled line intersection 1803 of the table cell shown in FIG. The main control unit 209 executes this process for each table determined in step S1607.

  Through the above processing, the main control unit 209 can determine whether or not a table is included in the document image.

  Note that the timing of the above processing is not limited to an instruction from the user, but may be a timing when an input from the video signal input unit 213 occurs, or may be a timing when data is read from an external device and displayed.

  Next, display processing based on the table information acquired in FIG. 16 will be described with reference to the flowchart in FIG. The processing shown in FIG. 20 is executed when the main control unit 209 expands the program recorded in the nonvolatile storage device 211 of the projector 100 in the memory 212.

  In step S2001, the main control unit 209 determines whether the document includes a table from the processing result in FIG. If the table is not included, the process proceeds to step S2002, and the determination process of whether or not the document image is shown in FIG. 3 is executed.

  In step S2001, if the main control unit 209 determines that the image includes a table, the process proceeds to step S2005.

  In step S2005, the main control unit 209 corrects the rotation of the image data input from the video signal input unit 213 recorded in the memory 212 by the image processing unit 207 according to the rotation angle of the image acquired in FIG. To record.

  In step S2006, the main control unit 209 determines and displays the display magnification from the ruled line information acquired in FIG. Specifically, as shown in FIG. 21A, the main control unit 209 displays the 7 × 15 portion 2102 in the case of the table 2101 of 13 × 27 length and width so that the display control unit 208, the image processing unit 207 is controlled to display. That is, control is performed so that the ruled line always becomes the boundary of the display surface.

  In step S2007, the main control unit 209 records and holds the enlargement base point 2103 in the memory 212, and proceeds to step S2003.

  In step S2003, input from the user is awaited. The main control unit 209 uses the operation control unit 214 to determine whether the user input is a display correction button, an enlarged display button, or a display screen movement button. Since each button has been described in the first embodiment, a description thereof will be omitted.

  If it is determined in step S3203 that the display correction button has been pressed, the processing in steps S2005 to S2007 described above is executed by the main control unit 209.

  If it is determined that the enlargement display button has been pressed, the main control unit 209 reads out the enlargement base point information recorded in step S2007 (step S2009).

  In step S2010, the main control unit 209 performs enlargement processing according to the enlargement base point read in step S2009. At this time, as shown in FIG. 21 (b), the main control unit 209 includes the display control unit 208 and the main control unit 209 so that the portion (2111) surrounded by the ruled line is displayed as a display surface at the ruled line boundary. The image processing unit 207 is controlled.

  If it is determined that the display surface movement button has been pressed, the main control unit 209 moves the display surface (step S2012). At this time, as indicated by reference numeral 2121 in FIG. 21C, the main control unit 209 controls the display control unit 208 and the image processing unit 207 so that the ruled line is the boundary as the movement amount.

  In step S2013, the main control unit 209 records 2122 in the memory 212 as an enlargement base point.

  With the above processing, when displaying a table, it is possible to provide suitable operability for an image including the table.

  FIG. 22A shows a state where tables 2202, 2203, 2204 and document 2205 are mixed in one document image 2201. In this case, each table is determined by the processing in step S1606 in FIG. The main control unit 209 displays the table selection frame 2206 in an identifiable manner by the display control unit 208, and allows the user to select the desired table by moving the table selection frame 2206 with the remote controller 140. For the selected table, the main control unit 209 performs the same processing as in FIG. 20, so that even when there are a plurality of tables on the screen, suitable table display control can be realized.

  Further, the main control unit 209 may display the selected table in full screen when the table is selected.

  Furthermore, if the main control unit 209 determines in step S1606 in FIG. 16 that there is no ruled line in the table, the main control unit 209 estimates that the non-document area is a figure or a photograph. The main control unit 209 divides the non-document area from the cumulative histograms in the horizontal direction and the vertical direction, and determines whether there are a plurality of figures and photographs in the non-document area.

  FIG. 22B shows a state where tables 2212, 2213 and 2214 and a document 2215 are mixed in one document image 2211. In this case, the main control unit 209 displays the table selection frame 2216 in an identifiable manner by the display control unit 208, and allows the user to select the desired table by moving the table selection frame 2216 with the remote controller 140. For the selected table, the main control unit 209 displays the selected image on the entire screen in response to the enlarged display button of the remote controller 140 being pressed.

  [Other Embodiments] The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program code. It is processing to do. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (14)

An acquisition means for acquiring a document image;
Detecting means for detecting whether the document image is vertical writing or horizontal writing;
Display control means for displaying the document image on a display device;
The display control means detects the position of the reference point for enlarging the document image when the detection means detects vertical writing and horizontal writing according to an instruction to enlarge the document image. A display control device characterized in that the display control device differs depending on the case. The display control means includes
When the document image is detected as vertical writing by the detection means, the position of the reference point for enlargement is changed to the upper right from the center of the document image,
The display control apparatus according to claim 1, wherein when the document image is detected as horizontal writing by the detection unit, the position of the reference point for enlargement is changed to the upper left from the center of the document image. . The display control means includes
If the document image is detected as vertical writing by the detection means, the reference point for the enlargement is set at the upper right position of the document image,
3. The display control according to claim 2, wherein when the document image is detected as horizontal writing by the detection unit, the position of the reference point for the enlargement is set to the upper left position of the document image. apparatus. The display control means, when the acquisition means acquires a document image,
When the document image is detected as vertical writing, the character string in the vertical direction is enlarged and displayed so as to fit in the vertical direction of the screen of the display device,
When the document image is detected as horizontal writing, the character string in the horizontal direction is enlarged and displayed so as to fit in the horizontal direction of the screen of the display device,
The display control apparatus according to claim 1, wherein when the document image is neither vertical writing nor horizontal writing, the document image is displayed so as to be within the screen of the display device. A discriminator for discriminating whether the document image includes a non-document area;
When the document image includes a non-document area, the display control unit enlarges the non-document area so that the non-document area is displayed on a full screen in response to an instruction to enlarge the document image displayed on the display device. The display control apparatus according to claim 1.   The display control apparatus according to claim 5, wherein the non-document area is a table, a figure, or a photograph configured by vertical and horizontal ruled lines. When the non-document area is a table, the display control means determines an enlargement ratio according to the number of ruled lines and the interval between the ruled lines,
7. The reference point for enlarging the upper left of the table is enlarged and displayed so that an area surrounded by vertical and horizontal ruled lines of the table is displayed in full screen according to the determined enlargement ratio. The display control apparatus described. When the document image includes a plurality of tables, the display control means determines whether at least one of the tables displayed on the display device is in accordance with an instruction to select a table displayed on the display device. Display a frame around the selected table so that it can be identified,
7. The display according to claim 6, wherein an area surrounded by vertical and horizontal ruled lines of the selected table is enlarged and displayed in accordance with an instruction to enlarge the document image displayed on the display device. Display controller. When the document image includes a plurality of figures or photos, the display control means displays the figures or photos displayed on the display device in response to an instruction to select the figures or photos displayed on the display device. Display a frame around the selected figure or photo so that at least one of them can be identified.
The display control apparatus according to claim 6, wherein an enlarged display is performed so that the selected figure or photograph is displayed on a full screen in response to an instruction to enlarge the document image displayed on the display apparatus.   The detection unit according to claim 1, wherein the detection unit determines whether or not the document image data acquired by the acquisition unit includes information indicating whether the document image is written vertically or horizontally. Display control device. The display control means rotates the document image in response to an instruction to rotate the document image displayed on the display device,
The display control apparatus according to claim 1, wherein the detection unit detects whether the rotated document image is vertically written or horizontally written. A display control method for displaying a document image acquired by an acquisition unit on a display device,
A detecting step for detecting whether the document image is vertical writing or horizontal writing;
When the display control means displays the document image on a display device, the position of the reference point for enlarging the document image is vertically written by the detection means in response to the enlargement instruction of the document image. A display control method comprising: a display control step for making a difference between when detected and when detected as horizontal writing.   The program for functioning a computer as each means of the display control apparatus of any one of Claims 1 thru | or 11.   A computer-readable storage medium storing a program for causing a computer to function as each unit of the display control device according to any one of claims 1 to 11.