JP3723816B2 - Display data creation device, display data creation method, display data creation program, and computer-readable recording medium on which display data creation program is recorded - Google Patents

Description

  The present invention relates to a display data creation device, a display data creation method, a display data creation program, and a computer-readable recording medium on which a display data creation program is recorded, and more particularly, in a small display area or a low-resolution display environment, The present invention relates to a display data creation apparatus that provides display data that can be browsed while grasping an image layout, a display data creation method, a display data creation program, and a computer-readable recording medium that records the display data creation program.

  With the widespread use and improvement in performance of mobile terminals such as mobile phones and PDAs (personal digital assistants), in recent years it has become possible to handle complex information on these mobile terminals. In the conventional technology, when viewing a document with a high resolution or a complex layout in a small display area or a low-resolution display environment such as these mobile terminals, characters are enlarged or reduced to a size that is easy to read, The method of presenting the user with the area that can be displayed on the screen has been mainly used.

  This method has the following problems for both producers and viewers. It is highly likely that the part that the document creator places importance on will be overlooked depending on the operation of the viewer, so that the content intended by the creator has not been accurately communicated to the viewer. In addition, if the layout of the document becomes complicated, the viewer has to operate and read while considering the order, which hinders browsing concentrated on the document contents.

  In order to solve these problems, a device has been proposed in which a viewer system has an operation related to display that has been performed by a viewer as automatic control data and performs display based on the automatic operation data (for example, Patent Documents). 1).

In the apparatus of Patent Document 1, in order to flexibly display an electronic book, the creator of the electronic book writes a desired scrolling procedure in advance in the electronic book data. By repeating one operation, scrolling is performed according to the procedure assumed by the producer.
JP-A-11-272399

  In the method of Patent Document 1, although scroll display is performed in the order assumed by the producer, since a plurality of lines are included in the display range, the viewer does not always read the line assumed by the producer. . As a result, there is a drawback that the line that the viewer wants to see is not displayed due to the switching of the display position such as after a line feed. For example, if 5 lines are included in the display range and the producer assumes that the viewer reads the 3rd line, which is the middle line, the 4th line will be displayed after the line feed. It will suffice if it is in a state. However, the viewer may read the first line. In this case, the second line needs to be displayed after the line feed, but there is no guarantee that the second line is displayed.

  In addition, there is a drawback that the viewer does not know which part of the entire document is viewed, and the viewer ignores the layout.

  Further, for example, when switching from the display at the right end at the end of the line to the display at the left end at the beginning of the line, it is not always possible to correctly recognize the line next to the line read by the user from among the plurality of displayed lines. In other words, the viewer must choose the line to read from the context of the sentence.

  In addition, it is difficult for the viewer to grasp the entire image of the page, and it is difficult to understand which part of the page is currently being read.

  SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide display data creation apparatus and display data that can create display data intended by the producer, or display data that allows the viewer to easily grasp the layout and to easily view the display data. A creation method, a display data creation program, and a computer-readable recording medium on which the display data creation program is recorded.

  According to one aspect of the present invention, an apparatus for creating data to be displayed on a screen operates a display image data creation unit for creating display image data for display using input image data, and creation of display image data. A display image for controlling the creation processing of the display image data creation unit by using an automatic operation data input unit for inputting an automatic operation data group prepared in advance and the automatic operation data group input by the automatic operation data input unit A data creation operation processing unit.

  Therefore, if the producer of the display image data to be presented to the user (viewer) prepares a desired automatic operation data group in advance, the display image data creation operation processing unit performs the automatic operation input by the automatic operation data input unit. A display image data creation process of the display image data creation unit is controlled using the data group.

  Therefore, display image data intended by the producer can be easily created and presented to the user.

  Preferably, the automatic operation data group includes data instructing the display image data creation unit to draw a line segment within a predetermined range of the image of the display image data.

  Therefore, when an image based on the created image data is displayed, attention can be drawn by drawing a line segment at a location intended by the producer. The user only has to read the point indicated by the line segment.

  Therefore, the viewer can read the document of the image along the drawn line segment. Thus, even when the viewpoint is moved greatly or the display is switched discontinuously, such as when a line is switched, the viewer does not lose sight of his / her reading position.

  Preferably, the automatic operation data group includes data instructing the display image data creation unit to extract image data of a predetermined area of the image of the input image data for display image data.

  Therefore, by preparing such an automatic operation data group, it is possible to instruct a predetermined area of the image of the input image data to use the image data for the display image data.

  Preferably, the automatic operation data group includes data instructing to enlarge or reduce the image of the image data of the predetermined region to be extracted at a predetermined magnification.

  Therefore, by preparing such an automatic operation data group, it is possible to instruct a magnification for displaying an image extracted from the image of the input image data.

  Preferably, the display image data creation processing unit cuts out data of a designated area from the input image data based on the area designation data in the automatic operation data group, and performs an enlargement or reduction process based on the size data in the automatic operation data group And a local image data creation processing unit that creates local image data and an entire image data creation processing unit that creates input image data by enlarging or reducing the input image data based on the size data. Display image data is created by combining the whole image data and local image data.

  Therefore, by preparing such an automatic operation data group, the local image data and the whole image data that are cut and synthesized from the input image data to create display image data are cut from the input image data. The area and size can be specified automatically at once.

  Preferably, a line segment is added to the range designated based on the range designation data in the automatic operation data group in the generated display image data.

  Therefore, by preparing such an automatic operation data group, it is possible to add a line segment to a desired range in the generated display image data.

  Preferably, image data indicating a position corresponding to local image data in the entire image data is added to the created display image data.

  This added image data is for indicating the position of the image data.

  Therefore, the position corresponding to the local image data in the entire image data can be indicated in the generated display image data.

  Preferably, the automatic operation data group includes a plurality of types of data sets, and the display image data creation operation processing unit selects a data set to be applied to the creation process from the automatic operation data group based on a user operation.

  Therefore, the user can arbitrarily select an automatic operation data set to be applied for display image data creation by user operation.

  Preferably, the automatic operation data group is included in the input image data.

  Therefore, the automatic operation data group is not provided to the apparatus separately from the input image data, but can be provided in a state of being included in the input image data.

  According to another aspect of the present invention, a method for creating data to be displayed on a screen includes a display image data creation step for creating display image data for display using input image data, and creation of display image data. An automatic operation data input step for inputting an automatic operation data group prepared in advance for operation, and a display for controlling the generation process in the display image data generation step using the automatic operation data group input in the automatic operation data input step Image data creation operation processing step.

  According to still another aspect of the present invention, there is provided a display data creation program for causing a computer to execute the display data creation method described above.

  According to still another aspect of the present invention, a computer-readable recording medium recording a display data creation program for causing a computer to execute the above-described display data creation method is provided.

  Each embodiment will be described below with reference to the drawings.

  FIG. 1 is a diagram showing the configuration of the image display data creation apparatus of the first embodiment, and FIG. 2 is a configuration diagram of a computer applied to each embodiment of the present invention. Each of the image display data creation apparatuses according to the first and second embodiments described later can be mounted on the computer. Each of the automatic image display apparatuses according to third and fourth embodiments described later can also be mounted on the computer.

  Referring to FIG. 2, the computer includes a monitor 110 made of CRT (cathode ray tube) or liquid crystal, CPU (abbreviation of central processing unit) 122 for centrally controlling the computer itself, ROM (Read Only Memory) or A memory 124 including a RAM (abbreviation of random access memory), a fixed disk 126, and an FD (flexible disk) 132 are detachably mounted, and an FD driving device 130 that accesses the mounted FD 132, a CD-ROM Various communication networks including a CD-ROM drive device 140, a keyboard 150, a mouse 160, a pen tablet 170, the Internet, and the like, to which a (Compact Disc Read Only Memory) 142 is detachably attached and accesses the attached CD-ROM 142 For communication connection between the computer 182 and the computer Including the communication Intafeisu 180. These units are connected for communication via a bus.

  The computer may be provided with a magnetic tape device in which a cassette type magnetic tape is detachably mounted to access the magnetic tape.

  Referring to FIG. 1, image display data creation device 0703 receives input image data from connected image input device 0701 and user operation information from connected operation input device 0702, and creates display image data. Output to the connected display device 0704. The image input device 0701 is a device connected to the computer of FIG. 2, and here is a device connected via the communication interface 180. The operation input device 0702 corresponds to the keyboard 150, the mouse 160, the pen tablet 170, and the like in FIG. The display device 0704 corresponds to the monitor 110 in FIG.

(First embodiment)
In the first embodiment, there is provided an image display data creation device that allows a user to manually specify the display degree of whole image data and local image data and has a function of displaying an underline at an arbitrary portion of an image. Indicated. Here, the drawn line segment is a straight line, but the line type such as a solid line, a broken line, and a wavy line is not limited to a straight line. Further, although the color, thickness, etc. of the line segment are not defined here, these attributes may be changed. In addition, as shown in FIG. 19, any figure or illustration 1902 can be used instead of a line as long as the position can be indicated.

  The image display data creation device 0703 includes an input image data buffer 0705, a whole image data creation processing unit 0706, a whole image data buffer 0707, a control processing unit 0708, a local image data creation processing unit 0709, a local image data buffer 0710, display image data. A creation processing unit 0711 and a display image data buffer 0712 are provided.

  The input image data buffer 0705 stores the image data input from the image input device 0701. The entire image data creation processing unit 0706 reads the input image from the input image data buffer 0705 and outputs the entire image data. The entire image data buffer 0707 stores the entire image data output from the entire image data creation processing unit 0706. A control processing unit 0708 controls creation of display image data in accordance with information input from the operation input device 0702. The local image data creation processing unit 0709 reads input image data from the input image data buffer 0705, creates local image data, and outputs it. The local image data buffer 0710 stores the local image data output from the local image data creation processing unit 0709.

  The display image data creation processing unit 0711 reads the whole image data from the whole image data buffer 0707 and the local image data from the local image data buffer 0710, and creates and outputs display image data according to the control information from the control processing unit 0708. . The display image data buffer 0712 stores the display image data output from the display image data creation processing unit 0711.

  Although not shown in FIG. 2, the input image data buffer 0705, the entire image data buffer 0707, the local image data buffer 0710, and the display image data buffer 0712 are realized by a RAM such as a flash memory, a memory 124, and a fixed disk 126. The whole image data creation processing unit 0706, the control processing unit 0708, the local image data creation processing unit 0709, and the display image data creation processing unit 0711 are realized by, for example, independent circuits or arithmetic processing circuits (not shown) of the CPU 122 of the computer of FIG. The virtual circuit may be realized by a program executed by the CPU 122.

  FIG. 3 shows a flow of processing of the image display data creation device 0703 according to the first embodiment. Here, the horizontal and vertical sizes of the input image corresponding to the input image data are XSIZE and YSIZE, respectively. The horizontal size and the vertical size of the display size of the display device 0704 are assumed to be XDISPLAYSIZE and YDISPLAYSIZE, respectively.

  The operation is started and input image data is received from the image input device 0701 and stored in the input image data buffer 0705 (S0801, S0802).

  The entire image data creation processing unit 0706 receives the input image data from the input image data buffer 0705, and the input image data is (XDISPLAYSIZE / XSIZE) times in the horizontal direction and (YDISPLAYSIZE / YSIZE) enlarged or reduced processing is output as entire image data (S0803).

  The enlargement or reduction process uses linear interpolation, but is not limited to linear interpolation. An example of the entire image data 0101 is shown in FIG.

  The entire image data output from the entire image data creation processing unit 0706 is stored in the entire image data buffer 0707 (S0804).

  Initial values such as various variables (parameters) for processing are set for the control processing unit 0708 (S0805). Here, various variables will be described. The control processing unit 0708 manages each variable related to both the entire image data and the local image data related to only the entire image data, only related to the local image data.

  For only the whole image data, the whole image straight line presence / absence whole_line indicating the presence or absence of a straight line in the whole image is managed. The value of whole image straight line presence / absence whole_line is 1 when a straight line is displayed and 0 when there is no straight line display.

  In addition, the following variables are managed only for local image data. The position (xposition, yposition) in the image of the input image data at the upper left point of the local image data image, the display magnification arate, and the local image straight line presence / absence part_line indicating the presence / absence of a straight line in the local image are managed. The value of the local image straight line presence / absence part_line indicates 1 when there is a straight line display and 0 when there is no straight line display. The position (xposition, yposition) is a variable for determining which portion of the input image data is to be the local image data.

  Manages the line start point (xstart, ystart), line end point (xend, yend), and the composition ratio orate indicating the ratio of the sum of the local image data and the whole image data as variables related to the whole image data and the local image data. . The straight line start point (xstart, ystart) and the straight line end point (xend, yend) both indicate the position of the input image data in the image.

  The whole image straight line presence / absence whole_line and the local image straight line presence / absence part_line use 1 and 0 as the reference for the presence / absence of the straight line.

  The control processing unit 0708, for example, (xposition, yposition) = (0, 0) (sets the image data of the upper left portion of the image of the input image data as the local image data). Further, arate = 1 (the display magnification of the local image data is equal), orate = 0.8, and 0 (no line display) is set in part_line and whole_line. The set value is an example, and other values may be used.

  The variables specific to the local image data described above are not limited to the position (xposition, yposition) of the upper left point of the local image data in the input image data and the display magnification arate, but the positional relationship of the local image in the input image As long as the size is determined. For example, the position of the lower right point in the input image data of the local image data may be used instead of the display magnification arate.

  Normally, the control processing unit 0708 operates in response to input information from the user via the operation input device 0702, but the initial value setting here is set instead of the input information from the user.

  Upon receiving an input from the operation input device 0702, the control processing unit 0708 changes (sets) the values of various variables based on the input content (S0806).

  The local image data creation processing unit 0709 receives input image data from the input image data buffer 0705, creates local image data based on the information specified by the control processing unit 0708, and outputs it (S0807).

  The local image data creation process creates an image with the size of (XDISPLAYSIZE / arate) in the horizontal direction and (YDISPLAYSIZE / arate) in the vertical direction extracted from (xposition, yposition) of the input image data. Is obtained by enlarging or reducing the image by arate times as local image data.

  Here, linear interpolation is used for the enlargement / reduction processing, but any other enlargement / reduction method may be used. An example of the local image data 0301 is shown in FIG.

  The local image data output from the local image data creation processing unit 0709 is stored in the local image data buffer 0710 (S0808).

  The display image data creation processing unit 0711 reads the entire image data and the local image data from the entire image data buffer 0707 and the local image data buffer 0710, respectively, and uses them to display the display image data according to the information specified by the control processing unit 0708. Is generated and output (S0809).

  When the pixel value value1 (x, y) of the entire image data at the coordinates (x, y), the pixel value value2 (x, y) of the local image data, and the pixel value value3 (x, y) of the display image data are value3 Display image data is created such that (x, y) = orate × value2 (x, y) + (1-orate) × value1 (x, y) (the display image data 0401 at this stage is shown in FIG. Add the frame data to it. The frame is for specifying a position in the entire display area of the display device 0704 corresponding to the position of the local image data in the entire image data.

  When the composition ratio orate is larger than 0 and smaller than 1, the display image data is displayed as the whole image data and the local image data at the same time as the image shown in FIG. A frame 0501 in FIG. 5 corresponds to the frame indicating the position of the local image data in the entire image data described above. Further, in order to make the relationship between the whole image data and the local image data easier to understand, an outer frame is added like a frame 0502 for the display image data, and a frame of the local image data corresponding to the frame 0501 in the whole image data is used. Also good. Further, an example of display image data may not include a corresponding frame as shown in FIG.

  When the composition ratio orate is 0, as the display image data, for example, as shown in FIG. 8, entire image data 0202 including a frame 0201 of local image data is displayed. When the composition ratio orate is 1, local image data as shown in FIG. 9 is displayed as display image data, for example.

  If the range of the composition ratio orate is limited, it is possible to set so that the entire image data and the local image data are always displayed.

  7, 8, and 9, frames 0501, 0201, and 0601 are the upper left point (xposition × XDISPLAYSIZE / XSIZE, yposition × YDISPLAYSIZE / YSIZE), lower right point ((xposition + XDISPLAYSIZE / arate) × XDISPLAYSZE / XSIZE, ( yposition + YDISPLAYSIZE / arate) × YDISPLAYSZE / XSIZE).

  Further, when information (variable) instructing whether or not to add the frame information of the local image data to the display image data is added to the variable group managed by the control processing unit 0708, the user dynamically specifies whether or not to display the frame. It is also possible to do.

  If the whole image straight line presence / absence whole_line is 1, the whole image data is the data of the line connecting 2 points (xstart × XDISPLAYSIZE / XSIZE, ystart × YDISPLAYSIZE / YSIZE), (xend × XDISPLAYSIZE / XSIZE, yend × YDISPLAYSIZE / YSIZE) Add to.

  When local image straight line presence / absence part_line is 1, 2 points (((xstart-xposition) × arate, (ystart-yposition) × arate), ((xend-xposition) × arate, (yend-yposition) × arate) ) Is added to the local image data.

  The straight lines specified by the variables xstart, ystart, xend, and yend are used in the manner shown in FIGS. 10 and 11, for example, to indicate a portion of an image to be noticed by the user and a line of a document to be viewed. it can. FIG. 10 shows a state where a straight line 1302 is drawn on the local image data 0301. FIG. 11 shows a state in which a straight line 1403 for the entire image and a straight line 1404 for the local image are drawn in the image 0401 of FIG. Such a straight line serves as a guide for the user's viewpoint in the displayed image. The straight line may be used to designate a portion corresponding to important information in the display image.

  The display image data created by the display image data creation processing unit 0711 is stored in the display image data buffer 0712 (S0810), and the display image data stored in the display image data buffer 0712 is output to the display device 0704 (S0811).

  Thereafter, the control processing unit 0708 detects an input from the operation input device 0702 (S0812). If the input from the operation input device 0702 is an end request, the end processing is performed, and in other cases, the processing after S0806 is performed again (S0813, S0814).

  According to the present embodiment, when the whole image data and the local image data are displayed in a superimposed manner as shown in FIG. 6 or FIG. 7, the display density of both image data can be made different depending on the value of the synthesis ratio orate. Therefore, the user can distinguish and visually recognize images such as characters displayed by both image data. Also, as shown in FIG. 7, by displaying frames 0502 and 0501 indicating the positional relationship between the local image data and the entire image data, the position of the local image data and the entire layout can be grasped even if the characters of the entire image data are small. You can browse while.

(Second Embodiment)
In the second embodiment, a function for automatically controlling the composition ratio orate, which is the display density of the entire image data and the local image data, is provided.

  FIG. 12 shows the configuration of an image display data creation device 0713 according to the second embodiment. The difference between the image display data creation device 0713 and the image display data creation device 0703 of FIG. 1 is that the image display data creation device 0713 replaces the display image data creation processing unit 0711 and the display image data creation processing unit 0714. It is in the point provided with. The other parts of the image display data creation device 0713 are the same as those shown in FIG.

  In the image display data creation device 0713, only variables of the type excluding the composition ratio orate among the various variables for the processing shown in the first embodiment are set in advance (for example, initial value setting or setting by user operation). However, the composition ratio orate is calculated based on the image data to be displayed in the display image data creation processing unit 0714.

  FIG. 13 shows the flow of processing of the image display data creation device 0713 according to the second embodiment. The difference between the processing flow of FIG. 13 and that of FIG. 3 of the first embodiment is that the density in the superimposed display of the whole image data and the local image data is controlled between the processing S0808 and the processing S0809. The density control processing S0909 is added. The other processes are the same as those shown in FIG.

  In operation, after the processes S0801 to S0808 are executed in the same manner as described above, in the density control process, the display image data creation processing unit 0714 reads local image data from the local image data buffer 0710, and reads the local image data and the whole The composition ratio orate of the image data is determined (S0909).

  Specifically, the composition ratio orate of the local image data and the entire image data is determined based on the importance of the local image data, that is, the degree of importance of information / content indicated by the local image data. For example, the higher the importance of local image data, the higher the composition ratio orate, and the lower the importance, the lower the composition ratio orate. Alternatively, the composition ratio orate may be determined based on the degree of importance of the other data with respect to one of the local image data and the entire image data. If local image data is more important, the composition ratio orate is set to a high value, and the composition processing is performed with emphasis on local image data. In the opposite case, the composition ratio orate is set to a low value, and the entire image data is Performs important synthesis processing.

  As a result, when the local image data is important, the image based on the whole image data becomes thin and the image based on the local image data becomes dark and is clearly displayed. On the other hand, when local image data is not important, the image based on the local image data becomes thin and the image based on the entire image data becomes dark and clearly displayed.

  The calculation of the composition ratio orate is calculated as orate = 1−SUM / (255 × XDISPLAYSIZE × YDISPLAYSIZE) using the sum SUM of the pixel values of the local image data. The pixel value is a value indicating the luminance component of the image.

  This calculation is an example, and the present invention is not limited to this. The calculation result may be calculated as orate = N / (XDISPLAYSIZE × YDISPLAYSIZE) where the count number N is the result of counting pixels having a pixel value less than or equal to the threshold TH of local image data. Absent.

  The above-described calculation of the composition ratio orate is based on the premise that the background of the input image data is white. However, if the sum of differences from the background color is used as the variable SUM, the calculation is used with an arbitrary background color. be able to. The composition ratio orate may be determined based on the magnitude of the root mean square error (distance) with the background color.

  Similarly, even when a count number N obtained by counting pixels having a pixel value equal to or less than the threshold TH is used, if the count number N is used after setting TH as a difference from the background color, the count value N can be set with an arbitrary background color. Arithmetic can be used.

  Further, on the basis of the number of edges indicated by the local image data, the composition ratio orate may be increased if there are many edges, and the composition ratio orate may be decreased if there are few edges. As a result, an image with many edges can be said to be a complex image that is rich in changes, so that it is displayed darkly and even a complex image can be clearly confirmed. Edge detection may be performed using, for example, a Sobel filter.

  Further, on the basis of the number of characters in the local image data, the composition ratio orate may be increased if the number of characters is large, and the composition ratio orate may be decreased if the number of characters is small. As a result, an image with many characters is displayed in a relatively fine character with a large amount of characters displayed at a narrow interval. However, since it is displayed darkly, even a fine character can be clearly confirmed and read. For the character detection, for example, a technique disclosed in Japanese Patent Laid-Open No. 2002-298139 may be used. In this method, image data is input and a character region in the image is determined based on the feature amount of the input image data.

  Thereafter, processes S0809 to S0814 in FIG. 3 are executed in the same manner.

  According to the present embodiment, the image display data creation device 0713 has a function of dynamically adjusting the synthesis ratio orate of the whole image data and the local image data, so that the local image data is important. When the image based on the whole image data indicating the layout becomes thin and, on the contrary, the local image data is not important, the image based on the whole image data indicating the layout is darkened so that the whole image data and the local image data are overlapped. Can preferentially display an image showing important information in a dark manner, and can prevent the important information from becoming difficult to read.

  In addition, the image display data creation device according to the above-described embodiment can be processed by a server and a client using communication. For example, the input image data buffer 0705 (1005), the entire image data creation processing unit 0706, the control processing unit 0708 (1008), and the local image data creation processing unit 0709 (1006) are provided on the server side, and the entire image data buffer 0707, local By realizing the image data buffer 0710 (1007), the display image data creation processing unit 0711 (1009), and the display image data buffer 0712 (1010) on the client side, communication between the entire image data with a small data amount and the local image data is performed. Can be browsed more comfortably, compared to the method of downloading the input image data as it is.

(Third embodiment)
In the third embodiment, an automatic image display apparatus in the case where a part of user operation is automated using automatic operation data described later is shown. The automatic image display device of the third embodiment has the display image data creation device 0703 of the first embodiment inside, and uses this as a display image data creation processing engine.

  Here, the display image data creation device 0703 uses the display image data creation device of the first embodiment. However, any display image data creation device 0703 may be used as long as it has a function of generating image data to be displayed on the display device. The apparatus may be an apparatus, and can be easily applied if a set of automatic operation data described later is determined in accordance with variables that can be operated from the outside of the apparatus.

  The automatic operation data describes in advance a procedure for inputting values of various variables to the control processing unit 0708 of the display image data creation device 0703 which is a display image data creation processing engine. The automatic image display apparatus according to the third embodiment can continuously display image data predetermined by each procedure by operating in a series of procedures according to the automatic operation data. The user can select a procedure and display an image according to the selected procedure by performing a forward operation for advancing the input procedure or a backward operation for returning the procedure.

  FIG. 14 is a diagram illustrating a configuration of an image automatic display device 1004 according to the third embodiment. FIG. 15 is a flowchart illustrating a process flow of the automatic image display apparatus according to the third embodiment. FIG. 16 is a diagram illustrating an example of the automatic operation data 200 according to the third embodiment.

  An image automatic display device 1004 in FIG. 14 connects an image input device 0701, a viewer operation input device 1002, an automatic operation data input device 1003, and a display device 1005. The automatic image display device 1004 receives input image data from the image input device 0701, automatic operation data 200 from the automatic operation data input device 1003, and user operation information from the viewer operation input device 1002, and results of processing based on the received information. Is output (displayed) to the display device 0704.

  The automatic image display device 1004 includes an automatic operation data buffer 1006, a display image data creation processing unit 1007, and a display image data creation device 0703. The automatic operation data buffer 1006 stores the automatic operation data 200 input from the automatic operation data input device 1003.

  The display image data creation operation processing unit 1007 receives the automatic operation data 200 read from the automatic operation data buffer 1006 and user operation information given from the viewer operation input device 1002, and controls the display image data creation device 0703. A variable (parameter) value is created and output to the display image data creation device 0703.

  The display image data creation device 0703 has the same configuration as that shown in FIG. In operation, the display image data creation device 0703 receives the image data input from the image input device 0701 via the input image data buffer 0705, and controls the values of various variables output from the display image data creation operation processing unit 1007. Part 0708 receives. Based on the received information, whole image data creation processing unit 0706 and local image data creation processing unit 0709 create whole image data and local image data, respectively. Thereafter, the display image data creation processing unit 0711 creates image data for display based on the whole image data, the local image data, and the received values of various variables. The created image data is given to the display device 0704 via the display image data buffer 0712 and displayed there.

  The automatic operation data buffer 1006 is realized by a flash memory as the memory 124 and a RAM such as the fixed disk 126. The display image data creation operation processing unit 1007 may be realized by, for example, an independent circuit, or may be realized by a virtual circuit (program processing) realized by the arithmetic processing circuit of the CPU 122 of the computer of FIG.

  The automatic operation data 200 is the same as that input to the control processing unit 0708 of the display image data creation device 0703 according to the first embodiment. Referring to FIG. 16, automatic operation data 200 is prepared as a kind of file, and a plurality of sets SEi (i = 0, 1, 2,..., N) are registered in the file. Each set SEi is the position xposition, yposition of the upper left point of the local image data in the input image data, the display magnification arate of the local image data, the composition ratio orate of the local image data and the whole image data, and the straight line drawing locations xstart, ystart, xend , Including yend variables. The definition of each variable of the set SEi is the same as that described in the first embodiment.

  The state of the display image is uniquely determined by the value of each variable included in one set SEi. Here, it is assumed that the sets SE0, SE1, SE2,... Are registered in order from the top of the file of the automatic operation data 200. In addition, the set SEi used to create the currently displayed image data is referred to herein as the current set SEi.

  In the automatic operation data 200, as shown in FIG. 16, each variable value in the set SEi is separated by a space, and the sets SEi are separated by a line feed.

  The data structure of the automatic operation data 200 is not limited to that shown in FIG. 16, and any structure can be used as long as each variable value of each set SEi can be read.

  The operation of the automatic image display apparatus 1004 using the automatic operation data 200 of FIG. 16 will be described according to the flowchart of FIG. In order to execute the processing of FIG. 15, a variable NL indicating the total number of sets SEi registered in the automatic operation data 200, a variable NS indicating an interval for reading the set SEi from the automatic operation data 200, and automatic operation data A variable N is prepared which indicates what number the current set at 200 is. Here, it is assumed that 1 is set in advance in the variable NS.

  When the variable NS is 1, the set SEi can be sequentially read from the automatic operation data 200 one by one. The variable NS determines how many sets SEi from the current set SEi or how many sets SEi are read in the automatic operation data 200 every time an instruction is given by a forward or backward operation via the viewer operation input device 1002 of the user. Acts like For example, if the current set is set SE5 and variable NS = 1, SE6, SE7, SE8,... Are read each time forward operation is performed, and SE4, SE3, SE2,. SEi can be determined. For example, if the variable NS = 2, SE7, SE9, SE11... Each time the forward operation is performed, and SE3, SE1. be able to.

  When the automatic image display device 1004 starts processing (S1101), the automatic image display device 1004 receives the automatic operation data 200 from the automatic operation data input device 1003 and stores it in the automatic operation data buffer 1006 (S1102). Then, an initial value N0 is set in the variable N (S1103).

  The display image data creation operation processing unit 1007 receives from the automatic operation data 200 of the automatic operation data buffer 1006 each variable xposition_i, yposition_i, arate_i, orate_i, part_line_i, whole_line_i, xstart_i, ystart_i, The values of xend_i and yend_i are read and set to variables xposition, yposition, arate, orate, part_line, whole_line, xstart, ystart, xend and yend for processing (S1104).

  The display image data creation device 0703 receives the image data given from the image input device 0701 and creates display image data based on the various variables set by the display image data creation operation processing unit 1007. . The created image data is output to the display device 0704 and displayed here (S1105).

  Next, an operation input by the user using the viewer operation input device 1002 is detected (S1106). Wait until an operation input is detected. It is assumed that the input by the user's operation is one of three types, that is, a termination request, a forward request, and a backward request. If an end request is detected (YES in S1107), the series of processing ends (S1108).

  If a forward request is detected (YES in S1109), the value of variable N is increased by the value indicated by variable NS (S1110). If the value of variable N is greater than (value of variable NL-1) (YES in S1111), the result of subtracting the value of variable NS from the value of variable NL is set in variable N (S1112). Transition to processing. If the value of variable N is equal to or less than (value of variable NL-1) (NO in S1111), the process proceeds to S1104.

  If the input through the viewer operation input device 1002 is not a forward request (NO in S1109), the value of the variable N is decreased by the value of the variable NS (S1113). As a result, if the value of the variable N is not 0 or more (NO in S1114), the value of the variable N is set to 0 (S1115), and the process proceeds to S1104. If it is 0 or more (YES in S1114), S1104 is continued. Move on to processing.

  Although the value of the variable NS is 1 here, it may be an integer of 1 or more. The variable NS does not need to be a constant, and may be varied as a parameter depending on conditions. For example, when the number of forward requests or backward requests input per unit time increases, the value of the variable NS may be increased to increase the number of sets SEi skipped. When such an input operation is performed, it can be assumed that the set SEi that the user desires to apply for image creation is registered earlier (or later) than the current set. By increasing the number, it is possible to quickly specify the desired set SEi in the automatic operation data 200.

  Further, the forward request and the backward request may be subdivided into a plurality of types, and the value of the variable NS may be changed according to the type of request input by the operation.

  In addition, a list of values of the set SEi of the automatic operation data 200 is displayed on the display device 0704 so that the user viewing the image can easily select a desired set SEi, and the user operates while checking the list display. It may be.

(Fourth embodiment)
The configuration of the automatic image display apparatus 1014 of this embodiment is shown in FIG. The automatic image display device 1004 and the image automatic display device 1014 in FIG. 14 are different from each other in that the automatic operation data 300 in FIG. 18 is input instead of the automatic operation data 200 in FIG. Instead of the data creation device 0703, a display image data creation device 0714 is provided. The other parts of the automatic image display device 1014 are the same as those shown in FIG.

  In this embodiment, since the display image data creation device 0714 of the second embodiment is adopted, the synthesis ratio orate of the whole image data and the local image data is automatically set to the optimum value based on the image data to be displayed. be able to. Therefore, the automatic operation data 300 given to the automatic image display device 1014 is composed of a plurality of sets SSEi that do not need to include the composition ratio orate as shown in FIG. Since the automatic operation data 300 is the same as the structure of the automatic operation data 200 except that the automatic operation data 300 does not include the composition ratio orate, the description is omitted. The processing procedure according to the present embodiment is the same as that shown in FIG.

  In this way, the type of variable that can be operated by the display image data creation device 0703 (0714), which is a core module for displaying a screen, can be easily changed depending on the type of variable held in the automatic operation data 200 (300). Can do. Therefore, there is no restriction on the types of variables handled in the display image data creation device 0703 (0714).

  Further, since the automatic operation data 200 (300) only needs to be able to read the value of the variable of the designated set SEi, the automatic operation data 200 (300) does not need to be prepared as independent data. The automatic operation data may be supplied to the apparatus by being included in the image data in advance and given to the apparatus.

  Further, as can be seen from the third and fourth embodiments, the automatic image display apparatus uses the control parameters of the engine and the automatic operation data 200 regardless of the type of automatic image display data creation processing engine. Alternatively, the engine can be used with the variables given at 300.

  For example, in the case of an image automatic display device having a simple function, such as an image automatic display device that displays a partial area of an image simply by changing the scale, the number of control parameters may be reduced according to the image automatic display device. Conversely, an image automatic display apparatus having a complicated function may be increased in accordance with the number of control parameters.

  Each of the above-described embodiments can be applied by handling a document (document data) for a word processor, a text editor, a draw tool, or the like as the image.

  Further, it is not necessary to perform enlargement or reduction processing of a document including object data such as a font by image processing, and if there is object data such as a font having substantially the same resolution, it may be used as an alternative.

  In addition, the image display data creation device of each embodiment is used by being incorporated in various terminals such as personal computers, mobile phones, PDAs, and electronic book devices, and various home appliances that have computer display control functions. Can do.

(Fifth embodiment)
The processing functions of the embodiments described above are realized by a program. In the present embodiment, it is indicated that this program is stored in a computer-readable recording medium.

  In the present embodiment, as the recording medium, a memory necessary for processing by the computer shown in FIG. 2, for example, the memory 124 itself may be a program medium or an external storage. A program reading device such as a magnetic tape device and a CD-ROM driving device 140 may be provided as a device, and a magnetic tape or a CD-ROM 142 as a recording medium may be inserted into the program reading device. In any case, the stored program may be configured to be accessed and executed by the CPU 122, or in any case, the program is read once, and the read program is the predetermined program shown in FIG. The program may be loaded into a program storage area, for example, the program storage area of the memory 124, and read and executed by the CPU 122. This loading program is assumed to be stored in advance in the computer.

  Here, the program medium described above is a recording medium configured to be separable from the computer main body, and is a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as the FD 132 or the fixed disk 126, or a CD-ROM 142 / MO (Magnetic Optical). Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc) optical disc system, IC card (including memory card) / optical card system, mask ROM, EPROM (Erasable and Programmable ROM), It may be a medium carrying a fixed program including a semiconductor memory such as an EEPROM (Electrically EPROM) or a flash ROM.

  In the present embodiment, the computer of FIG. 2 employs a configuration that can be connected to a communication network 182 including the Internet. Therefore, the computer downloads the program from the communication network 182 and fluidly carries the program. There may be. When the program is downloaded from the communication network 182 as described above, the download program is stored in the computer main body in advance, or is installed in the computer main body from another recording medium in advance. May be.

  Note that the content stored in the recording medium is not limited to a program, and may be data.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the image display data creation apparatus of 1st Embodiment. It is a block diagram of the computer by which the image display data creation apparatus which concerns on each embodiment is mounted. It is a process flowchart of the image display data creation apparatus of 1st Embodiment. It is a figure which shows an example of whole image data. It is a figure which shows an example of local image data. It is a figure which shows the state which displayed the whole image data and local image data simultaneously. It is a figure which shows the state which displayed the whole image data and local image data simultaneously, and added the frame. It is a figure which shows the state which added the frame to the whole image data. It is a figure which shows the state which added the frame to local image data. It is a figure which shows the state by which the straight line was drawn by the displayed image. It is a figure which shows the state by which the straight line was drawn by the displayed image. It is a block diagram of the image display data creation apparatus which concerns on 2nd Embodiment. It is a process flowchart of the image display data creation apparatus of 2nd Embodiment. It is a figure which shows the structure of the image automatic display apparatus of 3rd Embodiment. It is a process flowchart of the image automatic display apparatus of 3rd Embodiment. It is a figure which shows the automatic operation data which concern on 3rd Embodiment. It is a figure which shows the structure of the image automatic display apparatus of 4th Embodiment. It is a figure which shows the automatic operation data which concern on 4th Embodiment. It is a figure which shows an example of the image which concerns on 1st Embodiment.

Explanation of symbols

  200,300 Automatic operation data, 0703,1003 Image display data creation device, 0706 Overall image data creation processing unit, 0709,1006 Local image data creation processing unit, 0711,1009 Display image data creation processing unit, 0501, 0502, 0201, 0601, 0602 Frame, 1004, 1014 Image automatic display device, 1302, 1402, 1403 Straight line.

Claims (7)

A device for creating data to be displayed on a screen,
A display image data creation unit for creating display image data for display using the input image data;
An automatic operation data input unit for inputting an automatic operation data group prepared in advance for operating the creation of the display image data;
A display image data creation operation processing unit that controls a creation process of the display image data creation unit, using the automatic operation data group input by the automatic operation data input unit;
The display image data creation processing unit
From the input image data, the data of the area designated based on the area designation data in the automatic operation data group is cut out, and the enlargement or reduction process is performed based on the size data in the automatic operation data group to create local image data A local image data creation processing unit;
An overall image data creation processing unit that creates an overall image data by performing an enlargement or reduction process on the input image data based on the size data;
Wherein said entire image data created partial image data by combining with a change in image density and have a display image creation processing unit for creating the display image data,
The display image creation processing unit, wherein the display image creation processing unit synthesizes the whole image data and the local image data according to a synthesis ratio determined based on the local image data . The display data creation apparatus according to claim 1 , wherein the composition ratio is determined based on an edge amount of an image indicated by the local image data. The display data creation device according to claim 1 , wherein the composition ratio is determined based on an amount of characters in an image indicated by the local image data. The display data creation device according to claim 1 , wherein the composition ratio is determined based on a difference in luminance between an image indicated by the local image data and a background. A method for creating data to be displayed on a screen,
A display image data creation step for creating display image data for display using the input image data;
An automatic operation data input step for inputting an automatic operation data group prepared in advance for operating the creation of the display image data;
Using the automatic operation data group input in the automatic operation data input step, and a display image data creation operation processing step for controlling the creation processing in the display image data creation step,
The display image data creation processing step includes:
From the input image data, the data of the area designated based on the area designation data in the automatic operation data group is cut out, and the enlargement or reduction process is performed based on the size data in the automatic operation data group to create local image data Local image data creation processing step;
A whole image data creation processing step for creating a whole image data by enlarging or reducing the input image data based on the size data;
Wherein said entire image data created partial image data by combining with a change in image density and have a display image creating process step of creating the display image data,
The display image creation processing step is a display data creation method in which the entire image data and the local image data are synthesized according to a synthesis ratio determined based on the local image data . A display data creation program for causing a computer to execute the display data creation method according to claim 5 . A computer-readable recording medium on which a display data creation program for causing a computer to execute the display data creation method according to claim 5 is recorded.

Images