JP3897771B2 - Playback display device - Google Patents

Description

  The present invention relates to a reproduction display device that reproduces and displays digital data such as electronic book data recorded electronically, and more particularly to a data structure and reproduction display device that can perform display switching at high speed.

In a display device that displays a plurality of display data such as document data composed of a plurality of pages or image data of an image filing device, the display data is sequentially switched to find desired data in order to find target data. May search. In this case, if the entire display data is always displayed, the data cannot be switched at high speed, and the search efficiency decreases. Therefore, in the image filing apparatus disclosed in Japanese Patent Application Laid-Open No. 1-269174, only the area designated by the user among the image data displayed on the screen is developed in the image memory and sequentially displayed on the screen for searching. It was. In Japanese Patent Laid-Open No. 4-120670, original image data and its reduced data are recorded, and the reduced data are read and sequentially displayed at the time of retrieval to realize a high-speed page turning operation.
JP-A-1-269174 JP-A-4-120670

  However, in order to perform display switching at high speed, it is necessary to devise a display data storage method. However, since JP-A-1-269174 does not consider it at all, there is a problem that it takes time to turn the page. It was.

  In addition, when a reduced image is registered in advance as in Japanese Patent Laid-Open No. 4-120670, redundant data is stored in a recording medium, which increases the amount of data to be stored. there were.

  Furthermore, there is a problem that it is not possible to cope with page turning of display data in which various data such as characters, images, sounds, and moving images are arranged on one page as in recent document data.

  An object of the present invention is to provide a data structure and a reproduction display device that can perform display switching at high speed.

The present invention is a reproduction display device configured to reproduce and display the element data provided for each reproduction unit by setting data for each of a plurality of objects separately as element data as a reproduction unit. The element data includes a first data portion composed of schematic data indicating the entire element data used for reproduction when high-speed reproduction is instructed, and a second data composed of remaining data other than the approximate data. The first data portion is compressed by a method having a fast decompression process, and the second data portion is compressed and stored by a method having a high compression ratio, and high-speed playback is instructed. Then, the first data portion is read and sequentially reproduced and displayed.

  Thereby, since it is not necessary to provide special data for high speed reproduction for each reproduction unit, the amount of data to be processed for high speed reproduction can be reduced, and high speed reproduction display for each reproduction unit can be performed. In the case of an electronic book, since the playback unit is set to each page, high-speed page turning can be performed, and the data amount of the recording medium can be reduced.

The element data selected as the first data portion for high-speed playback is preferably the following. That is, when the element data selected as the first data portion is image data, the first bit portion is an upper bit image generated from a partly set bit of each pixel value . In the case where one data portion is a thinned image generated by thinning each pixel at an arbitrarily set ratio, and the element data selected as the first data portion is moving image data, the first data it is preferred parts are optionally selected one or more of the representative frame image as a representative frame data from the video data.

  According to the present invention, it is possible to easily read a part of data in which various object data such as characters, images, sounds, and moving images are recorded, and to quickly search for a desired page. You can turn.

  Hereinafter, an embodiment of the invention will be described by taking an electronic book display device as an example of a reproduction display device. This electronic book display device reproduces and displays electronic book data (hereinafter referred to as “book data”) such as weekly magazines, novels, and manga as digital data. In this embodiment, the electronic book display device is taken as an example, but the present invention can also be applied to a general reproduction display device such as an image filing device that reproduces and displays other digital data.

  FIG. 1 shows a block configuration of an electronic book display apparatus according to this embodiment. In the figure, 101 is a CPU as control means, 102 is a ROM for storing a control program of the apparatus, 103 is a RAM used for storing program data, a work area of the program, and book data such as page data, 104 is an input means such as a disk drive or communication line for reading and reproducing the book data recorded on the recording medium, 105 is a display means for displaying the book data, and 106 is a voice of the book data recorded on the recording medium. Voice output means 107 for outputting data, 107 is a page turning instruction means composed of buttons for enabling the user to instruct both normal and high-speed page turning of the page of the electronic book being displayed, 108 is the page data Display mode switching instruction means 109 for the user to instruct to switch the display mode, 109 A CPU bus connecting the location components. In accordance with a control program stored in the ROM 102, the CPU 101 controls the input means 104, the display means 105, and the audio output means 106 to control the reproduction and display of book data, and the page turning instruction means 107 and display mode switching. Various processes are performed in response to a user instruction from the instruction unit 108. The display unit 105 includes a display control unit 1051 that controls the content displayed on the display screen, and a display screen 1052 including a display.

  FIG. 2 shows an overview example of an electronic book display device according to the present invention. In FIG. 2, a resistance film pressure-sensitive tablet is pasted on the surface of the display screen 1052 including all of the components of FIG. 1, and this tablet is used as a display mode switching instruction means 108 or an input means from other users. A button provided on this apparatus is used as a page turning instruction means 107 for instructing the user to turn the page normally or at high speed. Reference numeral 111 denotes a recording medium insertion slot for inserting a recording medium on which book data is recorded, and 112 is a pen for switching display modes and performing various inputs through a tablet.

  FIG. 3 shows an outline of a storage format of book data to be displayed on this electronic book display device. As shown in FIG. 3, the book data is divided into page information corresponding to the body of the book data and the management information area for storing the bibliographic information such as the title and the page information such as the total number of pages and the size of each page. And is stored in a recording medium such as an IC card or a disk.

  FIG. 4 shows a configuration example of the management information area in the book data. The management information area includes a management information area identifier indicating that it is a management information area, a data size indicating the size of this area, a bibliographic information area in which a title, author name, etc. are recorded, a page size, and the total number of pages. Stored page information area and the like are stored. Each page is virtually provided with a coordinate system with the upper left vertex of the page as the origin, and the coordinates of the lower right vertex of the page in this coordinate system are recorded in the page size area. Note that the number on the right in FIG. 4 indicates the number of bytes when storing.

  As shown in FIG. 5, each page is composed of element data (hereinafter referred to as an object) such as character data, image data, audio data, and moving image data, and the size of the page recorded in the page information area of FIG. Each page is configured by arranging each object on a virtual virtual page. It should be noted that non-display data such as audio data is virtually arranged in the entire page or an area related in terms of content.

  FIG. 6 shows a data storage method of each page data in the page data area of FIG. Each page data includes a page data identifier indicating that the following information is page data, a data size indicating the number of bytes of page data, the number of objects in the area for recording the number of objects constituting the page data, and for each object. It consists of an object data area for storing data. Note that the numbers on the right in FIG. 6 indicate the number of bytes when stored.

  FIG. 7 shows a method of storing each object data area shown in FIG. As shown in FIG. 7, this object data area specifies an object data area identifier indicating that this area is an object data area, a data size of this area, a data type identifier, and a position where the object is arranged, The coordinates of the start and end points for recording the upper left and lower right coordinates of the rectangular area where the object is placed, the fast page turning playback identifier that indicates whether or not the object is played when the fast page turning mode is specified, the object's It consists of a real data area for storing real data. The high-speed page turning playback identifier in FIG. 7 is set so that only important objects or objects meaningful only for specific contents can be played back and displayed in the high-speed page turning mode in the book data creation stage. Or, it can be set at predetermined intervals of the page to reproduce and display as if the pages of the book were actually flipped. Note that the numbers on the right in FIG. 7 indicate the number of bytes when stored.

  The data type identifier in FIG. 7 is an identifier provided to specify the type of object and the storage method. FIG. 8 shows a correspondence table between the data type identifier and the data type in FIG. That is, by reading the value of the data type identifier, the type and storage method of the actual data area can be specified.

  Next, a specific method for storing the actual data area in FIG. 7 will be described in sequence.

For large data such as image data, audio data, and moving image data, the time to read from the recording medium becomes a bottleneck when it is desired to turn pages at high speed. Therefore, as necessary, for some object data (some element data), partial data in the object data, that is, schematic data ( first data portion ) and the remaining data of the object data ( second data portion) ) And store them so that only the summary data can be easily read in the high-speed page turning mode. In addition, when compressing and storing the outline data and the remaining data, an information area for designating each compression method is provided so that the compression methods of both can be changed as necessary. There are the following reasons for this. In order to turn pages at high speed, it is desirable to select a compression method that makes the total of the reading time from the recording medium, the decompression processing time, and the display time as small as possible even if the compression rate is not so high. On the other hand, book data including data with a large data capacity such as images, sounds, and moving pictures is generally desired to have a small data capacity. In particular, when high-speed display is not required, the decompression time is somewhat Even if it takes, a compression method with a high compression rate is often used. Therefore, it is desirable to be able to store the rough data that requires high speed and the remaining data that does not particularly require high speed by changing the compression method. For example, the outline data is compressed by run-length coding that does not require much processing time, and the remaining data is compressed by using arithmetic coding that requires processing time but can be expected to have a high compression rate.

  FIG. 9 shows a normal image data storage method in which the value of the data type identifier is 0x40, and this format is stored in the actual data area of FIG. Note that the number on the right in FIG. 9 indicates the number of bytes when storing, and the same applies to the data structure of actual data described below. Also, since the number of bytes is known in this way, desired data can be read by designating the desired number of bytes. As shown in FIG. 9, the number of vertical and horizontal pixels of the image, the number of planes of the image, the designation information of the compression method of each plane image, the offset value information indicating the position from the beginning of the actual data area of each plane image in bytes, the actual Are stored in the order of the plane image data, and each plane image is compressed by the compression method specified in the section of the compression method. In the case of a monochrome image, the number of planes is 1, and image data is stored using only the first plane image area. In the case of a color image, the data is expressed in the YUV color system adopted in JPEG, the number of planes is set to 3, the Y plane image in the first plane image area, the U plane image in the second plane image area, the first The V plane image is compressed and stored in the 3-plane image area by the method specified in the compression method section. In the YUV color system, the Y plane image is the luminance component of the original image, and can be used as schematic data of the original color image. Accordingly, when turning a page at high speed, only the Y plane image is read and displayed. In addition, even if it is not the YUV color system, the image data is expressed by a method of dividing the luminance signal and the color difference signal as in the YCrCb color system, and the luminance signal is used as the first plane image, or the RGB color system. Alternatively, the image data may be expressed by storing the G plane image in the first plane image.

  In the case of an image data format having a data type identifier of 0x41, the image is divided into bit plane images, and sequentially stored from the bit plane image composed of the most significant bits of each pixel. FIG. 10 schematically shows how image data composed of 3 bits for each pixel is divided into bit plane images. The upper part of FIG. 10 is image data before division, and a pixel value is recorded with 3 bits for each pixel. An image obtained by extracting only the first bit of each pixel, an image obtained by extracting only the second bit, and an image obtained by extracting only the third bit are divided into each bit plane. Although FIG. 10 has been described using an image composed of 3 bits for each pixel, it can be easily extended to an image composed of n bits for each pixel. In the case of a color image, the processing of FIG. 10 is performed for each of the R, G, and B plane images, and the i-th bit plane image includes, for each pixel, the i-th bit of the R plane pixel, The i-th bit of the pixel in the G plane and the i-th bit of the pixel in the B plane may be stored in the order of pixels. Such a format is due to the fact that the outline of the image can be understood even if the image is reproduced using only the upper bits or only the bit plane image of several bits from the upper bits. Therefore, it is possible to reduce the input time from the recording medium and reproduce it at high speed by dividing it into bit plane images in advance and reading only the bit plane image for several bits from the upper order when turning the page at high speed. To do. FIG. 11 shows a storage format in the case where data is divided into bit planes and stored in this format in the actual data area of FIG. As shown in FIG. 11, the number of vertical and horizontal pixels of the image, the number of bit planes, designation of the compression method of each bit plane image, offset value information indicating the position from the beginning of the actual data area of each bit plane image in bytes, and each bit plane It is recorded in the order of image data. Each bit plane image is compressed by the method specified in the compression method section.

  In addition, the data format with the data type identifier of 0x42 is divided into an image generated from only the most significant bit of each pixel value or bits for the upper several bits of each pixel and an image composed of the remaining bits. Store. FIG. 12 schematically shows how an image in which each pixel value is composed of 4 bits is divided into two. The upper part of FIG. 12 shows image data before division, and indicates that pixel values are recorded with 4 bits for each pixel. When dividing each pixel into upper 2 bits and lower 2 bits, as shown in FIG. 12, an upper bit image obtained by sequentially extracting only the first bit and the second bit for each pixel before division, and the third And a lower bit image in which only the fourth bit is sequentially extracted. Two images generated as a result are shown in FIG. FIG. 2B shows the result of dividing into an image generated from only the most significant bit of each pixel and the remaining image. In FIG. 12, for the sake of explanation, an example in which each pixel is composed of 4 bits has been described as an example. However, expansion to an n-bit image is easy and is not limited to 4 bits. In the case of a color image, the processing of FIG. 12 is performed for each of the R, G, and B plane images, and the upper bit image generated from each of the R, G, and B plane images is stored as the upper bit image. What is necessary is just to store the lower bit image produced | generated from each bit-plane image of R, G, and B as a lower bit image. FIG. 13 shows an example of a storage format when an image is divided and stored in this format, and is stored in this format in the actual data area of FIG. As shown in FIG. 13, this data includes the number of vertical and horizontal pixels of the image, the compression method of the upper bit image and the lower bit image, the number of bits taken out from each pixel when generating the upper bit image and the lower bit image, and the upper bit. The data size and data of the image, and the data size and data of the lower bit image are recorded in this order. The upper bit image data and the lower bit image data are each compressed by a method specified in the compression method section. By storing the image data in this format, it is possible to easily read only the approximate image data generated from the bits for the upper several bits. In addition, when displaying image data whose data type identifier is 0x41, it is necessary to read a bit plane image for several bits from the upper and then synthesize these bit plane images. Since the bit plane images corresponding to the upper several bits are stored in a synthesized form in advance, it is possible to save the time and effort of compositing at the time of display and to turn pages at a higher speed. On the other hand, in the case of image data with a data type identifier of 0x41, the page turning speed can be adjusted in several stages by adjusting the number of bit plane images to be read, whereas in this storage method, only the upper bit image is read, This is a two-stage speed adjustment for reading both bit images.

  The data format having a data type identifier of 0x43 is divided into a thinned image generated by extracting pixels every several pixels in the vertical and horizontal directions and the remaining pixel data and stored. . FIG. 14 shows a state in which a thinned image thinned every three pixels is generated. In FIG. 14, each grid represents each pixel of the image. For the original image shown on the left side of the figure, only the pixels indicated by diagonal lines in the vertical and horizontal directions are sequentially extracted to obtain the original image. A thinned image is generated as rough data by arranging the pixel data while maintaining the order in which the pixels are arranged. The purpose of this storage method is to reduce the time required for input from a recording medium by reading only a thinned image when turning pages at high speed. FIG. 15 shows an example of a storage format when registering in the thinned-out image format, and this format is recorded in the actual data area of FIG. As shown in FIG. 15, this data stores the number of vertical and horizontal pixels of the image, the compression method of the thinned image and the remaining pixel data, and then the thinning interval, the thinned image data size, the thinned image data, the remaining pixel data size, and the remaining pixels. Store in order of data. The thinned image data and the remaining pixel data are compressed by the method specified in the compression method section.

  Furthermore, a data storage method for high-speed page turning for moving image data will be described. FIG. 16 shows an example of a normal moving image data storage method (in this case, the data type identifier is 0xA0), and FIG. 17 shows an example of a moving image data storage method for high-speed page turning (in this case, the data type identifier is 0xA1). . As shown in FIG. 16, normal moving image data is recorded in the number of pixels in the vertical and horizontal directions of the moving image area, the specification of the compression method of the frame data, and the moving image data format. Each frame data is compressed by the method specified in the item of the compression method, and stored together with the size of the frame data in time order. On the other hand, in the moving picture storage system shown in FIG. 17, a representative frame data area is newly provided. In this area, some representative frame data is extracted from the frame data at each time of the video data, and each frame data is compressed by the method specified in the compression method section. Together with the frame number indicating the frame number and the size of the frame data. Other frame data is also compressed by the method specified in the section of the compression method, and stored in the remaining moving image data area of FIG. The method for storing the frame data in the remaining moving image data area is the same as the method for storing the frame data in FIG. 16, and the size of the frame data and the frame data are stored as a set for each frame data in time order. When turning pages at high speed, only the representative frame data area is read and reproduced, thereby reducing the reading time and reproducing time from the recording medium.

  By the way, when a desired page is searched while turning the page, the search may be performed based on position information in the page. For this reason, as shown in FIG. 7, position information on the page is attached to all objects, and only objects that are at least partially included in the area specified by the user are read based on this information. Can be played. However, in the case of an object that protrudes from the area specified by the user, an unnecessary area is read, leading to time loss. In particular, an object having a larger size on the display screen is more likely to be wasted. Therefore, a large object is divided and stored in advance in several areas so that only data in the same range as the area designated by the user can be easily read.

  FIG. 18 is a diagram schematically showing how image data is divided into blocks of a predetermined size (bx × by), and the image data is stored together for each divided region shown on the right side of FIG. In this case, the data type identifier is 0x44. FIG. 19 shows a storage method for storing image data divided into several block areas. As shown in FIG. 19, after storing the number of vertical and horizontal pixels of the image and the compression method of each block image, the horizontal pixel number and the vertical pixel number of each block are stored, and each block image divided according to its size is called a so-called block image. The data size and block image data are sequentially stored in the TV raster scanning order. Each block image data is compressed and stored by the method set in the item of the compression method. And by reading only the block image that contains at least a part in the area specified by the user, some parts other than the area specified by the user are read, but compared with the case where all the object data is read, useless data is read. There is little reading and it contributes to high-speed page turning. It should be noted that this block division storage method may be used to store each bit plane image of an object whose data type identifier is 0x41 or 0x42, a thinned image of 0x43, or each frame data of 0xA0 or 0xA1.

  Next, the operation of the electronic book display device will be described using a flowchart. This apparatus includes a normal reading mode in which pages to be displayed are sequentially updated every time a page turning instruction is issued through the page turning instruction means 107, and a page turning at a high speed such as when searching for a desired page. There are two modes, a high-speed page turning mode. When the power is turned on, the normal reading mode is set, and switching between the modes is shifted when the user instructs switching by the display mode switching instructing unit 108 during the display of the page data. Specifically, a button for instructing mode switching is displayed on the display screen, and the user clicks this button to switch the display mode. Hereinafter, each mode will be described.

  First, the normal reading mode will be described with reference to the flowchart of FIG. First, in step S100, the display page is set to a predetermined page. Here, the predetermined page is the first page of the book data when the power is turned on, or the page that was displayed last time, and the page that was opened in that mode when the mode is changed from another mode. Next, the number of objects is read from the page data area of the set page (step S101), the object data is read from the recording medium for each object constituting the page (step S102), and depending on the value of the data type identifier, respectively. The reproduction process is performed (step S103). In step S104, it is checked whether or not the reproduction process has been completed for all objects in the page. If there is an unprocessed object, the process returns to step S102 to perform the reproduction process. On the other hand, if all the objects have been processed, the process proceeds to step S105.

  A supplementary explanation will be given regarding step S103. The process of step S103 is performed by switching the process according to the value of the data type identifier. For example, when the data type identifier is 0x41, each bit plane image read and decompressed in step S102 is restored to the original image and displayed. For example, in the case of a grayscale monochrome image in which the value of each pixel is recorded with n bits, each bit plane image is represented by a higher bit as Bi (x, y) (i = 0,..., N−1, i is smaller. A plain image) for each pixel

  The original image I (x, y) is restored and displayed by calculating.

  In the case of an object whose data type identifier is 0x42, the image is restored to the pre-division image from the upper bit image and lower bit image read and decompressed in step S102 and displayed. For example, when the image before division is a grayscale monochrome image, the upper bit image U (x, y) is composed of upper n bits of each pixel, and the lower bit image D (x, y) is composed of lower m bits. For each pixel

  The original image I (x, y) is restored and displayed.

  In the case of image data whose data type identifier is 0x43, the original image is restored from the thinned image and the remaining pixel data with reference to the thinning interval given to the data and displayed.

  In the case of moving image data having a data type identifier of 0xA1, after the frame data in the representative frame data region and the frame data in the remaining moving image data region are rearranged in time order with reference to the frame number in the representative frame data region The frame data is processed by displaying it at predetermined time intervals in time order.

  Also, in the case of image data whose data type identifier is 0x44, after performing decompression processing for each block image, each block image is arranged from the number of vertical and horizontal pixels of each block and the number of vertical and horizontal pixels of the image before division. The position is calculated, and the image data before division is synthesized and displayed on the screen.

  When the output of all the objects constituting the displayed page is completed, it is checked in step S105 whether or not page turning is instructed through the page turning instruction means 107. If page turning is instructed, in step S108. The page number to be displayed is changed, and the process returns to step S101 to reproduce the page. If page turning is not instructed, it is checked whether or not the user has requested that the display mode be switched through the display mode switching instructing means 108 (step S106), and if switching of the display mode is requested. Then, the process proceeds to display processing in the high-speed page turning mode. If switching of the display mode is not requested, it is checked whether or not the user has requested to end the page data display process (step S107). If it is requested to end the page data display process, the reproduction of the book data is ended (step S109). On the other hand, if it is not requested to end the page data display process, the process returns to step S105, and thereafter, the process of steps S105 to S107 is performed until a request for any of steps S105 to S107 is made by the user. Is repeated.

  Next, the high-speed page turning mode will be described with reference to the flowchart of FIG. When the normal reading mode is shifted to the high-speed page turning mode, first, in step S200, a window as shown in FIG. 22 is displayed as a condition setting means on the display screen so that the user can set the reproduction conditions for turning the page at high speed. To.

  Here, the process of step S200 will be described in detail. As shown in FIG. 22, the playback conditions are roughly divided into four condition setting contents for only the data type, data size, position designation, and author-designated object. Of these four conditions, the logic of the condition selected by the user is selected. Select an object to play by product. For example, FIG. 22 shows that a request is made to select and play back only objects that satisfy both conditions of restriction by data type and restriction by position designation, and ignore restrictions by data size and author designation. Is done.

  Among these, the data type is an item that restricts an object (that is, element data) to be reproduced for each data type, and an object (partial data) that designates an object to be reproduced from four items of characters, images, sounds, and moving images. Limit to only. For example, if an image that was on a page remains in memory and you search for that page using that image as a clue, or if the audio that was playing on a page remains in memory, Use this item when searching. For example, when the item of character and image is selected as shown in FIG. 22, when each page is opened, the value of the data type identifier of each object data is read from the recording medium, and 0x01 meaning character data and image data are read. The actual data area is read and reproduced only for the object data of meaning 0x40, 0x41, 0x42, 0x43, 0x44. Even if there is audio or moving image data in the page, reproduction is not performed by skipping the object data by using the data size value of FIG. More detailed playback conditions can be set for the data type item. When the “Details” button in FIG. 22 is clicked, a window as shown in FIG. 23 is opened so that the user can set detailed conditions for each type of data. This is reflected in the processing in S208. FIG. 23 is a window for inputting settings for image data and moving image data. When high-speed playback is performed, all the data in the actual data area is read for each of the image data and moving image data in the same way as when turning pages in the normal reading mode. Whether to read and display, or to display only rough data in the case of an object such as a color image whose data type identifier is 0x40, 0x41, 0x42, 0x43, 0044, 0xA1 is set. In the case of a monochrome image with a data type identifier of 0x40 or an object that does not have rough data such as 0xA0, it is displayed in the same way as during normal page turning regardless of the user setting. Further, when displaying only the outline data, the display ratio of the outline data can be variably set by changing the position of the setting knob. When the data type identifier is 0x41, the number of bit plane images to be read is changed based on this setting position. For example, when the setting knob is at a position that divides the slow side and the fast side into 2: 1, if each pixel is an n-bit image, only n / 3 bit-plane images are read and displayed from the top. Also, in the case of image data whose data type identifier is 0x43, if the position of the setting knob is close to the slow side, only the thinned image is read and enlarged, and if it is close to the fast side, only the thinned image is read and enlarged. Display without change, and change the magnification according to the position of the knob. In the case of a color image with a data type identifier of 0x40, only the first plane image is read and displayed regardless of the position of the setting knob. For the image data whose data type identifier is 0x42, only the upper bit image is read and displayed regardless of the position of the setting knob. If the data type identifier is 0xA1, the number of frame data read from the representative frame data area is changed depending on the position of the setting knob. That is, the number of displayed frame data varies from one to the number of frames registered in the representative frame area depending on the position of the knob. In FIG. 23, only image data and moving image data can be set. However, if there are items to be set for characters and sounds, the items are added to this window.

  The data size items that can be set in the window of FIG. 22 simply limit the objects to be reproduced according to the data size. Since all objects are stored in the format shown in FIG. 7, the data size value is checked, and only objects smaller than the threshold value input by the user are read and reproduced.

  The position designation items that can be set in the window shown in FIG. 22 limit the objects to be reproduced with the position on the page where the objects are arranged as a clue. In other words, the position is specified by having the user input coordinate values, but the entire image of the page is displayed on the display screen, and the upper left and lower right points of the specified area are clicked with a pen. You may have it input by getting.

  The item designated by the author that can be set in the window of FIG. 22 is to select an object to be reproduced based on the contents (reproduction identifier at the time of high-speed page turning in FIG. 7) previously set for each object by the author. If this author-designated item is selected, only objects that are set to be played with the playback identifier for high-speed page turning are played back. Note that the author-specified items are always set to refer to the high-speed page turning playback identifier shown in FIG. 7 at the initial setting. In this state, the data type, data size, and position specification items are searched. Of course, it may be arbitrarily settable at the time. On the other hand, if it is not desired to refer to the playback identifier at the time of high-speed page turning, the default setting of the author-specified item is set to OFF and the data type Any one of the items of data size and position designation may be set to a desired state as illustrated in FIG.

  When the reproduction condition for high-speed page turning is set in step S200, the value of the object number area is read from the page data stored in the format shown in FIG. 6 (step S201), and the steps for the number of objects are performed. When the loop processing from S203 to S209 is performed and all objects are processed, the process proceeds from step S202 to step S210 to exit the loop processing.

  More specifically, if there is an object that has not yet been processed in step S202, the process moves to step S203, and data in an area other than the actual data area is read from the object data stored in the format of FIG. Then, based on the reproduction condition set by the user in step S200, it is checked whether or not the read data type identifier value meets the reproduction condition (step S204). At this time, if the restriction by the data type is not applied in step S200, the confirmation in step S204 is not performed, and the process directly proceeds to step S205. On the other hand, if there is a restriction based on the data type in step S200, it is checked whether the object currently being played is an object of the kind instructed to be played back by the user. The process proceeds to S205. On the other hand, if the type is not the one designated by the user, the process proceeds to step S202, and the process of the next object is performed. When the process proceeds to step S205, it is confirmed whether or not the data size of the object currently being reproduced is within the range specified in step S200. The value of the data size area of the object data stored in the format of FIG. 7 is examined, and the size other than the actual data area is subtracted from the value. If the value is in the range specified by the user, the process proceeds to step S206. If not, the process returns to step S202 to proceed to the next object process. However, if there is no restriction due to the data size in step S200, the process of step 205 is not performed, and the process directly proceeds to step S206. When the processing moves to step S206, it is checked whether or not the object being reproduced is at a position designated by the user. Referring to the areas of the start point coordinates and the end point coordinates in FIG. 7, if at least a part of the object is included in the area specified by the user in step S200, the process proceeds to step S207. Otherwise, the process returns to step S202. Move on to the next object. However, if the restriction by position designation is not applied in step S200, the process proceeds to step S207 without performing the process in step S206. When the process moves to step S207, if the author-specified restriction is applied in step S200, the value of the playback identifier area at the time of high-speed page turning of the object currently being played back is checked, and the value is played back at the time of high-speed page turning. If it is set, the process proceeds to step S208. Otherwise, the process returns to step S202, and the process of the next object is performed. However, if the restriction by the author is not applied in step S200, the process proceeds to step S208 without performing step S207. In this way, reproduction processing is performed in steps S208 and S209 for the objects that are not caught by the restriction in steps S204 to S207. In step S208, the object data is read according to the data type identifier of the object and the content set in step S200, and is output as necessary.

  FIG. 24 shows the processing procedure of step S208 when the data type identifier of the object is 0x40. First, in step S200, it is checked whether the data type is selected as a restriction item (step S300). If not selected, only the first plane image in FIG. 9 is read and decompressed as necessary (step S200). This is displayed in step S303) and step S209. Therefore, in the case of a monochrome image, since the number of planes is 1, all data is read and displayed. On the other hand, in the case of a color image, only image data of the Y plane or G plane, which is the outline data, is read and displayed. If the data type is selected as the restriction item in step S300, the details of the data type set in the window of FIG. 23 are examined, and if the image data is set to be displayed normally, In step S302, all plane image data is read and decompressed as necessary. Then, if necessary, the image is processed into a display image in step S304 and displayed in step S209. On the other hand, if the image is not set to normal display in step S301, only the first plane image is read and decompressed as necessary (step S303), and then displayed in step S209.

  FIG. 25 shows the processing procedure of step S208 when the data type identifier of the object is 0x41. First, it is checked whether or not the data type is selected as a restriction item in step S200 (step S400). If not selected, the number of bit planes read from the recording medium is set to 1 (step S402), and the process proceeds to step S405. . If the data type is set as a restriction item, the details of the detailed setting of the data type are checked to check whether the image data is set to be normally displayed (step S401). If set, the number of bit planes read from the recording medium is set to the bit number n of each pixel constituting the image (step S404), and the process proceeds to step S405. On the other hand, if it is set to display only the outline data instead of the normal display, the process proceeds to step S403, the number of bit planes read from the position of the setting knob is calculated as described above, and the process proceeds to step S405. In step S405, the bit plane images for the set number of bit planes are read from the recording medium and decompressed as necessary. Then, in step S406, the image density is converted, and a display image is created. For example, in the case of a grayscale monochrome image in which the value of each pixel is recorded with n bits, each bit plane image is represented by a higher bit as Bi (x, y) (i = 0,..., N−1, i is smaller. If the number of read bit planes is pnum, for each pixel

  The display image I (x, y) is calculated by calculating When the process of step S406 is completed, the process returns to step S209, and the created display image is displayed.

  FIG. 26 shows the processing procedure of step S208 when the data type identifier of the object is 0x42. In step S200, it is checked whether or not the data type is selected as a restriction item (step S500). If not selected, only the upper bit image is read from the recording medium (step S503), and decompressed as necessary. The process proceeds to step S504. On the other hand, if the data type is selected as the restriction item, the details of the detailed setting of the data type are checked to check whether the image data is set to be normally displayed (step S501). If it is set, both the upper bit image data and the lower bit image data are read from the recording medium (step S502), are decompressed as necessary, and then the process proceeds to step S504. On the other hand, if it is set to display only the outline data, the process proceeds to step S503, where only the upper bit image is read from the recording medium, decompressed as necessary, and then the process proceeds to step S504. In step S504, a display image is created from the image data read in step S502 or step S503. For example, when the image before division is a grayscale monochrome image, the upper bit image U (x, y) is composed of upper n bits of each pixel, and the lower bit image D (x, y) is composed of lower m bits. If both the upper bit image and the lower bit image are read,

  If only the upper bit image is read,

  Is calculated for each pixel, and the display image I (x, y) is calculated. When the display image is generated, the image is displayed in step S209.

  FIG. 27 shows a flowchart of step S208 when the data type identifier of the object is 0x43. In step S200, it is checked whether or not the data type is selected as a restriction item (step S600). If not selected, the process proceeds to step S606, where the thinned image data is read from the recording medium and decompressed as necessary. The process proceeds to step S607. In step S607, with reference to the value of the thinning interval in FIG. 15, the thinned image is enlarged to the thinning interval times and displayed in step S209. On the other hand, if the data type is selected as the restriction item in step S600, the details of the detailed setting of the data type are checked in step S601 to check whether the image data is set to be normally displayed. If set, the image data is read from the recording medium to restore the original image data (step S602, step S603), and displayed in step S209, as in the normal reading mode process. On the other hand, if the image data is set to display only approximate data in step S601, the thinned image data is read from the recording medium and decompressed as necessary (step S604), and then set in the window of FIG. The position of the setting knob for the image item is checked, and the enlargement ratio of the thinned image is calculated from the position of the knob (step S605). For example, there is a knob at a position that internally divides both ends of the “early” side and “slow” side into s: (1−s) (where 0 ≦ s ≦ 1), and the thinning interval of the thinned image is t. In this case, the enlargement ratio = s × t + (1−s) × 1 is set as the enlargement ratio. The thinned image is enlarged by the calculated enlargement ratio (step S607), and the enlarged image is displayed in step S209.

  FIG. 28 shows the processing procedure of step S208 when the data type identifier of the object is 0x44. It is checked whether or not position designation is selected as a restriction item in step S200 (step S700). If not selected, all data is read in the same manner as in the normal reading mode (step S703). After restoring the original image (step S704), the image is displayed in step S209. On the other hand, if position designation is selected as a restriction item in step S700, the position of each block image in the page calculated from the number of vertical and horizontal pixels of the block and the number of vertical and horizontal pixels of the image before division is a clue, All block images including at least part of the area designated by the user are selected (step S701). Then, after the block image data is read from the recording medium and decompressed as necessary (step S702), the read block images are rearranged at appropriate positions to create a display image (step S704). Displayed in step S209.

  FIG. 29 shows the processing procedure of step S208 in the case of moving image data whose object data type identifier is 0xA1. In step S200, it is checked whether or not the data type is selected as a restriction item (step S800). If not selected, the data in the representative frame data area is read from the recording medium among the data stored in the format of FIG. After decompression processing is performed for each frame data as necessary (step S806), the frame data is displayed on the screen at predetermined time intervals in order of time in step S209. On the other hand, if the data type is selected as the restriction item in step S800, the contents of the detailed setting of the data type are checked in step S801, and it is checked whether the moving image data is set to be normally displayed. If the normal display is set, all the data is read in the same manner as the normal reading mode described above (step S802), and then the frame data is rearranged in time order (step S803). A reproduction process is performed in S209. On the other hand, if the item of moving image data is set to display only outline data in step S801, the number of frames to be reproduced is calculated from the position of the setting knob for the item of moving image set in the window of FIG. S804), among the frame data in the representative frame data area, the frame data for the number of frames calculated in step S804 is selected from the recording medium in order of time or so that the time intervals are equal, and read as necessary. After decompression processing (step S805), reproduction processing is performed in step S209.

  Note that the processing in step S208 for objects stored in other formats is the same as the processing in the normal reading mode. However, when a special device for high-speed page turning is provided, the normal reading mode is used. You may perform processing different from the time.

  Thus, when the processing from step S203 to step S209 is performed on all the objects included in the currently displayed page, the processing proceeds from step S202 to step S210. Note that the processing from step S210 to step S214 is the same as the processing from step S105 to step S109, and a description thereof will be omitted.

  As explained above, by devising the storage method of each object data that composes the page, only the necessary objects can be easily read from the recording medium and played when turning the page at high speed. You can turn the page.

It is a block diagram of the electronic book display device concerning this embodiment. FIG. 2 is an overview diagram when the electronic book display device of FIG. 1 is a portable device. It is a figure which shows the outline of the format of the book data for reproducing | regenerating and displaying with the electronic book display apparatus which concerns on this Embodiment. It is a figure which shows the detail of data storage of the management information area | region of the book data of FIG. It is a figure for demonstrating typically that each page is constituted by arranging a plurality of objects. It is a figure which shows the detail of data storage of each page data of the book data of FIG. It is a figure which shows the detail of storage of the object data which are the components of FIG. It is a figure which shows a response | compatibility with the data type identifier of the object data which is a component of FIG. 6, and real data. It is a figure which shows the storage method of normal image data among object data. It is a figure explaining the method of dividing | segmenting image data into each bit plane image. It is a figure which shows the storage method of the image data in the case of dividing and storing in each bit plane image among object data. It is a figure explaining the method of dividing | segmenting each pixel of image data into a high-order bit image and a low-order bit image. It is a figure which shows the storage method of the image data in the case of dividing | segmenting and storing the upper bit image and lower bit image of each pixel among object data. It is a figure which shows a mode that image data is taken out for every predetermined number of pixels, and a thinning image is produced | generated. It is a figure which shows the storage method of the image data in the case of dividing | segmenting and storing in a thinned image and the remaining pixel data among object data. It is a figure which shows the storage method of normal moving image data among object data. It is a figure which shows the storage method in the case of providing a representative frame area | region among object data and storing moving image data. It is a figure which shows a mode that image data is divided | segmented into a some block area | region. It is a figure which shows the storage method of the image data in the case of dividing and storing in several block area | region among object data. It is a flowchart which shows the process sequence in the normal reading mode of the electronic book display apparatus which concerns on this Embodiment. It is a flowchart which shows the process sequence in the high-speed page turning mode of the electronic book display apparatus which concerns on this Embodiment. It is a figure which shows the example of the screen which sets the reproduction | regeneration conditions of an object at the time of high-speed page turning mode. It is a figure which shows the example of the screen for performing the detailed setting of a data classification at the time of a high-speed page turning mode. It is a flowchart which shows the process sequence which reads the image data whose value of a data classification identifier is 0x40 at the time of a high-speed page turning mode. It is a flowchart which shows the process sequence which reads the image data divided | segmented and stored in each bit plane at the time of the high-speed page turning mode. It is a flowchart which shows the process sequence which reads the image data stored by dividing into a high-order bit image and a low-order bit image in the high-speed page turning mode. It is a flowchart which shows the process sequence which reads the image data divided | segmented into the thinned image and the remaining pixel data at the time of the high-speed page turning mode. It is a flowchart which shows the process sequence which reads the image data stored by dividing into a some area | region at the time of the high-speed page turning mode. It is a flowchart which shows the process sequence which reads the moving image data which provided the representative frame area | region and stored in the high-speed page turning mode.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... Input means, 105 ... Display means, 106 ... Audio output means, 107 ... Page turning instruction means, 108 ... Display mode switching instruction means, 109 ... CPU bus.

Claims (4)

A reproduction display device configured to divide and set data on each of a plurality of objects into element data as reproduction units, and reproduce and display the element data provided for each reproduction unit, wherein the element data is A first data portion composed of schematic data indicating the entire element data used for reproduction when high-speed reproduction is instructed; a second data portion composed of remaining data other than the approximate data; The first data portion is compressed by a method with a fast decompression process, and the second data portion is compressed and stored by a method with a high compression ratio, and when high-speed playback is instructed, A reproduction display device, wherein the first data portion is read and sequentially reproduced and displayed.   When the element data is image data, an upper bit image generated from an arbitrarily set partial bit in each pixel value is set as the first data portion. Playback display device.   2. The reproduction display according to claim 1, wherein when the element data is image data, a thinned image generated by thinning each pixel at an arbitrarily set ratio is used as the first data portion. apparatus.   The element data according to claim 1, wherein when the element data is moving image data, one or more representative frame images arbitrarily selected as representative frame data from the moving image data are used as the first data portion. The reproduction display device described.

Images