JPH11282868A - Reproducing and display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accelerate data display switchover by attaching an identifier to partial data in element data provided in each reproduction unit and successively reproducing and displaying the partial data according to the instruction of fast reproduction. SOLUTION: In an electronic book display device as a reproduce and display device, book data stored in a RAM 103 has an object data area in which data is stored in each object in a page data area where page data is divided and stored. A fast page turn time reproduction identifier which shows the propriety of object reproduction at the time of a fast page turn mode is attached to the object area. And, when a user switches to a fast page turn mode with a display mode switch instruction means 108, only an object that is set so as to be reproduced with the fast page turn time reproduction identifier is successively reproduced at the time of successively updating a page whenever a CPU 101 instructs a page turn instructing means 107 to turn a page.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a playback / display device for playing back and displaying digital data such as electronically recorded electronic book data, and more particularly to a data structure and a playback device capable of switching the display at high speed. It relates to a display device.

[0002]

2. Description of the Related Art In a display device for displaying a plurality of display data, such as document data composed of a plurality of pages and image data of an image filing device, the display data is sequentially switched in order to search for target data. In some cases, desired data is searched. In this case, if the entire display data is constantly displayed, the data cannot be switched at a high speed, and the search efficiency is reduced. Therefore, in an image filing apparatus disclosed in Japanese Patent Application Laid-Open No. 1-269174, among image data displayed on a screen,
Only the area specified by the user is developed in the image memory and sequentially displayed on the screen for searching. Also, Japanese Patent Application Laid-Open No.
In Japanese Patent Application Publication No. 0670, there is a device that records original image data and its reduced data, reads the reduced data at the time of retrieval, and sequentially displays the reduced data, thereby realizing a high-speed page turning operation.

[0003]

However, in order to perform high-speed display switching, it is necessary to devise a method of storing display data. However, since the method is not considered at all in JP-A-1-269174, page turning is performed. There was a problem that processing took time.

When a reduced image is registered in advance as disclosed in Japanese Patent Application Laid-Open No. 4-120670, redundant data is stored in a recording medium, and the amount of data to be stored increases. There was a problem.

Further, there is a problem that it is not possible to deal with page turning of display data in which various data such as characters, images, sounds, and moving images are arranged on one page as in recent document data. there were.

An object of the present invention has been made in view of the above problems, and an object of the present invention is to provide a data structure and a reproduction display device capable of performing display switching at high speed.

[0007]

A reproduction display device according to claim 1, wherein the reproduction display device reproduces and displays element data provided for each apparatus reproduction unit, wherein a part of the element data is reproduced. Is provided with an identifier for high-speed playback,
When high-speed reproduction is instructed, the partial data is sequentially reproduced and displayed.

Accordingly, it is not necessary to provide special data for high-speed reproduction for each reproduction unit, so that the amount of data to be processed can be reduced, and high-speed reproduction display for each reproduction unit can be performed. In the case of an electronic book, since the reproduction unit is page by page, high-speed page turning can be performed, and the data amount of the recording medium can be reduced.

[0009] The reproduction display device according to the second aspect is the first aspect.
In the reproduction display device described above, a compression method for a part of the element data is different from a compression method for other data.

[0010] This makes it possible to reproduce and display at higher speed, and to turn pages faster than in the case of an electronic book.

Preferably, the element data is as follows. That is, the element data is image data, the partial data is an upper bit image generated from some bits of each pixel, the partial data is a part of a bit plane image divided into bit plane images, A thinned image in which some data is generated by thinning each pixel, a divided image in which the partial data is split from an original image,
Alternatively, it is preferable that the element data is moving image data and the partial data is a representative frame image selected from the moving image data.

[0012] The reproduction display device according to the eighth aspect is the first aspect.
In the reproduction display device described above, the element data is image data or moving image data, and a display ratio of the partial data can be variably set.

[0013] Thereby, at the time of high-speed reproduction and display, reproduction and display can be performed at a speed desired by the user, and operability such as search is improved.

According to a ninth aspect of the present invention, there is provided a reproduction / display apparatus.
The playback display device according to claim 1, further comprising condition setting means for setting at least one condition of a data type, a data size of the element data, or position information in a playback unit, and performing playback at high speed playback based on the set conditions. The method is characterized in that the element data is selected.

[0015] Thereby, the retrieval efficiency and the operability are improved in order not to reproduce the element data unnecessary for the user.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below by taking an electronic book display device as an example of a reproduction display device. This electronic book display device uses digital book data such as weekly magazines, novels, manga, etc.
"Book data") is reproduced and displayed as reproduction data. In the present embodiment, an electronic book display device has been described as an example, but the present invention is also applicable to a general reproduction display device such as an image filing device that reproduces and displays other digital data.

FIG. 1 shows a block configuration of an electronic book display device according to the present embodiment. In FIG. 1, reference numeral 101 denotes a CPU serving as control means; 102, a ROM for storing a control program of the apparatus; 103, a RAM used for storing a program, a work area of the program, and book data such as page data; 104 is input means such as a disk drive or a communication line for reading and reproducing book data recorded on the recording medium, 105 is display means for displaying book data, and 106 is audio data of book data recorded on the recording medium. A voice output unit 107 for outputting data, 107 is a page turning instructing unit configured by a button or the like that allows a user to instruct both normal and high-speed page turning of a displayed electronic book page, and 108 is a page data Display mode switching instructing means 109 for the user to instruct to switch the display mode; A CPU bus connecting the location components. The CPU 101
According to a control program stored in the ROM 102, the input unit 104, the display unit 105, and the audio output unit 106 are controlled to control reproduction and display of book data.
Various processes are performed in accordance with the user's instruction from the page turning instruction unit 107 and the display mode switching instruction unit 108. The display unit 105 includes a display control unit 1051 for controlling the content displayed on the display screen, and a display screen 1052 including a display.

FIG. 2 shows an example of the appearance of an electronic book display device according to the present invention. In FIG. 2, a resistive pressure sensitive tablet is attached on the surface of the display screen 1052, including all the components of FIG. 1, and this tablet is used as the display mode switching instructing means 108 and other input means from the user. A button provided on this device is used as a page turning instruction unit 107 for instructing a user to turn a page normally or at high speed. Reference numeral 111 denotes a recording medium insertion slot into which a recording medium on which book data is recorded is inserted.
112 is for switching the display mode through the tablet,
It is a pen for performing various inputs.

FIG. 3 schematically shows a storage format of book data to be displayed on the electronic book display device. As shown in FIG. 3, the book data is divided into a management information area for storing bibliographic information such as a title, page information such as the total number of pages and the size of each page, and page data corresponding to the body of the book data for each page. It is composed of a page data area which is stored after being stored in a recording medium such as an IC card or a disk.

FIG. 4 shows a configuration example of the management information area in the book data. The management information area includes a management information area identifier indicating a management information area, a data size indicating the size of this area, a bibliographic information area in which a title, an author name, and the like are recorded, and a page size and a total number of pages. The recorded page information area and the like are stored. Each page is virtually provided with a coordinate system whose origin is the upper left vertex of the page, and the coordinates of the lower right vertex of the page in this coordinate system are recorded in the page size area. Note that the number on the right in FIG. 4 indicates the number of bytes at the time of storage.

As shown in FIG. 5, each page is composed of element data (hereinafter, referred to as objects) such as character data, image data, audio data, and moving image data.
Each page is configured by arranging each object on a virtual page sheet having the page size recorded in the page information area of FIG. Note that non-display data such as audio data is virtually arranged in the entire page or in an area related to the content.

FIG. 6 shows a data storage method of each page data in the page data area of FIG. Each page data is
A page data identifier indicating that the following information is page data, a data size indicating the number of bytes of the page data, the number of objects in an area for recording the number of objects constituting the page data, an object storing data for each object It consists of a data area. Note that the number on the right in FIG. 6 indicates the number of bytes for storage.

FIG. 7 shows a method of storing each object data area in FIG. As shown in FIG. 7, the object data area specifies an object data area identifier indicating that this area is an object data area, a data size of this area, a data type identifier, and a position where the object is arranged. Coordinates of the start and end points for recording the upper left and lower right coordinates of the rectangular area where the object is placed, the playback identifier for fast page turning indicating whether the object is played when the fast page turning mode is specified, It consists of a real data area for storing real data. The high-speed page-turning playback identifier of FIG. 7 is set so that only important objects or objects that are meaningful only to specific contents can be played back and displayed in the high-speed page turning mode in the book data creation stage. Or at predetermined intervals of the page in order to reproduce and display the page of the book as if it were actually flipping. Note that the number on the right in FIG. 7 indicates the number of bytes for storage.

The data type identifier in FIG. 7 is an identifier provided for specifying the type of object and the storage method. FIG. 8 shows a correspondence table between the data type identifier and the data type in FIG. That is, by reading the value of the data type identifier, the type and storage method of the actual data area can be specified.

Next, a specific storage method of the real data area shown in FIG. 7 will be sequentially described.

Large data, such as image data, audio data, and moving image data, becomes a bottleneck when reading from a recording medium when it is desired to turn pages at high speed. Therefore, if necessary, the outline data and the remaining data are divided and stored, so that only the outline data can be easily read in the high-speed page turning mode. When the outline data and the remaining data are compressed and stored, an information area for designating each compression method is provided so that both compression methods can be changed as necessary. This is for the following reasons: In order to turn pages at high speed, it is desirable to select a compression method that minimizes the sum of the reading time from the recording medium, the decompression processing time, and the display time even if the compression ratio is not so high. On the other hand, for book data including data with a large data volume such as images, sounds, and moving images, it is generally desired to reduce the data volume. In particular, when high-speed display is not required, the decompression time may be slightly longer. Even if it is applied, a compression method with a high compression rate is often used. Therefore, it is desirable that the outline data requiring high speed and the remaining data not requiring high speed be stored in different compression methods. For example, approximate data is compressed by run-length coding that takes less processing time,
The remaining data is compressed using arithmetic arithmetic coding which requires a processing time but can be expected to have a high compression ratio.

FIG. 9 shows that the value of the data type identifier is 0x40.
Is stored in the actual data area of FIG. 7 in this format. Note that the number on the right in FIG. 9 indicates the number of bytes at the time of storage, and the same applies to the data structure of actual data to be described below. Also, since the number of bytes is known in this manner, desired data can be read by designating the desired number of bytes.
As shown in FIG. 9, the number of pixels in the vertical and horizontal directions of the image, the number of planes of the image, information on designating the compression method of each plane image, offset value information indicating the position of each plane image from the head of the actual data area by the number of bytes, Are stored in the order of the respective plane image data, and each plane image is compressed by the compression method specified in the section of the compression method. In the case of a monochrome image, the number of planes is set to 1, and image data is stored using only the first plane image area. In the case of a color image, data is expressed in the YUV color system adopted in JPEG, the number of planes is set to 3, a Y plane image is in the first plane image area, a U plane image is in the second plane image area, The V plane images are compressed and stored in the three plane image areas by the method specified in the section of the compression method. In the YUV color system, since the Y plane image is a luminance component of the original image, it can be used as general data of the original color image. Therefore, when it is desired to turn a page at high speed, only the Y plane image is read and displayed. It should be noted that even if the color system is not YUV color system, YCrCb
The image data is represented by a method of dividing into a luminance signal and a color difference signal as in a color system or the like, and the luminance signal is used as the first plane image.
The plane image may be stored in the first plane image.

In the case of the image data format in which the data type identifier is 0x41, the image is divided into bit-plane images, and the image is sequentially stored from the bit-plane image composed of the most significant bits of each pixel. FIG. 10 schematically illustrates how image data in which each pixel value is composed of 3 bits is divided into bit plane images. The upper part of FIG. 10 shows image data before division, and a pixel value is recorded in 3 bits for each pixel. An image in which only the first bit of each pixel is extracted, an image in which only the second bit is extracted, and an image in which only the third bit is extracted are divided into bit planes. Although FIG. 10 has been described using an image composed of 3 bits for each pixel, it can be easily extended to an image composed of n bits for each pixel in general. In the case of a color image, the process of FIG. 10 is performed for each of the R, G, and B plane images, and the i-th bit plane image has, for each pixel, the i-th bit of the R plane pixel, The data may be stored in the order of the i-th bit of the pixel of the G plane and the i-th bit of the pixel of the B plane, in the order of pixels. Such a format is derived from the fact that the outline of the image can be understood even if the image is reproduced using only the upper bits or only the bit plane image of several bits from the upper bits. Therefore, by dividing the bit-plane image in advance and reading only the bit-plane image of several bits from the upper bit when turning the page at high speed, the input time from the recording medium can be reduced and the data can be reproduced at high speed. I do. FIG. 11 shows a storage format in the case where the data is divided into bit planes and stored. In this format, the data is stored in the real data area in FIG. As shown in FIG. 11, the number of pixels in the vertical and horizontal directions of the image, the number of bit planes, the designation of the compression method of each bit plane image, offset value information indicating the position of each bit plane image from the head of the actual data area by the number of bytes, each bit plane It is recorded in the order of the image data. Each bit plane image is compressed by the method specified in the section of the compression method.

The data format in which the data type identifier is 0x42 includes an image generated from only the most significant bit of each pixel value or bits of several upper bits of each pixel,
An image composed of the remaining bits is stored in two parts.
FIG. 12 shows an image in which the value of each pixel is composed of 4 bits as 2 bits.
The state of separation is schematically shown. The upper part of FIG. 12 shows the image data before division, and indicates that the pixel value is recorded in 4 bits for each pixel. In case of dividing into upper 2 bits and lower 2 bits of each pixel, as shown in FIG.
This is performed by creating an upper bit image in which only the first bit and the second bit are sequentially extracted for each pixel before division and a lower bit image in which only the third and fourth bits are sequentially extracted. The two images generated as a result are shown in FIG. FIG. 3B shows the result of dividing the image generated from only the most significant bit of each pixel into the remaining image and the remaining image. In FIG. 12, for the sake of explanation, an image in which each pixel is composed of 4 bits has been described as an example, but expansion to an n-bit image is easy, and the present invention is not limited to 4 bits. In the case of a color image, the processing of FIG. 12 is performed for each of the R, G, and B plane images, and the upper bit image generated from each of the R, G, and B plane images is stored as the upper bit image. The lower bit image generated from each of the R, G, and B bit plane images may be stored as the lower bit image. FIG. 13 shows an example of a storage format when an image is divided and stored in this format, and the image is stored in the actual data area in FIG. 7 in this format. As shown in FIG. 13, this data includes the number of vertical and horizontal pixels of the image, the compression method of the upper bit image and the lower bit image, the number of bits extracted from each pixel when generating the upper bit image and the lower bit image, the upper bit The data size and data of the image and the data size and data of the lower bit image are recorded in this order. The upper bit image data and the lower bit image data are each compressed by the method specified in the section of the compression method. By storing the image data in this format, it is possible to easily read only the general image data generated from the upper several bits. The data type identifier is 0x
In the case of displaying the image data 41, it is necessary to read bit plane images of several bits from the upper bits and then combine these bit plane images. Is stored in a synthesized form, so that the time and effort of synthesizing when displaying can be omitted, and the page can be turned more quickly. On the other hand, when the data type identifier is 0x41 image data, the page turning speed can be adjusted in several steps by adjusting the number of bit plane images to be read, whereas in this storage method, only the upper bit image is read or This is a two-step speed adjustment for reading both bit images.

In the data format having a data type identifier of 0x43, a thinned image generated by extracting pixels every few pixels in the vertical and horizontal directions and the remaining pixel data are stored separately. Things. FIG.
FIG. 4 shows a state of generating a thinned image thinned out every three pixels. In FIG. 14, each grid represents each pixel of the image, and only the pixels indicated by diagonal lines in the vertical and horizontal directions for each three pixels are sequentially extracted from the original image described on the left side of FIG.
By arranging the pixel data while maintaining the order in which the pixels of the original image are arranged, a thinned-out image as general data is generated. The purpose of this storage method is to reduce the time required for input from a recording medium by reading only a thinned image when turning pages at high speed. FIG. 15 shows an example of a storage format in the case of registration in the form of a thinned image, which is recorded in the actual data area of FIG. 7 in this format. As shown in FIG. 15, after storing the number of vertical and horizontal pixels of the image, the compression method of the thinned image and the remaining pixel data, the thinning interval, the thinned image data size, the thinned image data, the remaining pixel data size, and the remaining pixels Store in data order. The thinned image data and the remaining pixel data are respectively compressed by the method specified in the section of the compression method.

Further, a data storage method for turning pages at a high speed with respect to moving image data will be described. FIG. 16 shows an example of a normal moving image data storage method (the data type identifier in this case is 0xA0), and FIG. 17 shows an example of a moving image data storage method for high-speed page turning (the data type identifier in this case is 0xA1). . As shown in FIG. 16, normal moving image data is recorded in the number of pixels in the vertical and horizontal directions of the moving image area, the designation of a frame data compression method, and the moving image data format. Then, each frame data is compressed by the method specified in the item of the compression method, and stored in chronological order along with the size of the frame data. In contrast, FIG.
In the moving image storage method shown in (1), a representative frame data area is newly provided. In this area, some representative frame data is extracted from the frame data at each time that constitutes the moving image data, and each frame data is compressed by the method specified in the section of the compression method. Is stored together with the frame number indicating the frame number and the size of the frame data. The other frame data is also compressed by the method specified in the section of the compression method, and stored in the remaining moving image data area in FIG. 17 in chronological order. The method of storing each frame data in the remaining moving image data area is the same as the method of storing the frame data in FIG. When turning pages fast,
By reading and reproducing only the representative frame data area, the reading time and the reproducing time from the recording medium are reduced.

When a desired page is searched while turning the page, the search may be performed based on positional information in the page. For this reason, as shown in FIG. 7, all the objects have positional information on the page attached thereto, and based on this information, only the objects at least partially included in the area designated by the user are read out. To be able to play. However, in the case of an object protruding from an area specified by the user, an unnecessary area is read out, leading to a time loss. In particular, an object having a larger size on the display screen is more likely to be wasted. So a large object
The data is divided into several areas in advance and stored, so that only data in the same range as the area designated by the user can be easily read as much as possible.

FIG. 18 shows a case where image data has a predetermined size (bx
FIG. 5 is a diagram schematically showing the state of division into (xby) blocks, in which image data is collectively stored for each divided area shown on the right side of FIG. The data type identifier in this case is 0x
44. FIG. 19 shows a storage method when image data is divided and stored in several block areas. FIG.
As shown in FIG. 9, after storing the number of vertical and horizontal pixels of the image and the compression method of each block image, the number of horizontal pixels and the number of vertical pixels of each block are stored, and each block image divided according to its size is referred to as a so-called TV. Data size and block image data are sequentially stored in the raster scanning order. The block image data is compressed and stored according to the method set in the section of the compression method. Then, by reading only the block image including at least a part of the area specified by the user, although a part other than the area specified by the user is read somewhat, useless data is compared with the case where all the object data is read. There is little reading and contributes to high-speed page turning. Each bit plane image of an object whose data type identifier is 0x41 or 0x42, a thinned image of 0x43,
This block division format storage method may be used for storing each frame data of A0 and 0xA1.

Next, the operation of the electronic book display device will be described.
This will be described with reference to a flowchart. This apparatus has a normal reading mode in which the displayed page is sequentially updated each time a page turning is instructed through the page turning instructing means 107, and a high-speed page turning such as when searching for a desired page. There are provided two modes of a high-speed page turning mode for turning. When the power is turned on, a normal reading mode is set, and the switching between the modes is performed by the user instructing the switching by the display mode switching instructing unit 108 during the display of the page data. Specifically, a button or the like for instructing mode switching is displayed on the display screen, and the user switches the display mode by clicking this button. Hereinafter, each mode will be described.

First, in the normal reading mode, FIG.
This will be described with reference to the flowchart of FIG. First, in step S100, a display page is set to a predetermined page. Here, the predetermined page is the first page of the book data when the power is turned on, or the page that was displayed last last time, and the page that was opened in that mode when the mode was shifted from another mode. Next, the number of objects is read from the page data area of the set page (step S101), object data is read from the recording medium for each object constituting the page (step S102), and each object is read in accordance with the value of the data type identifier. Is performed (step S103). Then, in step S104, it is checked whether or not the reproduction process has been completed for all the objects in the page. If there is any object that has not been processed, the process returns to step S102 to perform the reproduction process. On the other hand, if all objects have been processed, the process moves to step S105.

The explanation for step S103 will be supplemented. The process of step S103 is performed by switching the process according to the value of the data type identifier. For example, when the data type identifier is 0x41, each bit plane image read and decompressed in step S102 is restored to the original image and displayed. For example, in the case of a grayscale monochrome image in which the value of each pixel is recorded in n bits, each bit plane image is represented as Bi (x, y) (i = 0,. ), Then for each pixel

[0037]

(Equation 1)

Calculating the original image I
(X, y) is restored and displayed.

In the case of the object whose data type identifier is 0x42, the image before the division is restored and displayed from the upper bit image and the lower bit image read and decompressed in step S102. For example, the image before division is a grayscale monochrome image, and the upper bit image U (x, y)
Is the upper n bits and lower bit image D (x, y) of each pixel
Is composed of the lower m bits,

[0040]

(Equation 2)

The original image I (x, y) is restored and displayed by performing the above calculation.

In the case of image data whose data type identifier is 0x43, the original image is restored and displayed from the thinned image and the remaining pixel data with reference to the thinning interval given to the data.

In the case of moving image data whose data type identifier is 0xA1, the frame data in the representative frame data region and the frame data in the remaining moving image data region are arranged in chronological order with reference to the frame number in the representative frame data region. After the replacement, the processing is performed by displaying the frame data in a time sequence at predetermined time intervals.

In the case of image data whose data type identifier is 0x44, after decompression processing is performed for each block image, the number of vertical and horizontal pixels of each block and the number of vertical and horizontal pixels of the image before division are used to determine the block image of each block image. Calculate the placement position,
The image data before division is combined and displayed on the screen.

When the output of all the objects constituting the page being displayed is completed, it is checked in step S105 whether or not page turning has been instructed through the page turning instructing means 107, and if page turning has been instructed, Change the page number to be displayed in step S108,
Returning to step S101, the page is reproduced. If the page turning has not been instructed, it is checked whether the user has requested to switch the display mode through the display mode switching instructing means 108 (step S10).
6) If the switching of the display mode is requested, the processing shifts to the display processing in the high-speed page turning mode. If the switching of the display mode has not been requested, it is checked whether or not the user has requested to end the display processing of the page data (step S107). If you are requested to end the page data display process,
The reproduction of the book data ends (step S109). On the other hand, if it is not requested to end the page data display processing, the process returns to step S105, and thereafter, the processing of steps S105 to S107 is performed until a request relating to any of steps S105 to S107 is made by the user. Is repeated.

Next, regarding the high-speed page turning mode,
This will be described with reference to the flowchart in FIG. When the mode is shifted from the normal reading mode to the high-speed page turning mode, first, in step S200, as a condition setting means, as shown in FIG.
2 is displayed on the display screen so that the user can set reproduction conditions for turning pages at high speed.

Here, the processing in step S200 will be described in detail. As shown in FIG. 22, reproduction conditions are roughly divided into four types of condition setting contents of only data type, data size, position designation, and creator designation object.
An object to be reproduced is selected from a logical product of the conditions selected by the user among the four conditions. For example, FIG.
2 is the restriction of data type and the restriction of position specification
This indicates that only objects satisfying both conditions are requested to be selected and reproduced, and restrictions imposed by the data size and the creator's designation are ignored.

Among them, the data type is an item for restricting an object to be reproduced for each data type, and restricts an object to be reproduced from four items of characters, images, sounds, and moving images. For example, if an image that was on a page remains in the memory and the image is used as a clue to search for that page, or if the sound that was playing on a page remains in the memory and the page is caught using the sound Use this item when searching. For example, when the character and image items are selected as shown in FIG. 22, when opening each page, the value of the data type identifier of each object data is read from the recording medium, and 0x01 meaning character data is read.
And 0x40, 0x41, 0x4 meaning image data
The actual data area is read and reproduced only for the object data of 2, 0x43 and 0x44. Even if audio and video data are present in the page, reproduction is not performed by skipping the object data using the data size value in FIG. In the data type item, more detailed reproduction conditions can be set. When the "Details" button in FIG. 22 is clicked, a window as shown in FIG. 23 opens, and the user can set detailed conditions for each type of data. The contents set here are the same as those in FIG. This is reflected in the processing in S208. FIG.
Reference numeral 3 denotes a window for inputting settings for image data and moving image data. For each of the image data and moving image data, all data in the actual data area is read and displayed in the same manner as when turning pages in a normal reading mode. Or a color image whose data type identifier is 0x40, 0x4
In the case of an object such as 1, 0x42, 0x43, and 0xA1, the user is asked to set whether only the outline data is displayed. In the case of a monochrome image having a data type identifier of 0x40 or an object having no outline data such as 0xA0, the image is displayed in the same manner as when turning a normal page, regardless of the user setting. When only the summary data is displayed, the display ratio of the summary data can be variably set more flexibly by changing the position of the setting knob. When the data type identifier is 0x41, the number of bit plane images to be read is changed based on the set position. For example, if the setting knob is at a position that internally divides the slow side and the fast side into 2: 1, each pixel is n
If the image is a bit image, only n / 3 bit plane images are read and displayed from the top. In the case of the image data whose data type identifier is 0x43, if the position of the setting knob is closer to the slow side, only the thinned image is read and enlarged, and if the position of the setting knob is closer to the early side, only the thinned image is read and enlarged. Display without any change, and change the magnification according to the position of the knob. If the data type identifier is a color image of 0x40, only the first plane image is read and displayed regardless of the position of the setting knob. The image data with the data type identifier of 0x42 also reads and displays only the upper bit image regardless of the position of the setting knob.
If the data type identifier is 0xA1 moving image data, the number of frame data to be read from the representative frame data area is changed depending on the position of the setting knob. In other words, the number of displayed frame data is 1 depending on the position of the knob.
It changes from the number of frames to the number of frames registered in the representative frame area. In FIG. 23, only the image data and the moving image data can be set. However, if there are items to be set for characters and sounds, the items are added to this window.

The data size items that can be set in the window of FIG. 22 simply limit the objects to be reproduced according to the size of the data. Since all the objects are stored in the format of FIG. 7, the value of the data size is checked, and only the objects smaller than the threshold value input by the user are read and reproduced.

The position designation item that can be set in the window shown in FIG. 22 limits the object to be reproduced based on the position on the page where the object is located. In other words, the position is specified by having the user input the coordinate values, but the entire image of the page is displayed on the display screen, and the upper left and lower right points of the specified area are clicked with a pen You may be asked to enter it.

The items designated by the creator that can be set in the window of FIG. 22 are based on the contents set in advance by the creator for each object (the high-speed page turning reproduction identifier in FIG. 7).
This is for selecting an object to be reproduced. If the item designated by the creator is selected, only the object set to be reproduced by the reproduction identifier at the time of high-speed page turning is reproduced.

When the reproduction conditions for high-speed page turning are set in step S200, the value of the object number area is read from the page data stored in the format of FIG. 6 (step S201). The loop process from step S203 to step S209 is performed for several minutes, and when the process is performed on all the objects, the process proceeds from step S202 to step S210 and exits from the loop process.

More specifically, if there is an object that has not been processed yet in step S202, the process proceeds to step S203, where the object data stored in the format shown in FIG. Read. Then, based on the reproduction condition set by the user in step S200, it is checked whether the value of the read data type identifier satisfies the reproduction condition (step S204). At this time, step S20
If the data type is not restricted by 0, the process proceeds to step S205 without confirming step S204. On the other hand, if the restriction by the data type is imposed in step S200, it is checked whether the object currently being reproduced is an object of the type instructed to be reproduced by the user, and if the object is instructed to be reproduced, step S200 is performed. The process proceeds to S205. Conversely, if the type is not the type designated by the user, step S
The process moves to 202 and moves to the processing of the next object. When the process proceeds to step S205, it is checked whether the data size of the object currently being reproduced is within the range specified in step S200. The value of the data size area of the object data stored in the format of FIG. 7 is checked, the size other than the actual data area is subtracted from the value, and if the value is within the range specified by the user, the process proceeds to step S206. If not, the process returns to step S202 to move to the processing of the next object. However, if the data size is not restricted in step S200, the process proceeds to step S206 without performing step 205. When the process proceeds to step S206, it is checked whether the currently reproduced object is at a position designated by the user. Referring to the area of the start point coordinates and the end point coordinates in FIG.
If the area is included in the area designated by the user at 00, the process proceeds to step S207; otherwise, the process proceeds to step S2.
Returning to 02, the processing proceeds to the next object. However,
If the restriction by the position designation has not been applied in step S200, the process proceeds to step S207 without performing the process in step S206. When the process proceeds to step S207, the value of the reproduction identifier area for high-speed page turning of the currently reproduced object is checked, and if the value is set to be reproduced at high-speed page turning, the process proceeds to step S208. Otherwise, step S20
Returning to 2, the process proceeds to the next object. However, when the restriction by the creator designation is not applied in step S200, the process proceeds to step S208 without performing the process in step S207. In this way, the reproduction process is performed in steps S208 and S209 for the objects that are not caught by the restrictions in steps S204 to S207. In step S208, the object data is read out according to the data type identifier of the object and the contents set in step S200, and output as necessary.

The data type identifier of the object is 0x4
FIG. 24 shows the processing procedure of step S208 when the value is 0. First, it is determined whether or not the data type is selected as a restriction item in step S200 (step S200).
300), if not selected, the first in FIG.
After reading only the plain image and performing the decompression process (step S303), the image is displayed in step S209. Therefore,
In the case of a monochrome image, since the number of planes is 1, all data is read and displayed. On the other hand, in the case of a color image, only the image data of the Y plane, which is the approximate data, is read and displayed. In step S300, if the data type is selected as the restriction item, the contents of the detailed setting of the data type set in the window of FIG. 23 are checked, and if the image data is set to be normally displayed, The process proceeds to step S302, where all the plane image data is read and decompressed as necessary. Then, if necessary, the image is processed into a display image in step S304 and displayed in step S209. On the other hand, if the image is not set to the normal display in step S301, only the first plane image is read, and decompression processing is performed as necessary (step S303).
09 is displayed.

FIG. 25 shows the processing procedure of step S208 when the data type identifier of the object is 0x41. First, it is checked whether or not the data type is selected as a restriction item in step S200 (step S400). If not, the number of bit planes read from the recording medium is set to 1 (step S400).
402), the process moves to step S405. If the data type is set as a restriction item, the contents of the detailed setting of the data type are checked to determine whether the image data is set so as to be displayed normally (step S40).
1). If set, the number of bit planes read from the recording medium is set to the number of bits n of each pixel constituting the image (step S404), and the process proceeds to step S405. On the other hand, if the setting is such that only the general data is displayed instead of the normal display, the process proceeds to step S403, where the number of bit planes to be read from the position of the setting knob is calculated as described above, and the process proceeds to step S405. In step S405, the bit plane images for the set number of bit planes are read from the recording medium and decompression processing is performed as necessary. Then, in step S406, the image is subjected to density conversion to create a display image. For example, in the case of a grayscale monochrome image in which the value of each pixel is recorded in n bits, each bit plane image is represented by Bi (x, y) (i = 0,.
If the number of read bit planes is pnum, the smaller the value of -1, i is, the higher the bit plane image is.)

[0056]

(Equation 3)

The display image I is calculated by calculating
Calculate (x, y). Upon completion of the process in the step S406, the process returns to the step S209 to display the created display image.

FIG. 26 shows the processing procedure in step S208 when the data type identifier of the object is 0x42. It is checked whether or not the data type is selected as the restriction item in step S200 (step S200).
500), if not selected, only the upper bit image is read from the recording medium (step S503), and if necessary, decompressed, and then the process proceeds to step S504. On the other hand, if the data type is selected as the restriction item, the contents of the detailed setting of the data type are checked to determine whether or not the image data is set to be normally displayed (step S501). If it is set, both the upper bit image data and the lower bit image data are read from the recording medium (step S502), decompressed as necessary, and then the process proceeds to step S504. On the other hand, if the setting is such that only the outline data is displayed, the process proceeds to step S503, where only the upper bit image is read from the recording medium, decompressed as necessary, and then proceeds to the process of step S504. In step S504, step S502 or step S5
03, a display image is created from the image data read. For example, the image before division is a grayscale monochrome image,
The upper bit image U (x, y) is the upper n bits of each pixel,
When the lower bit image D (x, y) is composed of the lower m bits, when both the upper bit image and the lower bit image are read,

[0059]

(Equation 4)

When only the upper bit image is read,

[0061]

(Equation 5)

Is calculated for each pixel, and the display image I is calculated.
Calculate (x, y). When the display image is generated, the image is displayed in step S209.

FIG. 27 shows a flowchart of step S208 when the data type identifier of the object is 0x43. It is determined whether or not the data type has been selected as a restriction item in step S200 (step S600).
In step S607, the thinned image data is read from the recording medium and decompressed as necessary.
Move on to processing. In step S607, with reference to the value of the decimation interval in FIG. 15, the decimation image is enlarged by the decimation interval and displayed in step S209. On the other hand, step S6
If the data type is selected as the restriction item in 00, the contents of the detailed setting of the data type are checked in step S601, and it is checked whether the image data is set to be displayed normally. If it is set, the image data is read from the recording medium to restore the original image data (steps S602 and S603) and displayed in step S209 in the same manner as in the normal reading mode processing. On the other hand, if the image data is set to display only the outline data in step S601, the thinned image data is read from the recording medium and decompressed as needed (step S604), and then set in the window of FIG. The position of the setting knob of the image item is checked, and the magnification of the thinned image is calculated from the position of the knob (step S60).
5). For example, s: (1-
s) When there is a knob at a position internally divided in (0 ≦ s ≦ 1) and the thinning-out interval of the thinned image is t, the enlargement ratio = s × t + (1−s) × 1 is set as the enlargement ratio. . The thinned image is enlarged by the enlargement ratio calculated in this manner (step S
607), an enlarged image is displayed in step S209.

FIG. 28 shows the processing procedure in step S208 when the data type identifier of the object is 0x44. It is checked whether or not the position designation is selected as the restriction item in step S200 (step S200).
700) If not selected, all data is read in the same manner as in the normal reading mode (step S703), and the original image is restored (step S70).
4), displayed in step S209. On the other hand, step S
If the position designation is selected as the restriction item in 700, the position of each block image in the page calculated from the number of vertical and horizontal pixels of the block and the number of vertical and horizontal pixels of the image before division is used as a clue, and the user specifies All block images at least partially included in the selected area are selected (step S701). Then, after reading the block image data from the recording medium and performing decompression processing as needed (step S702), the read block image is rearranged at an appropriate position to create a display image (step S70).
4), displayed in step S209.

In the case of moving image data in which the data type identifier of the object is 0xA1, step S208
29 is shown in FIG. In step S200, it is checked whether or not the data type is selected as a restriction item (step S800). If not, the data of the representative frame data area is read from the recording medium among the data stored in the format of FIG. After decompression processing for each frame data as necessary (step S80
6) In step S209, the frame data is displayed on the screen at predetermined time intervals in order of time. On the other hand, if the data type is selected as the restriction item in step S800, the contents of the detailed setting of the data type are checked in step S801, and it is determined whether the setting is set so that the moving image data is normally displayed. If the display is set to the normal display, after reading all data in the same manner as in the normal reading mode described above (step S80)
2) The frame data is rearranged in chronological order (step S803), and the reproduction process is performed in step S209. On the other hand, when the item of the moving image data is set to display only the outline data in step S801, the number of frames to be reproduced is calculated from the position of the setting knob of the moving image item set in the window of FIG. S804) Of the frame data in the representative frame data area, frame data for the number of frames calculated in step S804 is selected from the recording medium in time order or at equal time intervals, and read from the recording medium. After performing the decompression process (step S805), the reproduction process is performed in step S209.

The processing in step S208 for an object stored in another format is the same as the processing in the normal reading mode. However, if a special mechanism for turning pages at high speed is provided, A different process from that in the reading mode may be performed.

When the processing from step S203 to step S209 is performed on all objects included in the currently displayed page, step S202
Then, the process moves to step S210. Step S
The processing from step 210 to step S214 is performed in step S10
5 to the step S109, so that the description is omitted.

As described above, by devising a method of storing each object data constituting a page, it is possible to easily read only a necessary object from a recording medium and reproduce the object when it is desired to turn the page at high speed. So you can turn pages quickly.

[0069]

According to the present invention, it is possible to easily read a part of data in which various object data such as characters, images, sounds, and moving images are recorded, and to quickly search a desired page. You can turn pages quickly.

[Brief description of the drawings]

FIG. 1 is a block diagram of an electronic book display device according to the present embodiment.

FIG. 2 is a schematic view of a case where the electronic book display device of FIG. 1 is a portable device.

FIG. 3 is a diagram showing an outline of a format of book data to be reproduced and displayed on the electronic book display device according to the present embodiment.

FIG. 4 is a diagram showing details of data storage in a management information area of the book data of FIG. 3;

FIG. 5 is a diagram for schematically explaining that each page is configured by arranging a plurality of objects.

FIG. 6 is a diagram showing details of data storage of each page data of the book data of FIG. 3;

FIG. 7 is a diagram showing details of storage of object data which is a component of FIG. 6;

8 is a diagram showing the correspondence between the data type identifier of object data, which is a component of FIG. 6, and actual data.

FIG. 9 is a diagram illustrating a method for storing normal image data among object data.

FIG. 10 is a diagram illustrating a method of dividing image data into bit plane images.

FIG. 11 is a diagram illustrating a method of storing image data in a case where object data is divided into bit plane images and stored.

FIG. 12 is a diagram illustrating a method of dividing each pixel of image data into an upper bit image and a lower bit image.

FIG. 13 is a diagram showing a method of storing image data in a case where object data is divided into upper bit images and lower bit images of each pixel and stored.

FIG. 14 is a diagram illustrating a state in which image data is extracted every predetermined number of pixels and a thinned image is generated.

FIG. 15 is a diagram illustrating a method of storing image data in a case where the image data is divided into a thinned image and the remaining pixel data in the object data and stored.

FIG. 16 is a diagram showing a method of storing ordinary moving image data among object data.

FIG. 17 is a diagram illustrating a storage method in a case where moving image data is stored by providing a representative frame area in the object data.

FIG. 18 is a diagram illustrating a state in which image data is divided into a plurality of block areas.

FIG. 19 is a diagram illustrating a method of storing image data when the image data is divided into a plurality of block areas and stored.

FIG. 20 is a flowchart illustrating a processing procedure in a normal reading mode of the electronic book display device according to the present embodiment.

FIG. 21 is a flowchart showing a processing procedure in a high-speed page turning mode of the electronic book display device according to the present embodiment.

FIG. 22 is a diagram illustrating an example of a screen for setting a reproduction condition of an object in a high-speed page turning mode.

FIG. 23 is a diagram illustrating an example of a screen for performing detailed setting of a data type in a high-speed page turning mode.

FIG. 24 is a flowchart illustrating a processing procedure for reading image data in which the value of the data type identifier is 0x40 in the high-speed page turning mode.

FIG. 25 is a flowchart showing a processing procedure for reading image data divided and stored in each bit plane in the high-speed page turning mode.

FIG. 26 is a flowchart showing a processing procedure for reading image data stored in two in an upper bit image and a lower bit image in a high-speed page turning mode.

FIG. 27 is a flowchart showing a processing procedure for reading image data divided and stored into a thinned image and remaining pixel data in a high-speed page turning mode.

FIG. 28 is a flowchart showing a processing procedure for reading image data stored in a plurality of areas divided into blocks in the high-speed page turning mode.

FIG. 29 is a flowchart illustrating a processing procedure for reading moving image data stored with a representative frame area provided in the high-speed page turning mode.

[Explanation of symbols]

 101 CPU 102 ROM 103 RAM 104 Input means 105 Display means 106 Audio output means 107 Page turning instruction means 108 Display mode switching instruction means 109 CPU bus

Continuation of the front page (51) Int.Cl. ⁶ Identification code FI G09G 5/36 510 G09G 5/36 510M H04N 5/76 H04N 5/76 B (72) Inventor Keisuke Iwasaki 22nd Nagaikecho, Abeno-ku, Osaka-shi, Osaka 22 Sharp Corporation (72) Inventor Yoshihiro Kitamura 22-22 Nagaikecho, Abeno-ku, Osaka City, Osaka Prefecture Sharp Corporation

Claims (9)

[Claims] 1. A reproduction display device for reproducing and displaying element data provided for each reproduction unit, wherein an identifier for high-speed reproduction is provided in a part of the element data, and high-speed reproduction is instructed. And reproducing and displaying the partial data sequentially. 2. The reproducing and displaying apparatus according to claim 1, wherein a compression method of a part of the element data is different from a compression method of other data. 3. The reproduction / display apparatus according to claim 1, wherein the element data is image data, and the partial data is an upper bit image generated from some bits of each pixel. 4. The reproduction display device according to claim 1, wherein the element data is image data, and the partial data is a part of a bit plane image divided into bit plane images. 5. The reproduction display device according to claim 1, wherein the element data is image data, and the partial data is a thinned image generated by thinning each pixel. 6. The reproduction display device according to claim 1, wherein the element data is moving image data, and the partial data is a representative frame image selected from the moving image data. 7. The reproduction display device according to claim 1, wherein the element data is image data, and the partial data is a divided image obtained by dividing an original image. 8. The reproduction display device according to claim 1, wherein the element data is image data or moving image data, and a display ratio of the partial data can be variably set. 9. A condition setting means for setting at least one condition of a data type, a data size of the element data, or position information in a reproduction unit, wherein the element to be reproduced at the time of high-speed reproduction based on the set condition. The reproduction display device according to claim 1, wherein data is selected.