EP1709586A1 - Method for creating, selecting and displaying digital images using a terminal - Google Patents
Method for creating, selecting and displaying digital images using a terminalInfo
- Publication number
- EP1709586A1 EP1709586A1 EP05706856A EP05706856A EP1709586A1 EP 1709586 A1 EP1709586 A1 EP 1709586A1 EP 05706856 A EP05706856 A EP 05706856A EP 05706856 A EP05706856 A EP 05706856A EP 1709586 A1 EP1709586 A1 EP 1709586A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- images
- tile
- container
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000004913 activation Effects 0.000 claims abstract description 3
- 239000002131 composite material Substances 0.000 claims abstract description 3
- 230000004044 response Effects 0.000 claims abstract description 3
- 238000004891 communication Methods 0.000 abstract description 8
- 230000008901 benefit Effects 0.000 abstract description 7
- 238000007906 compression Methods 0.000 description 9
- 230000006835 compression Effects 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 238000000844 transformation Methods 0.000 description 3
- 239000000470 constituent Substances 0.000 description 2
- 239000003550 marker Substances 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
Definitions
- the invention is in the technological field of creation, communication, and display of digital images. More specifically the invention relates to a method that enables, from a terminal or from a server, a digital image containing several images to be created; the method then enables, from a terminal comprising control and display means, an image included in the previously created container image to be selected for display. BACKGROUND OF THE INVENTION
- the communication of digitized images, resulting for example from photographs, is largely favored by communication networks such as the Internet. Digital images are generally saved or stored in servers that can be remote from one another.
- the network such as the Internet, enables these images to be reached by various terminals provided with control (e.g. keyboards, joystick) and display means.
- These terminals are for example PCs (Personal Computer), or mobile terminals such as cellphones, PDAs (Personal Data Assistant).
- the images can also be saved in terminals, and in this case, no connection to the network is necessary to recover them.
- the images are saved as collections of images.
- a collection of images generally comprises many images. Terminals enabling these images to be displayed are equipped with a keyboard and a display screen. In the case of mobile or portable terminals, the display screens are often small. The user of a terminal equipped with a display screen who wishes to display an image, needs to execute several operations, by using the terminal keyboard.
- the user wants, for example, to display an image extracted from a collection of images, to view it, he/she has to execute various successive operations, by using for example the terminal keyboard: open the application enabling the display; select the collection of images; select the image of the album; open the image file; optionally, zoom in on or move within the image by translation; close the image file; select another image; open this other image's file; close this other image's file; etc.
- This therefore requires a relatively high number of operations that have to be executed image-by-image, if the user needs to view several images of a collection, before sending them, for example, to an addressee.
- the term addressee generally means a terminal; the terminal is remote from a server, can communicate with this server, and the terminal can display images.
- the objective is thus to supply a faster and friendlier interface for the user who wishes to look for digital images easily and display these images on his/her terminal.
- the solution is an interface that enables better inter-images and intra-image browsing, in order to reduce the number of operations to be executed by the user with his/her terminal.
- Such an interface is produced at the terminal by creating container image files each comprised of individual images.
- the advantage of this browsing is all the greater with te ⁇ ninals, like for example mobile phones or PDAs, that have a limited graphic interface.
- the invention solves the above-mentioned problem by using a display control method of a digital image, selected from among a collection of digital images, the method comprising the following steps: first, the automatic creation of a composite image, or container image, made up of individual (selected) images, the container image being subdivided into many more-or-less adjacent areas, or tiles, and each individual image having respectively set dimensions and a set location in the container image matching one tile; second, the automatic display of the container image and the activation of each tile of the container image as a pointer to the individual image data corresponding to said tile, and, in response to the selection by a user of one of the tiles, the automatic enlarged display of the individual image corresponding to the selected tile.
- the container image is preferably created by using the tiles principle of the known image compression process JPEG 2000.
- JPEG 2000 compression process enables the container image to be cut automatically into tile areas.
- the areas or tiles cutting up the contamer image are generally rectangular and identical in their geometry. These areas enable the reception of the individual images selected in the source collection of images, at a rate of one image per area or tile; and then each selected image intended to be integrated into an area of the container image is encoded separately from the other selected images.
- each tile of the container image can be activated individually, for example with a tile selection cursor controlled with a two-way control, for displaying, modifying, or deleting an image or part of an image that it contains, without having to decode-encode all the container image.
- the encoding of each of the individual images making up each area or tile of the container image is performed so that the selected image intended to be included in a tile of the container image complies with the aspect ratio (dimensional ratio between the width and height) of the tiles of the container image.
- the image data of each tile are compressed data of the corresponding source image.
- An edge of white pixels enables for example the selected image to be adjusted to be included in a tile with the tile dimensions.
- the dimensions and location of the individual image in the container image are preferably determined automatically; but they can also be determined manually by the user with a suitable interface of the terminal.
- the selected image displayed in a tile is matched to the capacities and dimensions of the terminal screen used, for example a portable terminal, so as to provide the user with good viewing conditions, enabling him/her to easily recognize an individual image in an container image.
- the container image can contain individual images with different resolutions.
- the container image is preferably subdivided into nine tiles capable of comprising respectively nine individual images. Each of these individual images or thumbnails can be selected, for example using nine corresponding keys of a numerical keyboard of the terminal.
- full screen display also means that all the pixels of the image displayed according to the second resolution, completely fill the screen surface, i.e. 100 percent of the screen's surface.
- full screen display at 100 percent preferably an available resolution corresponding to an image size immediately greater than the screen size is adopted, and the image is decimated so as to obtain the best compromise between the screen aspect ratio and the image aspect ratio.
- the aspect ratio characterizes the ratio between the width and height (of the screen or the image).
- the image is displayed in full screen, so that one of the image dimensions more or less matches one screen dimension.
- the available resolutions are supplied by the existing standard sizes, like for example JPEG 2000. JPEG 2000 preferably enables files to be created having five different resolutions.
- the dimensions (width and height) of the image are divided by two to go to a lesser resolution, etc.
- the image display can thus be matched to the screen dimensions, while minimizing the volume of data to be decoded.
- An advantageous embodiment of the invention enables the enlarged display of the selected individual image to be produced in full screen, i.e. with an enlargement such that one of the image dimensions more or less matches one dimension of a terminal display screen, by having, besides all the pixels of this first selected image that practically fill the whole screen surface, part of the pixels of at least another non-selected image and also being part of the container image.
- This embodiment corresponds to a full screen display such that all the pixels making up the first displayed selected image do not completely fill the whole screen surface.
- the method according to the invention also to enlarge by zooming, using the terminal keyboard, part of the selected image displayed in full screen with the second resolution.
- the method according to the invention is preferably implemented, in an Internet type network environment, by using a mobile terminal, such as for example a cellphone or a PDA. But the method can be also implemented on a PC.
- the method is applicable to images files saved in a server, a PC, or a mobile terminal.
- the container image is created for example in the server, based on images remotely transmitted to the server from the mobile terminal or PC.
- the display of the container image is then performed in the mobile terminal or PC, based on the image data for display, transmitted from the server communicating with these terminals.
- the method according to the invention provides a solution removing all the operations of opening and closing each image file of an image set, by using a container image encoded as a single image file.
- the user can thus display the selected image directly, based on the thumbnail that he/she points to, on his/her terminal screen.
- the selected image is thus displayed, enlarged and matched to the terminal's screen, based on the display of a container image that includes the thumbnail (at a lesser resolution) corresponding to the image selected for full screen display.
- a container image that includes the thumbnail (at a lesser resolution) corresponding to the image selected for full screen display.
- Figure 2 shows a terminal enabling the method according to the invention to be implemented, and displaying a container image with the display areas.
- Figure 3 shows an image selected according to the invention method, and displayed in full screen on the terminal.
- Figure 4 shows a zoomed part of an image selected according to figure 3.
- Figure 5 shows an image part according to figure 4, for which a movement of said image part is performed in the display screen.
- Figure 6 shows a diagram of the implementation of the method according to the invention.
- Figure 7 shows a container image comprising a set of images.
- DETAILED DESCRIPTION OF THE INVENTION The following description is a detailed description of the main embodiments of the invention, with reference to the figures, in which the same numerical references identify the same elements in each of the different figures.
- Figure 1 shows an example of a network environment comprising terminals 1, 2 equipped with display means to implement the method according to the invention. In a preferred embodiment, the method is implemented by using a mobile terminal 1 , equipped with a keyboard 7 and with a display screen 6.
- the mobile terminal 1 is a cellphone or a PDA.
- the terminal 1 communicates with the other computers 2, 3, in a digital communication network, like for example the Internet.
- Interactive communications of digital images can be performed, for example between the terminal 1 and a remote server 3.
- the server 3 enables digital images to be saved, for example as a collection of 9 to N images (or 9-N).
- the collection of images is for example an album which contains many digital images 9-N.
- the terminal 2 is for example a PC type computer.
- the links 4 and 5 that enable the communication of digital data between the terminal 1 and the PC 2 on the one hand, and then between the terminal 1 and the server 3 on the other hand, are performed in a network such as GSM (Global System for Mobile), GPRS (General Packet Radio System), or WIFI.
- GSM Global System for Mobile
- GPRS General Packet Radio System
- the protocols used to communicate are for example of the type HTTP (Hyper Text Transmission Protocol), with the MMS infrastructure (Multimedia Message Service).
- the link 4 between the terminals 1 and 2 can also be a wire link, or a wireless link of the infrared or bluetooth type.
- the method enables, based on the selection (step 20) in the collection of 9 to N images saved in a directory saved in a memory of the server 3 or in a memory located in the terminal 1, 2, the automatic creation and display, according to a step 30, of at least one container image 8.
- the container image 8 contains a set of at least one image 9 to 17 selected, according to step 20 prior to step 30, from among the collection of 9-N source images.
- the individual images 9-17 are regrouped in the single image file of the container image 8.
- the selected images 9-17 are preferably regrouped into a single image: the container image 8.
- the creation of the container image 8 including the set of at least one image 9-17 is performed by the compression of each of the images 9-17, and by the division of the container image 8 into the tiles 9A' to 17 A' (figure 7), to enable the display of the contents of a compressed image 9-17 in one of the tiles 9 A' to 17 A' (or 9A'-17A') of the container image 8.
- the creation of the container image 8 is performed on the terminal 1, 2, or the server 3.
- a JP2 type file can be produced having a tile packet or codestream that complies with the standard JPEG 2000 part 1 (ISO 15444-1).
- the codestream is comprised of a main header, whose data are valid for the packet set, and a tilestream set.
- the main header describes for example the number of available resolutions in the image, the size of the image and the tiles.
- Each tilestream is dedicated to one tile, and consists of a tile header, and compressed image data regrouped as pack stream.
- Each tile's header contains a specific Start Of Tile (SOT) marker, which contains, among other information, the index of the tile _ ⁇ .
- SOT Start Of Tile
- the present invention uses the index information contained in the marker to make the link between an enlargement request for an individual image of the container image, for example visually marked by a number graphically superimposed on the image, and the addressing of the data in the physical file.
- Several codestreams can be juxtaposed in the same JP2 or JPX file; this means that a container image file can, for example, contain several image albums that classify the images by resolution for example.
- Files compressed using the JPEG2000 standard benefit from multiresolution acquired by wavelet compression. In the compression process using JPEG 2000, a source image is decorrelated into constituents, and each constituent is cut into tiles. Then, the dyadic transformations are applied to each of the tiles to obtain various resolutions.
- the multiresolution aspect is provided by the transformations into successive wavelets. Based, for example, on a file having a resolution of 3000 by 2000 pixels, five successive transformations result in the following six resolutions being available: 3000 by 2000, 1500 by 1000, 750 by 500, 375 by 250, 188 by 125, and 94 by 62.
- the application used to display and decode the images then chooses the most appropriate resolution according to the enlargement requested by the client.
- Example of the creation and update of a container image To produce a JP2 container image, including nine regular tiles of 3000 pixels (horizontal resolution) by 2000 pixels (vertical resolution), the following steps are performed: 1. the creation of a container image comprising only pixels of uniform color (white for example) and size 9000 pixels (horizontal resolution) by 6000 pixels (vertical resolution), cut into regular tiles of 3000 by 2000 pixels (horizontal resolution by vertical resolution);
- the container image is created by examining the resolution of each of images to be included in the tiles, and the decision on the size of the container image (and thus the tiles) is taken according to the maximum and minimal resolution of each of the source images to be included, and the minimization of their deterioration by decimation or stretching.
- the container image 8 is cut or subdivided into a whole number of tiles.
- this number is arbitrary, and the container image 8 can have any number of tiles.
- the preferred number of tiles 9 A'- 17 A' of the container image 8 is nine, as described in the example above, and as shown on figures 2, 6, and 7.
- the number of tiles of the container image 8 can be more than or equal to the number of selected images 9-17 to be included in the container image 8.
- the number of areas of the container image 8 is more than the number of selected images 9-17, new selected images can easily be added in tiles left uniform, preferably white, of the container image 8, until the maximum number of available tiles of the container images 8 is reached. But the number of tiles of the container image 8 can also be less than the number of selected images 9-17; in this case, several container images 8 are created to contain all the selected images 9-17.
- Each tile of the container image 8 contains the pixels of at least one image 9-17 displayed with a resolution that is typically a small resolution. These images 9-17 are displayed as thumbnails, in the corresponding areas 9A'-17A' of the container image 8. The display of the thumbnails 9-17 with the small resolution, enables an acceptable view for the user, i.e.
- a first embodiment of the method enables going from the display of a first container image to the display of a second container image by closing, using the keyboard 7 of the terminal 1, the file of the first container image, and then opening the file of the second container image.
- a second advantageous embodiment of the method enables the successive and automatic display, for example according to an adjustable timing, of each of the container images, without having to perform closings and openings of the respective files for these container images.
- the invention method enables the display, in the same container image 8, of images 9-17 that have various resolutions. That is, the tile packets 9A'- 17A' are different in this same container image.
- the algorithm of the invention method entails for example the inclusion of individual images with maximum resolution of 4 megapixels into a first tile packet, then individual images with maximum resolution of 2 megapixels into a second tile packet, and finally individual images of maximum resolution of 1 megapixels into a third tile packet. Each of these packets can be accessed, for example, by a tab displayed in the screen interface.
- This advantage of the invention method provides the option of including, in the same container image 8, an arbitrary number of individual images 9-17, for example as mini albums of images, each corresponding to many tiles.
- Another advantage of the invention is that the container image 8 thus created can be modified or updated, i.e. one or more individual images 9-17 can be added or removed in the contamer image, without having to decompress and recompress all these individual images of the container image.
- the update of the container image 8 is performed on the terminal 1, or on the server 3.
- the display of the container image 8 is performed by opening a single image file; i.e.
- this container image 8 contains for example sixteen images, while an acceptable view, given the characteristics of the terminal used, corresponds (as shown in figure 2) to the display of only nine areas on the screen, then a first container image 8 is displayed having the first nine thumbnails, and then, a second container image 8 is displayed sequentially having the seven remaining thumbnails.
- the display of the second container image 8 is preferably performed automatically according to a preset display timing for each container image displayed.
- Figures 2 and 7 show a container image 8 capable of having nine images 9-17 in nine tiles 9A'-17A' corresponding to the container image 8.
- the method enables the automatic placing of this secondly-selected eighth image, in one of these two white pixel tiles.
- Figures 3 and 6 show an image 10, in a specific area of the container image 8, selected using the terminal keyboard. Based on the selection of the image 10 in the container image 8, according to a step 40, the method enables the automatic full screen display of the image 10.
- Figure 3 shows a full screen display, in an advantageous embodiment, such that all the pixels making up the displayed image 10 do not completely fill, i.e. are distributed almost over all (less than 100 percent) the surface of the screen 6.
- full screen display also means that all the pixels of the image 10 can fill the whole (100 percent) surface of the screen 6 (not shown).
- Figure 3 shows the embodiment by which the user can see appearing on his/her screen, not only all the pixels of the selected image 10, but also part of the pixels making up at least one other image 9, 11 of all the images 9- 17 previously selected. Images 9, 11 belong to the container image 8, and are for example arranged, in the image 8, just before and just after the image 10.
- images 9, 11 are not selected at first, but they can be, if after viewing the image 10, the user needs to view, for example, either the image 9 or the image 11.
- a single click performed using the keyboard 1, either on the image 9 or on the image 11, enables the full screen display of this secondly- selected image 9, 11.
- image selection can be performed by entering, using the keyboard 7, an alphanumeric code 9A, 9B.
- This alphanumeric code 9 A, 9B corresponds for example to the increasing location row of the image selected for display, chosen according to the order of the lines formed by the areas of the container image 8.
- the alphanumeric code 9A, 9B is a whole number.
- the compression process used for example JPEG 2000, also enables the enlargement by zoom, using the terminal's keyboard 7, of part 10P of the selected image 10 displayed with the second resolution. Several levels of zoom can be performed, thus enabling several successive enlargements of the part 10P of the selected image.
- the compression process used, for example JPEG 2000 also enables, by using the terminal's keyboard 7 (e.g. a joystick button) a movement of the zoomed part of the image 10P, so as to display another part
- the display of the part 1 OP' only requires the decoding of a minimum of pixel data, i.e. those that did not appear in the previous image 10P.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention is in the technological area of the creation and communication of digital images. The invention relates to a method that enables, previously saved digital images to be created, selected and displayed from a terminal (1, 2). An advantage of this method is that it provides a user-friendly solution, avoiding the operations of opening and closing image files, when a terminal user wishes to view several images of an image collection. More particularly the invention relates to a display control method of a digital image (10), selected from among a collection of digital images (9-N), the method comprising the following steps: first, the automatic creation of a composite image (8), or container image, made up of individual images (9-17), the container image (8) being subdivided into many more-or-less adjacent areas, or tiles, and each individual image having respectively set dimensions and a set location in the container image corresponding to one tile; second, the automatic display of the container image (8) and the activation. of each tile of the container image (8) as a pointer to the individual image data (9-17) corresponding to said tile, and, in response to the selection by a user of one of the tiles, the enlarged display of the individual image (10) corresponding to the selected tile.
Description
METHOD FOR CREATING, SELECTING AND DISPLAYING DIGITAL IMAGES USING A TERMINAL FIELD OF THE INVENTION The invention is in the technological field of creation, communication, and display of digital images. More specifically the invention relates to a method that enables, from a terminal or from a server, a digital image containing several images to be created; the method then enables, from a terminal comprising control and display means, an image included in the previously created container image to be selected for display. BACKGROUND OF THE INVENTION The communication of digitized images, resulting for example from photographs, is largely favored by communication networks such as the Internet. Digital images are generally saved or stored in servers that can be remote from one another. The network, such as the Internet, enables these images to be reached by various terminals provided with control (e.g. keyboards, joystick) and display means. These terminals are for example PCs (Personal Computer), or mobile terminals such as cellphones, PDAs (Personal Data Assistant). The images can also be saved in terminals, and in this case, no connection to the network is necessary to recover them. The images are saved as collections of images. A collection of images generally comprises many images. Terminals enabling these images to be displayed are equipped with a keyboard and a display screen. In the case of mobile or portable terminals, the display screens are often small. The user of a terminal equipped with a display screen who wishes to display an image, needs to execute several operations, by using the terminal keyboard. If the user wants, for example, to display an image extracted from a collection of images, to view it, he/she has to execute various successive operations, by using for example the terminal keyboard: open the application enabling the display; select the collection of images; select the image of the album; open the image file; optionally, zoom in on or move within the image by translation; close the image file; select another image; open this other image's file; close this other image's file; etc. This therefore requires a relatively high number of operations that have to be executed image-by-image, if the user
needs to view several images of a collection, before sending them, for example, to an addressee. The term addressee generally means a terminal; the terminal is remote from a server, can communicate with this server, and the terminal can display images. During these successive operations of opening and closing image files, executed image-by-image, the problem is that the user is nonplussed by the complexity and time required to execute, using the terminal keyboard, all the above-mentioned operations or manipulations. If the user needs to view several images, he/she has in particular to open and close, for each displayed image, the file for each of these images. It is consequently interesting and necessary to ease the problem, by enabling faster and friendlier image selection and display. SUMMARY OF THE INVENTION The problem of the prior art is demonstrated by an excessive number of openings and closing of image files, when the terminal user needs to view encoded images, each one in an image file. The objective is thus to supply a faster and friendlier interface for the user who wishes to look for digital images easily and display these images on his/her terminal. The solution is an interface that enables better inter-images and intra-image browsing, in order to reduce the number of operations to be executed by the user with his/her terminal. Such an interface is produced at the terminal by creating container image files each comprised of individual images. The advantage of this browsing is all the greater with teπninals, like for example mobile phones or PDAs, that have a limited graphic interface. The invention solves the above-mentioned problem by using a display control method of a digital image, selected from among a collection of digital images, the method comprising the following steps: first, the automatic creation of a composite image, or container image, made up of individual (selected) images, the container image being subdivided into many more-or-less adjacent areas, or tiles, and each individual image having respectively set dimensions and a set location in the container image matching one tile; second, the automatic display of the container image and the activation of each tile of the
container image as a pointer to the individual image data corresponding to said tile, and, in response to the selection by a user of one of the tiles, the automatic enlarged display of the individual image corresponding to the selected tile. It is also an object of the invention to provide a terminal equipped with control and display means, and comprising a software program enabling the implementation of the display control method of an image according to the invention. The container image is preferably created by using the tiles principle of the known image compression process JPEG 2000. The JPEG 2000 compression process enables the container image to be cut automatically into tile areas. The areas or tiles cutting up the contamer image are generally rectangular and identical in their geometry. These areas enable the reception of the individual images selected in the source collection of images, at a rate of one image per area or tile; and then each selected image intended to be integrated into an area of the container image is encoded separately from the other selected images. The image data corresponding to all the individual images of the container image are included in the same digital file, and each tile points to a subset of file data. Each empty area or tile of the container image, that is not comprising an image, is formed by pixels of uniform color, for example white, on the whole surface of the empty area, so as to minimize the byte size of the container image. An advantage of the invention is that each tile of the container image can be activated individually, for example with a tile selection cursor controlled with a two-way control, for displaying, modifying, or deleting an image or part of an image that it contains, without having to decode-encode all the container image. The encoding of each of the individual images making up each area or tile of the container image is performed so that the selected image intended to be included in a tile of the container image complies with the aspect ratio (dimensional ratio between the width and height) of the tiles of the container image. The image data of each tile are compressed data of the corresponding source image. An edge of white pixels enables for example the selected image to be adjusted to be included in a tile with the tile dimensions. The dimensions and location of the individual image in the
container image are preferably determined automatically; but they can also be determined manually by the user with a suitable interface of the terminal. The selected image displayed in a tile is matched to the capacities and dimensions of the terminal screen used, for example a portable terminal, so as to provide the user with good viewing conditions, enabling him/her to easily recognize an individual image in an container image. In a particular embodiment of the invention, the container image can contain individual images with different resolutions. The container image is preferably subdivided into nine tiles capable of comprising respectively nine individual images. Each of these individual images or thumbnails can be selected, for example using nine corresponding keys of a numerical keyboard of the terminal. It is one of the advantages of the invention to enable the user to then select a second image of the container image by a single click, or a single entry, without having to close the file of the first selected image, without having to look for the second image in the source collection, and without having to open the file of this second image. Because the image data corresponding to all the individual images making up the container image are included in the same digital file, and in which each tile points to a subset of the digital file data. Full screen display is an enlarged display of an individual thumbnail of the container image, so that all the pixels making up the displayed enlarged image are distributed almost all over the surface of the terminal's screen; but not completely over the said surface. But, in an alternative embodiment, full screen display also means that all the pixels of the image displayed according to the second resolution, completely fill the screen surface, i.e. 100 percent of the screen's surface. In this last embodiment (full screen display at 100 percent), preferably an available resolution corresponding to an image size immediately greater than the screen size is adopted, and the image is decimated so as to obtain the best compromise between the screen aspect ratio and the image aspect ratio. The aspect ratio characterizes the ratio between the width and height (of the screen or the image). The image is displayed in full screen, so that one of the image dimensions more or less matches one screen dimension. The available resolutions are supplied
by the existing standard sizes, like for example JPEG 2000. JPEG 2000 preferably enables files to be created having five different resolutions. Based on the maximum resolution corresponding to the selected source image, the dimensions (width and height) of the image are divided by two to go to a lesser resolution, etc. The image display can thus be matched to the screen dimensions, while minimizing the volume of data to be decoded. An advantageous embodiment of the invention enables the enlarged display of the selected individual image to be produced in full screen, i.e. with an enlargement such that one of the image dimensions more or less matches one dimension of a terminal display screen, by having, besides all the pixels of this first selected image that practically fill the whole screen surface, part of the pixels of at least another non-selected image and also being part of the container image. This embodiment corresponds to a full screen display such that all the pixels making up the first displayed selected image do not completely fill the whole screen surface. This enables the display of part of the pixels of at least one other non-selected image contiguous with or adjacent to the first selected image. Inter-images browsing is improved in this way. It is an object of the process according to the invention to enable the direct selection, for example by a single click, using the terminal keyboard, and based on the display of the first selected image, at least one other image not initially selected, this other image being contiguous or adjacent to the first selected image. The selection of the image for full screen display (enlarged), and matched to the screen dimensions, is performed either by clicking on the image chosen in the displayed container image, i.e. by activating, as a pointer, the corresponding tile of the container image, or, in an alternative embodiment, by entering an alphanumeric code corresponding for example to the location of the thumbnail chosen in the container image. The alphanumeric code that corresponds to the thumbnail's location in the container image is preferably a figure or a number. This alphanumeric code is for example displayed in the container image,
either within each of the thumbnails making up the container image, or around each of these thumbnails. It is an object of the method according to the invention also to enlarge by zooming, using the terminal keyboard, part of the selected image displayed in full screen with the second resolution. It is another object of the method according to the invention also to move, using the terminal keyboard, part of the displayed zoomed image, so as to display another part of this previously zoomed image. The method according to the invention is preferably implemented, in an Internet type network environment, by using a mobile terminal, such as for example a cellphone or a PDA. But the method can be also implemented on a PC. The method is applicable to images files saved in a server, a PC, or a mobile terminal. The container image is created for example in the server, based on images remotely transmitted to the server from the mobile terminal or PC. The display of the container image is then performed in the mobile terminal or PC, based on the image data for display, transmitted from the server communicating with these terminals. The method according to the invention provides a solution removing all the operations of opening and closing each image file of an image set, by using a container image encoded as a single image file. The user can thus display the selected image directly, based on the thumbnail that he/she points to, on his/her terminal screen. The selected image is thus displayed, enlarged and matched to the terminal's screen, based on the display of a container image that includes the thumbnail (at a lesser resolution) corresponding to the image selected for full screen display. Other characteristics will appear on reading the following description, with reference to the various figures. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 shows a communication network environment, in which the method according to the invention is implemented.
Figure 2 shows a terminal enabling the method according to the invention to be implemented, and displaying a container image with the display areas. Figure 3 shows an image selected according to the invention method, and displayed in full screen on the terminal. Figure 4 shows a zoomed part of an image selected according to figure 3. Figure 5 shows an image part according to figure 4, for which a movement of said image part is performed in the display screen. Figure 6 shows a diagram of the implementation of the method according to the invention. Figure 7 shows a container image comprising a set of images. DETAILED DESCRIPTION OF THE INVENTION The following description is a detailed description of the main embodiments of the invention, with reference to the figures, in which the same numerical references identify the same elements in each of the different figures. Figure 1 shows an example of a network environment comprising terminals 1, 2 equipped with display means to implement the method according to the invention. In a preferred embodiment, the method is implemented by using a mobile terminal 1 , equipped with a keyboard 7 and with a display screen 6.
Advantageously, the mobile terminal 1 is a cellphone or a PDA. The terminal 1 communicates with the other computers 2, 3, in a digital communication network, like for example the Internet. Interactive communications of digital images can be performed, for example between the terminal 1 and a remote server 3. The server 3 enables digital images to be saved, for example as a collection of 9 to N images (or 9-N). The collection of images is for example an album which contains many digital images 9-N. The terminal 2 is for example a PC type computer. The links 4 and 5 that enable the communication of digital data between the terminal 1 and the PC 2 on the one hand, and then between the terminal 1 and the server 3 on the other hand, are performed in a network such as GSM (Global System for Mobile), GPRS (General Packet Radio System), or WIFI. The protocols used to
communicate are for example of the type HTTP (Hyper Text Transmission Protocol), with the MMS infrastructure (Multimedia Message Service). According to other embodiments, the link 4 between the terminals 1 and 2 can also be a wire link, or a wireless link of the infrared or bluetooth type. Using the means of the prior art, when the user of the terminal 1 , 2 needs to view one or, more generally, several digital images, he/she executes successively the opening of the application or the software program enabling the image to be viewed; the selection of the image collection 9-N, if these images 9 to N are archived in a file or a directory (album); the selection of a local (if the image is saved in the terminal 1) or remote (if the image is saved in the server 3) image file in the folder; the opening of the selected image file, which enables the image to be viewed on the screen 6, with the option of zooming the displayed image, and then moving the zoomed part in the screen 6; the closing of the image file, before being able to select a second image to be viewed, again requiring opening of the file of this second image, and then closing of this file, to be able to select a third image, etc. These operations of opening and closing image files quickly become awkward, even tedious, if the user of the terminal 1, 2 wishes to view quickly a large number of images of a collection of images contained in a directory. According to figures 2, 6 and 7, the method enables, based on the selection (step 20) in the collection of 9 to N images saved in a directory saved in a memory of the server 3 or in a memory located in the terminal 1, 2, the automatic creation and display, according to a step 30, of at least one container image 8. The container image 8 contains a set of at least one image 9 to 17 selected, according to step 20 prior to step 30, from among the collection of 9-N source images. The individual images 9-17 are regrouped in the single image file of the container image 8. In other words, the selected images 9-17 are preferably regrouped into a single image: the container image 8. The creation of the container image 8 including the set of at least one image 9-17 is performed by the compression of each of the images 9-17, and by the division of the container image 8 into the tiles 9A' to 17 A' (figure 7), to enable the display of the contents of a compressed image
9-17 in one of the tiles 9 A' to 17 A' (or 9A'-17A') of the container image 8. The creation of the container image 8 is performed on the terminal 1, 2, or the server 3. To produce a container image 8 with, for example, nine images 9-17 saved in the form of as many tiles 9A'-17 A', a JP2 type file can be produced having a tile packet or codestream that complies with the standard JPEG 2000 part 1 (ISO 15444-1). The codestream is comprised of a main header, whose data are valid for the packet set, and a tilestream set. The main header describes for example the number of available resolutions in the image, the size of the image and the tiles. Each tilestream is dedicated to one tile, and consists of a tile header, and compressed image data regrouped as pack stream. Each tile's header contains a specific Start Of Tile (SOT) marker, which contains, among other information, the index of the tile _χ. The present invention uses the index information contained in the marker to make the link between an enlargement request for an individual image of the container image, for example visually marked by a number graphically superimposed on the image, and the addressing of the data in the physical file. Several codestreams can be juxtaposed in the same JP2 or JPX file; this means that a container image file can, for example, contain several image albums that classify the images by resolution for example. Files compressed using the JPEG2000 standard benefit from multiresolution acquired by wavelet compression. In the compression process using JPEG 2000, a source image is decorrelated into constituents, and each constituent is cut into tiles. Then, the dyadic transformations are applied to each of the tiles to obtain various resolutions. Other operations are then applied to obtain the final codestream, such as entropic encoding and quantification. The multiresolution aspect is provided by the transformations into successive wavelets. Based, for example, on a file having a resolution of 3000 by 2000 pixels, five successive transformations result in the following six resolutions being available: 3000 by 2000, 1500 by 1000, 750 by 500, 375 by 250, 188 by 125, and 94 by 62. The application used to display and decode the images then chooses the most appropriate resolution according to the enlargement requested by the client.
Example of the creation and update of a container image To produce a JP2 container image, including nine regular tiles of 3000 pixels (horizontal resolution) by 2000 pixels (vertical resolution), the following steps are performed: 1. the creation of a container image comprising only pixels of uniform color (white for example) and size 9000 pixels (horizontal resolution) by 6000 pixels (vertical resolution), cut into regular tiles of 3000 by 2000 pixels (horizontal resolution by vertical resolution);
2. the populating of the various tilestreams from this container image with source images according to the following sub-steps, applicable to each of the images to be included: a. possibly adding a frame around the image; b. resizing the image to the tile size to optimize the display according to the aspect ratio of the image and the host tile, i. if the image has a resolution more than 90 percent of 3000 (2700) horizontally or 90 percent of 2000 (1800) vertically, decimating the image so that its biggest dimension is less than 10 percent of the tile's matching dimension. For example, for an image of 4500 pixels (horizontal resolution) by 4500 pixels (vertical resolution), there is a final image of 1800 by 1800 pixels; for an image of 3600 by 2400 pixels, a final image of 2700 by 1800 pixels, and for an image of 2000 by 3000 pixels, a final image of 1200 by 1800 pixels; ii. if the image has a resolution less than 90 percent of the tile size (2700 by 1800 pixels), stretch the image to optimize occupation of the space. For example, for an image of 900 pixels (horizontal resolution) by 600 pixels (vertical resolution), there is a final image of 2700 by 1800 pixels; for an image of 1000 by 1500 pixels, a final image of 1200 by 1800 pixels; c. adding uniform borders around the image to obtain an image measuring exactly 3000 pixels by 2000 pixels. This consists, for example, in adding
100 pixels at the top and bottom of the image, and 150 pixels to the right and left of the image for an image of 2700 by 1800 pixels; d. deleting of the tilestream of the tile to be updated, and writing of the new tilestream obtained after compression of the image prepared according to sub-steps a, b, c; 3. in an optimized approach, the container image is created by examining the resolution of each of images to be included in the tiles, and the decision on the size of the container image (and thus the tiles) is taken according to the maximum and minimal resolution of each of the source images to be included, and the minimization of their deterioration by decimation or stretching. In an advantageous embodiment of the invention, using a known standardized compression process, like JPEG 2000 (Joint Photographic Expert Group, standard ISO/IEC 15444), the container image 8 is cut or subdivided into a whole number of tiles. Of course this number is arbitrary, and the container image 8 can have any number of tiles. The preferred number of tiles 9 A'- 17 A' of the container image 8 is nine, as described in the example above, and as shown on figures 2, 6, and 7. The number of tiles of the container image 8 can be more than or equal to the number of selected images 9-17 to be included in the container image 8. If the number of areas of the container image 8 is more than the number of selected images 9-17, new selected images can easily be added in tiles left uniform, preferably white, of the container image 8, until the maximum number of available tiles of the container images 8 is reached. But the number of tiles of the container image 8 can also be less than the number of selected images 9-17; in this case, several container images 8 are created to contain all the selected images 9-17. Each tile of the container image 8 contains the pixels of at least one image 9-17 displayed with a resolution that is typically a small resolution. These images 9-17 are displayed as thumbnails, in the corresponding areas 9A'-17A' of the container image 8. The display of the thumbnails 9-17 with the small resolution, enables an acceptable view for the user, i.e. so that all the thumbnails 9- 17, included in the container image 8, are fully visible, and so that the contents (the scene of the image) can be recognized by the user on the terminal's screen 1, 2.
Several (small) display resolutions of the image 9-17 are possible, according to the display capacity of the terminal 1, 2. As already described above, if the number of selected images 9-17 is large, and does not enable an acceptable view in a single container image 8, this container image 8, being the subject of a single encoding, breaks down into several container images 8 that can be displayed successively on the screen 6. A first embodiment of the method enables going from the display of a first container image to the display of a second container image by closing, using the keyboard 7 of the terminal 1, the file of the first container image, and then opening the file of the second container image. A second advantageous embodiment of the method enables the successive and automatic display, for example according to an adjustable timing, of each of the container images, without having to perform closings and openings of the respective files for these container images. The invention method enables the display, in the same container image 8, of images 9-17 that have various resolutions. That is, the tile packets 9A'- 17A' are different in this same container image. The algorithm of the invention method entails for example the inclusion of individual images with maximum resolution of 4 megapixels into a first tile packet, then individual images with maximum resolution of 2 megapixels into a second tile packet, and finally individual images of maximum resolution of 1 megapixels into a third tile packet. Each of these packets can be accessed, for example, by a tab displayed in the screen interface. This advantage of the invention method provides the option of including, in the same container image 8, an arbitrary number of individual images 9-17, for example as mini albums of images, each corresponding to many tiles. Another advantage of the invention, is that the container image 8 thus created can be modified or updated, i.e. one or more individual images 9-17 can be added or removed in the contamer image, without having to decompress and recompress all these individual images of the container image. The update of the container image 8 is performed on the terminal 1, or on the server 3. The display of the container image 8 is performed by opening a single image file; i.e. if, for example, the user opens the encoding file of the
container image 8, and this container image 8 contains for example sixteen images, while an acceptable view, given the characteristics of the terminal used, corresponds (as shown in figure 2) to the display of only nine areas on the screen, then a first container image 8 is displayed having the first nine thumbnails, and then, a second container image 8 is displayed sequentially having the seven remaining thumbnails. The display of the second container image 8 is preferably performed automatically according to a preset display timing for each container image displayed. Figures 2 and 7 show a container image 8 capable of having nine images 9-17 in nine tiles 9A'-17A' corresponding to the container image 8. However, if the initial selection of images to be viewed in full screen contains only seven images, the two remaining white tiles of the container image 8 are retained. These white tiles contribute very little to the total weight of the image file, because the encoding of a white image, i.e. comprised of white pixels, only represents a few bytes. On the other hand, if the user wants to select an eighth image, the method enables the automatic placing of this secondly-selected eighth image, in one of these two white pixel tiles. Figures 3 and 6 show an image 10, in a specific area of the container image 8, selected using the terminal keyboard. Based on the selection of the image 10 in the container image 8, according to a step 40, the method enables the automatic full screen display of the image 10. Figure 3 shows a full screen display, in an advantageous embodiment, such that all the pixels making up the displayed image 10 do not completely fill, i.e. are distributed almost over all (less than 100 percent) the surface of the screen 6. This means that the image 10 preferably fills 70 percent or more of the surface of the screen 6. But full screen display also means that all the pixels of the image 10 can fill the whole (100 percent) surface of the screen 6 (not shown). Figure 3 shows the embodiment by which the user can see appearing on his/her screen, not only all the pixels of the selected image 10, but also part of the pixels making up at least one other image 9, 11 of all the images 9- 17 previously selected. Images 9, 11 belong to the container image 8, and are for
example arranged, in the image 8, just before and just after the image 10. These images 9, 11 are not selected at first, but they can be, if after viewing the image 10, the user needs to view, for example, either the image 9 or the image 11. In a preferred embodiment, a single click performed using the keyboard 1, either on the image 9 or on the image 11, enables the full screen display of this secondly- selected image 9, 11. In another embodiment, image selection can be performed by entering, using the keyboard 7, an alphanumeric code 9A, 9B. This alphanumeric code 9 A, 9B corresponds for example to the increasing location row of the image selected for display, chosen according to the order of the lines formed by the areas of the container image 8. Preferably, the alphanumeric code 9A, 9B is a whole number. According to figure 2, it is for example advantageously displayed within or around the thumbnails 9-17 of the container image 8. According to figure 4, the compression process used, for example JPEG 2000, also enables the enlargement by zoom, using the terminal's keyboard 7, of part 10P of the selected image 10 displayed with the second resolution. Several levels of zoom can be performed, thus enabling several successive enlargements of the part 10P of the selected image. According to figure 5, the compression process used, for example JPEG 2000, also enables, by using the terminal's keyboard 7 (e.g. a joystick button) a movement of the zoomed part of the image 10P, so as to display another part
10P' of the image 10 displayed with the second resolution. The display of the part 1 OP' only requires the decoding of a minimum of pixel data, i.e. those that did not appear in the previous image 10P.
Claims
CLAIMS 1 - A display control method of a digital image (10), selected from among a collection of digital images (9-N), comprising the following steps: a) the automatic creation of a composite image (8), or container image, formed by individual images (9-17), the container image (8) being subdivided into many areas (9A'-17A') more or less adjacent, or tiles, and each individual image (9-17) having respectively dimensions and a location determined in the container image (8) corresponding to a tile (9A'-17A'); b) the automatic display of the container image (8) and the activation of each tile of the container image as a pointer to the individual image data for said tile, and, in response to the selection by the user of one of the tiles (9A-17A'), c) the automatic enlarged display of the individual image (10) of the selected tile (lOA').
2 - A method according to claim 1, wherein the dimensions and location of the individual image (9-17) in the container image (8) are automatically determined. 3 - A method according to claim 1, wherein the dimensions and location of the individual image (9-17) in the container image (8) are determined by the user.
4 - A method according to claim 1, wherein the container image (8) comprises images (9-17) having various resolutions.
5 - A method according to claim 1, wherein the container image (8) is subdivided into nine tiles (9A'-17A') corresponding to nine individual images (9- 17) and selectable respectively by nine keys of a numeric keyboard.
6 - A method according to claim 1, also comprising the display of a tile selection cursor, controlled by a two-way control.
7 - A method according to claim 1, also comprising the enlarged display of one part of at least one image corresponding to a tile neighboring the selected tile.
8 - A method according to claim 1, wherein the image corresponding to the selected tile is displayed with an enlargement such that one of its dimensions matches one dimension of a display screen (6) of a terminal (1, 2) used to implement the method.
9 - A method according to claim 1, wherein the image data corresponding to all the individual images (9-17) of a container image (8) are included in the same digital file, and in which each tile points to a subset of the file data.
10 - A method according to claim 9, wherein the image data of each tile are compressed data.
11 - A method according to claim 1, wherein the container image (8) is created in a server (3), based on images remotely transmitted to the server from a terminal (1, 2). 12 - A method according to claim 10, wherein the display of the container image (8) is performed in the terminal (1,2), based on image data for display, transmitted from the server (3).
13 - A terminal (1, 2) equipped with control (7) and display (6) means, and comprising a software program to implement the method according to any one of claims 1 to 12.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0400866A FR2865829B1 (en) | 2004-01-30 | 2004-01-30 | METHOD FOR CREATING SELECT AND DISPLAYING DIGITAL IMAGES WITH A TERMINAL |
PCT/EP2005/000154 WO2005076211A1 (en) | 2004-01-30 | 2005-01-11 | Method for creating, selecting and displaying digital images using a terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1709586A1 true EP1709586A1 (en) | 2006-10-11 |
Family
ID=34746308
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05706856A Withdrawn EP1709586A1 (en) | 2004-01-30 | 2005-01-11 | Method for creating, selecting and displaying digital images using a terminal |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP1709586A1 (en) |
FR (1) | FR2865829B1 (en) |
WO (1) | WO2005076211A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10038902B2 (en) | 2009-11-06 | 2018-07-31 | Adobe Systems Incorporated | Compression of a collection of images using pattern separation and re-organization |
EP3161727A4 (en) | 2014-06-24 | 2018-02-14 | Pic2go Ltd. | Photo tagging system and method |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5903309A (en) * | 1996-09-19 | 1999-05-11 | Flashpoint Technology, Inc. | Method and system for displaying images and associated multimedia types in the interface of a digital camera |
JPH10243273A (en) * | 1997-02-24 | 1998-09-11 | Canon Inc | Image display method for digital camera |
US6310648B1 (en) * | 1997-09-12 | 2001-10-30 | Eastman Kodak Company | User interface for electronic image viewing apparatus |
JP2003037819A (en) * | 2001-07-25 | 2003-02-07 | Fuji Photo Film Co Ltd | Image data generation device and method therefor |
-
2004
- 2004-01-30 FR FR0400866A patent/FR2865829B1/en not_active Expired - Fee Related
-
2005
- 2005-01-11 EP EP05706856A patent/EP1709586A1/en not_active Withdrawn
- 2005-01-11 WO PCT/EP2005/000154 patent/WO2005076211A1/en not_active Application Discontinuation
Non-Patent Citations (1)
Title |
---|
See references of WO2005076211A1 * |
Also Published As
Publication number | Publication date |
---|---|
FR2865829B1 (en) | 2007-07-06 |
FR2865829A1 (en) | 2005-08-05 |
WO2005076211A1 (en) | 2005-08-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8654154B2 (en) | Method for processing a digital image | |
JP5194776B2 (en) | Information display system, information display method and program | |
US7529420B2 (en) | Method of displaying a thumbnail image, server computer, and client computer | |
KR100631008B1 (en) | Image display method and program | |
US6931661B2 (en) | Dynamic image provisioning | |
US7797455B2 (en) | Method for document viewing | |
US7006091B2 (en) | Method and system for optimizing the display of a subject of interest in a digital image | |
US6874131B2 (en) | Method and system for client-less viewing of scalable documents | |
CN100477672C (en) | Electronic equipment | |
US20020025084A1 (en) | Transfer and display method of digitally enlarged images | |
US7091974B2 (en) | Method for selecting and displaying a subject or interest in a still digital image | |
US20060050973A1 (en) | Image communication system, server apparatus, and image communication method | |
US20130101218A1 (en) | Apparatus, method and program for image search | |
US20080134070A1 (en) | Image processing apparatus and image processing method | |
US20100277754A1 (en) | Mosaic image generating apparatus and method | |
JP2008140361A (en) | Image processing apparatus or image processing method | |
EP1559264A1 (en) | Method and system for conducting image processing from a mobile client device | |
CN101150645A (en) | An image processing method and image processing device | |
CN105430393B (en) | Picture processing method, picture processing device, picture processing platform and storage medium | |
WO2003041001A1 (en) | Display parameter-dependent pre-transmission processing of image data | |
WO2007021135A1 (en) | Processing method of data structure for real-time image processing | |
EP1709586A1 (en) | Method for creating, selecting and displaying digital images using a terminal | |
US20050271285A1 (en) | Image display control apparatus, image display apparatus, image displaying method and program thereof | |
JP2010004166A (en) | Device, method and program for providing mosaic image | |
JP2009181450A (en) | Image processing device, image processing method, and image-processing program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20060711 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): DE FR GB |
|
DAX | Request for extension of the european patent (deleted) | ||
RBV | Designated contracting states (corrected) |
Designated state(s): DE FR GB |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20081120 |