Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00132—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
  • H04N1/00169—Digital image input
  • H04N1/00172—Digital image input directly from a still digital camera or from a storage medium mounted in a still digital camera
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00132—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00132—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
  • H04N1/00185—Image output
  • H04N1/00198—Creation of a soft photo presentation, e.g. digital slide-show
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00204—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
  • H04N1/00244—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server with a server, e.g. an internet server
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
  • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
  • H04N1/32128—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
  • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
  • H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
  • H04N2201/3242—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of processing required or performed, e.g. for reproduction or before recording

Definitions

• the invention relates to a method for mass production of interactive virtual tours for performing multimedia broadcasting, as well as a system for implementing such a method.
• the creation of virtual tours is a process increasingly used thanks to the growth of communication networks such as the Internet and mobile networks carrying images.
• a virtual tour allows a user to move virtually, smoothly and continuously, to a remote location, such as an apartment, and to visualize it from multiple angles as if it were actually on the premises and scan this place to visualize the whole.
• FIG. 1 A known method for creating a virtual visit by a user is shown in FIG. 1.
• Digital image this is a digital photograph taken with a digital camera
• Wide-angle image image obtained by an objective of focal length less than 50, ie covering an angle greater than 47 °
• Fisheye format image A fisheye image is a photograph that has been taken with a very wide angle (180 ° x180 °) specific lens called fisheye; the image taken is circular, disc-shaped;
• Panoramic format image This is a rectangular image with a wide angle of view; a panoramic image is the result of several digital images placed next to each other;
• 360x180 type image this is an image that has a field of view of 360 ° horizontally and 180 ° vertically: this is the result obtained by the joint processing of two fisheye images
• 180x180 type image this is an image that has a field of view of 180 ° horizontally and 180 ° vertically: this is the result of processing a single fisheye image or a panoramic image covering a 180 ° field of view
• An equirectangular image is the result of the processing of a circular image into a rectangular image whose width is equal to one or two times its height;
• Still image image having the format of a digital snapshot (proportion 4/3);
• Image thumbnail still image whose size has been reduced
• Paste program allows you to put together multiple digital snapshots as long as they succeed each other correctly; Using a collage program, panoramic images are obtained from multiple digital images;
• Applet A small application (or program) independent of the hardware and software used, which can be downloaded from a network server and run locally within a browser, or can be run directly from the server; applets are mostly used in the Java or Flash programming language;
• Visualization program Java applet or Flash applet that can read large panoramic images to go to the right, left, top and bottom of the image; thanks to these programs of visualization, it is possible to scan the image giving the impression of unrolling a small movie on which it is possible to interact; • Virtual tour: result obtained when a series of panoramic images are grouped together and read in a visualization program; • Web page: interface of an Internet network server.
• the known method consists in taking, with a digital apparatus A, a series S of successive photographs in space, and in making on a computer C1 a collage P of these photographs by means of a specialized program in order to to obtain a panoramic image.
• the user must then create a web page B in HTML format by integrating a dynamic visualization program and publish it on the Internet.
• the hypertext link L of the virtual visit stored on his computer is recorded on this page B so that other users can display it, activate this link L and view the virtual visit on their computer C2, C3 and C4.
• Each of these steps is highly complex.
• the shooting requires excellent technical mastery including the use of a foot D with a ball joint to rotate the digital device around a fixed point called nodal point. Then it is necessary to take the succession of photographs S presenting a recovery not to risk discontinuities of zones of the photographed landscape.
• the area of superposition should preferably represent 20% to 50% between the photographs to facilitate the assembly of the photographs, in particular as regards the correction of the colors. It is therefore appropriate to spend a significant amount of time for this step so as not to risk making the virtual tour unusable.
• the creation of the panoramic image requires the possession and control of an image processing program on the computer C1.
• the user chooses the series S of shots, the parameters to be taken into account and launches the program so that it sticks end-to-end each image of the series S to create a final image P which brings together all the shots.
• Another solution is to take a snapshot with a FISHEYE type FIS, but this requires even more control over the image processing program and image distortion phenomena to get a usable virtual tour. .
• the user must publish it on a website. For this, he must create the web page B by integrating a visualization program (usually a JAVA applet) that it sets by a script file. Once this page B created, it transfers - by a file transfer protocol (FTP) - on its web server N, all the elements constituting his virtual visit, that is to say: the panoramic images P created , that it places in a specific directory, page B, the program of visualization and the file of parameterization.
• FTP file transfer protocol
• This process is widely used by real estate agencies on the Internet and / or professional photographers who perform virtual tours.
• some collage programs can dynamically create the html page and the visualization program parameters, thanks to a transfer function panoramic images that have been created to a server.
• the state of the art does not allow anyone to create a virtual tour and publish it on the Internet because one must have at least the following techniques:
• each specialized provider can only perform a limited number of virtual visits, and successively, depending on the computer park in his possession.
• the present invention proposes to overcome these drawbacks by providing a mass virtual visit completion method and implementation system, fast and easy to use and allowing simultaneous processing of a very large amount of data. by delocalization, and in which all the interactions are done online, the user ensuring that the shooting and the virtual visit being created for the purpose of being published later, for example on a website , by e-mail or transmitted on a mobile phone.
• the subject of the invention is a method of mass production of interactive virtual visits for multimedia broadcasting from at least one image selected by a user. having a computer with a network connection, comprising the steps of:
• this processing unit automatically and uniquely renames it, in order to avoid redundancy of processing by another processing unit in the case of using a new processing file. at least two processing units;
• One of the advantages of the invention is the simplicity of use, since all the complex, long and constraining operations of the creation of virtual visits are carried out on remote servers.
• the user simply takes the photographs and uploads them (directly from his digital camera via a computer with a network connection) to the system.
• the rest of the operations are done automatically: transformation of the image and dynamic creation of the virtual visit ready to be sent to a website, an e-mail address or a mobile phone.
• the user no longer needs to possess only one of the previously mentioned techniques. It is enough that he is a simple surfer to realize and put on line a virtual visit. From the creation to the publication of a virtual visit, the user only uses his mouse and by clicking on icons or web links, he creates his virtual visit and uses it as he wishes. Also, the invention allows a refractory user of new technologies, or who has difficulty in understanding the computer tool, to create and use the virtual tour in a few clicks and minutes.
• the processing of a mass quantity of information - or data - requires, in the state of the art, numerous isolated treatment systems.
• the invention not only makes it possible to process a large amount of information in a centralized and automatic manner, but it also allows a significant saving in time (of the order of 10% to 50% depending on the transfer and processing conditions of the data. images) through simultaneous, not successive, processing of information.
• the invention aims to "industrialize" the creation of virtual tours, creation that is carried out in the state of the art manually, isolated and autonomous. But the invention is not the simple addition of isolated systems of the state of the art because it also allows an increase in the processing speed of each virtual visit.
• the invention also allows an update and easy evolution of the system because each update is automatically reflected on all users
• the invention also relates to a digital processing system for implementing the preceding method, comprising: an interface, viewable on a device such as a computer provided with a network connection, for the collection of information and data, and the sending of files;
• a remote unit for receiving and storing information and data files connected by a communication network to the interface
• each processing unit comprising a database and a digital processing circuit capable of detecting the presence of a new processing file, to reserve access to this new file, to treat the file according to the information contained in the database and the processing file to create a virtual visit, and to make the virtual visit available to the user.
• a system according to the invention is variable architecture using for example a variable number of blades of a blade server as a receiving unit and / or processing.
• the scale of a user group such as the global Internet network or mobile telephone networks.
• Figure 1 a schematic view of the structure of a system according to the state of the art
• FIG. 2 a schematic view of the structure of a virtual tour creation system according to the invention
• FIGS. 3 and 4 an operating diagram of a system for creating virtual tours according to the invention
• Figure 5 a schematic view of a fisheye image whose black edges have been removed;
• FIG. 6 a schematic view of an image extracted from the fisheye image of FIG. 5;
• FIG. 7 a schematic view of a cylindrical projection of the image of FIG. 6;
• FIG. 8 a schematic view of a still image obtained from a system according to the state of the art
• FIG. 9 a schematic view of a still image obtained from the cylindrical projection of FIG. 7;
• FIGS. 10 and 11 are diagrammatic views of a still image obtained from a system according to the state of the art and of a still image obtained from a cylindrical projection in accordance with that of FIG.
• the digital photographs used as examples are photographs taken with a digital camera with a very wide angle (180 ° x 180 °) commonly called FISHEYE.
• FISHEYE very wide angle
• the invention is not limited to these photographs, but allows to use any type of wide angle images.
• a digital processing system according to the invention whose general structure is shown in FIG. 2, comprises:
• an interface 100 viewable on a computer 102 provided with a double connection 104 to a communication network N, such as Internet WWW, for the collection of information and data, and the sending of files;
• a communication network N such as Internet WWW
• a remote unit 200 for receiving and storing information and data files connected via the communication network N to the interface 100 (link L1);
• the shooting may be the same as in the state of the art, but it is preferable to use a simple specific shot which consists of taking a single digital photograph 1 by desired panoramic image using a conventional digital camera 2 with a 3 fisheye lens 180 ° x180 °.
• a simple specific shot which consists of taking a single digital photograph 1 by desired panoramic image using a conventional digital camera 2 with a 3 fisheye lens 180 ° x180 °.
• the user no longer needs a foot to take a panoramic view 4: only what is behind him is not captured by his digital camera.
• By turning around and taking a second shot it covers 360 ° in two shots.
• the user no longer needs a gluing program to install and know how to operate with all the constraints that this may include. Also, once the different shots taken with his digital camera with the fisheye lens, it is sufficient for the user to connect to the web platform of the system according to the invention, then to transfer the digital photographs directly from the map digital device and the rest of the operations are done automatically according to the process described later.
• An interface according to the invention comprises: several interactive zones for collecting information: a selection zone 106 of the images to be processed and an identification zone 108 of the image type;
• an activation zone 110 of a transfer program capable of dividing the selected group of images into files comprising only a limited number of images according to their type.
• the interface may include secure access.
• the interactive zone can be an interactive menu that unfolds as information collection steps unfold.
• This information can be, for example, the reference of the camera used, the reference of the wide-angle lens used.
• a first phase consists of referencing the future virtual visit. This step qualifies the virtual tour so that it is associated with text or criteria. This referencing form may vary depending on the type of user: a real estate agent, a travel agent, a vehicle seller, etc.
• a second phase, represented in FIG. 3, is the selection of the images:
• the user activates, in step 120, a selection window, and selects in this window, in step 122, the images to be transferred.
• the user identifies the type of images, at step 124: the user selects the images to be processed, for example in the order of appearance in the virtual tour, and gives their type, for example 180 * 180 or 360 * 180.
• the transfer applet sends one or two images.
• the interactive selection area 106 may filter, in step 121, the selection of the images, in step 122, by the user in order to accept only certain file formats such as, for example, the conventional formats of jpeg, gif, tiff, png, eps, psd images, as well as some specific formats like, for example, ipx, qtvr.
• a sixth step 125 is the activation of the activation zone
• step 126 all the images that will constitute the virtual tour. After this operation, the virtual tour is automatically created on the processing units in a few seconds.
• the transfer program according to the invention transfers files comprising an image (type
• the processing file is generated by the transfer server once the image file has been downloaded completely.
• the transfer program therefore divides the group of images selected by the user in the previous steps into files comprising only a limited number of images according to their type.
• the applet when transferring eight images of type 180 °, transfers eight transfer files each comprising an image.
• the receiving unit detects the format of the image, creates a process file, and sends it to a storage unit.
• the processing step can begin as soon as a file arrives and does not have to wait for the arrival of the eight images to create the virtual tour.
• the transfer applet is able to determine, at step 128, the transfer rate authorized by the network connection of the device and to adapt, in step 130, the size of the images by compression according to the determined flow rate. Compression on the user's computer before sending allows the transfer to be faster.
• the transfer applet sends the images to a receiving and storage unit.
• This unit is composed, in the embodiment shown in FIGS. 3 and 4, of two distinct units, a reception unit 200 and a storage unit 400 (FIG. 4).
• the storage unit 400 also host the other data of the systems such as the virtual tours created and the processing files (see below).
• the reception unit comprises a digital processing circuit able to: - Receive, in step 210, images (1) taken with a camera
• step 215 Automatically detect, in step 215, the format of the images it receives;
• step 220 creating a processing file, in step 220, associated with the image including information concerning the format and characteristics of the image and at least one processing to be performed;
• the detection of the format of the images serves to determine, in step 240, whether this image should be processed. If the image is a still photograph, it will not be processed. If this image is a panoramic photograph or a fisheye photograph, it must be processed.
• the images 231 are stored in step 230 on the storage unit 400.
• the automatic detection of the image format can be done, for example, by comparing the value of the pixels of the image with a threshold value. For example, if it is a fisheye image, the receiving unit detects the circle of the image and removes the edges of black pixels.
• the receiving unit creates, in step 220, a processing file 221 including the information on the format of the image.
• This file may further include information about the characteristics of the image, such as information collected during the capture on the interface 100 or EXIF (Exchangeable Image File) information extracted in the step 250: make, model and version of the software of the digital camera, type of compression, resolution, exposure, opening , shooting speed, focal length of the camera lens, etc.
• At least one image processing is specified, for example, a projection of the wide-angle images for the distortions (equirectangular projection, Mercator projection, cylindrical projection, orthographic projection, Lambert's equivalent azimuthal projection, stereographic projection, projection gnomonic, Lambert conformal conic projection, sinusoidal projection, Bonne projection, Mollweide projection or a combination of these), a collage of several images, a reversal of images, etc.
• a projection of the wide-angle images for the distortions equirectangular projection, Mercator projection, cylindrical projection, orthographic projection, Lambert's equivalent azimuthal projection, stereographic projection, projection gnomonic, Lambert conformal conic projection, sinusoidal projection, Bonne projection, Mollweide projection or a combination of these
• a collage of several images a reversal of images, etc.
• the choice of the projection depends on the type of lens used and the place of the scene in the image that the user wants to highlight.
• the choice of the projection is reserved for informed users in a semiautomatic or manual mode of use of the system according to the invention. In automatic mode, the system performs three treatments described below.
• a processing file 221 may include one or more processing to be performed on an image. These processes are performed according to an order of priority to be defined in the system.
• the images 231 and the processing files 221 are stored on the separate storage unit 400.
• the images 231 corresponding to the processing file (s) 221 are copied before the processing files 221 to be sure of their presence during treatment.
• Images 231 and processing files 221 are copied to an available storage directory by a netbios share and dynamically mounted by the processing units.
• the recovery of the images 231 allows the just-in-time processing of the images 231 by their order of arrival on the storage unit 400.
• this processing file transmits mandatory information that will condition the type of storage. treatment that the processing units 300 will operate.
• the system according to the invention comprises (FIG. 2) two data processing units 300, connected in parallel with the reception and storage unit 200.
• the processing units are connected in parallel with the storage unit 400.
• the processing units are Linux servers allowing a precise adaptation of the source code of the operating system to reserve all the resources for processing the image.
• the use of a Windows server (registered trademark) involves the use of some of the resources for related programs.
• the assembly or reassembly in case of disconnection on the storage directory is done automatically on Linux servers. This makes it easy to add processing units 300 without having to disconnect the system to cope with an increase in the number of treatments.
• Each processing unit may be a blade of a blade server.
• Each processing unit comprising a database and a digital processing circuit able to detect the presence of a new processing file, to reserve access to this new file, to process it according to the information contained in the database data and processing file to create a virtual tour, and make the virtual tour available to the user.
• step 310 the processing units 300 perform an automatic and regular frequency scanning of the storage unit 400 the state of the storage directory present on the storage unit 400. If a new processing file appears , the processing units 300 check, in step 320, the processing files in order of priority.
• the files of treatment are then treated, for example depending on their extension determined by the treatment. These extensions are, for example, in order of priority: ".vis” for the priority processing, ".vis1" for the next processing, ".vis2" for the next processing, etc.
• the priorities are set according to the type of output image desired and to obtain a better processing speed.
• a processing unit 300 reserves, during step 320, access to the processing file 221 that it detected during step 310, renaming it to another unit 300 can no longer identify it as a processing file.
• One possible way is to add to the characteristic extension of a processing file a character string generated by a system of type GUID (Global Unique Identifier).
• GUID Global Unique Identifier
• the processing files 221 have a unique name GUID and generally contain: the image number, the name of the images in the order, the format of the input images, the desired output format, EXIF information if present, etc.
• the combination of the transfer program according to the invention and the reservation of each file by a single processing unit allows a substantial saving in processing time.
• a first processing unit detects a first transfer file, it prohibits access to other processing units and begins processing.
• a second transfer file arrives on the storage unit, a second processing unit detects it, denies access to other processing units and begins processing the second transfer file.
• the transfer of eight images by a traditional transfer applet has the following characteristics:
• the Java applet or the HTTP form transfers one or more files at one time.
• the processing unit that receives these files can only process the images once it has received all the files.
• the transfer of eight images by a transfer applet according to the invention has the following characteristics: the applet according to the invention proposes a multiple selection and transfers the files one by one for the images of the type 180.
• the processing unit processes these files as soon as they arrive.
• Three treatments are performed by default by the system according to the invention: a wide-angle image transformation to be viewed by a Java visualization applet, an image transformation wide-angle to be viewed by a Flash viewing applet and a wide-angle image transformation into still images for printing.
• the first is a step 330 of copying images to a local directory.
• the second is a step 332 of verifying the content of the image to check its conformity: for example the format of the JPEG (RGB / CMYK), the number of colors, the size, the presence of black edges, etc.
• the processing unit also retrieves the EXIF data if it exists to know the value of the focal point and the type of camera.
• the link with a table of correspondence present in the database gives precisely the diameter to take to have a square image without black edge. The treatment time is thus reduced to a minimum.
• the third is a step 334 of cutting the black edges of the images to obtain a square image or recovery of the already cut image if it exists in the image file directory on the storage unit.
• the processing unit 300 performs, in step 336, the processing in their order of priority.
• the priority processing is the transformation, in step 350, 180 ° circular fisheye images to be viewed by a Java visualization applet. This treatment is as follows:
• the processing unit 300 retrieves the data relating to the lens and performs a geometrical transformation of the circular image obtained in step 334 into an equirectangular image 352 (FIG. 2, link L5).
• the processing unit 300 performs a graphic correction if necessary-Gamma correction, attenuation filter, etc.- and cut a square image as wide as possible without taking black edges.
• the processing unit dresses, during step 355, the image thus obtained with a foot cover and a copyright of the system
• the processing unit 300 makes the virtual tour available to the user by creating, in step 360, a miniature image in the format 4/3 jpg 300 dpi (dots per inch) by default for displaying on the web, by copying, at step 365, the images of the virtual visit into the image directory of the storage unit, and the thumbnail image into a thumbnails directory and archiving, in step 370, the processing and report files in a directory 410 of the storage unit.
• the thumbnail image in 4/3 format is created from the images obtained in the virtual tour to warn the user of the end of image processing. This image can also be used for printing by modifying it in EPS format CMYK 300 dpi.
• the processing to be performed of several images during the processing step is an end-to-end gluing of the images followed by an equirectangular projection of the glued images.
• the second processing is the creation, at step 380, of panoramic images 382 (FIG. 2) for viewing in a Flash viewing applet.
• This treatment is as follows:
• the processing unit 300 retrieves the data relating to the lens and performs a geometrical transformation of the circular image obtained in step 334 into an equirectangular image 352 (FIG. 2). • Then the processing unit 300 performs, if necessary, a graphic correction-gamma correction, attenuation filter, etc.- and cut a rectangular image in the center of the equirectangular image, thus removing the black parts and the top and the bottom of the image.
• the rectangular image preferably represents half of the image, the upper and lower parts each representing a quarter of the image.
• the cutting deletes, on both sides of Ia long-side direction of the rectangular image, a portion of the image between 20% and 65% of the total image, preferably between 30% and 50%, typically between 35% and 45%. Beyond 65%, the image obtained is too small to be of good quality, below 20%, the deformation is not sufficiently corrected.
• the processing unit 300 performs a spatial correction to distort the rectangular image consisting in extending the image in the direction of the long side and according to a factor of between 20% and 45%, preferably between 25% and 40%. %, typically between 30% and 35%, to obtain ( Figure 2, link L6) a panoramic image 382 without deformation.
• the processing consists of processing images of types 360 °
• the second image is treated in the same way and glued transversely to the first one.
• the steps of providing the panoramic image 382 are the same as for the previous processing by L2 link to the network N.
• the third treatment is the creation, in step 390, of still images for high quality printing on a paper medium (newspaper, sheet A4, etc.).
• the detailed steps are shown in FIGS. 5 to 9.
• the processing unit 300 retrieves the data concerning the lens and the square image 391 (FIG. 5) without black fisheye edges, and then cuts out a square image 392 (FIG. 6). centered on the image 391 and of size substantially equal to half of the image to cover an angle of about 92 °.
• the size of the image 392 depends on the desired angle of view for the printed photograph: between 48 ° and 100 °, preferably 75 °.
• the size of the image 392 is chosen so that the maximum deformations of the edges of the image are excluded - viewing angle of less than 100 °. It is the same when using wide-angle images of focal length less than twenty-eight. For wide-angle images of focal length greater than twenty-eight, a barrel correction is sufficient to distort the image. If necessary, the processing unit 300 performs a graphic correction-Gamma correction, attenuation filter, etc.-.
• the processing unit 300 performs a cylindrical projection 393 ( Figure 7) depending on the angle of the lens used, and cuts a square image 395 ( Figure 8) as large as possible by removing the black areas 394 of the projection.
• the lens used is a 183 ° FC-E8 fisheye lens associated with a Nikon CoolPix (registered trademark) 4300.
• FIG. 9 An image 396 obtained with state-of-the-art processing is shown in FIG. 9.
• This image has two drawbacks: it covers only a small angle and has a significant geometrical deformation, visible, in particular, by an offset in the alignment of the neons that are, in reality, is perfectly aligned.
• the angle covered by image 396 is calculated as follows:
• the width angle is equal to the height angle multiplied by four and divided by three.
• a first neon in the background has an alignment materialized by the line ⁇ 1
• a second neon has an alignment materialized by a line ⁇ 2 forming a positive angle ⁇ with the line ⁇ 2.
• FIGS. 10 and 11 Another example is represented in FIGS. 10 and 11, respectively representing an image 500 obtained with a correction of the state of the art, and an image 510 obtained with a correction according to the invention.
• the lines ⁇ 3 and ⁇ 4 representing the alignment of the neon on the left and the alignment of the neon on the right, form an angle ⁇ between them.
• the lines ⁇ 3 and ⁇ 4 are collinear.
• the user is notified of the end of processing by the appearance of a thumbnail image on the interface.
• the speed of processing depends on the size of the images.
• the processing can be done simultaneously with several connected processing units and also simultaneously on the same processing units.
• the average processing time is 10 seconds for a 180x180 image with a server type 1 rack DELL (registered trademark) Poweredge (registered trademark) 1850 / bi processor Xeon (registered trademark) 3.2 GHz / 2 GB RAM.
• the processing is performed according to the parameters of the "screw" processing file and several procedures may exist in the case of errors during each of the processing steps.
• processing file is re-prioritized in storage directory and is reprocessed multiple times just as in case of repeated failure, or an image containing an error message is put in place of the thumbnail image and black images in the other directories where there is no image.
• the processing unit 300 After processing, the processing unit 300 stores the virtual tour on a storage unit 400 and provides the user with access to a viewing program and the virtual tour. This means of access is a hypertext link enabling the user to open the virtual tour and launch the viewing program which is stored on the remote storage unit 400 of the user's computer 102. According to another embodiment of the system, the processing unit 300 sends the user, for storage on his computer, the virtual visit and a visualization program of the virtual visit.
• the interface according to the invention makes it possible, optionally, to rename and organize the images in an order of appearance in the virtual tour.
• the user can define, for example, interactive areas on each image to move from one image to another: a door, a window, a closet, etc.
• a virtual tour distribution service makes it possible to use the virtual tour to publish it to a website, send it by e-mail to one or more correspondents, download it to your computer so you can burn it to CDROM, send it to a mobile phone, etc.
• the processing unit 300 creates a web page including a visualization program and a means of access to the virtual visit, and sends this web page to a website, an email or a mobile network.
• This means of access to the virtual tour is a hypertext link to open the virtual tour stored on a user's computer or on the remote storage unit 400.
• the visualization of the virtual visit is obtained by the activation of a link html.
• the processing unit automatically and dynamically creates an HTML page including the parameterization of a visualization program (JAVA, FLASH (registered trademark), QuickTime (registered trademark)) which allows calls to the storage unit to fetch the data. different images.
• a system according to the invention provides encryption means when selecting the html link.
• the user can enter the email address (es) of his or her correspondent (s) for the system to send directly to the body of the email the html page (including visualization elements of the virtual visit), either a html link to this page, or a pre-typed text associated with the html page as an attached file.
• This method of sending ensures that the recipient can, in any case, see the virtual tour whatever its mail manager.
• the user can also download each visualization element of the virtual visit:
• the system creates a ".zip” or ".exe” file including the formatted html page to allow viewing without being connected to the Internet.
• a system allows the creation of an A4 format html page including all the elements of the virtual visit.
• This page contains the textual elements that the user was able to enter during the selection of the images, as well as the images processed and rendered-still images obtained by the third processing- so that it is possible to print this page in high quality. .
• Two modes of diffusion of the virtual visit on one or more Web sites are possible: - a manual broadcast: the user can send a webmaster an e-mail containing the procedure for integrating the virtual visit on his website. This e-mail includes all the dynamic elements of the html page call which takes over the configuration of the virtual visit. He simply copies the text of the email and insert it into the HTML page of the client site to see the virtual visit.
• a system according to the invention also makes it possible to send the information of the advertisement as well as the virtual visit to a mobile phone.
• the system provides with the virtual tour a visualization program adapted to the different standard systems of the market:
• the invention makes it possible, from multiple input image formats (a fisheye image, two fisheye images, a panoramic image, several wide-angle images) to automatically create output: - A virtual tour for the Internet with at least one panoramic image;
• the user takes a photograph per site which he wishes to represent and the system according to the invention creates the visual content adapted to the output medium containing each time all the photographs that the user has taken.
• the transfer applet can create a file by image regardless of their type and start processing only when the number of corresponding files is totally transferred: one if the type of the image is
• the number of images needed for processing is determined by the image type. Therefore 120 ° wide-angle images will have to be received by three to make a 360 ° virtual visit. Thus, the number of images to be received for the processing to begin is equal to the typical report of the virtual visit / type of images.
• the interface of a system according to the invention can be displayed on a personal assistant. digital or a mini multimedia TV an internet connection.
• the display device must be able to allow the viewing of important image files by known visualization programs.
• the reception and storage unit comprises a digital circuit capable of renaming each image received. uniquely, for example by a GUID type system (Global Unique Identifier). This unique name is kept throughout processing and avoids confusion and / or overwriting of data in the system. Thus two virtual visits can not have the same name.
• the system according to the invention can therefore be reproduced by different online companies, without the risk of conflict between virtual visits on the same publication site.
• the display applet includes a zoom performing a polynomial interpolation to avoid pixilation when increasing the zoom factor.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computing Systems (AREA)
• General Engineering & Computer Science (AREA)
• Processing Or Creating Images (AREA)

Applications Claiming Priority (1)

Publications (1)

Family

ID=34993050

Family Applications (1)

Country Status (3)

Families Citing this family (12)

Family Cites Families (5)

• 2005
  • 2005-02-09 EP EP05717594A patent/EP1851948A1/de not_active Withdrawn
  • 2005-02-09 US US11/815,910 patent/US20080062168A1/en not_active Abandoned
  • 2005-02-09 WO PCT/FR2005/000293 patent/WO2006084959A1/fr active Application Filing

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events