Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00281—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal
  • H04N1/00307—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal with a mobile telephone apparatus
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00281—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal
  • H04N1/00318—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal with a multi-media apparatus
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/40—Picture signal circuits
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04M—TELEPHONIC COMMUNICATION
  • H04M1/00—Substation equipment, e.g. for use by subscribers
  • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
  • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
  • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
  • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
  • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/0077—Types of the still picture apparatus
  • H04N2201/0093—Facsimile machine

Definitions

• the invention relates to a method for improving the quality of use of at least one service relating to at least one multimedia datum, this service being offered by a service provider and / or a telecommunications operator using a mobile phone terminal.
• the invention also relates to a mobile telephone terminal implementing this method.
• Multimedia data means photographs, drawings, text, video, audio, audiovisual or programs.
• the invention results from the observation that the use of mobile telephony terminals is not very ergonomic when it comes to using these services. For example, when it is a mobile telephone terminal equipped with an image taking apparatus and one wishes to send the photos taken by MMS, it is necessary to execute several operations or functions in succession. each other.
• the method comprises, according to the invention, the automatic implementation before, and / or during, and / or after the acquisition of multimedia data, several terminal functions necessary for the service, this automatic implementation of terminal functions comprising the following steps:
• the method further comprising the step, for the user, of choosing a determined scenario from the previously established scenarios.
• model we mean data which is based on a previous use of the service sent, or being sent, or received or recorded by the user in his terminal in a folder called preferably.
• the model constitutes all or part of an electronic mail or a card postal already created, sent and received or registered.
• the user is guided by means of a terminal interface which presents the services accessible to the user via this terminal.
• At least part of the scenario is prerecorded, for example during a previous use of the service.
• the characteristics of the multimedia data item are automatically determined according to the service selected.
• the characteristics of this image which are automatically determined as a function of the service selected are shooting parameters. For example, an image intended for a mobile telephone is made to benefit from a longer exposure time than an image intended for a printing service or for viewing on a computer screen because an image on a screen of Small dimensions such as that of a mobile telephone terminal are much less sensitive to camera shake than a larger image.
• the multimedia data is also an image
• the latter is acquired for the provision of at least two services and the characteristics of this image are the shooting parameters which are determined automatically as a function of '' at least one of the two services and the amount of light when shooting so that in low light the image can be used for minus one of the two services.
• At least two multimedia data are acquired for the provision of at least two services, the characteristics of each multimedia data being adapted to the corresponding service.
• two images of the same subject can be produced, the characteristics of which differ depending on the use of the image or the end use of the image.
• This arrangement can be used generally in an image acquisition device in which the use of the image or the final use of the image can be selected and the shooting parameters are selected. automatically depending on the use of the image or the end use.
• such an image acquisition device includes the possibility of simultaneously taking an image of a subject intended for printing in a determined format such as 10 ⁇ 15 cm and an image of the same subject at full resolution.
• the image acquisition device allows a resolution of 6 million pixels
• the full resolution image will of course be taken with 6 million pixels while the image provided for a print in 10x15 format can be taken at a resolution of 2 million pixels.
• the reduction in resolution can be used to improve other characteristics.
• the exposure time can be reduced, which reduces the effect of any shake.
• the processing time is generally proportional to the number of pixels
• the decrease in resolution frees up a large amount of computing power to reduce noise in low light and extend the range of use in low light.
• the adaptation of the shooting parameters to the end use makes it possible to choose parameters which can cause non-visible or not very visible defects and to select, in return, parameters making it possible to improve the image.
• the method comprises, to implement the service, the step of searching for prerecorded multimedia data in the terminal.
• the method comprises the step of choosing a presentation, or layout, of the multimedia data, for example using a model and / or a presentation parameter.
• the method comprises the step of providing automatic assistance to the user of the terminal for carrying out an acquisition of the multimedia data, in particular by helping with the framing of an image and / or with quality control. of this image, by providing courses or instructions for acquisition and / or adjustment, or by displaying the final result of the acquisition.
• the method comprises the step of modifying the multimedia data.
• the method comprises the step of processing the multimedia data locally, that is to say in the terminal, or remotely, that is to say outside the terminal, in particular in a server.
• the method comprises the step of choosing a recipient, for example using a link with an address book and / or an automatic entry.
• the method comprises the step of compressing the multimedia data as a function of at least one characteristic of the network relating to its transmission rate.
• the method comprises the step of inserting multimedia data relating to text into multimedia data relating to an image, called postcard.
• the method comprises the step of transmitting multimedia data relating to an image by means of at least one of the following communication modes: fax, telephony, electronic mail.
• the method comprises the step of managing an album of multimedia data specific to the user, this album being stored in a server accessible to the terminal via the telecommunications network.
• the method comprises the step of transmitting the multimedia data to a printing service such as a printer.
• the invention also relates to a mobile telephone terminal in which, to improve the quality of use of at least one service relating to at least one multimedia datum, in particular relating to photographs of video, of audio and / or text, this service being offered by a telecommunications service provider and / or operator, which includes means for the automatic implementation before and / or during and / or after the acquisition of the multimedia data, of several terminal functions necessary for the services, these means comprising:
• [050] - a means for selecting, among the functions available in the terminal, the functions necessary for the services
• [051] - a means for automatically and / or manually establishing at least one scenario suitable for the service, this scenario being composed of logically chained sequences of the selected functions, and
• [052] - a means so that the user can choose a determined scenario from the previously established scenarios.
• a guide interface presents the services accessible to the user.
• the terminal comprises means for recording part of the scenario.
• the terminal comprises means for automatically determining the characteristics of the multimedia data as a function of the service selected.
• the means for automatically determining the characteristics of the image comprises means for automatically determining the shooting parameters according to the service so, for example, that an image intended to a mobile phone can benefit from a longer exposure time than an image intended for a printing service or for viewing on a computer screen.
• the terminal comprises means for acquiring an image for the provision of at least two services, and means for the characteristics of this image to be the shooting parameters which are determined automatically by function of at least one of the two services and the amount of light when shooting, so in particular that in low light, the image can be used for at least one of the two services.
• the terminal comprises means for acquiring at least two multimedia data for the supply of at least two services, and for the characteristics of each multimedia data to be adapted to the corresponding service.
• the terminal comprises means for searching for a prerecorded multimedia data item in the terminal to implement the service.
• the terminal comprises means for choosing a presentation or a layout of the multimedia data, for example by using a model and / or a presentation parameter.
• the terminal comprises means for providing automatic help to the user of the terminal for carrying out an acquisition of the multimedia data, in particular by helping to frame an image and / or to control the quality of 'an image, by providing courses or instructions for acquisition and / or adjustment, or by displaying the final result of the acquisition.
• the terminal comprises means for modifying the multimedia data.
• the terminal comprises means for processing the multimedia data locally, that is to say in the terminal, or remotely, that is to say outside the terminal.
• the terminal comprises means for choosing a recipient, for example using a link with an address book and / or an automatic entry.
• the terminal comprises means for compressing the multimedia data as a function of at least one characteristic of the network relating to its transmission rate.
• the terminal comprises means for inserting multimedia data relating to text in multimedia data relating to an image, called postcard.
• the terminal comprises means for transmitting multimedia data relating to an image by means of at least one of the following modes of communication: fax, telephony, electronic mail.
• the terminal comprises means for managing an album of multimedia data specific to the user, this album being stored in a server accessible to this terminal via the telecommunications network.
• the terminal comprises means for transmitting the multimedia data to a printing service such as a printer.
• FIG. 9, 10, 9a and 10a are charts making it possible to choose, in accordance with the invention, a compression rate and a sampling rate, and [073] the figure 11 is a diagram illustrating other steps of the method according to the invention. [074] The examples described relate mainly to a mobile telephone terminal equipped with a camera sometimes called a photophone or a camcorder. [075] Use of services
• the image quality is limited by the constraints of space, power consumption and cost of mobile terminals.
• the quality is variable depending on the type of terminal and requires specific image processing.
• the quality of an image depends on how you look at it. In particular on a small screen many defects are invisible while they become visible on a print or a larger screen.
• the images are strongly compressed to fit within the authorized bandwidth, which produces artifacts during the decompression necessary to display or print the images.
• These are particularly troublesome drawbacks which slow down the development of the use of photo services with a mobile telephone terminal because these services are much less efficient than those linked to autonomous photographic cameras.
• the computation time for improving the images is generally proportional to the size of the image, that is to say to the number of pixels. [089] Improving the quality of the image consumes a great deal of computing time and therefore electrical energy.
• the power of the processors embedded in the terminals increases more slowly than the number of pixels of the sensors.
• the computing power is limited and variable depending on the type of terminal.
• Access to computing power is variable depending on the type of terminal: some terminals are open to code written in C ++, others only to Java code (much slower for image processing than C ++ ), others are not open. [092] The size of the local storage is limited.
• the size of the transmission pipes is limited. In France it is 50kb per message and is gradually increasing to 100kb. [094] The images systematically pass through a server for the various services.
• the invention improves the image quality and / or improves the ergonomics of use.
• the method according to the invention takes place before the shooting and / or during the shooting and / or after the shooting.
• FIG. 1 we start from an image 100, or, more generally, from multimedia data, and we determine a first fraction 102 of this data which must be processed in mobile phone 110 and a second fraction 104 of image 100 which must be processed in a remote server 112.
• the processing of all of the multimedia data is divided so that a first fraction of the processing is carried out in the terminal 110 and that a second fraction of the processing is carried out in the server 112.
• the multimedia data 120 is stored without additional compression or at low additional compression in the remote server 112. It is compressed for its transmission to the mobile telephone 110. It is also subjected to a processing as a function of the service to be provided to this telephone 110 or requested by this telephone 110.
• the data 120 is assigned a marking 122 linked to this data. This marking is transmitted with the data from the server to the terminal 110 in order to allow the subsequent use of the same original data 120 uncompressed when it is required by the mobile terminal or another mobile terminal.
• a mobile terminal receives an image and wants to transmit it to another mobile terminal, to avoid the degradations due to compression and successive decompressions, thanks to the marking, it is possible to find the multimedia data with its quality d origin in server 112.
• An identity photo service includes, in one embodiment, the following steps: [136] - Shooting with framing assistance.
• This framing aid can be adapted to the country's standards for official documents.
• the framing aid makes it possible to segment the image to more easily carry out the checks below.
• Control of the respect of the rules are for example: the control of the uniformity of the background, the control of the color of the background, the control if the background is clear enough, the control of the presence of shadow on the background, control of the lighting of the face (which must not be too dark), the control of the absence of a hat or veil, the control of the absence of accessories, the control of the proportions of the face, the control that the face is of face and not of profile.
• Control can be automatic and / or manual.
• the correction is automatic, and / or the correction is carried out manually by an operator, for example cleaning the background, otherwise a message is returned to the user, preferably quickly so that he can retake the photo.
• This message indicates for example how to take a photo without the defect.
• This service can be adapted to the rules of a country for official documents.
• [161] - Security and identification or authentication Signature the written signature (added to a number generated by a server for example) can be used for authentication. The photo can also be used for authentication.
• - Professional services Quotation: The seller coming to establish a quote sometimes needs to consult a specialist. The cameraphone provides a means of consulting the installer / supplier when drawing up the estimate. For example, an installer of roller shutter motors can consult an installer to determine the complexity of dismantling.
• Metadata data associated with the multimedia data and corresponding to information relating to the format of the file containing the multimedia data, and / or information relating to the compression, and / or the origin of the data, and / or the acquisition characteristics.
• acquisition parameters such as focal length, aperture and exposure time
• results of a calculation obtained from the multimedia data for example the number of pixels.
• Image processing can be done in various ways:
• the layout can be done locally or remotely:
• a method and system is thus obtained for improving the quality of use of a service, implementing at least one processing, relating to at least one multimedia data item, in particular relating to photos, and / or video. , and / or audio, and / or text, this service being offered by a telecommunications service provider and / or operator on a user's mobile phone via a network.
• this method is suitable for overcoming the limitations resulting from at least one factor, affecting the quality of use, such as: [188] - the size of the multimedia data, and / or
• the method comprises the following steps:
• This method can also comprise the following steps:
• [207] - define by means of a format instructions relating to the remote processing
• These instructions may include:
• the method further comprises the step, for the server, of transmitting the result of the execution of the instructions to the beneficiary of the service.
• Service means in particular:
• Processing also called correction, means in particular:
• IT resources include:
• identifier is meant in particular:
• [250] Remove or reduce all or part of the defects in the camera and / or the camera: exposure, lighting, geometric distortion, chromatic aberration, vignetting, blurring, astigmatism, white balance, saturation , demosa ⁇ sation, noise, camera shake, focus blur, compression artifact, deblocking artifact, other processing artifact, aliasing artifact (aliasing).
• the formatting data must be independent of the physical format in order to allow printing in several formats.
• the size and position of text and image elements are determined downstream.
• This content can be transmitted in the form of an address and / or metadata.
• the content can be described by a format.
• This format can be open (standard and / or extensible); it can be an extension of the MMS smil format. It must be compatible with any type of transport protocol (MMS, http, wap, email %) and therefore compatible with existing networks.
• a standard Jpeg compression program is used, which is implemented in all telephones; however, another format can also be used.
• the stages of image processing are as follows: [293] - Possibly preprocessing.
• the message can be intended for a third party and / or used on the sending terminal for example for viewing the result or obtaining advice.
• a standard Jpeg compression program is installed installed in all the terminals; however, another format can also be used.
• the image processing steps are as follows: [301] a) Possibly preprocessing.
• the remote server also called correction server can be located:
• Telecommunication operators limit the size of messages transmitted, for example by MMS.
• the size of an image file depends on the content of the image. At a given number of pixels and a given perceived quality level, an image which contains a lot of details will produce a larger file than an image containing less details.
• the images follow the following path:
• the terminal has limited computing power and exchanges are slow. The availability of overviews for the user will be more limited, but the other advantages (ergonomics, accessibility to services ...) are preserved. [353] It is therefore possible to carry out the processing in the server by limiting the returns to the user. [354] 3. TEXT PHOTOGRAPHY SOLUTION (FotoText + component) - background cleaning [355]
• the invention provides a component, called “FotoText +”, which is a text scanner which allows to transform the photo of any document “of binary nature » For example composed of lines on a light background, in particular a handwritten text, a line drawing, plan or sketch, a printed text.
• This component corrects paper defects (background cleaning): shadows, grid or lines, creases, stains, creases in the paper, and, of course, camera and lighting faults. This can be done for example by extracting information above a threshold. [357] It optimizes the level of contrast.
• a user interface makes it possible to position the text / graphic on the photo on the front; local or remote processing at the resolution of the terminal screen makes it possible to display a preview and facilitates the work of the user.
• the photo of the text / graphic is processed, cleaned by removing non-uniform lighting zones to optimize readability, cleaned of the background and printed on the photo on the front.
• background cleaning consists in making the part of the photo other than the person photographed uniform, for example by detecting the outline of the face and filling in the exterior with uniform color.
• FIGS. 1b to 8 A description will be given below, using FIGS. 1b to 8, of a service for producing postcards, also called a "photocard".
• the figures represent the various screens of the terminal interface which presents the service to the user and guides the user.
• the figures also show the automatic implementation of several terminal functions necessary for the service; this automatic implementation of terminal functions comprising the following steps: [375] - select, from among the functions available in the terminal, functions necessary for the service, [376] - establish automatically, and / or manually by the user, at least one scenario suitable for the service, this scenario being composed of logically chained sequences of the selected functions, [377] the method further comprising the step, for the user, of choosing a determined scenario from the previously established scenarios.
• the screen 10 represented in FIG. 1b corresponds to the reception when the postcard service has been selected by the user who has been guided by means of a terminal interface which presents the services accessible to the user via the terminal.
• It is a welcome screen which offers, at the opening, the choice between several scenarios appropriate to the service also called actions which are as shown: “new photocards”, “draft”, “cards sent”, “ cards being sent ”,“ models ”. The choice is made, using the terminal's “joystick” by selecting one of the actions.
• Each scenario is made up of logically linked sequences of shooting, album search, text entry, address search, layout functions. A mechanism of preferences and models makes it possible to pre-record at least part of the scenario.
• FIG 3 there is shown the screen 20 displayed when the user selects an action with the option menu "Select" of screen 12 of Figure lb.
• a screen 20 is displayed on which we see the choice between draft, model, card to be sent and card being sent.
• the last draft is shown, which includes a photo 22 and a text 24.
• the option menu of screen 20 allows access to a screen 26 with an “open” command.
• the image can be selected from the “front” (setting on page), text, “back” (layout) and address as shown in Figure 4.
• the screen 30 shown in FIG. 4 corresponds to the selection of an image which, as shown, indicates that it is the service of making a new postcard with the image on the front and offers the ability to take a new photo, choose the last photo taken, choose the photo pre-recorded in an album in the terminal's memory, choose a photo recently used for the same service, or finally choose a photo on a remote server.
• an album of multimedia data specific to the user can be managed, this album being stored on a server accessible to the user's mobile telephone terminal via the telecommunications network.
• an automatic help is provided to the user to acquire the image, by helping with the framing.
• This framing aid consists of superimposing a silhouette on the image which indicates to the user how to frame in different cases which he can choose on a horizontal screen (image wider than it is high) or on a vertical screen, which allows to obtain both a properly framed image and better resolution than if a later crop were performed.
• This framing aid respects, preferably, the "golden rule" of photography known as three-thirds: never center the subject or the horizon.
• the user can choose using the joystick between several use cases, for example corresponding to the following cases: close-up, bust, group, landscape, photo of text in horizontal or vertical screen.
• the man / machine interface switches to the creation of a text with a standard entry or a semi-automatic entry which consists of providing several fields for the text and in each of these fields, to reuse texts already memorized.
• the first field is the stubbornness field which relates to the recipient: "dear friend”, “dear mother”, etc.
• a second field concerns the body of the text: “the weather is fine”, “I'm having a good holiday”, etc.
• a third field concerns the end of the text comprising the courtesy formula and a fourth field includes the signature.
• a screen (not shown) is displayed to indicate to the user that he must photograph a text, for example handwritten, with advice on how to take it correctly a photo of text such as "be parallel” and "prefer uniform lighting”.
• a rectangular framing is displayed on the screen and makes it possible to determine, depending on whether it is distorted or not, whether the photo is taken at the right angle.
• the choice of layout which is, for example, in memory of the terminal, consists, in one embodiment, in choosing the nature of the postage stamp to be affixed and corresponding, for example, to the place where the photo is taken . It can also consist of a choice of background color.
• Figure 8 shows the screen 38 which is selected when the user has chosen the "address" tab of the screen of Figure 4. If the terminal already has an address book or a list of contacts , then the recipient is chosen from this contact list via the "option" box (screen 40). If this is a new contact, then the screen has several areas for the first name (which can then be chosen by using option T9), the last name, the street number, the name of the street, postal code of the city and country.
• the corresponding city is indicated automatically and vice versa, when the city is indicated, the postal code is indicated automatically.
• the sending screen indicates that the card postal is ready to be sent and offers the user to save it as a template.
• the photo is compressed as a function of at least one characteristic of the network relating to its transmission rate (for example the maximum size of MMS messages) while optimizing the quality of the image transmitted using the protocol described below, making it possible to choose, for this optimization, the sub-sampling rate, and the compression parameters, in particular of the JPEG type.
• the photo thus compressed and the postcard are transmitted by telephone, for example by MMS.
• a screen shows that the postcard has been sent and offers the user to send this card to another recipient.
• a VGA sensor provides 300,000 pixels and each pixel uses one byte to encode each of the three color channels, which results in a raw image of approximately 900 KB.
• most terminals are only capable of sending files, after compression, of 30 to 50 kb, or approximately 3 to 5% of the initial information in the case of a VGA sensor.
• the invention proposes a method which makes it possible to optimize the quality of the image transmitted thanks to a protocol making it possible to choose, with a view to this optimization, the rate of subsampling, and the parameters compression, especially of the JPEG type.
• JPEG compression leads to a loss of information and causes the appearance of artifacts (defects) which are all the more important the higher the compression rate.
• This abacus has three curves corresponding to three different images.
• the abacus is obtained as follows: three test images have been chosen which initially have a definition of 1 mega pixel.
• compressed copies are generated at different rates to obtain files of given size: 200 kb, 150 kb, 100 kb, 80 kb, 60 kb, 55 kb, 50 kb, 45 kb , 40 kb, 35 kb, etc., previously resampled, the sampling rate being 90%, 80%, 70%; 60%, etc., the sampling rate being the same in horizontal direction and in vertical direction.
• FIG. 9a is an abacus with a curve 50 constituting an average of the curves in FIG. 9 and the abacus of FIG. 10a comprises a curve 52 corresponding to an average value of the curves of FIG. 10.
• an algorithm is provided in the mobile telephone terminal which starts from the weight of a file which the terminal can send over the network.
• This file weight on the abscissa in FIG. 10a corresponds to the ordinates of this same figure, a sampling rate.
• This sampling rate makes it possible to determine, from curve 50 of FIG. 9a, a compression rate on the abscissa of FIG. 9a.
• This algorithm is represented by the arrowed path which starts from a point A on the abscissa of FIG. 10a to arrive at a point B on the abscissa of FIG. 9a.
• the compression rate obtained can provide a file weight greater than that which the network can support, because, for a given compression rate, the final weight of the file depends on the amount of detail contained in the image. .
• the algorithm chooses a higher compression rate B ', which makes it possible to select a corresponding sampling rate thanks to the curve 50 of FIG. 9a and to verify, using the diagram in FIG. 10a, if the file weight A 'is less than the maximum admissible by the network.
• This iterative process continues if the weight A ′ is still too large, that is to say that a file weight A ′ is chosen which is less than A ′ until a satisfactory file weight is obtained.
• the optimal compression curve as a function of the size of the multimedia data can appear in the memory of the terminal in the form of the charts in FIGS. 9a and 10a but also in the form of tables of values or algorithms.
• the useful part of the optimal compression curve is for example the extract corresponding to the maximum file sizes that can pass through the networks of the different telephone operators.
• digital image is meant an image in digital form.
• the image can come from a digital image acquisition device also called image capture device.
• the image can be a still or animated image, an image of a video sequence before shooting or an image intended to be transmitted or stored.
• the digital image can be represented by a set of digital values, hereinafter called gray level, each digital value being associated with a color sensitivity and a relative geometric position on a surface or a volume.
• Gray level in the sense of the invention means all the numerical values associated with the same color sensitivity.
• the digital image is preferably the raw image of the sensor (“raw” format in English) before demosaicing operation (“demosaicing” in English).
• the digital image may also have undergone processing, such as demosaicing, white balance, or subsampling.
• the latter comprises a sensor fitted with sensitive elements.
• sensitive element means an element of the sensor making it possible to convert a flow of energy into an electrical signal.
• the energy flow can take the form in particular of a light flux, X-rays, a magnetic field, an electromagnetic field or sound waves.
• the sensitive elements can be, depending on the case, juxtaposed on a surface and / or superimposed in a volume.
• the sensitive elements can be arranged in a rectangular matrix, a hexagonal matrix or other geometry.
• the invention applies to sensors comprising sensitive elements of one or more different type (s), each type having a color sensitivity, each color sensitivity corresponding to the part of the flux d energy converted into an electrical signal by the sensitive element of the sensor.
• the sensors In the case of a visible image sensor, the sensors generally have a sensitivity in 3 colors and the digital image has 3 colors: red, green and blue. Some sensors have a sensitivity in 4 colors: red, green, emerald, blue.
• the sharpness of a color can correspond to the measurement of a value called BXU which is a measurement of the blur spot area, as described in the article published in the “Proceedings of IEEE, International ConfInter of Image Processing, Singapore 2004 ”, and entitled“ Uniqueness of Blur Measure ”by Jércons BUZZI and Frédéric GUICHARD.
• the blurring of an optical system is measured from the image, called "impulse response", from an infinitely small point located in the plane of sharpness.
• the parameter BXU is the variance of the impulse response (i.e. its mean area). Processing capabilities may be limited to a maximum value of BXU.
• the sharpness is obtained by calculating a gradient.
• the sharpness can be obtained by calculating a gradient of 9 gray levels taken in neighboring geometric positions.
• An image capture device is, for example, a disposable camera, a digital camera, a reflex camera (digital or not), a scanner, a fax, an endoscope, a camera, a camcorder, a surveillance camera, a toy, a camera or a camera integrated or connected to a telephone, a personal assistant or a computer, a thermal camera, an ultrasound machine, an MRI (magnetic resonance) imaging device, an x-ray X-ray machine.
• a disposable camera for example, a disposable camera, a digital camera, a reflex camera (digital or not), a scanner, a fax, an endoscope, a camera, a camcorder, a surveillance camera, a toy, a camera or a camera integrated or connected to a telephone, a personal assistant or a computer, a thermal camera, an ultrasound machine, an MRI (magnetic resonance) imaging device, an x-ray X-ray machine.
• MRI magnetic resonance
• optical image capture system means the optical means making it possible to restore images on a sensor.
• image sensor mechanical, chemical or electronic means allowing the capture and / or recording of an image.
• servo system means mechanical, chemical, electronic, or computer type allowing elements or parameters of the device to meet a set point.
• These include the autofocus system, automatic white balance control, automatic exposure control, optical control, for example to maintain consistent quality images, an image stabilization system, an optical and / or digital zoom factor control system, or a saturation control system, or a contrast control system.
• the digital image processing means can take various forms depending on the application.
• the digital image processing means can be integrated, in whole or in part, into the apparatus, as in the following examples:
• [453] An image rendering device which displays or prints modified images, for example a video projector or a printer including processing means images.
• [454] A mixed device which corrects defects in its elements, for example a scanner / printer / fax machine including image processing means.
• [455] A professional image capture device which produces modified images, for example an endoscope including image processing means.
• the image processing means can be deported in whole or in part to a server. [457] Camera setting, shooting setting:
• the camera settings or shooting parameters include one or more of the following: [460] - The mode of use, for example: automatic, aperture priority, speed priority, portrait, landscape, sport , night. The use has in particular an influence on the ISO sensitivity, the exposure time, the noise, the blur. [461] - Manual exposure correction which has an influence on noise and contrast in particular. [462] - The ISO sensitivity setting which has an influence on noise and camera shake in particular. [463] - The setting of the exposure time which has in particular an influence on the blurring of camera shake.
• the white balance setting for example: automatic, tungsten, fluorescent, halogen, sunny, covered, shaded, which has an influence on color in particular.
• the contrast adjustment for example: strong, normal, weak, which in particular has an influence on the contrast.
• the sharpness setting for example: strong, normal, weak, which notably has an influence on the blurring.
• the resolution setting which has an influence in particular on the details and the sharpness.
• [472] The color rendering setting, for example: color, black and white, sepia, saturated, which has an influence on color in particular.
• [473] The setting of the output color space, which in particular has an influence on the color.
• [474] The maximum value for digital zoom factor. To deactivate the zoom, it is given the value 1.
• [475] The parameters of the various servos.
• the image processing parameters in particular: the coefficients and tables used by the various filters and processing necessary for the construction of the color, the sharpness, the contrast, the details and the reduction of the noise , the demosaicing parameters, “tone curve” (which is a correspondence table used to adapt the dynamic range of the sensor signal, for example 10 bits, to the dynamic range of the image signal, for example 8 bits), noise reduction, white balance, interpolation.
• tone curve which is a correspondence table used to adapt the dynamic range of the sensor signal, for example 10 bits, to the dynamic range of the image signal, for example 8 bits
• noise reduction white balance
• interpolation interpolation
• the indication of the end use of the image can be done in different ways: when creating a message for a particular service, for example: for a postcard service on mobile after the request for creation of postcard, for an MMS service on mobile, after the choice of the recipient, which allows, if it is a postcard service number or address, to know that the image will be printed, s 'it is an email address to know that the image is going to be used on a computer screen or for printing, if it is a mobile phone number to know that the image is going to be used on a mobile screen, via a setting made by the user, via a setting made by the service operator, via a setting made by the manufacturer or seller of the phone, in order to favor certain types of services, via a history of the uses of images.
• Use of the image is:
• the multimedia data is an image
• service is meant in particular services as described above but also services corresponding to a specific use of the image, the service not necessarily being offered by a service provider but can also be provided by the user himself or by a third party, in in particular, the use of the determined image can correspond to uses for sharing images (on a small screen, on a computer screen, on a print, on an electronic or physical medium) and memory (archiving for subsequent consultation by printing or saving the image file) such as:
• [483] - display on a large screen usually from 1 to 2 million pixels in particular: a computer screen, a television set, a projector,
• the services can be grouped according to the number of pixels necessary for use:
• the quality of use of the service is increased by using image usage information.
• This information can be:
• the camera generally has an image resolution setting.
• Image acquisition includes all or part of the following steps:
• the multimedia data is an image
• the characteristics of this image being the shooting parameters which are determined automatically according to the service, in such a way that an image intended for a mobile telephone can benefit from a longer exposure time than an image intended for a printing service or for viewing on a computer screen.
• the device can be a terminal but also a camera or any other device linked to the image as described above,
• the method comprises the step of automatically determining the characteristics of the multimedia data as a function of the service selected.
• the characteristics of this image being the shooting parameters.
• the shooting parameters are determined to optimize the image for using:
• the method comprises at least one of the following steps:
• a digital zoom consists in using only the central zone of the sensor. Thus for a digital zoom x2, only the central quarter of the pixels of the sensor are kept.
• a maximum zoom factor can be calculated so that the number of pixels acquired is close to the number of pixels for using the image. For example :
• the exposure control measures the amount of light on the sensor, and adjusts the exposure time, the aperture and the gain of the sensor (linked to the ISO sensitivity) according to the camera settings to reach target exposure.
• [541] - take into account the reduction in the number of pixels acquired and the noise reduction to set a higher gain.
• the shooting parameters were automatically determined as a function of the service and the amount of light during the shooting, since instead of providing an image unusable for the service, an image was provided with 4 times less detail, but with a significantly reduced noise level, for example from 6 to 9dB, which makes the image usable.
• the invention makes it possible to obtain an image of maximum quality, in particular in low light, compatible with use by adapting the acquisition, the size and the treatments.
• One or more shooting parameters can be determined, in particular:
• One or more shooting parameters can be determined, in particular:
• [573] the size of the raw image fixed at 4 times the number of pixels of use, 4,000,000 pixels in the example
• [574] - the demosaicing method we can simplify the demosaicing by the known method superimposition of 4 neighboring pixels
• One or more shooting parameters can be determined, in particular:
• the multimedia data is an image
• the multimedia data is acquired for the provision of at least two services, the characteristics of this image being the parameters for taking views which are automatically determined as a function of at least one of the two services and of the quantity of light when shooting, so, in particular, that in low light, the image is usable for at least one of the two services.
• This embodiment is more particularly suitable for using the image in maximum size and taking light into account.
• a 4,000,000 pixel sensor is considered, the invention however being applicable to any sensor size.
• the shooting parameters will thus have been automatically determined as a function of at least two uses of the image and of the quantity of light during the shooting to improve the quality of the image for at least one use.
• the amount of light is determined by the exposure control according to a known method.
• One or more shooting parameters can be determined, in particular,
• the exposure time can be fixed at 1/60 for sensitivities varying from ISO 100 to ISO 400, then increase beyond ISO 400, the sensitivity can vary between ISO 100 and ISO 400, the size of the raw image is fixed at 4,000,000 pixels in the example, the demosaicing method uses an interpolation to calculate the missing colors in each pixel and so, obtain a visible image of 4,000,000 pixels, the noise reduction parameters: we use a smaller neighborhood, for example 4 pixels, the sharpness parameters: we use a larger filter, for example 5x5.
• the exposure time can be fixed at 1/60 for a sensitivity varying from ISO 100 to 800, then increases beyond ISO 800, the sensitivity can vary between ISO 100 and 800, the size of the raw image is fixed at 4 times the number of pixels of use, 4,000,000 pixels in the example, the demosaicing method: we can simplify the demosaicing by the known method of super-position of 4 neighboring pixels, the noise reduction parameters: an average neighborhood is used, for example 64 pixels.
• the maximum value of the digital zoom for use in small size, the digital zoom is limited to the square root of (4,000 000 / 100,000), i.e. around 6, the exposure time can be fixed at 1/15 for a sensitivity varying from ISO 100 to 3200, then increase beyond ISO 3200, the sensitivity can vary between ISO 100 and 3200, the size of the raw image is fixed at 4 times the number of pixels of use, 400,000 pixels in the example, the demosaicing method: we can simplify the demosaicing by the known method of superposition of 4 neighboring pixels , the noise reduction parameters: we use a larger neighborhood, for example 256 pixels, the sharpness parameters: we use a smaller filter, for example 3x3.
• At least two multimedia data are acquired for the supply of at least two services, the characteristics of each multimedia data being adapted to the corresponding service.
• This embodiment is more particularly suited to the case where one wishes to be able to carry out a use in two different sizes, for example: [603] - small and standard: this case corresponds, for example, to services, for a mobile terminal , sending to a mobile and sending to an email / print / postcard. [604] - standard and maximum: this case corresponds, for example, for a camera, to services, on the one hand, standard printing or use on a computer and, on the other hand, enlargement. [605] Usually the image is acquired for the maximum size and then the image size is reduced.
• the shooting parameters of each image being adapted to each use in order to optimize the quality of the image during each use.
• the use of the smallest size will have an improved quality compared to the usual methods.
• [606] For example, if you want to use in standard size and use in small size, you can determine the shooting parameters for each shot as follows: [607] - Image for use in standard size: time exposure can be fixed at 1/60 for a sensitivity varying from ISO 100 to 800, then increase beyond ISO 800, the sensitivity can vary between ISO 100 and 800, the size of the raw image is fixed at 4 times the number of pixels in use, 4,000,000 pixels in the example, the demosaicing method: demosaicing can be simplified by the known method of superposing 4 neighboring pixels, the noise reduction parameters: an average neighborhood is used, for example 64 pixels.
• [608] - Image for use in small size the maximum value of the digital zoom: for use in small size, the digital zoom is limited to the square root of (4,000,000 / 100,000), or about 6, the time exposure can be set to 1/15 for a sensitivity varying from ISO 100 to 3200, then increase beyond ISO 3200, the sensitivity can vary between ISO 100 and 3200, the size of the raw image is fixed at 4 times the number of pixels of use, 400,000 pixels in the example, the demosaicing method: we can simplify the demosaicing by the known method of super-position of 4 neighboring pixels, the noise reduction parameters: we use a neighborhood larger for example 256 pixels, the sharpness parameters: we use a smaller filter, for example 3x3.
• FIG 11 illustrates very schematically, these provisions of the invention.
• the exposure time is automatically determined at 1/60 me second in order to minimize the risk of camera shake.
• the maximum exposure time is limited to 1/15 me of a second because on the screen of small dimension the blurring of camera shake is less sensitive.
• the characteristics of the photograph 202 are adapted: 4 times fewer pixels and greater noise reduction in order to make the photograph usable, even if the details are reduced.
• the shooting parameters can be adapted to the end use: [612] - the parameters optimized for observation on a device display screen not being, for example, the same as the optimized parameters for a enlargement, [613] - the parameters optimized for the observation of an image taken in low light on an impression not being the same as the parameters optimized for the observation of an image taken in stronger light on an impression .

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Human Computer Interaction (AREA)
• Telephonic Communication Services (AREA)
• Mobile Radio Communication Systems (AREA)
• Studio Devices (AREA)
• Facsimile Image Signal Circuits (AREA)
• Television Signal Processing For Recording (AREA)
• Data Exchanges In Wide-Area Networks (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=35064880

Family Applications (2)

Family Applications After (1)

Country Status (7)

Families Citing this family (27)

Family Cites Families (24)

• 2004
  • 2004-06-08 FR FR0451132A patent/FR2872317A1/fr active Pending
• 2005
  • 2005-06-08 US US11/628,712 patent/US20090017795A1/en not_active Abandoned
  • 2005-06-08 WO PCT/FR2005/050428 patent/WO2005125184A1/fr active Application Filing
  • 2005-06-08 KR KR1020077000476A patent/KR20070034051A/ko not_active Application Discontinuation
  • 2005-06-08 EP EP05776444A patent/EP1757155A2/de not_active Withdrawn
  • 2005-06-08 WO PCT/FR2005/050430 patent/WO2005125242A2/fr active Application Filing
  • 2005-06-08 JP JP2007526518A patent/JP2008502249A/ja active Pending
  • 2005-06-08 CN CNA2005800230958A patent/CN1985535A/zh active Pending
  • 2005-06-08 JP JP2007526519A patent/JP2008502250A/ja active Pending
  • 2005-06-08 EP EP05776418A patent/EP1757154A2/de not_active Withdrawn
  • 2005-06-08 WO PCT/FR2005/050429 patent/WO2005125099A2/fr active Application Filing
  • 2005-06-08 KR KR1020077000448A patent/KR20070034048A/ko not_active Application Discontinuation
  • 2005-06-08 CN CNA2005800230248A patent/CN1981555A/zh active Pending
  • 2005-06-08 US US11/628,987 patent/US20090116471A1/en not_active Abandoned

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events