FR2862467A1 - Mobile barcode reader includes image scanner and detector with communication module transmitted code after reading - Google Patents

Abstract

The mobile barcode reader includes sensor (110) scanning a two dimensional image, and a control (120) able to read a message contained within the image data. A memory (126) holds the message for transmission by a communication module (130). The mobile reader includes a matrix image sensor (110) arranged to transmit signals representing a two dimensional image, and a control (120) able to read a message contained within the image data. A memory (126) holds the message and a communication module (130) transmits the message. The control is configured to control the communication module in order to connect an address on a network depending on the contents of the message. The control carries out the decoding of a barcode, recognition of printed characters and/or recognition of manuscript characters. The control may also be capable of filing the message.

Description

METHOD AND DEVICE FOR READING AND COMMUNICATING 5

  The present invention relates to a method and a device for reading and communication. It applies, in particular, to the reading of bar codes and remote transmission of this code.

  The entry of information with a mobile phone or a personal digital assistant is tedious: the use of the keyboard whose each key corresponds to several characters imposes a high number of operations (choice of key, corresponding character selection and verification at the same time). screen for each character to enter) and does not allow a quick entry, on the one hand, and writing on a touch screen is a source of error and requires quite lengthy manipulations and verifications, on the other hand.

  The use of an extended keyboard allows faster input but suffers from 20 ergonomic problems and portability.

  The present invention aims to remedy these disadvantages.

  According to a first aspect, the present invention relates to a mobile device, characterized in that it comprises: a matrix image sensor adapted to transmit signals representative of a two-dimensional image, control means adapted to reading a message contained in representative signals transmitted by the image sensor, - means for storing said message and - communication means adapted to transmit said message.

  Thanks to these provisions, the user easily reads a message such as an address, a comment, an identification code and / or a network address by positioning the mobile device such that the image sensor captures the image. of the message.

  The input of the message is therefore both fast and reliable.

  According to particular features, the control means are adapted to control the communication means for connecting to an address on a network depending on the content of said message. Thanks to these provisions, the user can enter into communication with a telephone, a URL address or an e-mail address.

  According to particular features, the control means are adapted to perform a bar code decoding.

  With these provisions, the message can be provided in the form of bar codes, for example printed on a business card.

  According to particular characteristics, the control means are adapted to perform a print character recognition.

  Thanks to these provisions, the message can be provided in the form of a sequence of 10 printed characters, for example on a business card, an e-mail address, a fax number or on a fax or a printed electronic mail, a reservation number, a subscriber number.

  According to particular characteristics, the control means are adapted to perform a recognition of handwritten characters.

  With these provisions, the message can be provided in the form of a sequence of handwritten characters, for example in an address book.

  According to particular characteristics, the control means are adapted to associate a file with said message.

  With these provisions, the message can be associated with a digital photograph, a text file to be transmitted, for example in the form of mini-messages ("SMS") or email.

  According to particular features, the control means are adapted to perform a motion recognition of the mobile device, said movements being picked up by a succession of images taken by the image sensor.

  With these features, the message can be provided by manipulating the mobile device like a pen.

  According to a second aspect, the present invention aims a reading and communication method, characterized in that it comprises: a step of capturing two-dimensional matrix images; a step of reading a message contained in said images, - a step of storing said message and - a step of communicating said message.

  The advantages, aims and characteristics of this process being similar to those of the device briefly described above, they are not recalled here.

  Other advantages, aims and features of the present invention will emerge from the following description given for explanatory purposes and in no way limitative with reference to the appended drawings, in which: FIG. 1 represents a first embodiment of the device the present invention; FIG. 2 represents a first embodiment of the method that is the subject of the present invention; FIG. 3 represents a second embodiment of the method that is the subject of the present invention; FIG. 4 represents a third embodiment of the device that is the subject of the present invention and FIG. 5 represents a fourth embodiment of the device that is the subject of the present invention.

  Throughout the description, the following definitions are used: - barcode: image which contains coded information, for example one or two-dimensional barcode; - Mobile electronic device or device: a self-powered electronic device comprising a processor, for example a personal assistant (PDA for personal digital assistant) or a mobile phone; - network address: an address on an electronic network, for example a URL address (for uniform resource location), an email address (in English e-mail address), a telephone number; - Wireless communication: remote communication by wave transmission without hardware support, for example wireless.

  The mobile apparatus 100 comprises a matrix image sensor 110, a control means 120, a wireless communication means 130, an image display 140 and a selection means 150.

  The mobile device 100 is, for example, constituted of a mobile phone comprising a digital camera or a digital personal assistant comprising a digital camera, provided with a module for reading messages in images taken by said camera. digital photo and a controller programmed to implement the present invention.

  The control means 120 includes a program memory 122 which stores message reading software in image data provided by the array image sensor 110 and a data memory 126.

  The control means 120 consist, for example, of a microcontroller whose program memory keeps a program adapted to implement one of the succession of steps illustrated in FIGS. 2 to 5.

  The matrix image sensor 110 comprises, for example, a charge coupled device (CCD) image sensor placed behind a lens. It provides digital signals representative of the images that form on its surface, according to known techniques.

  The selection means 150 comprises, for example, a keyboard and / or a pointing device such as a touch screen, a mono or bidirectional navigation key. It allows a user of the mobile device to select functions to perform and / or data to enter.

  According to the variants, the control means comprise: a barcode decoding module; an optical character recognition module printed; an optical recognition module for handwritten characters; and / or a motion recognition module.

  In a general manner, according to the invention, the matrix image sensor sends representative image signals (video image) to the control means which comprise a message recognition module (for example one of the three modules indicated in the previous paragraph). This module decodes a message in the image, for example a network address and the control means causes the display of the message on the display. The user can choose to keep this message by using the keyboard or a touch screen. In this case, the control means causes the message to be stored in the data memory of the mobile device.

  Whether or not the user has chosen to keep the decoded message, the control means ask the user, by displaying a question on the display, whether he wishes to associate data with this message. If the user responds positively, he can choose to capture a new image or enter a complementary message to the keyboard or with the use of the touch screen and control means. If the user has chosen to memorize the decoded message, the control means associate, in memory, these data (image and / or complementary message) with the initially decoded message.

  Whether or not the user has chosen to keep the decoded message, if the message includes or refers to a network address, the control means ask the user if he wishes to connect to the network address displayed at the screen and represented by the decoded message. If the user chooses to connect, the control means cause the connection, via the wireless communication means, to transmit a message (for example a mini-SMS message, a data file or an electronic mail, possibly including complementary data, image and / or additional messages) or to speak to the party who uses a telephone number represented by the decoded message.

  FIG. 2 shows a step 200 of initialization of the mobile device, followed by a step 205 of selecting the message capture application in an image. During a step 210, the application displays, in real time, the video image taken by the array image sensor.

  During a step 215, the user places the mobile device so as to see clearly and completely the bar code in the displayed image. The mobile device decodes the message contained in the bar code in a succession of (for example) each image captured by the matrix image sensor and this message is automatically displayed on the display of the mobile device.

  As soon as the application has decoded the barcode present in an image, during a step 225, the network address represented by the barcode is displayed on the screen. During a step 230, the user is asked, by displaying a question on the screen, whether he wants to connect immediately to the network address or if he wants to store the network address for a subsequent use.

  If the user chooses an immediate connection, during a step 235, it is determined whether the decoded message includes a network address consisting of an e-mail address or a telephone number. For example, a succession of digits with no "@" sign is considered a telephone number and a succession of characters with the "@" sign is considered an email address. If the decoded message does not include a network address, the user is asked to enter a network address and, once entered, it is determined whether this network address is an e-mail address or a telephone number.

  If the network address represents an e-mail address, during a step 240, an entry screen for an e-mail whose destination is the decoded network address is opened, during a step 245. user enters a message, data in memory and / or an image from the image sensor, during a step 250, it validates the message entered and in a step 255, the e-mail is transmitted to the decoded network address.

  If the network address is a telephone number, during a step 260, a mini-message entry screen (SMS) is opened in which the user can also choose to immediately call the telephone number decoded. During a step 265, it is determined whether the user has chosen the immediate call of the telephone number. If yes, during a step 270, this call is made according to known techniques. If the user does not select the immediate call, during a step 275, the user enters a message, data in memory and / or an image from the image sensor, during a step 280 , it validates the message entered and in a step 285, the mini-message is transmitted to the decoded network address.

  If, during step 230, the user chooses to store the decoded message (for example the network address), during a step 290, the user optionally enters data to be associated and / or takes the data. minus a photo to associate with the decoded message. When the user validates this data or if he has chosen not to associate additional data, during a step 295, the message and any additional data are stored in the data memory.

  Thus, the user can associate a picture of a person with his telephone number, his name, the data of his business card, or a picture of a product with his references or with a reference of place of sale, commercial stand ...

  As a variant, the message contained in the barcode refers to a database to which the user can access to extract numerous coordinates corresponding to this message: e-mail addresses, landline telephone numbers, mobile numbers, In this case, during step 225, this database is used, the information available is extracted and displayed as indicated above.

  Alternatively, during step 215, the user places the mobile device so as to clearly and completely see the bar code in the displayed image and then, before step 225, in a step 220, the user selects an image and the mobile device decodes the message contained in the bar code of the selected image and this message is automatically displayed on the display of the mobile device.

  FIG. 3 shows a step 300 for initializing the mobile device and then a step 305 for selecting the message capture application in an image. During a step 310, the application displays, in real time, the video image taken by the array image sensor.

  During a step 315, the user places the mobile device so as to see clearly and completely the message printed in the displayed image. The term "printed" here means both messages consisting of printed characters printed on paper or other physical media that messages displayed on screens, for example computer. The user selects an image during a step 320 and the application decodes the message contained in the selected image. As soon as the application has recognized a message present in the selected image, during a step 325, the recognized message is displayed on the screen. During a step 330, the user is asked, by displaying a question on the screen, whether he wants to connect immediately to a network address present in the recognized message or if he wants to store the message. recognized for later use.

  If the user chooses an immediate connection, during a step 335, it is determined whether the recognized message includes a network address consisting of an e-mail address or a telephone number. For example, a succession of digits with no "@" sign is considered a telephone number and a succession of characters with the "@" sign is considered an email address. If the recognized message does not include a network address, the user is asked to enter a network address and, once entered, it is determined whether this network address is an e-mail address or a telephone number.

  If the network address represents an e-mail address, during a step 340, an entry screen for an e-mail whose destination is the recognized network address is opened, during a step 345. user enters a message, data in memory and / or an image from the image sensor, during a step 350, it validates the message entered and in a step 355, the e-mail is transmitted to the recognized network address.

  If the network address is a telephone number, during a step 360, a screen for entering a mini-message (SMS) is opened in which the user can also choose to immediately call the telephone number decoded. During a step 365, it is determined whether the user has chosen the immediate call of the telephone number. If so, during a step 370, this call is made according to known techniques. If the user does not select the immediate call, during a step 375, the user enters a message, data in memory and / or an image from the image sensor, during a step 380 it validates the message entered and in a step 385, the message is transmitted to the recognized network address.

  If, during step 330, the user chooses to store the decoded message (for example the network address), during a step 390, the user optionally enters data to be associated and / or takes the data. minus a photo to associate with the decoded message. When the user validates this data or if he has chosen not to associate additional data, during a step 395, the message and any additional data are stored in the data memory.

  Thus, the user can associate a picture of a person with his telephone number, his name, the data of his business card, or a picture of a product with his references or with a reference of place of sale, commercial stand ...

  In a variant, the recognized message refers to a database that the user can access to extract numerous coordinates corresponding to this message: e-mail addresses, home, mobile, work, address, home phone numbers In this case, in the course of step 325, this database is used, the information available is extracted and displayed as indicated above.

  Alternatively, step 320 is eliminated and the mobile device decodes the message contained in the bar code in each image input by the array image sensor and this message is automatically displayed on the display of the mobile device.

  By implementing the second embodiment of the method that is the subject of the present invention illustrated in FIG. 3, the user can capture, transmit and / or memorize data read on a business card, an advertisement, a book, an invoice, a subscription contract or a web page, for example, and associate comments or additional images.

  For example, the user can enter a SMS mini-message with a computer, thus with the ease of use of an alphanumeric keyboard, then enter it, by optical character recognition, to transmit it to a recipient whose number of phone has been recognized previously.

  FIG. 4 shows a step 400 of initialization of the mobile device, followed by a step 405 of selecting the message capture application in an image. During a step 410, the application displays, in real time, the video image taken by the array image sensor.

  During a step 415, the user places the mobile device so as to see clearly and entirely the handwritten message in the displayed image. The user selects an image during a step 420 and the application determines the message contained in the selected image. As soon as the application has recognized a message present in the selected image, during a step 425, the recognized message is displayed on the screen. During a step 430, the user is asked, by displaying a question on the screen, whether he wishes to immediately connect to a network address present in the recognized message or whether he wishes to store the message recognized for later use.

  If the user chooses an immediate connection, during a step 435, it is determined whether the recognized message includes a network address consisting of an e-mail address or a telephone number. For example, a succession of digits with no "@" sign is considered a telephone number and a succession of characters with the "@" sign is considered an email address. If the recognized message does not include a network address, the user is asked to enter a network address and, once entered, it is determined whether this network address is an e-mail address or a telephone number.

  If the network address represents an e-mail address, during a step 440, an entry screen for an e-mail is opened, the addressee of which is the recognized network address, and the message is the message recognized by the e-mail address. except for the network address, during a step 445, the user enters a message complement, data in memory and / or an image from the image sensor, during a step 450, it is valid the message entered and during a step 455, the e-mail is transmitted to the recognized network address.

  If the network address is a telephone number, during a step 460, a screen for entering a mini-message (SMS) is opened in which the user can also choose to immediately call the telephone number decoded, the SMS mini-message containing the recognized message except the phone number.

  During a step 465, it is determined whether the user has chosen the immediate call of the telephone number. If so, during a step 470, this call is made according to known techniques. If the user does not select the immediate call, during a step 475, the user enters a message complement, data in memory and / or an image from the image sensor, during a call. step 480, it validates the message entered and during a step 485, the mini-message is transmitted to the recognized network address.

  If, during the step 430, the user chooses to store the decoded message (for example the network address), during a step 490, the user optionally enters data to be associated and / or takes the minus a photo to associate with the decoded message. When the user validates this data or if he has chosen not to associate additional data, during a step 495, the message and any additional data are stored in the data memory.

  Thus, the user can quickly create a mini-message or an email, by handwriting and recognition of this writing, and possibly associate a photo.

  In a variant, step 420 is eliminated and the mobile device decodes the message contained in the barcode in each image input by the matrix image sensor and this message is automatically displayed on the display of the mobile device.

  By implementing the third embodiment of the method that is the subject of the present invention illustrated in FIG. 4, the user can easily create electronic mails and / or SMS mini-messages and associate comments or complementary images with them.

  FIG. 5 shows a step 500 of initialization of the mobile device, then a step 505 of selecting the message capture application in an image. During a step 510, the application processes, in real time, the video image taken by the matrix image sensor to determine the movement of the mobile device relative to its environment. For example, the user positions the mobile device such that a black spot on a white background is in the optical field of the matrix image sensor and, by determining the movements of this task from one image to the next, the movements made by the mobile device are determined.

  During a step 515, the user moves the mobile device so as to write, by the movement of the mobile device, a succession of handwritten characters, in a plane, by separating the device of this plane between two characters.

  As soon as the application has recognized a message represented by all the movements of the mobile device, during a step 525, the recognized message is displayed on the screen. During a step 530, the user is asked, by displaying a question on the screen, whether he wishes to immediately connect to a network address present in the recognized message or if he wishes to store the message. recognized for later use.

  If the user chooses an immediate connection, during a step 535, it is determined whether the recognized message includes a network address consisting of an e-mail address or a telephone number. For example, a succession of digits with no "@" sign is considered a telephone number and a succession of characters with the "@" sign is considered an email address. If the recognized message does not include a network address, the user is asked to enter a network address and, once entered, it is determined whether this network address is an e-mail address or a telephone number.

  If the network address represents an e-mail address, during a step 540, an entry screen for an e-mail is opened, the addressee of which is the recognized network address, and the message is the message recognized by the e-mail address. exception of the network address, during a step 545, the user enters a message complement, data in memory and / or an image from the image sensor, during a step 550, it is valid the message entered and in a step 555, the e-mail is transmitted to the recognized network address.

  If the network address is a telephone number, during a step 560, a screen for entering a mini-message (SMS) is opened in which the user can also choose to immediately call the telephone number decoded, the SMS mini-message containing the recognized message except the phone number.

  During a step 565, it is determined whether the user has chosen the immediate call of the telephone number. If yes, during a step 570, this call is made according to known techniques. If the user does not select the immediate call, during a step 575, the user enters a message complement, data in memory and / or an image from the image sensor, during a call. step 580, it validates the message entered and in a step 585, the mini-message is transmitted to the recognized network address.

  If, during step 530, the user chooses to store the decoded message (for example the network address), during a step 590, the user optionally enters data to associate and / or takes at least a photo to associate with the decoded message. When the user validates these data or if he has chosen not to associate additional data, during a step 595, the message and any additional data are stored in the data memory.

  Thus, the user can quickly create a mini-message or an electronic mail, by handwriting by manipulating the mobile device as a pen, then recognition of this writing, and possibly associate a photo.

  By implementing the fourth embodiment of the method that is the subject of the present invention illustrated in FIG. 5, the user can easily create electronic mails and / or SMS mini-messages and associate comments or complementary images with them.

Claims (8)

  1 - mobile device (100), characterized in that it comprises: - a matrix image sensor (110) adapted to transmit signals representative of a two-dimensional image, - control means (120) adapted to reading a message contained in representative signals transmitted by the image sensor, - means for storing (126) said message and - communication means (130) adapted to transmit said message.   2 - Device according to claim 1, characterized in that the control means (120) are adapted to control the communication means (130) for connecting to an address on a network depending on the content of said message.   3 - Device according to any one of claims 1 or 2, characterized in that the control means (120) are adapted to carry out a barcode decoding.   4 - Device according to any one of claims 1 to 3, characterized in that the control means (120) are adapted to carry out a recognition of printed characters.   - Device according to any one of claims 1 to 4, characterized in that the control means (120) are adapted to carry out a recognition of handwritten characters.   6 - Device according to any one of claims 1 to 5, characterized in that the control means (120) are adapted to associate a file audit message.   7 - Device according to any one of claims 1 to 4, characterized in that the control means (120) are adapted to perform a motion recognition of the mobile device, said movements being picked up by a succession of images taken by the image sensor (110).   8 - Reading and communication method, characterized in that it comprises: - a step of capturing two-dimensional matrix images (210, 215, 220), - a step of reading a message contained in said images (220, 225), a step of storing said message (295) and a step of communicating said message (255, 270, 285).   9 - Process according to claim 8, characterized in that the step of communicating said message comprises a step of connection to an address on a network, said address depending on the content of said message.   Method according to any one of claims 8 or 9, characterized in that it comprises a step of associating a file with said message.