WO2013127449A1 - Method, apparatus and computer program for associating pictures related to an event - Google Patents

Method, apparatus and computer program for associating pictures related to an event Download PDF

Info

Publication number
WO2013127449A1
WO2013127449A1 PCT/EP2012/053445 EP2012053445W WO2013127449A1 WO 2013127449 A1 WO2013127449 A1 WO 2013127449A1 EP 2012053445 W EP2012053445 W EP 2012053445W WO 2013127449 A1 WO2013127449 A1 WO 2013127449A1
Authority
WO
WIPO (PCT)
Prior art keywords
barcode
event
picture
pictures
data processing
Prior art date
Application number
PCT/EP2012/053445
Other languages
French (fr)
Inventor
Wolfgang Müller
Thomas Hieber
Michael KRELL
Phillip MERENSKY
Original Assignee
Lirdy UG (haftungsbeschränkt)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lirdy UG (haftungsbeschränkt) filed Critical Lirdy UG (haftungsbeschränkt)
Priority to PCT/EP2012/053445 priority Critical patent/WO2013127449A1/en
Publication of WO2013127449A1 publication Critical patent/WO2013127449A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Definitions

  • the invention relates to a method, apparatus and computer program for associating pictures on an event basis.
  • the sending via email to sharing partners necessitates the definition of all destination addresses of the sharing partners.
  • the data package comprising all shared pictures has to be sent to each sharing partner even if the sharing partner is not interested in the pictures.
  • the inboxes of the chosen sharing partners are not always capable of receiving such big amounts of data needed for sending photos and videos at all or at least not in one email. Therefore, for some sharing partner the sending process does not work and has to be repeated.
  • the sharing by email is therefore very time consuming and necessitates the sending of a huge amount of data, even if some of the sharing partners are not interested in the photos.
  • WO 2004/100042 proposes to upload a group of photos identified by a user on a server.
  • the server generates an html email, which does not contain the photos itself, but only the source paths pointing to an address of photos stored on the server. Therefore, the recipient of this email receives only small sized emails, has not to register on a photosharing application and can still access all the photos.
  • this process needs still the definition of the email addresses of all the recipients or if they are stored on the server, the step of choosing the persons of interest.
  • a common alternative solution of sharing photos is the use of photosharing applications. Those work all by the basic principle that a user opens an account and uploads pictures to this account. In general, pictures are organized by events by the user.
  • the user creates folders containing the group of photos related to said event.
  • the pictures on the account of the user are shared by different concepts. Either a number of persons are selectively invited to watch the photos for each event or a group of persons defined only once can access the pictures of all events created. Again the first solution has the disadvantage that all the recipients have to be selected manually.
  • the second solution may create some privacy issues, since pictures are uploaded which should only be seen by a smaller group of people than originally defined. In addition, these processes share the general problem that also the people who want to watch the pictures are forced to create an account on the photosharing application.
  • Method to associate pictures related to an event comprising the following steps: storing on a data processing apparatus an event identifier for identifying pictures related to said event; receiving at least one picture; detecting a barcode within the at least one received picture; reading out the barcode information from said barcode, wherein the barcode
  • the information comprises an event identifier; comparing the event identifier comprised in the barcode information with the event identifier stored on the data processing apparatus; associating the at least one picture received with the identifier stored on the data processing apparatus on the basis of the comparison result.
  • Method for providing authorization means for associating pictures to an event comprising the following steps: creating an event identifier for identifying pictures related to said event on a data processing apparatus or on an electronic apparatus; creating a barcode comprising barcode information, wherein the barcode information comprises said event identifier; displaying the barcode for capturing a photo of the barcode as authorization means.
  • storage means configure to store an event identifier for identifying pictures related to said event; communication means configured to receive at least one picture; detecting means configured to detect a barcode within the at least one received picture; reading means
  • barcode information configured to read out barcode information from said barcode, wherein the barcode information comprises an event identifier; comparing means configured to compare the event identifier comprised in the barcode information with the event identifier stored in said storage means ; and associating means configured to associate the at least one picture received with the identifier stored on the data processing apparatus on the basis of the comparison result of the comparison means.
  • the invention refers also to a computer program for executing the above mentioned methods on a processor and a carrier storing such a computer program code.
  • the invention has the advantage that the authorization of sharing pictures is contained in the picture data itself and thus an
  • the dependent claims refer to preferred embodiments of the invention.
  • the event identifier stored on the data processing apparatus is created by creating a random character string or a random number. This has the advantage that events can even be created on an electronic apparatus without any internet connection. The event identifier is sent to the data processing apparatus after the
  • connection to the data processing apparatus has been established and is stored on the data processing apparatus.
  • the barcode information comprises time information.
  • the time information of each picture of the at least one picture received can be corrected on the basis of the difference between the time information of the picture comprising the barcode and the time information of the barcode information. This has the advantage that the timestamp of all pictures uploaded can be corrected. Consequently, even pictures from different users with wrong time configurations on their devices can be displayed in the correct timely order.
  • the barcode information comprises authenticity information.
  • the authenticity of the barcode is checked by combining a private event identifier with the time information of the barcode information in a predetermined way to a combined information, by encrypting this combined information in a predetermined way and by comparing the encryption result to the authenticity information, wherein the private event identifier is stored in the data processing apparatus in addition to the event identifier.
  • Time information from the barcode is needed for comparing the combined encrypted information from the barcode with the combined information comprising the private key from the server and the time information from the barcode. This offers a very simple and trustworthy way to check if a third person might have corrupted the barcode.
  • barcode information comprising the event identifier stored on said data processing apparatus is created, a barcode containing the barcode information is created and the created barcode is displayed. This is a very easy way for a user to control who might get the permission to share pictures with him. He shows the displayed barcode only to those persons, with whom he wants to share photos at the
  • the barcode is "given " to one person of said group by letting him take a picture of the displayed barcode by the use of a picture capturing apparatus and detecting then the barcode from this picture as explained above.
  • the event identifier comprised in the barcode information read out from the detected barcode identifies another event than the one stored in the data processing apparatus, i.e. they are not the same. However, they are related to each other, because one of the events is a subevent. Consequently, a user can create whole events himself, but associating all pictures of his event to a related parent event. [0022] In one embodiment, further pictures associated with the event identifier stored on the data processing apparatus are displayed
  • the present invention provides very easy means to access further pictures related to one event only by uploading one picture comprising the barcode.
  • the step of uploading pictures and watching further pictures is done with the same step. This is a huge step forward for the process of sharing photos and is dramatically reducing the burden of sharing photos of the state of the art.
  • Fig. 1 shows an embodiment of the system according to the invention
  • Fig. 2 shows a method according to the invention
  • Fig. 3A, B show the step of uploading pictures on a server
  • Fig. 4 shows the step of displaying all pictures associated with the event.
  • the invention refers to a method, computer program or apparatus for associating pictures to an event.
  • Pictures in the sense of the invention can be all kind of optical reproduction of a moment in the physical reality. This includes especially photos (still picture) and videos (moving picture) taken by any picture capturing apparatus preferably by a photo capturing apparatus or video capturing apparatus, even more preferably by a digital photo or video capturing device, but also e.g. by a digital scanning apparatus.
  • the picture is a digital picture.
  • each picture is stored in an individual file, however, the invention is not restricted thereto and it is also possible to merge a number of picture files together to one file.
  • a photo and a video as picture in the sense of this invention distinguishes to further pictures by being pictures using in the picture capturing technique the projection of an image on a picture capturing projection plane preferably by the use of a hole.
  • photos and videos include all files produced by digital photo/video apparatuses, but also files produced by scanning photos/videos produced in an analogue way, thus to all photos/videos comprising in their production process at least once the step of projecting an image on a projection plane.
  • the invention is not restricted to photos or videos, but might be.
  • the invention does further preferably refer to all pictures containing at least one photo or video element being produced as a photo or video as described above.
  • the following description of the invention uses photos as exemplary picture according to the invention. It is obvious that the invention can be carried out with any other picture like for example a video.
  • barcode in the sense of this invention refers to one- dimensional barcodes which actually contain a series of bars.
  • a barcode refers also and preferably to two and three-dimensional barcodes displayed in a picture, like for example QR-codes.
  • Two dimensional barcodes are often also called matrix barcodes. Even if two and three dimensional codes do not actually show bars as in the sense of a one dimensional barcode, they are still called barcode. Therefore, the scope of the invention is not restricted to one dimensional codes which actually show bars, but comprises also the use of two and three dimensional codes as barcodes. Most preferably a QR-code is used as a barcode according to the invention.
  • Fig. 1 shows a system according to the invention.
  • the system comprises a server 1 as data processing apparatus according to the claims and an electronic apparatus 2 according to the claims.
  • the system might comprise in addition a picture capturing device 3.
  • the server 1 is connected to the electronic apparatus 2 by a communication connection 4 for transferring pictures.
  • the communication connection 4 is preferably an internet connection, but is not restricted thereto.
  • the communication connection 6 might be cable based like a phone wire, DSL connection etc.
  • a wireless connection such as a mobile telecommunication network like mobile phone connection (UMTS, GPRS, EDGE, LTE, etc.), a wireless local area network (WLAN) connection, or also a closed wireless network like e.g. a police radio network.
  • UMTS mobile phone connection
  • GPRS global positioning reference
  • EDGE wireless fidelity
  • LTE Long Term Evolution
  • WLAN wireless local area network
  • closed wireless network e.g. a police radio network.
  • server 1 is locally accessible by the users of the electronic apparatus 2, even short range communication techniques, such as near field
  • NFC Bluetooth
  • Bluetooth are further possible communication connections. Also combinations thereof are possible.
  • the electronic apparatus 2 comprises a communication means 21 (communicator) for establishing a communication connection 4 with the Server 1.
  • the communication means 21 may not only be able to perform the communication with the server 1, but also with other electronic apparatuses in order to exchange pictures or other information. Therefore, the communication means 21 may support additionally to the
  • the electronic apparatus 2 comprises further a picture input means 22 (picture inputter) connected to the communication means 21 for
  • the picture input means 22 is preferably a picture capturing apparatus (picture capturer) for capturing pictures, especially photos and videos.
  • An example for a preferred electronic apparatus 2 is a smartphone whose mobile phone communication means and/or Wireless Local Area Network (WLAN) means corresponds to the communication means 21 and the picture capturing apparatus of the smartphone corresponds to the picture input means 22.
  • the picture input means 22 is only an interface for receiving pictures.
  • the electronic apparatus 2 might be a computer having access to the internet and the picture input means might be any interface like USB, Bluetooth, Firewire, etc. to transfer pictures to the computer.
  • Pictures might be taken by a digital picture capturing device 3, like a digital photo or video camera.
  • the electronic apparatus 2 comprises further a storage means 25 for storing the pictures received by the picture input means 22 or by the communication means 21.
  • the electronic apparatus 2 comprises also a display 23 for displaying pictures received by the picture input means 22, the communication means 21 or pictures stored in the storage means 25.
  • the electronic apparatus 2 comprises input means (inputter) 24 for inputting user requests to the electronic apparatus 2.
  • a keyboard, mouse, a group of buttons, a scrolling device, a combination of arrows are only examples of such input means 24.
  • the user requests can be directed to the electronic apparatus 2 itself, for example to control the picture input means 22 to capture a picture, or can be directed to the server 1.
  • Fig. 1 shows only one exemplary electronic apparatus 2, it is obvious to a person skilled in the art that the system can comprise a plurality of electronic apparatuses like the electronic apparatus 2.
  • the server 1 comprises a communication means 1 1
  • the communication means 1 1 is also configured to receive requests from the electronic apparatus 2.
  • the communication means 1 1 has an interface for uploading pictures, wherein the interface is publicly available for uploading pictures, e.g. over the internet.
  • the communication means 1 1 is connected with a control means 14 (controller) for sending the request from the electronic apparatus 2 to the control means 14.
  • the communication means 1 1 is further connected with a storage means 15 (storage) for storing pictures, e.g. the pictures received via the communication means 1 1.
  • the communication means 1 1 is further connected with a detection means 12 (detector) for detecting a barcode in the received pictures.
  • the detection means 12 analyses the optical data of the picture and detects the pattern in this data of the barcode by the use of pattern recognition methods.
  • the barcode can be detected in the background or foreground of the picture. If a barcode is detected in one of the pictures, the barcode information contained in the barcode is read out by a reading means 13 (reader).
  • the reading means 13 is further connected to the control means 14, which analyses the barcode information and associates the pictures received on the basis of the barcode information to an event.
  • the barcode information will be described in detail later.
  • the control means 14 is also configured to create barcode information for a new event.
  • the association of pictures stored in the storage means 15 to events is stored in a database 16, wherein the events are identified by event identifiers (described later).
  • a barcode creation means 17 for creating a barcode containing a barcode information created by the control means 14 upon request from the electronic apparatus 2.
  • the method according to the invention will be described with reference to Fig. 2.
  • the party is visited by a number of visitors which all take some pictures at the party.
  • visitors will be called users, when they upload their pictures to the server 1.
  • a first step S1 a first user has to register on the server 1 by giving identification data like his email address, name, postal address, etc. to the server 1. This registration step S1 is performed by the use of the electronic apparatus 2.
  • the first user uses the input means 24 to open a browser in the display means 23 and connect with the server 1 by typing the URL of the server 1 in the browser and performing the registration steps.
  • the registration may also be done by an application stored on the electronic apparatus 2. The registration has to be done only once. Afterwards, the first user performs an identification step, which is not shown in the figures. However, the registration step S1 and/or
  • identification step is not essential for the invention and can be omitted.
  • a second step S2 the first user creates an event.
  • the event is created by sending a request for creating an event from the electronic apparatus 2 to the server 1.
  • the control means 14 creates a public event key as an event identifier.
  • the control means 14 creates in step S2 also a private event key as a second independent identifier for the created event and stores the private event key together with the public event key in the database 16.
  • step S2 could also be performed locally on the electronic apparatus 2 and the public and optionally also private event key are sent to the server 1. Therefore, the public and optional private event key can be created even without a connection to the server 1. In this case, the public and maybe private event key are sent to server 1 later, when there is a connection to the server 1.
  • step S3 the public event key related to the registration of the first user is stored in the database 16.
  • the public event key is preferably stored in association with the registration data of the first user.
  • a private event key is created in the second step S2, the private event key is stored in association with the public event key in the database 16.
  • An association can be achieved by any association means. For example a folder comprising all the pictures of one event can be named as the public event key.
  • the barcode information consists of six different parameters.
  • the public event key is essential for the invention and has to be contained in the barcode information.
  • the other parameters are preferably also contained, but the invention is not restricted to them.
  • the first parameter is an address pointing to the storage means 15 of server 1 , i.e. on the place in the server 1 where the pictures are stored.
  • the second parameter is the public event key.
  • the third parameter is a parent public event key which will be described in detail later. In this case, there is no parent event and the third parameter is set to a value representing that there is no parent event, e.g. 0.
  • the fourth parameter is an authenticity parameter.
  • the private event key is mixed, e.g. by a connection in series, with the sixth parameter.
  • the mixed private event key and the sixth parameter are encrypted.
  • a one way encryption is used, e.g. SHA.
  • the encrypted mixed private event key and sixth parameter correspond to authenticity information stored in the fourth parameter.
  • the fifth parameter is a Session ID of the smartphone or the browser.
  • the sixth parameter is a timestamp as time information according to the claims.
  • the timestamp represents the present time or the present date and time.
  • the date and time are represented by one number.
  • the timestamp resolution is at least exact as seconds, preferably more exact than 10 ⁇ -1 , 10 ⁇ -2 or 10-3 seconds as used for the fourth parameter. All these parameters are mixed together, e.g. by a concatenation, and are translated into a QR-code as a two-dimensional barcode.
  • the public event key, the private event key and the barcode information and the barcode are created in one embodiment in the server 1 and the created barcode is sent back to the electronic apparatus 2 which requested to create an event.
  • the public event key, the private event key and the barcode information and the barcode can also be created in the electronic apparatus 2.
  • both are sent to the server 1. If there is no internet connection, sending keys to server 1 can be delayed till the next time apparatus 2 has a communication connection to the server 1. Consequently, a smartphone can store an application for creating the barcode with all necessary parameters and for sending the public and private event key to the server 1 , when there is an internet connection the next time.
  • the public event key is preferably a random character string, e.g. a random number or a chain of characters.
  • the chain of characters in the sense of this invention is a character string comprising at least one character not being a number.
  • the random character string e.g. the chain of characters or the random number, is so long that the probability that two events are created with the same random string identification is very small , preferably below 10 ⁇ -6, 10 ⁇ -7, 10 ⁇ -8 or 10 ⁇ -9.
  • a random number with a length of 64 Bits as a random character string is used as public event key.
  • the public event key is preferably equal or longer than 32 Bit, preferably equal or longer than 64 Bits.
  • the use of a random character string as public event key has the advantage that the public event key can be created at the electronic apparatus 2, even when there is no connection to the server 2.
  • the private event key is also a random
  • character string e.g. a random number, which is longer than the public event key, preferably longer by a factor of two.
  • the private event key is used for checking the authenticity of the barcode, i.e. for checking that the barcode is not corrupted by someone, as it will be explained later.
  • the created barcode is displayed in the display means 24 in the electronic apparatus 2 in the fifth step S5.
  • the first user could show the other visitors of the party the displayed barcode, e.g. by showing them the display of his electronic apparatus 2 which displays the QR-code.
  • the first user could print the barcode and attach it at the party location. Consequently, each user who wants to share his photos can take a picture of said printed barcode. If the user forgot to take a photo of the barcode, he could search for a photo containing the barcode in the background. However, it is preferred that the barcode is
  • step S12 it is desired that the time when the photo containing the barcode is taken is stored in the barcode itself. Therefore, the barcode information is renewed after a predetermined time period. At each point in time, the barcode information contains a renewed sixth and fourth parameter, because the fields comprise an actualized time. The new barcode information is translated into a new barcode and displayed after the elapse of each predetermined time period. Therefore, the time when the picture was taken can be determined with a resolution of the predetermined time period.
  • the predetermined time period should be shorter than 10 seconds, preferably shorter than 5 seconds.
  • the renewal of the displayed barcode at each predetermined point in time has the advantage that the present time is stored in the barcode.
  • the barcode can be displayed electronically close to the stage, such that all visitors take a picture of the barcode, when they take a picture of the stage. Therefore, all pictures taken of the stage automatically contain an identifier for the event, here the concert, and the information of the time.
  • a second user who is one of the visitors could make a photo of this barcode with his digital camera.
  • the barcode could be transferred by any other means to another electronic apparatus 2. Especially, the transfer by any wireless short range
  • the barcode is stored in a picture file like a jpg. or in any file format suitable to store the barcode.
  • This file is then sent to the other electronic apparatus.
  • this file is stored as a photo with photos taken by said receiving electronic apparatus.
  • the second user continues to take photos at the party and later when he is at home, the second user will probably load the photos taken at the party to his computer and store them locally on his computer.
  • the computer is the electronic apparatus 2 of the second user.
  • the second user in a seventh step S7 has only to upload the photos taken at the party including the photo with the QR-code. No additional identification or registration step is needed.
  • the second user can still identify himself and associate the pictures uploaded with his user account, but the identification or registration step is not obligatory anymore and users without a user account can share their photos as well.
  • the upload can be done for example by opening an internet page on the server 1. Fig.
  • FIG. 3A shows an exemplary and simplified browser window 5 comprising an area 51 for uploading pictures.
  • the area 51 can e.g. be equal to the browser window 5.
  • photos to be uploaded are identified and moved by drag and drop to the area 51.
  • the photos dropped are automatically uploaded to the server 1.
  • Fig. 3B shows the same window 5 after dropping the identified photos 61 , 62 and 63 in area 51.
  • reproduced photo 61 shows a QR-code 7.
  • three photos were identified.
  • the invention is not restricted thereto.
  • Each number of photos one, two, three, four etc. can be uploaded to the server. The upload may be initiated by a button or can be done automatically when the identified photos are dropped on area 51.
  • the at least one picture 61, 62, 63 uploaded and received at the data processing apparatus refers to all pictures uploaded in the same state of connection to the electronic apparatus.
  • the state of connection may be determined by the IP address, the IMEI of the electronic apparatus or an identifier for the connection itself.
  • the IP address and the IMEI may be combined with further
  • the state of the connection might be identified by a session identifier.
  • the at least one uploaded picture refers to all pictures uploaded in one upload action, wherein one upload action may be defined as all pictures uploaded by the same state of connection in a predetermined period of time.
  • the electronic apparatus 2 may have an application, which uploads the identified photos, when they are dropped on an area of the display related to said application. If the image capturing means of the second user corresponds to the picture input means 22 of the electronic apparatus 2, the electronic apparatus 2 might store a program which might automatically upload the photo with the QR- code 7 and upload each taken photo after the server 1 confirmed the authenticity of the QR-code 7 and associates the QR-code 7 with an event in the database 16.
  • the server 1 receives the photos in the communication means 1 1 and sends them to the storage means 15 and the detection means 12. [0041]
  • the server 1 detects in an eighth step S8 in the detecting means 12 the QR-code in one of the received photos.
  • step S9 the barcode information is read out from the QR-code in the photo received.
  • the barcode information is sent to the control means 14. Steps S8 and S9 can also be performed in the electronic apparatus 2. Then, the barcode information can be sent directly to the server 1.
  • step S10 the event related to the second parameter, i.e. the public event key, is looked up in the database 16. This is done by comparing the public event key contained in the second parameter with the public keys contained in the database 16. If there is one public event key in the database 16 which is equal to the public event key in the second
  • an authenticity check step S1 1 is performed.
  • the combined information is encrypted by the same encryption mechanism as in S4.
  • the result is compared with the fourth parameter of the barcode information. If this result is equal to the fourth parameter, the barcode was not corrupted with a very high probability and the method according to the invention is continued. Otherwise, the process is
  • the combination of the private event key can be performed with any of the other parameters different from the
  • step S4 the authenticity information in step S4 has to be created by combining the private event key with the same other parameter.
  • this parameter is the time information. [0044] In step S12, the time, stored as metadata in each photo
  • step S13 the second user is now authorized to access the event related to the public event key.
  • to access the event means that the second user is allowed to store the uploaded pictures together with the event. In addition, he might change or remove the pictures uploaded. He might further be allowed to upload further pictures which are automatically stored with said event. The authorization may be restricted to the connection of the upload and to a predetermined authorization time period.
  • to access the event means that the further pictures related to said event are displayed in addition to the photos already uploaded.
  • Fig. 4 shows the window 5, wherein now also further pictures 71 , 72 and 73 are displayed. In this example, the further pictures 71 , 72 and 73 are displayed with a grey shadow in order to distinguish the further pictures from the pictures uploaded by the second user.
  • to access the event means to download further pictures being related to said event.
  • to access the event means to change or remove further pictures stored in association with the event. All possible combinations of the first to fourth embodiment are possible.
  • the server offers all possibilities of access as defined in embodiments one to four and the first user defines which photos are accessible by the second and other users.
  • the first user can configure by which way of access of the first to fourth embodiment all or each accessible photos are accessible. In one embodiment, all photos stored related to said event are made accessible to the second and other users.
  • the first user Since the first user has a choice to decide to whom he shows the barcode, an effective and very simple privacy control is performed.
  • Each person having a photo of the barcode can show the photo with the barcode to a third user who can photograph and access the photos of all users being in possession of the barcode and having uploaded there photos. Therefore, the authorization for accessing and exchanging photos can be distributed like written invitation. Instead of sending the invitations by post or giving them to somebody, a picture with the barcode is shown and photographed or the picture of the barcode is sent to somebody.
  • the huge advantage of the method is that the authorization is contained in one of the pictures itself and no additional information like an internet address, an email address, a log in, a password or similar is needed.
  • the second user himself can show the photo of the barcode to a third user at the party.
  • the third user can also upload his photos which are also associated with the event (or a subevent generated by the second user, generation of subevents can be transparent to the user, as described below) in the same way as for the second user. Therefore, it becomes very easy to share and exchange photos between all guests of the party.
  • a fourth user may have a smartphone as electronic apparatus 2.
  • the electronic apparatus 2 has an application, which directly detects that a photo contains a barcode with a public key.
  • the fourth user takes a photo of the barcode displayed by the digital camera of the second user for example, but would like to create his own event which however is related to the event of the first usersuch an event is called subevent.
  • the application reads out all six parameters and creates a new event with a new public and private event key and a new barcode as described in steps S2 and S4.
  • the public and private event keys are sent to the server 1 and stored therein as described in step S3.
  • a new barcode is created as described in step S4.
  • the new barcode contains the public event key, read out from the barcode displayed on the digital camera of the second user, in the third parameter.
  • the fourth parameter of this new barcode is created by mixing the fourth parameter of the old barcode with the timestamp of the new barcode and encrypting this information. The timestamp is also renewed. Consequently, a fifth user could again profit from the correction of time in the server 1.
  • the fourth user has more control about his own photos and photos associated to his event, because the fourth user has the same power of control like the first user to control the permission of further users taking a photo of the new barcode created by the fourth user.
  • the invention was described with reference to a photo sharing application. However, the invention can also be used for business wherein a large number of photos are taken and the association to single events is difficult.
  • a company managing a notable number of real estate objects and taking photos for each real estate object during the year could create an event for each real estate object.
  • a dependent of the company takes photos of one real estate he first takes a photo of the barcode maybe shown in the file to said real estate object.
  • the photos are arranged automatically with the real estate and with the photos of this real estate object taken some years ago.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Method to associate pictures related to an event comprising the following steps. First an event identifier for identifying pictures related to said event is stored on a data processing apparatus. At least one picture (61, 62, 63) is received. A barcode (7) is detected within the at least one received picture and barcode information is read out from said barcode (7), wherein the barcode information comprises an event identifier. The event identifier comprised in the barcode information is compared with the event identifier stored on the data processing apparatus. Finally the at least one picture received is associated with the identifier stored on the data processing apparatus on the basis of the comparison result.

Description

Method, apparatus and computer program for associating pictures related to an event
Field of the invention
[0001] The invention relates to a method, apparatus and computer program for associating pictures on an event basis.
Description of related art [0002] In the past, a photo was taken by analogue photo cameras and the printing of the photos was expensive. Therefore, the number of photos taken was limited. In recent years, digital cameras became popular and the number of photos taken worldwide has increased dramatically. This trend has been further accelerated by the fact that nowadays almost each mobile phone and each other mobile device like portable computers, touch pads, etc. include a digital picture capturing device like a photo or video capturing device. With this increase in number of photos captured, it became common to share photos and videos among friends or even publicly. [0003] Even if the internet has reduced the burden to share photos with others, the sharing of photos and videos over the internet is still very complicated and each available sharing process provides several
disadvantages. The sending via email to sharing partners necessitates the definition of all destination addresses of the sharing partners. In addition, the data package comprising all shared pictures has to be sent to each sharing partner even if the sharing partner is not interested in the pictures. In addition, often the inboxes of the chosen sharing partners are not always capable of receiving such big amounts of data needed for sending photos and videos at all or at least not in one email. Therefore, for some sharing partner the sending process does not work and has to be repeated. The sharing by email is therefore very time consuming and necessitates the sending of a huge amount of data, even if some of the sharing partners are not interested in the photos. [0004] For this reason, WO 2004/100042 proposes to upload a group of photos identified by a user on a server. The server generates an html email, which does not contain the photos itself, but only the source paths pointing to an address of photos stored on the server. Therefore, the recipient of this email receives only small sized emails, has not to register on a photosharing application and can still access all the photos. However, this process needs still the definition of the email addresses of all the recipients or if they are stored on the server, the step of choosing the persons of interest. [0005] A common alternative solution of sharing photos is the use of photosharing applications. Those work all by the basic principle that a user opens an account and uploads pictures to this account. In general, pictures are organized by events by the user. Therefore, the user creates folders containing the group of photos related to said event. The pictures on the account of the user are shared by different concepts. Either a number of persons are selectively invited to watch the photos for each event or a group of persons defined only once can access the pictures of all events created. Again the first solution has the disadvantage that all the recipients have to be selected manually. The second solution may create some privacy issues, since pictures are uploaded which should only be seen by a smaller group of people than originally defined. In addition, these processes share the general problem that also the people who want to watch the pictures are forced to create an account on the photosharing application.
[0006] Thus, said solutions for sharing with the help of a central application have the disadvantage that the pictures are organized on the basis of the owner of the pictures. Considering an event like a marriage, where each of the maybe 100 guests and potential sharing partners makes some photos, it could be cumbersome to watch the photos of all guests on each account of the 100 guests. In addition, probably only a small percentage has an account at the same photosharing application.
Therefore, not only photos of different user accounts, but also of different photosharing applications have to be checked. For each photosharing application an account is needed. [0007] Finally, a big percentage of the photos is probably " lost" completely on a local not accessible storage device, because the process of sharing the photos by said central application or by email is too
cumbersome. [0008] There are some new approaches to solve at least some of the described problems. The United States Patent Application Publication US 201 1/0126184 discloses that pictures are not anymore organized on the basis of the user who uploaded the data, but on the basis of an event. Since new picture capturing devices store time and location with the picture, pictures uploaded by different users can be organized together, when they are captured in predetermined spatio-temporal vicinity, i.e. if they are taken at similar times and similar locations. This solution may store all the photos captured at the marriage together, if all 100 guests upload the photos at exactly this photosharing application. However, several parties in one apartment block would probably mix the photos of all parties together in one event, since the location resolution in the vertical direction is not very good and since a certain horizontal spatial range for one event has to be defined. Finally, the problem of authorization of accessing these photos is not solved. An authorization only by the fact that someone has photos with the same location and time does not mean that they have received the permission to access and share their photos.
[0009] In some special situations, there have been developed adapted solutions for sharing and organizing pictures. The United States Patent US 7 800 646 B2 discloses to detect runners during a run by face recognition or by detecting their starter number attached to their body. Therefore, each runner can easily filter the pictures and videos of interest for him. However, this approach is restricted to sport events which provide participants with detectable numbers and is not transferable to general sharing applications. The object of the present invention is to solve the above given problems, especially to provide a method, apparatus and a computer program for accessing a location for storing pictures at a server which is simple to use for the person providing the pictures and for persons who want to access and download the pictures. It gives the opportunity to easily add pictures related to the event and provides an automatic authorization control which needs not to be controlled by the user for each location for storing pictures.
Brief summary of the invention [0010] According to the invention, these aims are achieved by method of claims 1 and 16, by apparatus of claim 23 and computer program 24.
[0011] Method to associate pictures related to an event comprising the following steps: storing on a data processing apparatus an event identifier for identifying pictures related to said event; receiving at least one picture; detecting a barcode within the at least one received picture; reading out the barcode information from said barcode, wherein the barcode
information comprises an event identifier; comparing the event identifier comprised in the barcode information with the event identifier stored on the data processing apparatus; associating the at least one picture received with the identifier stored on the data processing apparatus on the basis of the comparison result.
[0012] Method for providing authorization means for associating pictures to an event comprising the following steps: creating an event identifier for identifying pictures related to said event on a data processing apparatus or on an electronic apparatus; creating a barcode comprising barcode information, wherein the barcode information comprises said event identifier; displaying the barcode for capturing a photo of the barcode as authorization means.
[0013] Apparatus for associating pictures related to an event
comprising: storage means configure to store an event identifier for identifying pictures related to said event; communication means configured to receive at least one picture; detecting means configured to detect a barcode within the at least one received picture; reading means
configured to read out barcode information from said barcode, wherein the barcode information comprises an event identifier; comparing means configured to compare the event identifier comprised in the barcode information with the event identifier stored in said storage means ; and associating means configured to associate the at least one picture received with the identifier stored on the data processing apparatus on the basis of the comparison result of the comparison means.
[0014] The invention refers also to a computer program for executing the above mentioned methods on a processor and a carrier storing such a computer program code.
[0015] The invention has the advantage that the authorization of sharing pictures is contained in the picture data itself and thus an
identification and authorization check is not necessary any more for sharing pictures. This dramatically facilitates the process of sharing pictures.
[0016] The dependent claims refer to preferred embodiments of the invention. [0017] In a preferred embodiment, the event identifier stored on the data processing apparatus is created by creating a random character string or a random number. This has the advantage that events can even be created on an electronic apparatus without any internet connection. The event identifier is sent to the data processing apparatus after the
connection to the data processing apparatus has been established and is stored on the data processing apparatus.
[0018] In one embodiment, the barcode information comprises time information. The time information of each picture of the at least one picture received can be corrected on the basis of the difference between the time information of the picture comprising the barcode and the time information of the barcode information. This has the advantage that the timestamp of all pictures uploaded can be corrected. Consequently, even pictures from different users with wrong time configurations on their devices can be displayed in the correct timely order. [0019] In another embodiment, the barcode information comprises authenticity information. The authenticity of the barcode is checked by combining a private event identifier with the time information of the barcode information in a predetermined way to a combined information, by encrypting this combined information in a predetermined way and by comparing the encryption result to the authenticity information, wherein the private event identifier is stored in the data processing apparatus in addition to the event identifier. In other words, Time information from the barcode is needed for comparing the combined encrypted information from the barcode with the combined information comprising the private key from the server and the time information from the barcode. This offers a very simple and trustworthy way to check if a third person might have corrupted the barcode.
[0020] In one embodiment, barcode information comprising the event identifier stored on said data processing apparatus is created, a barcode containing the barcode information is created and the created barcode is displayed. This is a very easy way for a user to control who might get the permission to share pictures with him. He shows the displayed barcode only to those persons, with whom he wants to share photos at the
corresponding event. In addition, this gives each person of his chosen group for sharing photos an identification means for being part of this group and allows these persons to upload their photos without any identification. In one embodiment, the barcode is "given " to one person of said group by letting him take a picture of the displayed barcode by the use of a picture capturing apparatus and detecting then the barcode from this picture as explained above.
[0021] In one embodiment, the event identifier comprised in the barcode information read out from the detected barcode identifies another event than the one stored in the data processing apparatus, i.e. they are not the same. However, they are related to each other, because one of the events is a subevent. Consequently, a user can create whole events himself, but associating all pictures of his event to a related parent event. [0022] In one embodiment, further pictures associated with the event identifier stored on the data processing apparatus are displayed
automatically in response to the associating step. Therefore, the present invention provides very easy means to access further pictures related to one event only by uploading one picture comprising the barcode. In addition, the step of uploading pictures and watching further pictures is done with the same step. This is a huge step forward for the process of sharing photos and is dramatically reducing the burden of sharing photos of the state of the art. Brief Description of the Drawings
[0023] The invention will be better understood with the help of the description of an embodiment given by way of example and illustrated by the figures, in which:
Fig. 1 shows an embodiment of the system according to the invention;
Fig. 2 shows a method according to the invention,
Fig. 3A, B show the step of uploading pictures on a server, and
Fig. 4 shows the step of displaying all pictures associated with the event. Detailed Description of possible embodiments of the Invention
[0024] The invention refers to a method, computer program or apparatus for associating pictures to an event. Pictures in the sense of the invention can be all kind of optical reproduction of a moment in the physical reality. This includes especially photos (still picture) and videos (moving picture) taken by any picture capturing apparatus preferably by a photo capturing apparatus or video capturing apparatus, even more preferably by a digital photo or video capturing device, but also e.g. by a digital scanning apparatus. Preferably the picture is a digital picture.
Preferably, each picture is stored in an individual file, however, the invention is not restricted thereto and it is also possible to merge a number of picture files together to one file. A photo and a video as picture in the sense of this invention distinguishes to further pictures by being pictures using in the picture capturing technique the projection of an image on a picture capturing projection plane preferably by the use of a hole.
Therefore, photos and videos include all files produced by digital photo/video apparatuses, but also files produced by scanning photos/videos produced in an analogue way, thus to all photos/videos comprising in their production process at least once the step of projecting an image on a projection plane. The invention is not restricted to photos or videos, but might be. The invention does further preferably refer to all pictures containing at least one photo or video element being produced as a photo or video as described above. The following description of the invention uses photos as exemplary picture according to the invention. It is obvious that the invention can be carried out with any other picture like for example a video.
[0025] The term barcode in the sense of this invention refers to one- dimensional barcodes which actually contain a series of bars. However, a barcode refers also and preferably to two and three-dimensional barcodes displayed in a picture, like for example QR-codes. Two dimensional barcodes are often also called matrix barcodes. Even if two and three dimensional codes do not actually show bars as in the sense of a one dimensional barcode, they are still called barcode. Therefore, the scope of the invention is not restricted to one dimensional codes which actually show bars, but comprises also the use of two and three dimensional codes as barcodes. Most preferably a QR-code is used as a barcode according to the invention. [0026] The term event in the sense of this invention is not restrictive for the invention. Any possible topics for organizing a group of photos may be a reason for creating an event. [0027] Fig. 1 shows a system according to the invention. The system comprises a server 1 as data processing apparatus according to the claims and an electronic apparatus 2 according to the claims. The system might comprise in addition a picture capturing device 3. [0028] The server 1 is connected to the electronic apparatus 2 by a communication connection 4 for transferring pictures. The communication connection 4 is preferably an internet connection, but is not restricted thereto. The communication connection 6 might be cable based like a phone wire, DSL connection etc. or also be a wireless connection such as a mobile telecommunication network like mobile phone connection (UMTS, GPRS, EDGE, LTE, etc.), a wireless local area network (WLAN) connection, or also a closed wireless network like e.g. a police radio network. However, if the server 1 is locally accessible by the users of the electronic apparatus 2, even short range communication techniques, such as near field
communication (NFC), Bluetooth are further possible communication connections. Also combinations thereof are possible.
[0029] The electronic apparatus 2 comprises a communication means 21 (communicator) for establishing a communication connection 4 with the Server 1. The communication means 21 may not only be able to perform the communication with the server 1, but also with other electronic apparatuses in order to exchange pictures or other information. Therefore, the communication means 21 may support additionally to the
communication technique for connecting with server 1 a second
communication technique like NFC or Bluetooth or any other short range wireless connection in order to connect with further electronic apparatuses. The electronic apparatus 2 comprises further a picture input means 22 (picture inputter) connected to the communication means 21 for
transferring pictures from the picture input means 22 to the
communication means 21. The picture input means 22 is preferably a picture capturing apparatus (picture capturer) for capturing pictures, especially photos and videos. An example for a preferred electronic apparatus 2 is a smartphone whose mobile phone communication means and/or Wireless Local Area Network (WLAN) means corresponds to the communication means 21 and the picture capturing apparatus of the smartphone corresponds to the picture input means 22. Alternatively, the picture input means 22 is only an interface for receiving pictures. In the latter, the electronic apparatus 2 might be a computer having access to the internet and the picture input means might be any interface like USB, Bluetooth, Firewire, etc. to transfer pictures to the computer. Pictures might be taken by a digital picture capturing device 3, like a digital photo or video camera. Pictures might be transferred from the digital picture capturing device 3 to the picture input means 22 to the communication means 21 to the server 1. The electronic apparatus 2 comprises further a storage means 25 for storing the pictures received by the picture input means 22 or by the communication means 21. The electronic apparatus 2 comprises also a display 23 for displaying pictures received by the picture input means 22, the communication means 21 or pictures stored in the storage means 25. Finally, the electronic apparatus 2 comprises input means (inputter) 24 for inputting user requests to the electronic apparatus 2. A keyboard, mouse, a group of buttons, a scrolling device, a combination of arrows are only examples of such input means 24. The user requests can be directed to the electronic apparatus 2 itself, for example to control the picture input means 22 to capture a picture, or can be directed to the server 1. Each user connecting to the server 1 normally uses an electronic apparatus 2, since the direct access to a server 1 is normally not given. Even if Fig. 1 shows only one exemplary electronic apparatus 2, it is obvious to a person skilled in the art that the system can comprise a plurality of electronic apparatuses like the electronic apparatus 2.
[0030] The server 1 comprises a communication means 1 1
(communicator) for receiving pictures from the electronic apparatus 2 over the communication connection 4. The communication means 1 1 is also configured to receive requests from the electronic apparatus 2. In a preferred embodiment, the communication means 1 1 has an interface for uploading pictures, wherein the interface is publicly available for uploading pictures, e.g. over the internet. The communication means 1 1 is connected with a control means 14 (controller) for sending the request from the electronic apparatus 2 to the control means 14. The communication means 1 1 is further connected with a storage means 15 (storage) for storing pictures, e.g. the pictures received via the communication means 1 1. The communication means 1 1 is further connected with a detection means 12 (detector) for detecting a barcode in the received pictures. Therefore, the detection means 12 analyses the optical data of the picture and detects the pattern in this data of the barcode by the use of pattern recognition methods. The barcode can be detected in the background or foreground of the picture. If a barcode is detected in one of the pictures, the barcode information contained in the barcode is read out by a reading means 13 (reader). The reading means 13 is further connected to the control means 14, which analyses the barcode information and associates the pictures received on the basis of the barcode information to an event. The barcode information will be described in detail later. The control means 14 is also configured to create barcode information for a new event. The association of pictures stored in the storage means 15 to events is stored in a database 16, wherein the events are identified by event identifiers (described later). Finally, there is a barcode creation means 17 for creating a barcode containing a barcode information created by the control means 14 upon request from the electronic apparatus 2. [0031] The method according to the invention will be described with reference to Fig. 2. In order to describe the invention, the situation of a party shall be used as an example of an event. The party is visited by a number of visitors which all take some pictures at the party. In the following, visitors will be called users, when they upload their pictures to the server 1. In a first step S1 a first user has to register on the server 1 by giving identification data like his email address, name, postal address, etc. to the server 1. This registration step S1 is performed by the use of the electronic apparatus 2. The first user uses the input means 24 to open a browser in the display means 23 and connect with the server 1 by typing the URL of the server 1 in the browser and performing the registration steps. Alternatively, the registration may also be done by an application stored on the electronic apparatus 2. The registration has to be done only once. Afterwards, the first user performs an identification step, which is not shown in the figures. However, the registration step S1 and/or
identification step is not essential for the invention and can be omitted.
[0032] In a second step S2, the first user creates an event. In one embodiment the event is created by sending a request for creating an event from the electronic apparatus 2 to the server 1. When the server 2 receives this request, the control means 14 creates a public event key as an event identifier. Preferably, the control means 14 creates in step S2 also a private event key as a second independent identifier for the created event and stores the private event key together with the public event key in the database 16. In a second embodiment, step S2 could also be performed locally on the electronic apparatus 2 and the public and optionally also private event key are sent to the server 1. Therefore, the public and optional private event key can be created even without a connection to the server 1. In this case, the public and maybe private event key are sent to server 1 later, when there is a connection to the server 1.
[0033] In step S3, the public event key related to the registration of the first user is stored in the database 16. The public event key is preferably stored in association with the registration data of the first user. If a private event key is created in the second step S2, the private event key is stored in association with the public event key in the database 16. It is clear that the association of pictures with a public event key has not necessarily to be stored in a database 16. An association can be achieved by any association means. For example a folder comprising all the pictures of one event can be named as the public event key. There is a plurality of further known methods to store pictures in association with an identifier. Each of these methods is suitable to store the association between pictures and public event key.
[0034] In a step S4, barcode information and the barcode are created. In the present embodiment, the barcode information consists of six different parameters. The public event key is essential for the invention and has to be contained in the barcode information. The other parameters are preferably also contained, but the invention is not restricted to them. The first parameter is an address pointing to the storage means 15 of server 1 , i.e. on the place in the server 1 where the pictures are stored. The second parameter is the public event key. The third parameter is a parent public event key which will be described in detail later. In this case, there is no parent event and the third parameter is set to a value representing that there is no parent event, e.g. 0. The fourth parameter is an authenticity parameter. For the authenticity parameter, the private event key is mixed, e.g. by a connection in series, with the sixth parameter. The mixed private event key and the sixth parameter are encrypted. Preferably a one way encryption is used, e.g. SHA. The encrypted mixed private event key and sixth parameter correspond to authenticity information stored in the fourth parameter. The fifth parameter is a Session ID of the smartphone or the browser. The sixth parameter is a timestamp as time information according to the claims. The timestamp represents the present time or the present date and time. Preferably the date and time are represented by one number. Preferably the timestamp resolution is at least exact as seconds, preferably more exact than 10Λ-1 , 10Λ-2 or 10-3 seconds as used for the fourth parameter. All these parameters are mixed together, e.g. by a concatenation, and are translated into a QR-code as a two-dimensional barcode.
[0035] The public event key, the private event key and the barcode information and the barcode are created in one embodiment in the server 1 and the created barcode is sent back to the electronic apparatus 2 which requested to create an event. However, in said second embodiment of the invention, the public event key, the private event key and the barcode information and the barcode can also be created in the electronic apparatus 2. After the creation of the public event key and the private event key, both are sent to the server 1. If there is no internet connection, sending keys to server 1 can be delayed till the next time apparatus 2 has a communication connection to the server 1. Consequently, a smartphone can store an application for creating the barcode with all necessary parameters and for sending the public and private event key to the server 1 , when there is an internet connection the next time. This has the advantage, that events can also be created offline. [0036] The public event key is preferably a random character string, e.g. a random number or a chain of characters. The chain of characters in the sense of this invention is a character string comprising at least one character not being a number. The random character string, e.g. the chain of characters or the random number, is so long that the probability that two events are created with the same random string identification is very small , preferably below 10Λ-6, 10Λ-7, 10Λ-8 or 10Λ-9. In this embodiment, a random number with a length of 64 Bits as a random character string is used as public event key. The public event key is preferably equal or longer than 32 Bit, preferably equal or longer than 64 Bits. The use of a random character string as public event key has the advantage that the public event key can be created at the electronic apparatus 2, even when there is no connection to the server 2. The private event key is also a random
character string, e.g. a random number, which is longer than the public event key, preferably longer by a factor of two. The private event key is used for checking the authenticity of the barcode, i.e. for checking that the barcode is not corrupted by someone, as it will be explained later.
[0037] The created barcode is displayed in the display means 24 in the electronic apparatus 2 in the fifth step S5. During the party, the first user could show the other visitors of the party the displayed barcode, e.g. by showing them the display of his electronic apparatus 2 which displays the QR-code. Alternatively, the first user could print the barcode and attach it at the party location. Consequently, each user who wants to share his photos can take a picture of said printed barcode. If the user forgot to take a photo of the barcode, he could search for a photo containing the barcode in the background. However, it is preferred that the barcode is
photographed from an electronic display means as display means 23 as will be explained in the following. As will be described in relation to step S12, it is desired that the time when the photo containing the barcode is taken is stored in the barcode itself. Therefore, the barcode information is renewed after a predetermined time period. At each point in time, the barcode information contains a renewed sixth and fourth parameter, because the fields comprise an actualized time. The new barcode information is translated into a new barcode and displayed after the elapse of each predetermined time period. Therefore, the time when the picture was taken can be determined with a resolution of the predetermined time period. The predetermined time period should be shorter than 10 seconds, preferably shorter than 5 seconds. The renewal of the displayed barcode at each predetermined point in time has the advantage that the present time is stored in the barcode. In big concerts, the barcode can be displayed electronically close to the stage, such that all visitors take a picture of the barcode, when they take a picture of the stage. Therefore, all pictures taken of the stage automatically contain an identifier for the event, here the concert, and the information of the time.
[0038] Then in a sixth step S6, a second user who is one of the visitors could make a photo of this barcode with his digital camera.
[0039] Instead of steps S5 and S6, in an alternative embodiment the barcode could be transferred by any other means to another electronic apparatus 2. Especially, the transfer by any wireless short range
communication which has a range of less than 20m, 10m or preferably 5m. Examples are NFC, Bluetooth, WLAN, etc. However, also other method of transferring said barcode, e.g. by email are possible. In order to transfer the barcode, the barcode is stored in a picture file like a jpg. or in any file format suitable to store the barcode. This file is then sent to the other electronic apparatus. Preferably, this file is stored as a photo with photos taken by said receiving electronic apparatus.
[0040] The second user continues to take photos at the party and later when he is at home, the second user will probably load the photos taken at the party to his computer and store them locally on his computer. In this case the computer is the electronic apparatus 2 of the second user. Instead of the cumbersome process of sharing photos of the state of the art, the second user in a seventh step S7 has only to upload the photos taken at the party including the photo with the QR-code. No additional identification or registration step is needed. Certainly, the second user can still identify himself and associate the pictures uploaded with his user account, but the identification or registration step is not obligatory anymore and users without a user account can share their photos as well. The upload can be done for example by opening an internet page on the server 1. Fig. 3A shows an exemplary and simplified browser window 5 comprising an area 51 for uploading pictures. The area 51 can e.g. be equal to the browser window 5. Then, photos to be uploaded are identified and moved by drag and drop to the area 51. After that, the photos dropped are automatically uploaded to the server 1. Fig. 3B shows the same window 5 after dropping the identified photos 61 , 62 and 63 in area 51. Here, reproduced photo 61 shows a QR-code 7. In this example, three photos were identified. However, the invention is not restricted thereto. Each number of photos one, two, three, four etc. can be uploaded to the server. The upload may be initiated by a button or can be done automatically when the identified photos are dropped on area 51. Since no identification is necessarily needed, the upload of photos can be done in a second. The at least one picture 61, 62, 63 uploaded and received at the data processing apparatus refers to all pictures uploaded in the same state of connection to the electronic apparatus. The state of connection may be determined by the IP address, the IMEI of the electronic apparatus or an identifier for the connection itself. The IP address and the IMEI may be combined with further
parameters like time and/or location. The state of the connection might be identified by a session identifier. The at least one uploaded picture refers to all pictures uploaded in one upload action, wherein one upload action may be defined as all pictures uploaded by the same state of connection in a predetermined period of time. Alternatively, the electronic apparatus 2 may have an application, which uploads the identified photos, when they are dropped on an area of the display related to said application. If the image capturing means of the second user corresponds to the picture input means 22 of the electronic apparatus 2, the electronic apparatus 2 might store a program which might automatically upload the photo with the QR- code 7 and upload each taken photo after the server 1 confirmed the authenticity of the QR-code 7 and associates the QR-code 7 with an event in the database 16. The server 1 receives the photos in the communication means 1 1 and sends them to the storage means 15 and the detection means 12. [0041] The server 1 detects in an eighth step S8 in the detecting means 12 the QR-code in one of the received photos. In step S9, the barcode information is read out from the QR-code in the photo received. The barcode information is sent to the control means 14. Steps S8 and S9 can also be performed in the electronic apparatus 2. Then, the barcode information can be sent directly to the server 1.
[0042] In step S10, the event related to the second parameter, i.e. the public event key, is looked up in the database 16. This is done by comparing the public event key contained in the second parameter with the public keys contained in the database 16. If there is one public event key in the database 16 which is equal to the public event key in the second
parameter, the process according to the invention is continued. If no public event key is found, usually, the inventive method is terminated.
[0043] In order to guarantee that the barcode was not corrupted by a third person, an authenticity check step S1 1 is performed. The private event key stored in the database in relation to the event, i.e. to the public event key of the barcode information, is looked up and combined with the sixth parameter of the barcode information in the same way as in step S4. The combined information is encrypted by the same encryption mechanism as in S4. Then, the result is compared with the fourth parameter of the barcode information. If this result is equal to the fourth parameter, the barcode was not corrupted with a very high probability and the method according to the invention is continued. Otherwise, the process is
terminated and the photos received by the second user are removed from the storage means 15. The combination of the private event key can be performed with any of the other parameters different from the
authenticity parameter. Certainly, the authenticity information in step S4 has to be created by combining the private event key with the same other parameter. However, preferably this parameter is the time information. [0044] In step S12, the time, stored as metadata in each photo
uploaded, is corrected. The metadata are generated by the picture capturing device 3 or apparatus 22, when capturing the photo. If the time of the picture capturing device 3 or apparatus 22 has an offset, this will be corrected by the following procedure. Since the timestamp in the barcode information contains the correct time when the photo was captured, an offset between the time contained in the metadata of the photo can be determined on the basis of the timestamp of the barcode information. If there is an offset, the time of all photos uploaded is corrected accordingly. Consequently, each of the photos on the server 1 has the same time base, i.e. the camera time corrected by the calculated offset, and thus can be displayed in the correct timely order. [0045] In step S13, the second user is now authorized to access the event related to the public event key. In a first embodiment, to access the event means that the second user is allowed to store the uploaded pictures together with the event. In addition, he might change or remove the pictures uploaded. He might further be allowed to upload further pictures which are automatically stored with said event. The authorization may be restricted to the connection of the upload and to a predetermined authorization time period. In a second embodiment, to access the event means that the further pictures related to said event are displayed in addition to the photos already uploaded. Fig. 4 shows the window 5, wherein now also further pictures 71 , 72 and 73 are displayed. In this example, the further pictures 71 , 72 and 73 are displayed with a grey shadow in order to distinguish the further pictures from the pictures uploaded by the second user. These further pictures may have been uploaded by the first user or by other users having a picture of the barcode of this event. The first user can determine which photos shall be displayed to other users. Maybe also other users can determine who can see their uploaded photos. They can determine that only the first user can see them or than all users can see them. In a third embodiment, to access the event means to download further pictures being related to said event. In a fourth embodiment, to access the event means to change or remove further pictures stored in association with the event. All possible combinations of the first to fourth embodiment are possible. In a fifth embodiment, the server offers all possibilities of access as defined in embodiments one to four and the first user defines which photos are accessible by the second and other users. In addition, the first user can configure by which way of access of the first to fourth embodiment all or each accessible photos are accessible. In one embodiment, all photos stored related to said event are made accessible to the second and other users. [0046] Since the first user has a choice to decide to whom he shows the barcode, an effective and very simple privacy control is performed. Each person having a photo of the barcode can show the photo with the barcode to a third user who can photograph and access the photos of all users being in possession of the barcode and having uploaded there photos. Therefore, the authorization for accessing and exchanging photos can be distributed like written invitation. Instead of sending the invitations by post or giving them to somebody, a picture with the barcode is shown and photographed or the picture of the barcode is sent to somebody. The huge advantage of the method is that the authorization is contained in one of the pictures itself and no additional information like an internet address, an email address, a log in, a password or similar is needed.
[0047] The second user himself can show the photo of the barcode to a third user at the party. The third user can also upload his photos which are also associated with the event (or a subevent generated by the second user, generation of subevents can be transparent to the user, as described below) in the same way as for the second user. Therefore, it becomes very easy to share and exchange photos between all guests of the party.
[0048] A fourth user may have a smartphone as electronic apparatus 2. The electronic apparatus 2 has an application, which directly detects that a photo contains a barcode with a public key. When the fourth user takes a photo of the barcode displayed by the digital camera of the second user for example, but would like to create his own event which however is related to the event of the first usersuch an event is called subevent. The
application reads out all six parameters and creates a new event with a new public and private event key and a new barcode as described in steps S2 and S4. The public and private event keys are sent to the server 1 and stored therein as described in step S3. A new barcode is created as described in step S4. In order to show the relation of both events, the new barcode contains the public event key, read out from the barcode displayed on the digital camera of the second user, in the third parameter. The fourth parameter of this new barcode is created by mixing the fourth parameter of the old barcode with the timestamp of the new barcode and encrypting this information. The timestamp is also renewed. Consequently, a fifth user could again profit from the correction of time in the server 1. In addition, the fourth user has more control about his own photos and photos associated to his event, because the fourth user has the same power of control like the first user to control the permission of further users taking a photo of the new barcode created by the fourth user.
[0049] The invention was described with reference to a photo sharing application. However, the invention can also be used for business wherein a large number of photos are taken and the association to single events is difficult. For example, a company managing a notable number of real estate objects and taking photos for each real estate object during the year, could create an event for each real estate object. When a dependent of the company takes photos of one real estate, he first takes a photo of the barcode maybe shown in the file to said real estate object. When he uploads all photos, the photos are arranged automatically with the real estate and with the photos of this real estate object taken some years ago.

Claims

Claims
1. Method to associate pictures related to an event comprising the following steps:
- storing on a data processing apparatus (1) an event identifier for identifying pictures related to said event;
- receiving at least one picture (61 , 62, 63);
- detecting a barcode (7) within the at least one received picture;
- reading out barcode information from said barcode (7), wherein the barcode information comprises an event identifier;
- comparing the event identifier comprised in the barcode information with the event identifier stored on the data processing apparatus (1);
- associating the at least one picture received with the identifier stored on the data processing apparatus (1) on the basis of the comparison result.
2. Method according to claim 1 comprising the further step of creating the event identifier stored on the data processing apparatus (1) by creating a random character string or a random number.
3. Method according to claim 1 or 2, wherein the event identifier is created in an electronic apparatus (2) during a period in which a connection to the data processing apparatus (1) is interrupted and is sent to the data processing apparatus (1) after the connection to the data processing apparatus (1) has been established and is stored on the data processing apparatus (1).
4. Method according to claim 1 to 3, wherein at least two pictures are received, the barcode is detected in one of the at least two pictures and the at least two pictures are associated with the event identifier stored on the data processing apparatus (1).
5. Method according to claim 1 to 4, wherein the barcode information comprises time information.
6. Method according to claim 5, wherein the time information of each picture of the at least one picture received is corrected on the basis of the difference between the time information of the picture comprising the barcode and the time information of the barcode information.
7. Method according to claim 5 or 6, wherein the barcode information comprises an authenticity information and wherein the method comprises the further step of testing the authenticity of the barcode by combining a private event identifier with the time information of the barcode information in a predetermined way to a combined information, by encrypting this combined information in a predetermined way and by comparing the encryption result to the authenticity
information, wherein the private event identifier is stored in the data processing apparatus in addition to the event identifier.
8. Method according to anyone of claims 1 to 7 comprising the further steps of creating a barcode information comprising the event identifier stored on said data processing apparatus (1), creating a barcode containing the barcode information and displaying the created barcode.
9. Method according to claim 8 comprising the further step of taking a picture of the displayed barcode by the use of a picture capturing apparatus (22, 3) and transferring the picture with the barcode as one of the at least one picture to the data processing apparatus (1).
10. Method according to anyone of claims 1 to 7 comprising the further steps of creating a barcode information comprising the event identifier stored on said data processing apparatus (1), creating a barcode containing the barcode information and transferring the barcode between two electronic apparatuses (2) by a wireless short range communication or email.
1 1. Method according to anyone of claims 1 to 10, wherein the event identifier comprised in the barcode information read out from the detected barcode identifies another event than the one stored in the data processing apparatus (1) which is related to the event identifier stored in the data processing apparatus (2).
12. Method according to anyone of claims 1 to 1 1 comprising the further step of displaying further pictures associated with the event identifier stored on the data processing apparatus (1) in response to the associating step.
13. Method according to anyone of claims 1 to 12 comprising the further step of storing the at least one picture in association with the event identifier stored on the data processing apparatus (1).
14. Method according to anyone of claims 1 to 13 comprising the further steps of identifying the present connection by which the at least one picture is received and authorising an electronic apparatus (2) related to said identified connection to access, change, remove and/or download the at least on picture received and/or to upload further pictures and associate these further pictures uploaded with the event identifier stored in the data processing apparatus.
15. Method according to anyone of claims 1 to 14 comprising the further steps of identifying the present connection by which the at least one picture is received and authorising an electronic apparatus (2) related to said identified connection to access, display, change, remove and/or download pictures already been associated with the event identifier stored on the data processing apparatus.
16. Method according to anyone of claims 1 to 15, wherein the barcode is a two-dimensional code.
17. Method for providing authorization means for associating pictures to an event comprising the following steps:
- creating an event identifier for identifying pictures related to said event on a data processing apparatus (1);
- creating a barcode (7) comprising barcode information, wherein the barcode information comprises the event identifier;
- displaying the barcode for capturing a photo of the barcode as
authorization means.
18. Method according to claim 17, wherein the barcode
information comprises time information.
19. Method according to claim 18, wherein the time information is continuously actualized, the barcode is created newly after each actualization of the time information and the barcode is newly displayed after each creation of the barcode.
20. Method according to one of claims 18 and 19, wherein the barcode comprises authenticity information comprising an encryption of a combination of the time information with a private event identifier for identifying said event.
21. Method according to anyone of claims 17 to 20 comprising the further step of creating the event identifier by randomly creating a character string or a random number.
22. Method according to anyone of claims 17 to 22, wherein the barcode information comprises another event identifier for identifying another event related to pictures, wherein the other event is related to said event.
23. Apparatus (1) for associating pictures related to an event comprising:
storage means (15) configure to store an event identifier for identifying pictures related to said event;
communication means (1 1) configured to receive at least one picture (61 , 62, 63);
detecting means (12) configured to detect a barcode (7) within the at least one received picture;
reading means (13) configured to read out barcode information from said barcode (7), wherein the barcode information comprises an event identifier;
comparing means (14) configured to compare the event identifier comprised in the barcode information with the event identifier stored in said storage means (15);
associating means (16) configured to associate the at least one picture received with the identifier stored on the data processing apparatus (1) on the basis of the comparison result of the comparison means (14).
24. Computer program configured to execute the steps of method according to one of claims 1 to 21 on a processor.
PCT/EP2012/053445 2012-02-29 2012-02-29 Method, apparatus and computer program for associating pictures related to an event WO2013127449A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/EP2012/053445 WO2013127449A1 (en) 2012-02-29 2012-02-29 Method, apparatus and computer program for associating pictures related to an event

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2012/053445 WO2013127449A1 (en) 2012-02-29 2012-02-29 Method, apparatus and computer program for associating pictures related to an event

Publications (1)

Publication Number Publication Date
WO2013127449A1 true WO2013127449A1 (en) 2013-09-06

Family

ID=45922649

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/053445 WO2013127449A1 (en) 2012-02-29 2012-02-29 Method, apparatus and computer program for associating pictures related to an event

Country Status (1)

Country Link
WO (1) WO2013127449A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9112936B1 (en) 2014-02-27 2015-08-18 Dropbox, Inc. Systems and methods for ephemeral eventing
CN104869128A (en) * 2014-02-20 2015-08-26 阿里巴巴集团控股有限公司 Method of uploading form attachment, system of uploading form attachment and web server
WO2015153285A1 (en) * 2014-03-31 2015-10-08 Google Inc. Content synchronization using profiles
US9462054B2 (en) 2014-02-27 2016-10-04 Dropbox, Inc. Systems and methods for providing a user with a set of interactivity features locally on a user device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030066883A1 (en) * 2001-10-10 2003-04-10 Yu Allen K. Electronic ticketing system and method
WO2004100042A2 (en) 2003-05-02 2004-11-18 Icu Software, Inc. Sharing photos electronically
US20070033109A1 (en) * 2005-08-05 2007-02-08 Microsoft Corporation Informal trust relationship to facilitate data sharing
US20070189333A1 (en) * 2006-02-13 2007-08-16 Yahool Inc. Time synchronization of digital media
US7800646B2 (en) 2008-12-24 2010-09-21 Strands, Inc. Sporting event image capture, processing and publication
US20110126184A1 (en) 2009-11-21 2011-05-26 Michael-Anthony William Lisboa Event-Associating Software Application for Accessing Digital Media

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030066883A1 (en) * 2001-10-10 2003-04-10 Yu Allen K. Electronic ticketing system and method
WO2004100042A2 (en) 2003-05-02 2004-11-18 Icu Software, Inc. Sharing photos electronically
US20070033109A1 (en) * 2005-08-05 2007-02-08 Microsoft Corporation Informal trust relationship to facilitate data sharing
US20070189333A1 (en) * 2006-02-13 2007-08-16 Yahool Inc. Time synchronization of digital media
US7800646B2 (en) 2008-12-24 2010-09-21 Strands, Inc. Sporting event image capture, processing and publication
US20110126184A1 (en) 2009-11-21 2011-05-26 Michael-Anthony William Lisboa Event-Associating Software Application for Accessing Digital Media

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104869128A (en) * 2014-02-20 2015-08-26 阿里巴巴集团控股有限公司 Method of uploading form attachment, system of uploading form attachment and web server
WO2015126880A1 (en) * 2014-02-20 2015-08-27 Alibaba Group Holding Limited Uploading a form attachment
US9692852B2 (en) 2014-02-20 2017-06-27 Alibaba Group Holding Limited Uploading a form attachment
CN104869128B (en) * 2014-02-20 2018-08-31 阿里巴巴集团控股有限公司 A kind of method, system and web server uploading form attachment
TWI637279B (en) * 2014-02-20 2018-10-01 阿里巴巴集團服務有限公司 Method, system and web server for uploading form attachments
US10623522B2 (en) 2014-02-20 2020-04-14 Alibaba Group Holding Limited Uploading a form attachment
US9112936B1 (en) 2014-02-27 2015-08-18 Dropbox, Inc. Systems and methods for ephemeral eventing
US9462054B2 (en) 2014-02-27 2016-10-04 Dropbox, Inc. Systems and methods for providing a user with a set of interactivity features locally on a user device
US9942121B2 (en) 2014-02-27 2018-04-10 Dropbox, Inc. Systems and methods for ephemeral eventing
US10235444B2 (en) 2014-02-27 2019-03-19 Dropbox, Inc. Systems and methods for providing a user with a set of interactivity features locally on a user device
WO2015153285A1 (en) * 2014-03-31 2015-10-08 Google Inc. Content synchronization using profiles
US10645157B2 (en) 2014-03-31 2020-05-05 Google Llc Content synchronization using profiles

Similar Documents

Publication Publication Date Title
US11611553B2 (en) Online identity verification platform and process
CN103365957B (en) Photo be shared based on adjacency and connection
US11003878B2 (en) System for communication from a user to the publisher of a scannable label
KR101294582B1 (en) Sharing of media using contact data
US9794264B2 (en) Privacy controlled network media sharing
JP4999751B2 (en) Data sharing techniques
US7899887B2 (en) Real time collaborative on-line multimedia albums
US7853483B2 (en) Medium and system for enabling content sharing among participants associated with an event
US20150356121A1 (en) Position location-enabled, event-based, photo sharing software and service
US20150242444A1 (en) Coded image sharing system (ciss)
WO2012162467A1 (en) Image-related methods and systems
US20140025591A1 (en) System and method for recording and delivering a personal legacy to a beneficiary
CN102685357A (en) Album system, photographing device, and server
US20130206832A1 (en) Electronic media management system with external references
CN102165444A (en) Access control to content published by a host
US20070033142A1 (en) Informal trust relationship to facilitate data sharing
JP5703748B2 (en) Management system, management method, and temporary storage document server
WO2013127449A1 (en) Method, apparatus and computer program for associating pictures related to an event
JP2013047944A (en) Moving image disclosure device, method and computer program
US8960532B2 (en) Coded business card on badge
JP4585801B2 (en) Advertisement information registration method and advertisement display system
KR101231156B1 (en) System for managing picture folder using quick response code and method thereof
FR3095874A1 (en) PROCESS FOR GENERATING AN ARCHIVING CODE TO CREATE A FOOTPRINT OF MULTIMEDIA CONTENT
Wazirali et al. Steganographic image sharing app
US20220256117A1 (en) Information processing apparatus and computer readable medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12711356

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 05/11/2014)

122 Ep: pct application non-entry in european phase

Ref document number: 12711356

Country of ref document: EP

Kind code of ref document: A1