WO2017151065A1

WO2017151065A1 - Media scanning system

Info

Publication number: WO2017151065A1
Application number: PCT/TH2016/000015
Authority: WO
Inventors: Suwat DAMRONGCHAITHAM
Original assignee: Damrongchaitham Suwat
Priority date: 2016-02-29
Filing date: 2016-02-29
Publication date: 2017-09-08

Abstract

A media scanning system according to this invention comprising at least one set of backend processor for converting a media file into a set of image frames, identifying distinctive features of each frame, linking each frame to a vendor operated platform, assigning a specific identifier code to the frame and utilizing a user's mobile device for scanning and capturing the fingerprinted image frames in the media before displaying the associated vendor operated platform including, but not limited to, a vendor s landing page, website, or social media page. The system further comprises a customer relationship management (CRM) system for managing user information and for assigning the most appropriate vendor platform based on his/her previous screening or purchasing activities.

Description

Title of the invention

MEDIA SCANNING SYSTEM

Field of the invention

The present invention relates to the system and method for scanning media that enables a user to capture a desired product or service in ormation directly from the media, such as from real-time or recorded broadcast and online media, through or via his/her mobile device and wherein the user can make the purchase of said product or service or engage with a vendor through a vendor generated platform, accordingly.

Background of the invention The media scanning system according to this invention has been developed to facilitate

TV or other media-based advertisers, merchants, and vendors to reach out to viewers or customers who are looking to buy products and services or rather to engage with advertisers or vendors through their smart phones or other mobile devices. Presently, the common technologies that are available for scanning advertised products on media and printed advertisements are ID barcode, 2D barcode, and QR codes which have been used mostly for static and printed advertisements. Some TV-based advertisers may use QR codes to help customers with mobile QR code readers to detect product offerings through specified landing pages. The media scanning system according to this invention, on the other hand, does not require any uses of such static bar code or QR code technologies that may interrupt the viewer or user from viewing the media program. Instead, as illustrated in Figure 1 A, the media scanning system includes a set of the product identifiers are hidden in the background of the displaying media so that the user can focus on the product or service being advertised in the program and, wherein, he/she can hold a mobile device d ), to the certain range from the media being displayed on a certain type of digital display device (5), with the image capturing module (2) facing in the direction of the media to directly receive (6), wirelessly or through ad-hoc network, the product or service information in an advertiser, merchant, or vendor landing page, platform or website (3). The platform may comprise an e-commerce module where customer can instantly make purchases of products, concert tickets, coupons, music, and make other reservations; as well, a social module may also be incorporated into the vendor platform so that the user can engage with advertisers or vendors for some gaming, quizzing, or other entertainment activities. The media scanning system according to this invention further comprises a customer relationship management (CRM) module to help track user's previous scanning and purchasing activities so that the system can assign the most suitable vendor platform for said user and attract more purchasing or engagement activities from him/her.

Summary of the invention

A media scanning system according to this invention comprising at least one set of backend processor for converting a media file into a set of image frames, identifying distinctive features of each frame, linking each frame to a vendor operated platform, assigning a specific identifier code to the frame and utilizing a user s mobile device for scanning and capturing the fingerprinted image frames in the media before displaying the associated vendor operated platform including, but not limited to, a vendor s landing page, website, or social media page.

The system further comprises a customer relationship management (CRM) system for managing user information and for assigning the most appropriate vendor platform based on his/her previous screening or purchasing activities.

Brief description of drawings

Figure 1 A illustrates interactions between a user s mobile device and different types of media displaying devices according to one embodiment.

Figure IB illustrates a front side and a back side of the mobile device according to one embodiment.

Figure 2 is a flowchart showing a method for preparing a set of image files with fingerprinted codes from a media file wherein the method is carried out by a backend processor and its internal modules according to one embodiment.

Figure 3 is a flowchart showing a method for downloading and setting up a scanning application in the mobile device according to one embodiment.

Figure 4 is a flowchart showing a method for scanning and capturing images from the displaying media and identifying a vendor platform via a media targeting module of the j

backend processor and/or via association with a customer relationship management (CRM) system according to one embodiment.

Figure 5 is a flowchart showing a method for displaying the e-commerce and/or social TV modules of the vendor generated platform wherein the e-commerce element further comprises a payment and delivery element and an after-sale services element according to one embodiment.

Detailed description of the invention

A media scanning system according to this invention comprising: a backend processor (37), as illustrated in Figure 2, comprising the following components:

a source File preparation module (7) for converting a media file (8), preferably a video file, into a set of image frames (9) at 1 -1 ,000 frames per second, identifying a distinctive or unique feature or characteristic, or a fingerprint of each image frame ( 10) and adjusting each image frame to optimize transparency, such as by adjusting its color, sharpness, fingerprint location, and reducing or enlarging frame size to best fit its fingerprinted part;

a media identification and storage module ( 1 1 ) for creating, business condition- setting (e.g. platform display duration or other business terms and conditions) or storing a vendor platform ( 12, 13), and for matching the image frame with the associated vendor platform and recording the image frame after said association

(14); and

a media targeting module ( 15) for calculating and assigning an identifier code to each fingerprinted image file ( 16) from the module (1 1 ) and uploading each image to an internet-based system d 7), preferably a cloud-based system (17). - a mobile device d ) as illustrated in Figure I B including, but not limited to a mobile phone, a smart phone, a digital tablet, a digital camera, a lap-top, and other mobile devices with image capturing module, wherein the mobile device ( 1 ) comprising: an image capturing module (2), preferably a camera, attachable to one part of the front and/or back side of the mobile device for capturing at least one image in the media that is being displayed on a display device (5) wherein the display device including, but not limited to a TV, a lap-top, a digital tablet, a personal computer, a digital billboard, a digital kiosk, or other digital display device; and a scanning application (4) installing in the mobile device (1 ) as illustrated in

Figure 3 wherein the method (1 8) comprising downloading the scanning application < 19) from a digital distribution platform (e.g. Apple Store and Google

Play), accepting terms and conditions of use (20), registering user information

(21 ) on the application or transferring (23) existing user information from user's social media account (22) (e.g. Facebook, Twitter, Instagram) to the application, and starting the application (24). User information recorded and tracked by the application (4) is continuously updated and may be in-sync with user's social media account data and may comprise details on user's age, gender, race, nationality, occupation, location, language preferences, lifestyle and dietary preference, weight, height, medical and health conditions, religion, hobbies, and previous scanning, gaming, and purchasing activities: As illustrated in Figure 4, the method (25) of scanning, capturing, processing and displaying the images comprises the steps of scanning and capturing images (26) (e.g. as snapshots) from the media, reversing the images (27) received from the image capturing module

(2) into their assigned identifier codes (27), and sending to and matching said codes (28) with the media targeting module d 5) in order to identify and display the associated vendor platform (30) comprising at least one of business, product or service information offered in the media being displayed.

a customer relationship management (CRM) system (29) for identifying and recording user s interest based on the user information tracked and recorded in the scanning application (4) and/or the CRM system (29) and/or the backend processor (37) and/or via user s social media account, and for further assigning to and assisting the media targeting module ( 15) to display a suitable vendor platform for said user on his/her mobile device < b based on his/her tracked and recorded information. As demonstrated in Figure 4, one of the possible ways the CRM system can be utilized (29) is to assist the media targeting module (15) in the backend processor (37) to assign a suitable vendor platform based on user s past scanning and purchasing activities which can be obtained from the scanning application (4) or backend processor (37) or the CRM itself.

The vendor platform as described in this invention can be internally created and operated by the media scanning system administrator or externally created and operated by a third-party vendor, merchant, or advertiser wherein the vendor platform can be in at least one or more of the following forms: an online landing page, a website, a social media page, an offline landing page, a platform with e-commerce module, a platform with gaming module, a platform with social TV module, a database-driven page, a platform with video-streaming module, and a search engine. In one embodiment of the vendor platform with the e-commerce and the social TV modules (3 h as illustrated in Figure 5, the vendor platform being displayed

(32) comprising the e-commerce module (33) for various commercial activities such as, delivering coupons, selling and buying products and services, downloading digital content, buying tickets, and reserving products and services, and the social TV module (34) for various engagement activities such as gaming, quizzing and other forms of entertainment in order to detect rating of TV program or to help advertiser, vendor, or merchant to improve media-based product or service offerings. The e-commerce module (33) of the vendor platform further comprises the payment and delivery element (35) for calculating payment, making payment, confirming payment, delivering product or service, confirming product or service delivery and returning product, and the after-sale services element (36) for checking the payment, cancelling order or payment, tracking product or service delivery, evaluating customer satisfaction, and responding to user via an interactive voice response (IVR) or call center service. One method for scanning the media that may be considered together with the media scanning system as described above (Figures 2-5) generally comprising the following steps:

Step 1 : preparing the source file utilizing the source file preparation module <7) for preparing the media file (8) and converting the media file into a set of image frames (9), identifying the distinctive feature or fingerprint of each image frame, and adjusting each image frame to optimize transparency of said distinctive feature in each image frame ( 10); Step 2: matching the file with the vendor platform utilizing the media identification and storage module ( 1 1 ) for creating, business condition-setting or storing a vendor platform ( 12, 13) and for matching the image frame with the associated vendor platform and for recording the image frame after said association ( 14); Step 3: assigning an identifier code to image utilizing the media targeting module < 15) for calculating and assigning the identifier code to each fingerprinted image file from the media identification and storage module and for uploading each image to an internet-based system ( 16, 17);

Step 4: capturing images - utilizing the image capturing module (2) of the mobile device ( 1 ) for capturing images (26) in the media being displayed on the display device (5);

Step 5: processing the captured images and displaying the associated vendor platforms utilizing the downloaded scanning application (4), as demonstrated in Figure 3, with capacity for registering, tracking, and recording a user information on the mobile device ( 1 ) to reverse and record the images received from the image capturing module (2) into their assigned identifier codes (27), and to send said codes (28) to the media targeting module ( 15 ) in order to identify and display (30) the associated vendor platforms comprising at least one of business, product or service information offered in the media being displayed; and Step 6: assigning or additionally providing suitable vendor platforms to user utilizing a relationship management (CRM) system (29) for identifying and recording user s interest based on the user information tracked and recorded in the application (4), the CRM system (29), the backend processor (37), and/or the social media data, and for further assigning and assisting the media targeting module (15) to display the suitable vendor platforms (30) for said user on his/her mobile device based on his/her tracked and recorded information.

The vendor platforms as described in step 5 and 6 may comprise at least one or more of the e-commerce module (33) and the social TV module (34) as illustrated in Figure 5 and wherein the e-commerce module may further comprise the payment and delivery element (35) and after-sale services element (36)

Although this invention has been disclosed in the context of certain embodiments, it will be understood by those skilled in the art that the present invention extends beyond the specifically disclosed embodiments to other alternative embodiments and/or uses of the invention and obvious modifications and equivalents thereof. In addition, while several variations of the invention have been shown and described in detail, other modifications, which are within the scope of this invention, will be readily apparent to those of skill in the art based upon this disclosure. It is also contemplated that various combinations or sub-combinations of the specific features and aspects of the embodiments may be made and still fall within the scope of the invention. It should be understood that various features and aspects of the disclosed embodiments can be combined with, or substituted for, one another in order to form varying modes of the disclosed invention Thus, it is intended that the scope of the present invention herein disclosed should not be limited by the particular disclosed embodiments described above, but should be determined only by a fair reading of the claims that follow.

Claims

1. A media scanning system comprising:

a backend processor comprising:

a source file preparation module for converting a media file into a set of image frames, identifying a distinctive feature or a fingerprint of each image frame, and adjusting each image frame to optimize transparency of said distinctive feature in each image frame;

- a media identification and storage module for creating, business condition- setting or storing a vendor platform, and for matching the image frame with the associated vendor platform and recording the image frame after said association; and

a media targeting module for calculating and assigning an identifier code to each fingerprinted image file from the media identification and storage module and uploading each image to an internet-based system.

a mobile device comprising:

an image capturing module for capturing at least one image in the media that is being displayed on a display device; and

a scanning application for registering, tracking and recording a user information, reversing and recording the image received from the image capturing module into its assigned identifier code, and sending said code to the media targeting module in order to identify and display the associated vendor platform comprising at least one of business, product or service information offered in the media being displayed.

- a customer relationship management (CRM) system for identifying and recording user s interest based on the user information tracked and recorded and for further assigning and assisting the media targeting module to display a suitable vendor platform on user s mobile device based on his/her tracked and recorded information.

2. The media scanning system according to claim 1 wherein the source file preparation module converts the media file into a set of image frames at 1-1,000 frames per second.

3. The media scanning system according to any of the claims 1 or 2 wherein the media file is a video file.

4. The media scanning system according to claim 1 wherein the source file preparation module identifies the distinctive feature or fingerprint of each image frame and adjusts each frame s color, sharpness, and fingerprint location.

5. The media scanning system according to claim 1 wherein the source file preparation module reduces or enlarges each image file size to best fit its fingerprinted part.

6. The media scanning system according to claim 1 wherein the media identification and storage module receives the vendor platform s display duration or other business requirement information from and set by vendor.

7. The media scanning system according to claim 1 wherein the internet-based system is a cloud-based system.

8. The media scanning system according to claim 1 wherein the mobile device is chosen from a mobile phone, a smart phone, a digital tablet, a digital camera, a lap-top, and other mobile device with image capturing module.

9. The media scanning system according to any of the claims 1 or 8 wherein the image capturing module is a camera attachable to one part of the mobile device.

10. The media scanning system according to claim 1 wherein the scanning application is downloadable from a digital distribution platform.

1 1. The media scanning system according to claim 1 wherein the user information registered, tracked and recorded in the scanning application is further incorporated from or via a users social media account.

12. The media scanning system according to claim 1 wherein the user information is tracked and recorded in the CRM system.

13. The media scanning system according to claim 1 wherein the user information is tracked and recorded in the backend processor.

14. The media scanning system according to claim 1 wherein the user information is tracked and recorded in the CRM system and the backend processor.

15. The media scanning system according to any of the claims 12-14 wherein the user information is incorporated from or via a user s social media account.

16. The media scanning system according to claim 1 wherein the vendor platform has an e- commerce module for serving at least one of the purposes of distributing coupons, buying and selling of products or services, downloading digital content, buying tickets, and reserving products.

17. The media scanning system according to claim 1 wherein the vendor platform has a social TV module for engaging user through gaming, quizzing, or other form of entertainment.

18. The media scanning system according to claim 1 wherein the vendor platform comprising.

an e-commerce module for serving at least one of the purposes of distributing coupons, buying and selling of products or services, downloading digital content, buying tickets, and reserving products; and

a social TV module for engaging user through gaming, quizzing, or other form of entertainment.

19. The media scanning system according to any of the claims 16 or 18 wherein the e- commerce module of the vendor platform comprising:

- a payment and delivery element for calculating payment, making payment, confirming payment, delivering product or service, confirming product or service delivery, and returning product; and

an after-sale services element for checking the payment, canceling order or payment, tracking product or service delivery status, evaluating user satisfaction, and contacting and responding to user via an interactive voice response (IVRj or a call center service.

20. The media scanning system according to any of the claims 16-19 wherein the CRM system contributes to identification and assignment of the suitable vendor platform to its user based on tracked and recorded user information.

21. The media scanning system according to any of the claims 1 , 1 1, 12, 13, 14, 15 or 20 wherein the user information includes at least one of the following: age, gender, race, education, nationality, occupation, location, language preferences, lifestyle and dietary preferences, weight, height, medical and health conditions, religion, hobbies, and previous scanning, gaming, and purchasing activities.

22. A method for scanning media comprising the following steps: firstly, preparing a source file by utilizing a source file preparation module of a backend processor for converting a media file into a set of image frames, identifying a distinctive feature or a fingerprint of each image frame, and adjusting each image frame to optimize transparency of said distinctive feature in each image frame; secondly, matching the file with a vendor platform by utilizing a media identification and storage module of the backend processor for creating, business condition-setting or storing a vendor platform, and for matching the image frame with the associated vendor platform and for recording the image frame after said association;

thirdly, assigning an identifier code to image by utilizing a media targeting module of the backend processor for calculating and assigning the identifier code to each fingerprinted image file from the media identification and storage module and for uploading each image to an internet-based system;

fourthly, capturing image by utilizing an image capturing module of a mobile device for capturing at least one image in the media being displayed on a display device; fifthly, processing the captured image and displaying the vendor platform by utilizing a scanning application with capacity for registering, tracking, and recording a user information on the mobile device to reverse and record the image received from the image capturing module into its assigned identifier code, and to send said code to the media targeting module in order to identify and display the associated vendor platform comprising at least one of business, product or service information offered in the media being displayed; and

lastly, assigning the suitable vendor platform to user by utilizing a relationship management (CRM) system for identifying and recording user's interest based on the user information tracked and recorded and for further assigning and assisting the media targeting module to display a suitable vendor platform for said user on his/her mobile device based on his/her tracked and recorded information.

23. The method for scanning media according to claim 22 wherein the first step provides that the source file is converted into a set of image frames at 1-1,000 frames per second.

24. The method for scanning media according to any of the claims 22 or 23 wherein the first step provides that the source file is a video file.

25. The method of scanning media according to claim 22 wherein the first step provides that the distinctive feature or fingerprint of each image frame is detected by the source file preparation module and is adjusted for its color, sharpness, and fingerprint location accordingly.

26. The method of scanning media according to claim 22 wherein the first step provides that the source file preparation module can reduce or enlarge each image file size to best fit its fingerprinted part.

27. The method of scanning media according to claim 22 wherein the second step provides that the media identification and storage receives the vendor platform's display duration or other business requirement information from or set by vendor.

28. The method of scanning media according to claim 22 wherein the third step provides that the internet-based system is a cloud-based system.

29. The method of scanning media according to claim 22 wherein the fourth step provides that the mobile device is chosen from a mobile phone, a smart phone, a digital tablet, a digital camera, a lap-top, and other mobile device with image capturing module.

30. The method of scanning media according to any of the claims 22 or 29 wherein the fourth step provides that the image capturing module is a camera attachable to one part of the mobile device.

31. The method of scanning media according to claim 22 wherein the fifth step provides that the scanning application is downloadable from a digital distribution platform.

32. The method of scanning media according to claim 22 wherein the fifth step or the last step provides that the user information registered, tracked and recorded in the scanning application is incorporated from or via a users social media account information.

33. The method of scanning media according to claim 22 wherein the last step provides that the user information is tracked and recorded in the CRM system.

34. The method of scanning media according to claim 22 wherein the last step provides that the user information is tracked and recorded in the backend processor.

35. The method of scanning media according to claim 22 wherein the last step provides that the user information is tracked and recorded in the CRM system and the backend processor.

36. The method of scanning media according to any of the claims 33-35 wherein the last step provides that the user information is further incorporated from or via a users social media account.

37. The method of scanning media according to claim 22 wherein the fifth step provides that the vendor platform has an e-commerce module for serving at least one of the purposes of distributing coupons, buying and selling of products or services, downloading digital content, buying tickets, and reserving products.

38. The method of scanning media according to claim 22 wherein the fifth step provides that the vendor platform has a social TV module for engaging user through gaming, quizzing, or other form of entertainment.

39. The method of scanning media according to claim 22 wherein the fifth step provides that the vendor platform comprising:

40. The method of scanning media according to any of the claims 37 or 39 wherein the fifth step provides that the e-commerce module of the vendor platform comprising:

- an after-sale services element for checking the payment, canceling order or payment, tracking product or service delivery status, evaluating user satisfaction, and contacting and responding to user via an interactive voice response (IVR) or a call center service.

41. The method of scanning media according to any of the claims 37-40 wherein the CRM system contributes to identification and assignment of the suitable vendor platform to its user based on tracked and recorded user information.

42. The method of scanning media according to any of the claims 22, 32, 33, 34, 35, 36, and 40 wherein the user information includes at least one of the following: age, gender, race, nationality, education, language preferences, occupation, location, lifestyle and dietary preferences, weight, height, medical and health conditions, religion, hobbies, and previous scanning, gaming, and purchasing activities.