WO2015006134A1 - Embedded barcodes for displaying context relevant information - Google Patents

Embedded barcodes for displaying context relevant information Download PDF

Info

Publication number
WO2015006134A1
WO2015006134A1 PCT/US2014/045264 US2014045264W WO2015006134A1 WO 2015006134 A1 WO2015006134 A1 WO 2015006134A1 US 2014045264 W US2014045264 W US 2014045264W WO 2015006134 A1 WO2015006134 A1 WO 2015006134A1
Authority
WO
WIPO (PCT)
Prior art keywords
barcode
information
user
imperceptible
supplemental information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2014/045264
Other languages
English (en)
French (fr)
Inventor
Keir Finlow-Bates
Koushik ANNAPUREDDY
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority to CN201480038857.0A priority Critical patent/CN105359547B/zh
Priority to JP2016525385A priority patent/JP2016527788A/ja
Priority to KR1020167001685A priority patent/KR20160030951A/ko
Priority to EP14747185.8A priority patent/EP3020211A1/en
Publication of WO2015006134A1 publication Critical patent/WO2015006134A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1439Methods for optical code recognition including a method step for retrieval of the optical code
    • G06K7/1447Methods for optical code recognition including a method step for retrieval of the optical code extracting optical codes from image or text carrying said optical code
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6581Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • the present embodiments relate to image display systems, and in particular, to systems and methods for embedding supplemental information in an image or video and displaying preferred information to viewers.
  • Many visual presentations such television shows or movies, include information in addition to the still video images that make up the presentation.
  • additional information such as subtitles in a variety of languages, director's commentary, closed captioning, or interesting facts may be available for selection through a menu.
  • this particular solution may be time consuming and often complex to execute by an average user.
  • menu-oriented systems for presenting supplemental information do not automatically present the viewer with the desired information while the movie is playing. Displaying all additional information at once may clutter the display area and overwhelm a viewer. Accordingly, it can be desirable to provide visual presentation systems which automatically present each user with information relevant to that user.
  • the barcode embedding and detection techniques described provide a way to embed supplemental information into a visual presentation, provide the supplemental information to a user device, and display preferred information to the user.
  • the system may include two components, a subliminal frame, or frames, in the visual presentation and a user presentation device which can detect the frame or frames and output information according to user preferences.
  • the subliminal frames may comprise a barcode, such as a matrix or 2D barcode, which is not visible to the viewer.
  • a barcode such as a matrix or 2D barcode
  • Some embodiments of the barcodes may be non-visible to the human eye because they are spliced, physically or digitally, into a moving picture frame shown for too brief a time to be detectable to the human eye, though still detectable by a camera sensor.
  • Such barcodes are referred to herein as "subliminal barcodes.”
  • Other embodiments may display the barcodes superimposed over the visual presentation in infrared or ultraviolet light, which is outside of the visible spectrum but still detectable by camera sensors. For example, in one embodiment of an embedded subliminal barcode system, a movie may be projected onto a UV or IR reflective surface.
  • non-visible barcodes Such barcodes are referred to herein as “non-visible barcodes," where the term non-visible denotes that the wavelength of light is outside of the visible spectrum of the typical human eye, though still detectable by a device such as an image sensor.
  • imperceptible barcode may refer to either a subliminal barcode or a non-visible barcode, wherein a user watching a video with an imperceptible barcode would not notice an embedded imperceptible barcode. While a movie viewer would only be aware of the projected movie, a device of the viewer may be configured to detect reflected UV or IR barcodes and would thus be able to provide the viewer with additional information about the movie, though the viewer was unaware of the barcodes.
  • a personal computing device may store preferences of a viewing user regarding preferred supplemental information, and, upon detection of a barcode in the image using a sensor of the personal computing device, the device may decode the barcode and display any available preferred information to the user.
  • Some embodiments of the personal computing device may comprise a heads-up display (HUD) or head-mounted display (HMD) system for presenting information to the user.
  • HUD heads-up display
  • HMD head-mounted display
  • an image and information display system may comprise at least one image; at least one barcode, the at least one barcode representing supplemental information about the at least one image, wherein the at least one barcode is configured to be subliminal or non-visible to the human eye; and a personal computing device of a user, the personal computing device comprising a detector configured to detect the at least one barcode, a display portion, and a processor configured to decode the supplemental information, retrieve at least one user information preference, and, if the supplemental information contains information relevant to the at least one user information preference, display the relevant information to the user on the display.
  • a method of displaying embedded information comprises generating at least one barcode representing supplemental information about an image; embedding the at least one barcode into the image, wherein the at least one barcode is embedded subliminally or non-visibly; and displaying the image with the at least one embedded barcode.
  • the image may a video comprising a plurality of frames, and embedding the at least one barcode into the image may further comprise splicing the at least one barcode into a barcode frame between a first frame and a subsequent frame of the plurality of frames.
  • the at least one barcode may comprise infrared or ultraviolet light, and embedding the at least one barcode into the image may further comprise overlaying at least a portion of the image with the infrared or ultraviolet light.
  • a method of presenting embedded information to a user may comprise scanning an image with a portable computing device of the user, wherein the image comprises at least one subliminally embedded barcode representing supplemental information about the image; detecting the at least one subliminally embedded barcode; decoding the supplemental information; retrieving at least one user information preference; and comparing the supplemental information to the at least one user information preference; wherein, if the supplemental information contains information relevant to the at least one user information preference, the method further comprises displaying the relevant information to the user on the portable computing device.
  • a user presentation device for displaying additional information to a user may comprise means for scanning an image, wherein the image comprises at least one subliminally embedded barcode representing supplemental information about the image; means for detecting the at least one subliminally embedded barcode; means for decoding the supplemental information; means for retrieving at least one information preference of a user; means for comparing the supplemental information to the at least one information preference; and means for presenting information to the user, wherein, if the supplemental information contains information relevant to the at least one information preference, the relevant information is presented to the user.
  • FIGS. 1A-C illustrates an embodiment of supplemental information display system
  • FIG. 2 illustrates another embodiment of supplemental information display system
  • FIG. 3 illustrates an embodiment of a supplemental information display process
  • FIGS. 4A-D illustrates various embodiments of moving picture display systems with embedded imperceptible barcodes
  • FIG. 5 illustrates an embodiment of infrared non-visible barcode display and detection process.
  • One embodiment relates to systems, methods and apparatus for embedding supplemental information in a visual presentation, detecting the supplemental information, and displaying preferred supplemental information to a user.
  • visual presentations such as movies or television shows
  • optional supplemental information that a viewer may select for display, for example subtitles of a selected language, closed captioning, or director's commentary.
  • Such systems do not automatically present the additional information desired by the viewer.
  • some embodiments of the present disclosure provide systems and methods for automatically presenting a viewer with any available desired supplemental information.
  • some embodiments described herein relate to a user device which is able to detect subliminal barcodes in a movie, decode the information associated with the barcode, and display at least some of the information based on specified preferences of the viewer. For example, a user may specify that they would like to see French subtitles in movies when French subtitles are available.
  • a movie may be provided with embedded imperceptible barcodes containing extra information about the movie, and when the user's personal computing device detects barcodes containing French subtitle information, the device may display those subtitles to the user.
  • Some embodiments provide imperceptible barcodes by inserting subliminal barcodes into a moving picture frame, wherein the subliminal barcodes are shown for too brief a time to be detectable to the human eye, for example at at least 24 frames per second.
  • Other embodiments may provide imperceptible barcodes by superimposing non-visible barcodes over the visual presentation, wherein the non- visible barcodes are displayed in ultraviolet or infrared (UV/IR) light, which is not visible to the typical human eye.
  • UV/IR ultraviolet or infrared
  • the visible spectrum, or visible light is the portion of the electromagnetic spectrum that can be detected by the human eye. A typical human eye will respond to light having wavelengths from approximately 380 to 700 nm.
  • infrared light refers to light having a wavelength longer than that of visible light, or light having a wavelength in the range of approximately 700 nm to 1 mm; ultraviolet light refers to light having a wavelength shorter than that of visible light, or light having a wavelength of approximately 10 nm to 380 nm.
  • both the quickly-displayed barcode frame and the UV/IR barcodes are detectable by a camera on the user's portable computing device, such as a handheld device or heads-up display.
  • the examples may be described as a process, which is depicted as a flowchart, a flow diagram, a finite state diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel, or concurrently, and the process can be repeated. In addition, the order of the operations may be rearranged.
  • a process is terminated when its operations are completed.
  • a process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a software function, its termination corresponds to a return of the function to the calling function or the main function.
  • FIG. 1A-C an embodiment of an exemplary supplemental information display 100 is depicted in the context of a motion picture.
  • the system 100 comprises a first movie frame 102, a supplemental information frame 104, a second movie frame 106, and a user device 1 10.
  • the user device 1 10 comprises an optical sensor 1 12 and a display 1 14.
  • the first movie frame 102, supplemental information frame 104, and second movie frame 106 may be displayed in some embodiments in a movie theater, for example on a projection screen. In other embodiments, the first movie frame 102, supplemental information frame 104, and second movie frame 106 may be displayed on a user device such as a television, computer, tablet, game console, smartphone, etc.
  • the supplemental information frame 104 is illustrated as containing a matrix barcode. Though depicted as a matrix barcode and discussed in the context of barcodes herein, it will be appreciated that the supplemental information may be conveyed by any optically detectable machine-readable representation of data.
  • the user device 1 10 is depicted as cinema glasses, this is intended for illustrative purposes only and is not intended to limit the types of user devices which may detect subliminal barcodes and present supplemental information to a user.
  • the user device may be a heads-up display (HUD) or head- mounted display (HMD), which may be equipped with a transparent or translucent display element or other means of projecting visual information over the user's field of view.
  • the user device may be a handheld portable computing device such as a tablet computer, smartphone, personal digital assistant (PDA), or handheld gaming console, or the device may be wearable, such as a watch or a pendant.
  • Such embodiments may employ a screen, such as an LCD or LED screen, to display visual supplemental information to a user, and may further comprise touch-sensitive display technology.
  • Some embodiments of the user device may employ contact lenses with a display element or virtual retinal display to provide information to a user.
  • some embodiments may comprise an auditory element to provide a user with auditory supplemental information, such as a speaker or headphone jack. This may be used, for example, to present an audio stream of director's commentary on a movie.
  • user device 1 10 may be any ubiquitous computing device or augmented reality device capable of information processing and presentation.
  • the user device 1 10 may be equipped with an optical sensor 112 configured to detect barcodes, among other visual information.
  • the sensor 1 12 can be, for example, a charge-coupled device (CCD), a complementary metal-oxide semiconductor (CMOS) sensor, a photodiode, or the like.
  • the sensor 1 12 may be incorporated into an image sensing device such as a camera, which may scan images for barcodes.
  • the sensor may be incorporated into a barcode reader additionally comprising a light source, for example a laser, and the light source may be used to scan images for barcodes.
  • the light source may comprise ultraviolet or infrared light.
  • the barcodes may be detectable only by light within the ultraviolet or infrared spectrum and would thus be invisible to the human eye.
  • the user device 110 may be equipped with additional input devices, for example a wireless network connection or microelectromechanical systems (MEMS) sensors such as a gyroscope, accelerometer, GPS, indoor tracking/positioning system, and solid state compass, which may, in some embodiments, be used in conjunction with or instead of the optical sensor 112 to determine when to display a user with additional information.
  • MEMS microelectromechanical systems
  • GPS and/or indoor position coordinates may indicate to the user device that the user is in a movie theater or in front of a movie screen.
  • a solid state compass may indicate when the user turns their head away from the movie screen, or location coordinates may indicate when the user has left the theater, and the device may stop displaying supplemental information when the user is not facing or in front of the movie screen.
  • an embedded imperceptible barcode supplemental information display system employed in a museum may use location coordinates of pieces of interest to indicate to user device 1 10 that a barcode containing supplemental information may be present.
  • a user may view a first movie frame 102 through the display 1 14 of user device 110.
  • a subliminal barcode frame 104 may be presented between the first movie frame 102 and the second movie frame 106.
  • the optical sensor 112 of the user device may scan the subliminal barcode frame 104 and detect the barcode.
  • the user device may decode the information contained in the barcode and present relevant information to the user, for example the subtitles 1 16 presented on the display 1 14.
  • a supplemental information display system 200 comprises a visual presentation 210 and a user device 220.
  • the visual presentation 210 may be, as illustrated, a motion picture, and may comprise one or more subliminal barcode frames 212. Though discussed in the context of subliminal barcodes, it will be appreciated that the system 200 may operate with non-visible barcodes as well.
  • the user device 220 may comprise an optical sensor 222, a barcode decoder 240, a processor 226, a display 228, and a data store 230.
  • the subliminal barcode frame 212 may comprise a barcode containing supplemental information about the motion picture 210. As will be described in more detail below, in some embodiments the subliminal barcode frame 212 may be visible but spliced in between frames and displayed too briefly to be detected by the human eye. In other embodiments, the subliminal barcode frame 212 may be embedded in one or more frames of the motion picture 210 but may comprise infrared or ultraviolet light and therefore be undetectable by the human eye. However, the optical sensor 222 of the user device 220 may be configured to detect the subliminal barcode frame 212 even when it is not visible to the human eye.
  • Data representing the barcode in the subliminal barcode frame 212 may be passed from the optical sensor 222 to the barcode decoding module 240.
  • the sensor may capture an image of the barcode comprising an array of pixels.
  • a data stream representing the array of pixels may be transmitted to the barcode decoding module 240.
  • a type of barcode present in the subliminal barcode frame 212 may be recognized, for example a matrix barcode.
  • one or more processes such as denoising, grayscale extraction, adaptive brightness equalization, and binarization of pixel values may be carried out on the captured image of the barcode prior to decoding the barcode.
  • the barcode 242 may be decoded by known decoding techniques for example feature or pattern identification, extracting a bitmap from the barcode, and code word extraction.
  • the information contained in the barcode 242 may comprise the available supplemental information 244 for potential display to a user.
  • the supplemental information 244 may be encoded in the barcode 242 together with header information 246 identifying the type or types of supplemental information contained in the barcode 242, so that upon decoding the information, the user device 220 may quickly identify the type of supplemental information available for display.
  • the supplemental information may also be associated with display information, for example an audio file or a specified duration for displaying subtitles.
  • the barcode 242 may contain a link or pointer to a location where the supplemental information may be obtained.
  • user device 220 may further comprise a wireless communication means such as WiFi, Bluetooth, or access to a telecommunications network.
  • the barcode may be decoded to reveal a hyperlink to an Internet-based data store of supplemental information, and the user device 220 may access the data store via the wireless communication means.
  • the supplemental information 244 may comprise any information relating to the visual presentation 210. Although only one piece of supplemental information 244 is illustrated, it will be appreciated that this is for clarity of illustration and that a barcode may be encoded with a large amount of supplemental information. However, a user may be overwhelmed if all available supplemental information is presented at once. Therefore, after the contents of the barcode are decoded, the decoded supplemental information is passed to the processor 226. The processor 226 compares the types of available supplemental information which has been decoded with user preferences. If there is a match, then the available and preferred information is sent to the display module 228 for presentation to the user.
  • the display 228 of the user device 220 may be used to present supplemental information to the user.
  • the matrix barcode has been decoded to reveal French subtitles, and the user information specifies that the user desires to see French subtitles. Therefore, "Vous sentez-vous chanceux?" will be displayed to the user.
  • the display 228 may be a visual display such as an LCD or LED screen, a HUD display panel, holographic display, or the like.
  • the display 228 may be an auditory display such as an audio stream transmitted through a speaker or headphones.
  • Tactile means conveying information to a user may be employed as well, for example a refreshable braille display.
  • a combination of display means may be employed by some embodiments of the user device 220.
  • the display 228 may be static or may be configured to present changing information according to the contents of the barcode 242.
  • Data store 230 may be used to store the user information preferences.
  • user information preferences may comprise subtitles in a plurality of languages, and one or more languages may be selected 232 as desired information.
  • user information preferences in the context of a motion picture may also specify what, if any, information is desirable to display with respect to director's commentary, closed captioning, supplemental character information, actor biographies, etc.
  • Data store 230 may be incorporated into the user device 220 or may be stored remotely in a network accessible by the user device 220.
  • the display 228 may also be used to present a user interface in which the user may make selections regarding types of desired supplemental information.
  • the preference specification user interface may be presented, for example, upon the user opening a software application or when the user device 220 detects a subliminal barcode.
  • the device 220 may determine that the user is at a theater, and the user may be prompted at the beginning of a motion picture to specify preferences regarding desired available information.
  • the user may specify a set of desired supplemental information to be displayed at any future time. Whenever the device 220 detects a subliminal barcode containing specified desired information, the device 220 may display such information to the user.
  • FIG. 3 depicts an embodiment of a supplemental information display process 300 which may be carried out in the portable computing devices 110 and 220 of Figures 1A-C and 2.
  • the process 300 begins at step 305 in which the portable computing devices scans for an embedded imperceptible barcode.
  • an imperceptible barcode is unnoticeable by a viewing user, but may be detectable by a computing device of the user.
  • the optical sensors 1 12 and 222 described above with respect to Figures 1A-C and 2 may be used to carry out step 305 in some embodiments.
  • the process 300 loops back to step 305 to scan for an embedded barcode.
  • the process 300 may continuously or periodically execute step 305 even while other steps of the process 300 is being carried out.
  • step 310 If, at step 310, a barcode is detected, then the process 300 transitions to step 315 in which the portable computing device reads information associated with the barcode. In some embodiments this may be carried out by the barcode decoding module 240 of Figure 2. In embodiments in which the barcode is decoded to contain a pointer or link identifying a location of a data store of supplemental information, step 315 may further comprise accessing the identified supplemental information database. The process 300 then moves to step 320 in which user preferences for displaying supplemental information are retrieved. For example this may be accomplished by accessing the data store 220 of Figure 2. At step 325, the process 300 compares the information decoded from the barcode with the user preferences, for instance by using the processor 226 of Figure 2.
  • the process 300 determines whether preferred information is available in the supplemental information decoded from the barcode. If no preferred information is available, the process 300 loops back to step 305 to scan for a new embedded imperceptible barcode. If preferred information is available, then the process 300 transitions to step 335 in which the preferred information is presented to the user for a specified duration.
  • the information may comprise a subtitle and may be specified for display for the duration of some portion of dialogue.
  • the process 300 After completing the step 335 of displaying preferred information to a user, the process 300 loops back to step 305 to scan for further embedded imperceptible barcodes. In some embodiments, the process 300 may continue looping back to step 305 for a specified duration, for example the length of a movie. In certain embodiments, the process 300 may continue as long as a supplemental information display program or application is open on the user device. In other embodiments a user device may be configured to execute the process 300 whenever it is powered on.
  • Figure 4A illustrates an embodiment in which a barcode frame 415 has been spliced between frames in a movie 414.
  • a barcode frame may be physically spliced between frames in cellulose film.
  • the movie 414 is pictured as comprising a series of frames on physical film, it will be appreciated that the movie may also be a digital file comprising a plurality of frames.
  • the barcode frame 415 may be digitally spliced between frames of a digital movie file.
  • the movie 414 containing at least one spliced barcode 415 is then sent to a projector 420 for display.
  • the movie 414 may also be stored as a digital file for playback on an electronic display.
  • Figure 4B illustrates an embodiment in which a barcode insertion system 410 communicates with the projector 420.
  • Some embodiments of barcode insertion system 410 may provide subliminal barcodes by inserting the barcodes into a moving picture frame shown for too brief a time to be detectable to the human eye, for example at a rate of at least 24 frames per second.
  • the barcode insertion system 410 may be part of a computing device.
  • the barcode insertion system 410 may comprise a data store (not illustrated) configured to store a movie file 411 as well as at least one barcode 412.
  • the movie file 411 and at least one barcode 412 may be sent to a merging module 413.
  • the merging module 413 may insert the at least one barcode 412 between the relevant frames in the movie 411, creating a second movie file 414 with at least one spliced barcode 415.
  • the barcode insertion may occur in realtime during the display of the movie. In other embodiments the barcode insertion may occur in advance of a movie showing and a data file comprising the second movie file 414 with at least one spliced barcode 415 may be digitally stored for later playback.
  • the barcode insertion system 410 may send the second movie file 414 to the projector 420 or another display device.
  • Figure 4C illustrates another embodiment in which a barcode insertion system 410 communicates with the projector 420.
  • the barcode insertion system 410 may provide non-visible barcodes, e.g. UV or IR barcodes.
  • the barcode insertion system 410 may be part of a computing device.
  • the barcode insertion system 410 may comprise a data store (not illustrated) configured to store a movie file 411 as well as at least one barcode 412.
  • the movie file 411 and at least one barcode 412 may be sent to a merging module 413.
  • the merging module 413 may be configured to embed the at least one barcode 412 in the relevant frames in the movie 411, for example by overlaying the barcode 412, creating a second movie file 414 with at least one embedded imperceptible barcode 416. As discussed above, the barcode embedding may occur in real-time during the display of the movie or in advance of a movie showing.
  • the barcode insertion system 410 may send the second movie file 414 to the projector 420 or another display device configured to display both visible images and UV/IR barcodes.
  • Figure 4D illustrates another embodiment in which a barcode insertion system 410 communicates with the projector 420. Similar to the embodiment illustrated in Figure 4C, this embodiment may provide non-visible barcodes, e.g. UV or IR barcodes. The embodiment of Figure 4D may also provide subliminal barcodes.
  • a movie file 411 and at least one barcode 412 may be passed to a synchronization module 417.
  • the synchronization module may store the movie file 41 1 and at least one barcode 412 and send them to a movie projector 420 and a UV/IR barcode projector 430, respectively.
  • non-visible barcode display and detection process 500 will now be described with greater detail with respect to Figure 5.
  • the process 500 may be carried out using moving picture display systems such as described with respect to Figures 4C and 4D above.
  • the process 500 beings at step 505, in which a display surface reflective to IR and/or UV frequencies of light is provided, dependent upon the frequency of light which will be used to display non-visible barcodes.
  • the surface may also have material properties which are conducive to high-quality display of a movie in the visible spectrum of light.
  • the process 500 then transitions to step 510 in which a movie overlaid with non-visible barcodes is generated, for example by the barcode insertion system 410 of Figures 4C-D described above.
  • the movie generated in step 510 is projected onto the surface provided in step 505.
  • Step 515 may be executed throughout the remainder of the process 500, as the barcode detection steps 520 through 535 are carried out during playback of the movie projected in step 515.
  • a camera with an IR or UV filter scans the surface for barcodes.
  • the camera may be the optical sensors 112 and 222 described above in Figures 1 and 2. If, at step 525, a barcode is not detected, then the process 500 loops back to step 520 to scan for barcodes. If, at step 525, a barcode is detected, then the process 500 moves to step 530 in which the barcode is decoded to obtain supplemental information about the film. For example, the decoding may be carried out by the barcode decoder 240 of Figure 2 as described above. Next, at step 535, any relevant available supplemental information is displayed for a specified period of time. The process 500 then moves to step 540 in which it is determined whether the movie is over. If the movie is not over, the process 500 loops back to step 520 to scan for additional barcodes. If, at step 540, it is determined that the movie is over, then the process 500 ends.
  • UV or IR barcodes to convey information has a wide range of applications in other contexts.
  • the example of barcodes superimposed over motion picture frames is intended to illustrate and not limit the use of such barcodes.
  • UV/IR barcodes may be used to convey additional information about still images, groceries, commercial products, books, etc.
  • Museums or art galleries may benefit from the use of UV/IR barcodes superimposed over items of interest, such as on a protective glass or acrylic panel, to provide viewers with supplemental information about the items of interest.
  • a viewer's device may be configured to detect and decode the barcode and provide relevant supplemental information according to user preferences, as described above.
  • the technology is operational with numerous other general purpose or special purpose computing system environments or configurations.
  • Examples of well-known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, processor-based systems, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
  • instructions refer to computer-implemented steps for processing information in the system. Instructions can be implemented in software, firmware or hardware and include any type of programmed step undertaken by components of the system.
  • a processor may be any conventional general purpose single- or multi-chip processor such as a Pentium ® processor, a Pentium ® Pro processor, a 8051 processor, a MIPS ® processor, a Power PC ® processor, or an Alpha ® processor.
  • the processor may be any conventional special purpose processor such as a digital signal processor or a graphics processor.
  • the processor typically has conventional address lines, conventional data lines, and one or more conventional control lines.
  • the system is comprised of various modules as discussed in detail. As can be appreciated by one of ordinary skill in the art, each of the modules comprises various sub-routines, procedures, definitional statements and macros. Each of the modules are typically separately compiled and linked into a single executable program.
  • each of the modules is used for convenience to describe the functionality of the preferred system.
  • the processes that are undergone by each of the modules may be arbitrarily redistributed to one of the other modules, combined together in a single module, or made available in, for example, a shareable dynamic link library.
  • the system may be used in connection with various operating systems such as Linux®, UNIX® or Microsoft Windows®.
  • the system may be written in any conventional programming language such as C, C++, BASIC, Pascal, or Java, and ran under a conventional operating system.
  • C, C++, BASIC, Pascal, Java, and FORTRAN are industry standard programming languages for which many commercial compilers can be used to create executable code.
  • the system may also be written using interpreted languages such as Perl, Python or Ruby.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • a general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
  • a processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • the functions and methods described may be implemented in hardware, software, or firmware executed on a processor, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer- readable medium.
  • Computer-readable media include both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another.
  • a storage medium may be any available media that can be accessed by a computer.
  • such computer- readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
  • any connection is properly termed a computer-readable medium.
  • the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave
  • DSL digital subscriber line
  • wireless technologies such as infrared, radio, and microwave
  • Disk and disc includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Toxicology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • Health & Medical Sciences (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
PCT/US2014/045264 2013-07-12 2014-07-02 Embedded barcodes for displaying context relevant information Ceased WO2015006134A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201480038857.0A CN105359547B (zh) 2013-07-12 2014-07-02 用于显示背景相关信息的嵌入式条形码
JP2016525385A JP2016527788A (ja) 2013-07-12 2014-07-02 コンテキスト関連情報を表示するための埋め込まれたバーコード
KR1020167001685A KR20160030951A (ko) 2013-07-12 2014-07-02 컨텍스트 관련 정보를 디스플레이하기 위한 내장된 바코드들
EP14747185.8A EP3020211A1 (en) 2013-07-12 2014-07-02 Embedded barcodes for displaying context relevant information

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/941,252 US9471824B2 (en) 2013-07-12 2013-07-12 Embedded barcodes for displaying context relevant information
US13/941,252 2013-07-12

Publications (1)

Publication Number Publication Date
WO2015006134A1 true WO2015006134A1 (en) 2015-01-15

Family

ID=51263486

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/045264 Ceased WO2015006134A1 (en) 2013-07-12 2014-07-02 Embedded barcodes for displaying context relevant information

Country Status (6)

Country Link
US (1) US9471824B2 (enExample)
EP (1) EP3020211A1 (enExample)
JP (1) JP2016527788A (enExample)
KR (1) KR20160030951A (enExample)
CN (1) CN105359547B (enExample)
WO (1) WO2015006134A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101557829B1 (ko) * 2013-08-07 2015-10-06 (주) 엠티콤 음성 기반 재생정보 생성 및 인식 방법 및 기록 매체
US20150332623A1 (en) * 2014-05-15 2015-11-19 Elwha Llc Unobtrusive visual messages
US9508110B2 (en) 2014-05-15 2016-11-29 Elwha Llc Unobtrusive audio messages
US9525918B2 (en) * 2014-06-25 2016-12-20 Rovi Guides, Inc. Systems and methods for automatically setting up user preferences for enabling subtitles
US9538251B2 (en) 2014-06-25 2017-01-03 Rovi Guides, Inc. Systems and methods for automatically enabling subtitles based on user activity
US9456132B2 (en) * 2014-12-19 2016-09-27 Semiconductor Components Industries, Llc Image sensor system for detection and information processing based on user preferences
US9749685B2 (en) * 2015-07-23 2017-08-29 Echostar Technologies L.L.C. Apparatus, systems and methods for accessing information based on an image presented on a display
US9870049B2 (en) 2015-07-31 2018-01-16 Google Llc Reflective lenses to auto-calibrate a wearable system
WO2017106072A2 (en) 2015-12-17 2017-06-22 Technicolor Usa, Inc. Personalized presentation enhancement using augmented reality
CN116778367A (zh) * 2016-06-03 2023-09-19 奇跃公司 增强现实身份验证
US9563798B1 (en) * 2016-08-23 2017-02-07 V.L. Engineering, Inc. Reading invisible barcodes and other invisible insignia using physically unmodified smartphone
WO2018198646A1 (ja) * 2017-04-28 2018-11-01 ソニー株式会社 通信装置、通信システム、およびデータ通信方法、並びにプログラム
WO2018208293A1 (en) * 2017-05-09 2018-11-15 Visa International Service Association Video matrix barcode system
JP6972729B2 (ja) * 2017-07-24 2021-11-24 コニカミノルタ株式会社 画像表示システム、資料提供支援装置、資料取得装置、資料提供支援方法、およびコンピュータプログラム
WO2019022716A1 (en) 2017-07-25 2019-01-31 Visa International Service Association REAL TIME CROSSING MATCH DATA
US11176746B2 (en) * 2019-11-08 2021-11-16 Msg Entertainment Group, Llc Modulated display AR tracking systems and methods
KR102285663B1 (ko) * 2020-01-10 2021-08-04 (주)얼라이브엔터테인먼트 코드 추출을 통한 영상 콘텐츠 오버래핑 시스템
US11347823B2 (en) 2020-02-18 2022-05-31 The DTX Company Refactoring of static machine-readable codes
US11205105B1 (en) 2020-08-09 2021-12-21 The DTX Company Machine-readable label generator
JP7626142B2 (ja) * 2020-09-16 2025-02-04 ソニーグループ株式会社 情報処理装置、情報処理方法、およびプログラム
US11593579B2 (en) 2021-01-04 2023-02-28 The DTX Company Multiplexed quick response (“QR”) code experience derivation
JP7725870B2 (ja) * 2021-05-26 2025-08-20 セイコーエプソン株式会社 表示方法および表示システム
US11599757B1 (en) 2021-08-24 2023-03-07 The DTX Company Collectible machine-readable codes
US11334779B1 (en) * 2022-01-14 2022-05-17 The DTX Company Dynamic embedding of machine-readable codes within video and digital media
US11741331B1 (en) 2022-02-23 2023-08-29 The DTX Company Electronic tag with two scanning modalities
US11734533B1 (en) 2022-06-08 2023-08-22 The DTX Company Secure scanning of machine-readable codes
US11768374B1 (en) * 2022-06-24 2023-09-26 Rockwell Collins, Inc. Vehicle including head wearable display device and imperceptible reference fiducials and method therefor
US11709907B1 (en) 2023-02-01 2023-07-25 The DTX Company Offline to online conversion linkage
US12307326B2 (en) * 2023-09-25 2025-05-20 Resi Media, Llc Interactive region based on optically readable code
US12020114B1 (en) 2024-01-22 2024-06-25 The DTX Company Real-time comprehensive quick response (“QR”) code testing for reliable scanning
US12254057B1 (en) 2024-11-20 2025-03-18 The DTX Company Intelligent redirects

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060086796A1 (en) * 2004-10-27 2006-04-27 Denso Corporation Image signal output device, coded image signal generation method, image signal output program, camera operation system, camera operation program, matrix code decoding device, and matrix code decoding program
US20080244675A1 (en) * 2007-04-02 2008-10-02 Sony Corporation Imaged image data processing apparatus, viewing information creating apparatus, viewing information creating system, imaged image data processing method and viewing information creating method
US20120169928A1 (en) * 2010-12-29 2012-07-05 Echostar Technologies L.L.C. Network Media Device with Code Recognition
WO2012120524A2 (en) * 2011-03-09 2012-09-13 Tata Consultancy Services Limited A method and system for implementation of an interactive television application

Family Cites Families (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6538623B1 (en) * 1999-05-13 2003-03-25 Pirooz Parnian Multi-media data collection tool kit having an electronic multi-media “case” file and method of use
MXPA03009198A (es) * 2001-04-09 2004-05-21 Koplar Interactive Systems Int Metodos universales y dispositivo para oportunidades promocionales portatiles.
JP4774622B2 (ja) * 2001-04-27 2011-09-14 ソニー株式会社 情報授受方法および情報授受システム
US20060184617A1 (en) * 2005-02-11 2006-08-17 Nicholas Frank C Method and system for the creating, managing, and delivery of feed formatted content
US20040103023A1 (en) * 2002-11-25 2004-05-27 Irwin John R. Coupon barcode internet verification system
JP4140898B2 (ja) * 2003-08-20 2008-08-27 日本電信電話株式会社 情報提示装置および情報提示装置の使用方法
JP2005354603A (ja) * 2004-06-14 2005-12-22 Fujitsu Ltd 情報取得システム、コンピュータプログラム及び発注支援方法
US20120246184A1 (en) * 2004-11-29 2012-09-27 Ariel Inventions, Llc Storing and retrieving information associated with a digital image
US8936192B2 (en) * 2005-12-20 2015-01-20 United States Postal Service Method and system for interrogating and processing codes
US8529409B1 (en) * 2006-02-22 2013-09-10 Jennifer Lesea-Ames Mobile personal fitness training
JP4637235B2 (ja) * 2006-03-01 2011-02-23 株式会社エル・エー・ビー 映像連動型制御対象外部機器制御装置
US7861933B2 (en) * 2006-11-06 2011-01-04 Ikan Technologies Inc. Methods and systems for network configuration
US8520979B2 (en) 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US8385590B1 (en) * 2008-11-05 2013-02-26 Adobe Systems Incorporated Video watermarking with temporal patterns
US8851378B2 (en) 2009-09-24 2014-10-07 Ebay Inc. System and method for recognizing deformed linear barcodes from a stream of varied-focus video frames
US20110079639A1 (en) * 2009-10-06 2011-04-07 Samsung Electronics Co. Ltd. Geotagging using barcodes
JP5576667B2 (ja) * 2010-02-17 2014-08-20 Kddi株式会社 情報送出表示システム
US20140289134A1 (en) * 2010-06-25 2014-09-25 Adobe Systems Incorporated Method and system for managing content for an electronic collaboration tool
US9814977B2 (en) * 2010-07-13 2017-11-14 Sony Interactive Entertainment Inc. Supplemental video content on a mobile device
US20110145074A1 (en) * 2010-08-31 2011-06-16 Paul Anthony Polizzotto Apparatuses, methods and systems for an environmental advertising, financing and management platform
GB2484316A (en) * 2010-10-06 2012-04-11 St Microelectronics Res & Dev Self navigation of mobile devices
US8534540B2 (en) 2011-01-14 2013-09-17 Echostar Technologies L.L.C. 3-D matrix barcode presentation
US8550334B2 (en) * 2011-02-28 2013-10-08 Echostar Technologies L.L.C. Synching one or more matrix codes to content related to a multimedia presentation
US8485428B1 (en) * 2011-03-10 2013-07-16 Symantec Corporation Systems and methods for providing security information about quick response codes
US8880100B2 (en) * 2011-03-23 2014-11-04 Radium, Inc. Proximity based social networking
US20120304224A1 (en) 2011-05-25 2012-11-29 Steven Keith Hines Mechanism for Embedding Metadata in Video and Broadcast Television
KR101081438B1 (ko) 2011-06-14 2011-11-15 주식회사 지웨이 디지털 바코드 인식 시스템 및 방법
US9022280B2 (en) * 2011-06-24 2015-05-05 Verisign, Inc. Multi-mode barcode resolution system
US20130054387A1 (en) * 2011-08-26 2013-02-28 Elwha LLC, a limited liability company of the State of Delaware Stock Supply Based Modifiable Selection System and Method for Ingestible Material Preparation System and Method
US8943320B2 (en) * 2011-10-31 2015-01-27 Novell, Inc. Techniques for authentication via a mobile device
US20130130785A1 (en) * 2011-11-18 2013-05-23 Maynard SMALL Method and apparatus for consumer rewards
US8948445B2 (en) * 2012-05-03 2015-02-03 The Hong Kong University Of Science And Technology Embedding visual information in a two-dimensional bar code
US20140100935A1 (en) * 2012-10-09 2014-04-10 Groundspeak, Inc. Computer-Implemented System And Method For Tying Symbolic Content To A a Physical Locality In A User-Performable Activity Scenario
US9070000B2 (en) * 2012-10-18 2015-06-30 Dell Products L.P. Secondary information for an information handling system matrix bar code function
US8813154B1 (en) * 2012-12-07 2014-08-19 American Megatrends, Inc. Injecting a code into video data without or with limited human perception by flashing the code
US20140172531A1 (en) * 2012-12-14 2014-06-19 Michael A. Liberty Performing transactions using qr codes
US20140266639A1 (en) * 2013-03-15 2014-09-18 Ebay Inc. Automated mobile device configuration for remote control of electronic devices
WO2014145944A1 (en) * 2013-03-15 2014-09-18 Frank Nemirofsky Personal device-enabled lifestyle, commerce and exchange tracking system
CN103200441A (zh) * 2013-04-01 2013-07-10 天脉聚源(北京)传媒科技有限公司 一种电视频道信息的获取方法、确认方法及装置
US20150019321A1 (en) * 2013-07-12 2015-01-15 Klever Marketing, Inc. Using universal product code to retrieve coupons at checkout
US20150081440A1 (en) * 2013-09-19 2015-03-19 Jeffrey Blemaster Methods and systems for generating domain name and directory recommendations

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060086796A1 (en) * 2004-10-27 2006-04-27 Denso Corporation Image signal output device, coded image signal generation method, image signal output program, camera operation system, camera operation program, matrix code decoding device, and matrix code decoding program
US20080244675A1 (en) * 2007-04-02 2008-10-02 Sony Corporation Imaged image data processing apparatus, viewing information creating apparatus, viewing information creating system, imaged image data processing method and viewing information creating method
US20120169928A1 (en) * 2010-12-29 2012-07-05 Echostar Technologies L.L.C. Network Media Device with Code Recognition
WO2012120524A2 (en) * 2011-03-09 2012-09-13 Tata Consultancy Services Limited A method and system for implementation of an interactive television application

Also Published As

Publication number Publication date
CN105359547A (zh) 2016-02-24
EP3020211A1 (en) 2016-05-18
KR20160030951A (ko) 2016-03-21
US20150014417A1 (en) 2015-01-15
US9471824B2 (en) 2016-10-18
CN105359547B (zh) 2019-01-01
JP2016527788A (ja) 2016-09-08

Similar Documents

Publication Publication Date Title
US9471824B2 (en) Embedded barcodes for displaying context relevant information
KR102462206B1 (ko) 가상 현실 비디오에서 시간 지정 텍스트 및 그래픽을 렌더링하는 방법 및 장치
US10542323B2 (en) Real-time modifiable text captioning
US9024844B2 (en) Recognition of image on external display
KR102164723B1 (ko) 3-d 플레놉틱 비디오 이미지들을 생성하는 시스템 및 방법
US9424767B2 (en) Local rendering of text in image
US11720179B1 (en) System and method for redirecting content based on gestures
KR20150091474A (ko) 멀티 디스플레이 장치 상에서의 로우 레이턴시 이미지 디스플레이 기법
US9224322B2 (en) Visually passing data through video
EP2972759A1 (en) Screencasting for multi-screen applications
US9813666B2 (en) Video transmission and reconstruction
US20200097068A1 (en) Method and apparatus for providing immersive reality content
KR102005406B1 (ko) 디스플레이 장치 및 그 제어 방법
US20230344973A1 (en) Variable audio for audio-visual content
WO2019228969A1 (en) Displaying a virtual dynamic light effect
CN114047902A (zh) 用于空间音频的文件格式
KR101682215B1 (ko) 가상현실 vr 웹툰의 제공 장치 및 방법
TW202243468A (zh) 3d顯示系統與3d顯示方法
TWM628625U (zh) 3d顯示系統
EP4517409A1 (en) Artificial reality devices with light blocking capability and projection of visual content over regions of blocked light
US20250030821A1 (en) Projection device and operating method thereof
JP2025533559A (ja) 時間進化シーン記述におけるトリガ起動機構
WO2025012249A1 (en) Generic avatar trigger in virtual environments
CA3268477A1 (en) Trigger activation mechanism in time-evolving scene description
KR20150133580A (ko) 디스플레이 장치 및 그 제어 방법

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480038857.0

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14747185

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2014747185

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2016525385

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20167001685

Country of ref document: KR

Kind code of ref document: A