Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
  • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
  • H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
  • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
  • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
  • H04N21/44213—Monitoring of end-user related data
  • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/482—End-user interface for program selection
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
  • H04N21/643—Communication protocols
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/81—Monomedia components thereof
  • H04N21/812—Monomedia components thereof involving advertisement data
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/845—Structuring of content, e.g. decomposing content into time segments
  • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream

Definitions

• Methods and apparatuses consistent with exemplary embodiments relate to an electronic apparatus for replacing in real time an advertisement provided according to a broadcast program and a method of operating the same.
• a television (TV) connected to the Internet may receive data from a data network such as an Internet network
• viewers may receive not only digital broadcast content but also multimedia contents.
• content providers may provide more abundant content, advertisements, and interactive content.
• a viewer when viewing a particular channel at a particular time point by using a TV, a smart TV, or a TV connected to the Internet, a viewer may have no choice but to view a scheduled advertisement on a broadcast schedule of a broadcast channel in the same way due to the characteristics of broadcasting.
• an electronic apparatus such as a TV may need to provide a suitable advertisement for a user of the electronic apparatus at a suitable time.
• an electronic apparatus may provide a replacement advertisement at an accurate point by beforehand recognizing a start point of a replacement target existing advertisement, according to an exemplary embodiment.
• an electronic apparatus may recognize a broadcast channel viewed by a user and may accurately determine a reproduction position of the recognized broadcast channel, according to an exemplary embodiment.
• an electronic apparatus may allow a user to efficiently control the electronic apparatus by providing an execution screen for control of the electronic apparatus on a replacement advertisement when the execution screen for control of the electronic apparatus is called while the replacement advertisement is provided in the electronic apparatus, according to an exemplary embodiment.
• an electronic apparatus may provide a replacement advertisement at an accurate point by beforehand recognizing a start point of a replacement target existing advertisement, according to an exemplary embodiment.
• an electronic apparatus may recognize a broadcast channel viewed by a user and may accurately determine a reproduction position of the recognized broadcast channel, according to an exemplary embodiment.
• an electronic apparatus may allow a user to efficiently control the electronic apparatus by providing an execution screen for control of the electronic apparatus on a replacement advertisement when the execution screen for control of the electronic apparatus is called while the replacement advertisement is provided in the electronic apparatus, according to an exemplary embodiment.
• FIG. 1 is a diagram illustrating an example in which an advertisement of a broadcast program is replaced with another advertisement in an electronic apparatus in consideration of information of a user of the electronic apparatus, according to an exemplary embodiment
• FIG. 2 is a flow diagram of a method in which an advertisement of a broadcast program is replaced in an electronic apparatus, according to an exemplary embodiment
• FIG. 3 is a flow diagram of a method of recognizing a broadcast channel corresponding to content displayed on an electronic apparatus, according to an exemplary embodiment
• FIG. 4 is a flow diagram of a method of determining whether a recognized broadcast channel is locked in an electronic apparatus, according to an exemplary embodiment
• FIG. 5 is a flow diagram of a method of receiving an advertisement replacement event notification in an electronic apparatus, according to an exemplary embodiment
• FIG. 6 is a flow diagram of a method of downloading a replacement advertisement by determining in real time a reproduction position of content displayed on an electronic apparatus, according to an exemplary embodiment
• FIG. 7 is a diagram illustrating the time of downloading a replacement advertisement in an electronic apparatus, according to an exemplary embodiment
• FIG. 8 is a diagram illustrating a layer for reproducing a replacement advertisement in an electronic apparatus, according to an exemplary embodiment
• FIG. 9 is a flow diagram of a method of reproducing a replacement advertisement in an electronic apparatus and displaying an execution screen for control of the electronic apparatus, according to an exemplary embodiment
• FIG. 10 is a flow diagram of a method of displaying an execution screen for control of an electronic apparatus on a replacement advertisement in the electronic apparatus, according to an exemplary embodiment
• FIG. 11 is a diagram illustrating an example in which an execution screen for control of an electronic apparatus is displayed on a replacement advertisement according to a control command of a user, according to an exemplary embodiment
• FIG. 12 is a diagram illustrating an operation of an electronic apparatus when a broadcast channel changes in the electronic apparatus, according to an exemplary embodiment
• FIG. 13 is a diagram illustrating a method of recognizing an image or a video frame by using a fingerprint of the image or the video frame, according to an exemplary embodiment
• FIG. 14 is a flow diagram of a method of extracting and identifying a fingerprint based on a plurality or regions in an image of content, according to an exemplary embodiment
• FIG. 15 is a diagram illustrating a method of extracting and identifying a fingerprint based on a plurality or regions in an image of content, according to an exemplary embodiment
• FIGS. 16 and 17 are block diagrams of an electronic apparatus according to an exemplary embodiment
• FIG. 18 is a block diagram of a server according to an exemplary embodiment
• FIG. 19 is a diagram illustrating a system for replacing an advertisement of a broadcast program in an electronic apparatus, according to an exemplary embodiment.
• FIG. 20 is a diagram illustrating a method of replacing an advertisement of a broadcast program in an electronic apparatus, according to another exemplary embodiment.
• an electronic apparatus includes a communication interface, a display, a memory configured to store one or more instructions, and a processor configured to execute the one or more instructions stored in the memory, wherein, when executed, the one or more instructions cause the processor to receive, based on a fingerprint extracted from content displayed on the display, information of a first broadcast channel corresponding to the content from a server and recognize the first broadcast channel corresponding to the content, in response to determining that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, download a replacement advertisement from the server based on a start point of the replacement target existing advertisement, and reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.
• the one or more instructions may further cause the processor to extract the fingerprint of the content, and transmit information of the fingerprint of the content to the server and receive information of the first broadcast channel corresponding to the content from the server, wherein the first broadcast channel is determined based on a comparison result between the fingerprint of the content and a fingerprint of an image of each of broadcast channels.
• the one or more instructions may further cause the processor to extract the fingerprint of the content at predetermined time intervals and determine, based on the fingerprint extracted at the predetermined time intervals, whether the first broadcast channel is continuously output on the display, and request information of a broadcast fingerprint of the first broadcast channel from the server in response to determining that the first broadcast channel is continuously output on the display.
• the one or more instructions may further cause the processor to receive a notification indicating the broadcast schedule of the replacement target existing advertisement in the first broadcast channel from the server, wherein the broadcast schedule of the replacement target existing advertisement is determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.
• the one or more instructions may further cause the processor to receive a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server.
• the one or more instructions may further cause the processor to determine a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display, and download at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.
• the one or more instructions may further cause the processor to set a second layer on a first layer where a broadcast of the first broadcast channel is output and reproduce the replacement advertisement on the second layer.
• the one or more instructions may further cause the processor to, in response to an execution screen for control of the electronic apparatus being called, based on a difference image between an image of the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen, display the execution screen overlappingly on an image of the replacement advertisement.
• the one or more instructions cause the processor to, in response to the first broadcast channel changing into a second broadcast channel, interrupt the reproduction of the replacement advertisement and display a screen broadcasted on the second broadcast channel on the display.
• the one or more instructions may further cause the processor to set a plurality of regions in an image of the content and extract the fingerprint of the content based on a pixel value of the plurality of regions.
• a method of operating an electronic apparatus includes extracting a fingerprint of content displayed on a display of the electronic apparatus, receiving, based on the extracted fingerprint of the content, information of a first broadcast channel corresponding to the content from a server and recognizing the first broadcast channel corresponding to the content, in response to determining that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, downloading a replacement advertisement from the server based on a start point of the replacement target existing advertisement, and reproducing the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.
• the method may further include extracting the fingerprint of the content at predetermined time intervals and determining, based on the fingerprint extracted at the predetermined time intervals, whether the first broadcast channel is continuously output on the display, and requesting information of a broadcast fingerprint of the first broadcast channel from the server in response to determining that the first broadcast channel is continuously output on the display.
• the method may further include receiving a notification indicating the broadcast schedule of the replacement target existing advertisement in the first broadcast channel from the server, wherein the broadcast schedule of the replacement target existing advertisement is determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.
• the method may further include receiving a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server, wherein the downloading of the replacement advertisement from the server comprises: determining a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display, and downloading at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.
• the reproducing of the replacement advertisement may further include setting a second layer on a first layer where a broadcast of the first broadcast channel is output, and reproducing the replacement advertisement on the second layer.
• the method may further include, in response to an execution screen for control of the electronic apparatus being called, based on a difference image between an image of the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen, displaying the execution screen overlappingly on an image of the replacement advertisement.
• the method may further include, in response to the first broadcast channel changing into a second broadcast channel, interrupting the reproducing of the replacement advertisement and displaying a screen broadcasted on the second broadcast channel on the display.
• a server includes a communication interface, a storage storing one or more instructions, and a processor configured to execute the one or more instructions stored in the storage, wherein when executed, the one or more instructions cause the processor to receive broadcast information about each of broadcast channels from a broadcast station and extract a broadcast fingerprint of an image of each of the broadcast channels, receive a fingerprint of content displayed on an electronic apparatus from the electronic apparatus, determine a first broadcast channel corresponding to the content by comparing the fingerprint of the content and the broadcast fingerprint of the image of each of the broadcast channels, determine, based on a broadcast schedule of the first broadcast channel, whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus, and transmit a replacement advertisement to the electronic apparatus based on a start point of the replacement target existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus.
• the one or more instructions may further cause the processor to: determine whether an advertisement fingerprint of the replacement target existing advertisement in the electronic apparatus is included in an advertisement fingerprint of the first broadcast channel, add and store start point information of the replacement target existing advertisement in a broadcast fingerprint of the first broadcast channel in response to determining that the advertisement fingerprint of the replacement target existing advertisement is included in the advertisement fingerprint of the first broadcast channel, and transmit the broadcast fingerprint of the first broadcast channel to the electronic apparatus.
• a method of operating a server includes receiving broadcast information about each of broadcast channels from a broadcast station and extracting a broadcast fingerprint of an image of each of the broadcast channels, receiving a fingerprint of content displayed on an electronic apparatus of a user from the electronic apparatus, determining a first broadcast channel corresponding to the content by comparing the fingerprint of the content and the broadcast fingerprint of the image of each of the broadcast channels, determining, based on a broadcast schedule of the first broadcast channel, whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus, and transmitting a replacement advertisement to the electronic apparatus based on a start point of the replacement target existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus.
• unit means a software component or a hardware component such as a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC), and the “unit” performs some functions.
• FPGA field-programmable gate array
• ASIC application-specific integrated circuit
• the term “unit” is not limited to software or hardware.
• the “unit” may be formed so as to be in an addressable storage medium, or may be formed so as to operate one or more processors.
• the "unit” may include components such as software components, object-oriented software components, class components, and task components, and may include processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, micro codes, circuits, data, a database, data structures, tables, arrays, and variables.
• a function provided by the components and “units” may be associated with the smaller number of components and “units", or may be divided into additional components and “units”.
• first and second may be used herein to describe various elements or components, these elements or components should not be limited by these terms. These terms are only used to distinguish one element or component from another element or component. For example, a first element or component may also be referred to as a second element or component, and vice versa. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
• FIG. 1 is a diagram illustrating an example in which an advertisement of a broadcast program is replaced with another advertisement in an electronic apparatus in consideration of information of a user of the electronic apparatus, according to an exemplary embodiment.
• An electronic apparatus 10 may provide a suitable advertisement to a user of the electronic apparatus 10 based on profile information of the electronic apparatus 10.
• the profile information of the electronic apparatus 10 may include, but is not limited to, the sex, age, talent, hobby, and favorite channel of the user of the electronic apparatus 10.
• the electronic apparatus 10 may be, but is not limited to, a smart phone, a tablet personal computer (PC), a PC, a television (TV) a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop computer, a media player, a micro server, a global positioning system (GPS) apparatus, an e-book terminal (reader), a digital broadcast terminal, a navigation apparatus, a kiosk, an MP3 player, a digital camera, or other mobile or non-mobile apparatuses.
• a smart phone a tablet personal computer (PC), a PC, a television (TV) a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop computer, a media player, a micro server, a global positioning system (GPS) apparatus, an e-book terminal (reader), a digital broadcast terminal, a navigation apparatus, a kiosk, an MP3 player, a digital camera, or other mobile or non-mobile apparatuses.
• PC personal computer
• TV television
• the user of the electronic apparatus 10 may view a news broadcast 100, a cosmetic advertisement broadcast 200, and a sports news broadcast 300 according to a broadcast schedule of a first broadcast channel. However, based on the profile information of the electronic apparatus 10, the electronic apparatus 10 may replace the cosmetic advertisement broadcast 200 with a health product advertisement broadcast 500 targeted at the user. Thus, the user of the electronic apparatus 10 may view a news broadcast 400, a health product advertisement broadcast 500, and a sports news broadcast 600 unlike the broadcast schedule of the first broadcast channel.
• the electronic apparatus 10 may provide a suitable advertisement to the user based on a broadcast channel being viewed in the electronic apparatus 10, a replacement target existing advertisement, a start point of the replacement target existing advertisement, a previous advertisement time of the replacement target existing advertisement, and information about a replacement advertisement.
• FIG. 2 is a flow diagram of a method in which an advertisement of a broadcast program is replaced in an electronic apparatus, according to an exemplary embodiment.
• the electronic apparatus 10 may recognize a first broadcast channel corresponding to the content. Specifically, based on a fingerprint extracted from the content displayed on the display of the electronic apparatus 10, the electronic apparatus 10 may receive information of the first broadcast channel corresponding to the content from a server and recognize the first broadcast channel corresponding to the content.
• the "fingerprint” may refer to a unique identifier extracted from an image or a video frame.
• the "fingerprint technology” is a technology for recognizing an image or a video frame by comparing a unique identifier extracted from the image or the video frame instead of comparing the image or the video frame itself. A method of extracting a fingerprint of content will be described below with reference to FIGS. 13 to 15.
• the electronic apparatus 10 may determine whether there is a replacement target existing advertisement among the existing advertisements broadcasted on the first broadcast channel. That is, the electronic apparatus 10 may determine whether there is a broadcast schedule of the replacement target existing advertisement is included in a schedule of the first broadcast channel.
• the electronic apparatus 10 may download a replacement advertisement from a server 20 based on a start point of the replacement target existing advertisement.
• the electronic apparatus 10 may download all or part of the replacement advertisement before the start point of the replacement target existing advertisement.
• the electronic apparatus 10 may reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement on the first broadcast channel.
• the electronic apparatus 10 may reproduce the replacement advertisement overlappingly on a screen where the replacement target existing advertisement is output.
• the electronic apparatus 10 may set a second layer on a first layer where a broadcast of the first broadcast channel is output and reproduce the replacement advertisement on the second layer.
• the electronic apparatus 10 may output the existing advertisement broadcasted according to the broadcast schedule of the first broadcast channel.
• FIG. 3 is a flow diagram of a method of recognizing a broadcast channel corresponding to content displayed on the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may extract a fingerprint of the content. For example, the electronic apparatus 10 may divide an image of the content into a plurality of regions and extract a fingerprint of the content based on a color value or a pixel value of each of the plurality of regions.
• the electronic apparatus 10 may transmit the extracted fingerprint of the content to the server 20.
• the server 20 may acquire a fingerprint of an image of each of the broadcast channels.
• the fingerprint of the image of each of the broadcast channels may be understood as a fingerprint of each of the images broadcasted on the broadcast channels.
• the fingerprint of the image broadcasted on the first broadcast channel may be understood as a fingerprint of the first broadcast channel.
• the server 20 may receive a broadcast signal, which is identical to a broadcast signal received in the electronic apparatus 10, from a broadcast station a few seconds earlier than the electronic apparatus 10.
• the server 20 may receive broadcast information about the broadcast channels broadcasted respectively by a plurality of broadcast stations from the plurality of broadcast stations.
• the server 20 may extract and store a fingerprint of an image of each of the broadcast channels.
• the server 20 may interlock the fingerprint of the image of each of the broadcast channels with the broadcast program information and store the interlocking result.
• the fingerprint of the broadcast channel may include a fingerprint of a broadcast program included in the schedule of the broadcast channel and a fingerprint of an advertisement included in the schedule of the broadcast channel.
• the server 20 may detect a fingerprint of the first broadcast channel that matches the fingerprint of the content.
• the server 20 may determine the first broadcast channel of the matched fingerprint as a broadcast channel of the content and acquire information of the first broadcast channel.
• the server 20 may transmit the information of the first broadcast channel corresponding to the content to the electronic apparatus 10.
• the electronic apparatus 10 may receive the information of the first broadcast channel from the server 20 and recognize the broadcast channel of the content broadcasted in the electronic apparatus 10 as the first broadcast channel.
• FIG. 4 is a flow diagram of a method of determining whether a recognized broadcast channel is locked in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may extract a fingerprint of the content output by the electronic apparatus 10 at predetermined time intervals. For example, the electronic apparatus 10 may extract a fingerprint of the content output on a display of the electronic apparatus 10 at intervals of 2 seconds.
• the electronic apparatus 10 may determine whether the first broadcast channel is continuously output by the electronic apparatus 10. According to whether the information of the broadcast channel acquired from the fingerprint of the content extracted at predetermined time intervals is identical to the information of the first broadcast channel, the electronic apparatus 10 may determine whether the first broadcast channel is continuously output by the electronic apparatus 10.
• the electronic apparatus 10 may determine that the broadcast channel output by the electronic apparatus 10 is locked at the first broadcast channel.
• the electronic apparatus 10 may recognize the broadcast channel corresponding to the content and repeat a process of determining whether the recognized broadcast channel is locked.
• the electronic apparatus 10 may request information of a broadcast fingerprint of the first broadcast channel from the server 20.
• FIG. 5 is a flow diagram of a method of receiving an advertisement replacement event notification in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may determine whether the first broadcast channel corresponding to the content output by the electronic apparatus 10 is locked. Because a process of determining whether the first broadcast channel is locked is the same as that illustrated in FIG. 4, redundant descriptions thereof will be omitted for conciseness.
• the server 20 may acquire information of the replacement target existing advertisement and information of the replacement advertisement.
• the server 20 may acquire advertisement fingerprint information of the replacement target existing advertisement and advertisement fingerprint information of the replacement advertisement.
• the server 20 may receive the information of the replacement target existing advertisement and the information of the replacement advertisement from an external apparatus. Also, the server 20 may determine a replacement target existing advertisement and a replacement advertisement and acquire information of each advertisement. Specifically, the server 20 may receive profile information of the electronic apparatus 10 from the electronic apparatus 10 and determine the replacement target existing advertisement and the replacement advertisement based on the profile information of the electronic apparatus 10.
• the profile information of the electronic apparatus 10 may include, but is not limited to, the sex, age, talent, hobby, and favorite channel of the user of the electronic apparatus 10.
• the server 20 may determine to replace a cosmetic advertisement, which is to be broadcasted on the first broadcast channel, with a golf product advertisement and acquire information of the cosmetic advertisement (i.e., the replacement target advertisement) and information of the golf product advertisement (i.e., the replacement advertisement).
• the server 20 may determine whether there is an advertisement fingerprint identical to an advertisement fingerprint of the replacement target existing advertisement among the advertisement fingerprints of the first broadcast channel.
• the server 20 may transmit a notification indicating the existence of an advertisement replacement event to the electronic apparatus 10.
• the server 20 may transmit a notification indicating the non-existence of an advertisement replacement event to the electronic apparatus 10.
• the server 20 may set an advertisement replacement event including a start point of the replacement target existing advertisement in a broadcast fingerprint of the first broadcast channel.
• the electronic apparatus 10 may receive the broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event is set, from the server 20.
• FIG. 6 is a flow diagram of a method of downloading a replacement advertisement by determining in real time a reproduction position of content displayed on the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may determine a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and the broadcast fingerprint of the content displayed on the display of the electronic apparatus 10.
• the electronic apparatus 10 may acquire an advertisement replacement event suitable for the current point.
• the electronic apparatus 10 may download all or part of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.
• the electronic apparatus 10 may download all or part of the replacement advertisement in consideration of the state of the electronic apparatus 10.
• the state of the electronic apparatus 10 may include, but is not limited to, the capacity of a storage space of the electronic apparatus 10 and the communication state between the electronic apparatus 10 and the server 20.
• the electronic apparatus 10 may download a portion of the replacement advertisement before the start of the replacement advertisement and download and reproduce the remaining portion in a streaming manner during the reproduction of the replacement advertisement.
• FIG. 7 is a diagram illustrating the time of downloading a replacement advertisement in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may acquire information including a broadcast schedule 700 of the first broadcast channel.
• the broadcast schedule 700 of the first broadcast channel may include a broadcast schedule timetable of a OOO 9 o’clock news 710, an advertisement A 720, a OOO sports news 730, an advertisement B 740, and a XXX drama 750.
• the electronic apparatus 10 may determine a current reproduction position 761 of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and the fingerprint of the content displayed on the electronic apparatus 10.
• the electronic apparatus 10 may receive an advertisement replacement event notification indicating that the advertisement A 720 is replaced with an advertisement C 762 and the advertisement B 740 is replaced with an advertisement D 764, from the server 20.
• the advertisement replacement event in which the advertisement A 720 is replaced with the advertisement C 762 and the advertisement B 740 is replaced with the advertisement D 764 may be determined based on the profile information of the electronic apparatus 10.
• a download time 763 of the advertisement C 762 may be from the point corresponding to the current reproduction position 761 to the start point of the replacement target advertisement A 720.
• a download time 765 of the advertisement D 764 may be from the point corresponding to the current reproduction position 761 to the start point of the replacement target advertisement B 740.
• the electronic apparatus 10 may download the advertisement D 764 from the point corresponding to the current reproduction position 761; however, during the broadcasting of the advertisement C 762 or the OOO sports news 730, the electronic apparatus 10 may be turned off or the broadcast channel displayed on the display of the electronic apparatus 10 may change. In this case, the electronic apparatus 10 may download the replacement advertisement D 764 T seconds before the start point of the advertisement B 740.
• T seconds may be determined in consideration of the capacity of the replacement advertisement D 764 or the time taken for the electronic apparatus 10 to download the replacement advertisement D 764.
• FIG. 8 is a diagram illustrating a layer for reproducing a replacement advertisement in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may receive a broadcast signal of the first broadcast channel from a broadcast station or a set-top box and output a broadcast of the first broadcast channel.
• the electronic apparatus 10 may display an execution screen for control of the electronic apparatus 10, such as broadcast channel change, volume control, displaying of a broadcast schedule timetable of a broadcast channel, or setting of the environment of the electronic apparatus 10, overlappingly on a screen where a broadcast of the first broadcast channel is output. That is, the electronic apparatus 10 may set an execution screen for control of the electronic apparatus 10 as an on-screen display (OSD).
• OSD on-screen display
• layers constituting the screen displayed on the display of the electronic apparatus 10 may be configured as illustrated in 810 of FIG. 8.
• the layers may include a first layer 811 for outputting a broadcast of the first broadcast channel, a second layer 812 for reproducing an image of the replacement advertisement, and a third layer 813 for displaying an execution screen for control of the electronic apparatus 10.
• the electronic apparatus 10 may reproduce the replacement advertisement on the second layer 812.
• the electronic apparatus 10 may display an execution screen for control of the electronic apparatus 10 on the third layer 813. Because the execution screen for control of the electronic apparatus 10 is displayed on the upper layer, the user may efficiently control the electronic apparatus 10 even while the replacement advertisement is reproduced.
• layers constituting the screen displayed on the display of the electronic apparatus 10 may be configured as illustrated in 820 of FIG. 8.
• the layers may include a first layer 811 for outputting a broadcast of the first broadcast channel and a second layer 814 for outputting an image of the replacement advertisement and an execution screen for control of the electronic apparatus 10.
• FIG. 9 is a flow diagram of a method of reproducing a replacement advertisement in the electronic apparatus 10 and displaying an execution screen for control of the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may determine a current reproduction position of the first broadcast channel corresponding to the content displayed on the electronic apparatus 10.
• the electronic apparatus 10 may determine a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and the fingerprint of the content displayed on the display of the electronic apparatus 10.
• the electronic apparatus 10 may determine whether the start point of the replacement target existing advertisement is T seconds before.
• T seconds may be determined in consideration of the capacity of the replacement advertisement or the time taken for the electronic apparatus 10 to download the replacement advertisement and the replacement target advertisement.
• the electronic apparatus 10 may operate according to operation S930.
• the start point of the replacement target existing advertisement is (T+1) seconds before, the electronic apparatus 10 may operate according to operation S910.
• the electronic apparatus 10 may receive the replacement target existing advertisement and the replacement advertisement.
• the electronic apparatus 10 may monitor the broadcast schedule of the first broadcast channel to determine whether the start point of the replacement target existing advertisement has arrived. When it is before the start point of the replacement target existing advertisement, the electronic apparatus 10 may operate according to operation S910. When it is the start point of the replacement target existing advertisement, the electronic apparatus 10 may operate according to operation S950.
• the electronic apparatus 10 may reproduce the replacement advertisement on a second layer that is separately set on a first layer where the replacement target existing advertisement is reproduced.
• the actual screen displayed on the display of the electronic apparatus 10 may be the replacement advertisement that is reproduced on the second layer.
• the electronic apparatus 10 may receive a command for control of the electronic apparatus 10 from the user.
• the electronic apparatus 10 may display an execution screen for control of the electronic apparatus 10 overlappingly on the second layer where the replacement advertisement is reproduced.
• FIG. 10 is a flow diagram of a method of displaying an execution screen for control of the electronic apparatus 10 on a replacement advertisement in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may mute an image of the first broadcast channel and display the replacement advertisement overlappingly on an image of the replacement target existing advertisement of the first broadcast channel. Specifically, the electronic apparatus 10 may perform a control operation to mute a broadcast of the first broadcast channel and reproduce the replacement advertisement on the second layer that is separately set on the first layer where the broadcast of the first broadcast channel is output. The user of the electronic apparatus 10 may view the replacement advertisement.
• the electronic apparatus 10 may determine whether the muted image of the first broadcast channel and the downloaded image of the existing advertisement are identical. By comparing the broadcast fingerprint of the first broadcast channel and the advertisement fingerprint of the existing advertisement, the electronic apparatus 10 may determine whether an image of the first broadcast channel and the downloaded image of the existing advertisement are identical. When the image of the first broadcast channel and the downloaded image of the existing advertisement are not identical, the electronic apparatus 10 may operate according to operation S910.
• the electronic apparatus 10 may acquire a difference image by using the downloaded image of the existing advertisement and the image of the first broadcast channel including the execution screen for control of the electronic apparatus 10.
• the image of the first broadcast channel may be an image of the replacement target existing advertisement.
• the electronic apparatus 10 may display an image of the replacement target existing advertisement and the execution screen for control of the electronic apparatus 10 on the first layer.
• the electronic apparatus 10 may calculate a difference image between images by using the downloaded image of only the existing advertisement and the image of the replacement target existing advertisement including the execution screen for control of the electronic apparatus 10.
• the calculated difference image may include only the execution screen for control of the electronic apparatus 10.
• the electronic apparatus 10 may determine whether an absolute value of the difference image is greater than or equal to a threshold value and determine whether the execution screen for control of the electronic apparatus 10 is called according to the determination result. For example, when the absolute value of the difference image is greater than or equal to the threshold value, the electronic apparatus 10 may determine that a control command of the electronic apparatus 10 is received from the user and an execution screen for the control command is called. When the absolute value of the difference image is smaller than the threshold value, the electronic apparatus 10 may operate according to operation S1030.
• the electronic apparatus 10 may display the difference image overlappingly on the downloaded replacement target advertisement. Specifically, the electronic apparatus 10 may set a third layer on the second layer where the replacement advertisement is reproduced and display an execution screen for control of the electronic apparatus 10 on the third layer. Also, the electronic apparatus 10 may display the execution screen for control of the electronic apparatus 10 overlappingly on the second layer where the replacement advertisement is reproduced.
• the replacement advertisement is reproduced in the electronic apparatus 10, even when a control command of the electronic apparatus 10 is received from the user, because the electronic apparatus 10 displays an execution screen for control of the electronic apparatus 10 overlappingly on the replacement advertisement, the user may smoothly control the electronic apparatus 10.
• FIG. 11 is a diagram illustrating an example in which an execution screen for control of the electronic apparatus 10 is displayed on a replacement advertisement according to a control command of the user, according to an exemplary embodiment.
• the electronic apparatus 10 may replace the existing cosmetic advertisement broadcasted on the first broadcast channel with a health product advertisement prior to display. As described above, based on the profile information of the electronic apparatus 10, the electronic apparatus 10 may reproduce an image of the health product advertisement while an image of the cosmetic advertisement is broadcasted on the first broadcast channel. The electronic apparatus 10 may reproduce an image of the health product advertisement overlappingly on an image of the cosmetic advertisement broadcasted on the first broadcast channel. That is, during the advertisement time of the cosmetic advertisement of the first broadcast channel, the user of the electronic apparatus 10 may view an image of the health product advertisement, and the user of another electronic apparatus 10 may view an image of the cosmetic advertisement.
• the electronic apparatus 10 may receive a control command of the user while an image of the health product advertisement is reproduced in the electronic apparatus 10. Because an image of the health product advertisement is displayed on a display of the electronic apparatus 10, an execution screen for control of the electronic apparatus 10 may not be directly displayed on the display. Specifically, an image of the cosmetic advertisement broadcasted on the first broadcast channel and an execution screen for control of the electronic apparatus 10 may be displayed on the first layer, and an image of the health product advertisement may be displayed on the second layer.
• the electronic apparatus 10 may acquire a difference image between an image of only the downloaded cosmetic advertisement and an image of the cosmetic advertisement including an execution screen for control of the electronic apparatus 10, which is displayed on the first layer.
• the electronic apparatus 10 may display a difference image indicating an execution screen for control of the electronic apparatus 10 overlappingly on an image of the health product advertisement.
• FIG. 11 illustrates a screen displayed on the display of the electronic apparatus 10 when the user controls the volume of the electronic apparatus 10.
• the electronic apparatus 10 may display a screen for control of the volume size overlappingly on an image of the health product advertisement even when the user controls the volume size by using a remote control of the electronic apparatus 10 at the time of the cosmetic advertisement broadcasted on the first broadcast channel in a state where the broadcast channel of the electronic apparatus 10 is locked at the first broadcast channel.
• FIG. 11 illustrates a screen displayed on the display of the electronic apparatus 10 when the user calls a broadcast schedule timetable.
• the electronic apparatus 10 may display a broadcast schedule timetable overlappingly on an image of the health product advertisement even when the user calls the broadcast schedule timetable by using a remote control of the electronic apparatus 10 at the time of the cosmetic advertisement broadcasted on the first broadcast channel in a state where the broadcast channel of the electronic apparatus 10 is locked at the first broadcast channel.
• FIG. 12 is a diagram illustrating an operation of the electronic apparatus 10 when a broadcast channel changes in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may reproduce a broadcast program according to a broadcast schedule 122 of the first broadcast channel.
• the broadcast schedule 122 of the first broadcast channel may include a broadcast schedule timetable of OOO 9 o’clock news, advertisement A, OOO sports news, advertisement B, and XXX drama.
• the electronic apparatus 10 may reproduce an image of the advertisement C at the broadcast time of the advertisement A and reproduce an image of the advertisement D at the broadcast time of the advertisement B.
• the electronic apparatus 10 may reproduce an image of the advertisement C at the broadcast time of the advertisement A of the first broadcast channel.
• the user may change the broadcast channel of the electronic apparatus 10 from the first broadcast channel to the second broadcast channel.
• the electronic apparatus 10 may change from the first broadcast channel to the second broadcast channel.
• the electronic apparatus 10 may interrupt the reproduction of an image of the advertisement C and reproduce an image of the advertisement E broadcasted on the second broadcast channel.
• the electronic apparatus 10 may reproduce a broadcast program according to a broadcast schedule 124 of the second broadcast channel.
• the broadcast schedule 124 of the second broadcast channel may include a broadcast timetable of XXX golf relay, advertisement B, OOO drama, advertisement F, and XXX entertainment.
• the electronic apparatus 10 may reproduce an image of the advertisement D that is to be replaced at the broadcast time of the advertisement F of the second broadcast channel.
• FIG. 13 is a diagram illustrating a method of recognizing an image or a video frame by using a fingerprint of the image or the video frame, according to an exemplary embodiment.
• the server 20 may extract a fingerprint from an image or a video frame and recognize the image or the video frame by using the extracted fingerprint.
• FIG. 13 illustrates the server 20 that recognizes an image or a video frame by using a fingerprint of the image or the video frame
• the electronic apparatus 10 may also extract a fingerprint from an image or a video frame and recognize the image or the video frame by using the extracted fingerprint.
• an operation of extracting and recognizing a fingerprint by the server 20, which will be described below with reference to FIG. 13, may also be applied to the electronic apparatus 10.
• the server 20 may include a processor, a storage, and a communication interface. However, not all of the components illustrated in FIG. 13 are necessary components of the server 20.
• the server 20 may be implemented by more components than the components illustrated in FIG. 13, or may be implemented by less components than the components illustrated in FIG. 13.
• the server 20 may uniquely recognize the image or the video frame by using a fingerprint of the image or the video frame even when the size of the image or the video frame decreases and various signal process changes occur.
• the "fingerprint” may refer to an identifier for uniquely recognizing the image or the video frame. Also, the “fingerprint” may be referred to as a digital fingerprint, a digital signature, or a hash. Also, the "fingerprint technology” is a technology for extracting a unique identifier from an image or a video frame and recognize the image or the video frame by identifier comparison.
• the processor may extract a fingerprint from a reference image or a reference video necessary for object recognition and store the extracted fingerprint in a fingerprint database (DB).
• the processor may acquire an image or a video that is a recognition target.
• the processor may capture an image or a video frame and extract a fingerprint based on a captured portion. By comparing the extracted fingerprint and the reference fingerprint stored in the fingerprint DB, the processor may detect the reference fingerprint matching the extracted fingerprint.
• the processor may recognize the image or the video based on the matched reference fingerprint.
• the processor may remove an unnecessary portion and select a certain region based on the center of the image or the video frame to extract a fingerprint.
• the certain region may be the entire region.
• the processor may detect a logo and a text region in the image or the video frame and extract a fingerprint based on the detected region.
• the processor may generate a 3xMxN dimensional feature vector by connecting all of the calculated block B i values.
• the processor may extract a fingerprint of the image or the video frame by using the generated 3xMxN-dimensional feature vector.
• the processor may extract a fingerprint of the image or the video frame by using an encoded gray thumbnail (EGT) feature. Specifically, the processor may divide the image or the video frame into PxQ blocks and calculate the average of a Y value with respect to each block B i . By quantizing the average of the Y value by b-bit, the processor may extract a feature according to Math. 3 below. In this case, the processor may quantize each bit by 0 and 1 by using a b number of different threshold values.
• GCT encoded gray thumbnail
• the processor may extract a fingerprint of the image or the video frame by using a local binary pattern (LBP) histogram feature.
• LBP local binary pattern
• Pc is a center value of a region
• u(x) is a Heaviside step function that becomes 1 when "x" is greater than or equal to 0 and becomes 0 when "x" is smaller than 0.
• Math. 4 is an example in a case where a block size is 3x3, and the block size may be set to be larger when necessary.
• the processor may calculate the LBP by using a difference value between a center point and an outermost point. According to the LBP, the processor may acquire an LBP histogram as in Math. 5 below.
• the processor may extract a fingerprint of the image or the video frame by a combination of F Color , F EGT , F LBP .
• the storage may include an image or video DB and a fingerprint DB.
• the image or video DB may store an image or a video that is received by the server 20 from the electronic apparatus 10, and may store an image or a video that is acquired by the server 20.
• the fingerprint DB may store a fingerprint that is extracted from a reference image or a reference video that is necessary for object recognition.
• the communication interface allows the server 20 to communicate data with an external apparatus.
• the communication interface may receive an image or a video frame (i.e., a recognition target) from the electronic apparatus 10.
• the communication interface may receive a fingerprint of an image or a video frame (i.e., a recognition target) from the electronic apparatus 10.
• the communication interface may transmit information of a reference fingerprint, which matches a fingerprint of an image or a video frame, to the electronic apparatus 10.
• FIG. 14 is a flow diagram of a method of extracting and identifying a fingerprint based on a plurality or regions in an image of content, according to an exemplary embodiment.
• the server 20 may set a plurality of regions in a content image.
• the server 20 may set the plurality of regions to include an overlapping region.
• the server 20 may set the plurality of regions not to overlap each other.
• the server 20 may set an index for each of the plurality of regions and extract a fingerprint for each of the plurality of regions.
• the fingerprint for each of the plurality of regions may be generated by a combination of F Color , F EGT , F LBP as described with reference to FIG. 13, or may be generated in other ways.
• the server 20 may determine a candidate region for the plurality of regions. For example, the server 20 may determine a candidate region for the plurality of regions by using the previous matching result. When a fingerprint of an ROI #0 region is previously matched with a reference fingerprint, the server 20 may set the fingerprint of the ROI #0 region to determine whether it is matched with the reference fingerprint.
• the server 20 may determine whether there is matching between the fingerprint of the candidate region and the reference fingerprint. Specifically, according to the priority of the candidate region, the server 20 may identify the content by detecting whether there is a reference fingerprint matching the fingerprint of the candidate region.
• FIG. 15 is a diagram illustrating a method of extracting and identifying a fingerprint based on a plurality or regions in an image of content, according to an exemplary embodiment.
• the server 20 may set a plurality of regions to include an overlapping region in a content image as illustrated in 151 of FIG. 15.
• the server 20 may set a plurality of regions not to overlap each other as illustrated in 152 of FIG. 15.
• FIGS. 16 and 17 are block diagrams of an electronic apparatus according to an exemplary embodiment.
• the electronic apparatus 10 may include a processor 1300, a display 1210, a communication interface 1500, and a memory 1700. However, not all of the components illustrated in FIG. 16 are necessary components of the electronic apparatus 10. The electronic apparatus 10 may be implemented by more components than the components illustrated in FIG. 16, or may be implemented by less components than the components illustrated in FIG. 16.
• the electronic apparatus 10 may further include a user input interface 1100, an output interface 1200, sensor 1400, and an audio/video (A/V) input interface 1600 in addition to the processor 1300, the display 1210, the communication interface 1500, and the memory 1700.
• a user input interface 1100 may further include a user input interface 1100, an output interface 1200, sensor 1400, and an audio/video (A/V) input interface 1600 in addition to the processor 1300, the display 1210, the communication interface 1500, and the memory 1700.
• A/V audio/video
• the user input interface 1100 may refer to a unit through which the user inputs data for controlling the electronic apparatus 10.
• the user input interface 1100 may include, but is not limited to, a keypad, a dome switch, a touch pad (e.g., a capacitive overlay type, a resistive overlay type, an infrared beam type, a surface acoustic wave type, an integral strain gauge type, or a piezoelectric type), a jog wheel, and a jog switch.
• the user input interface 1100 may request a response message with respect to a voice input of the user and receive a user input for executing an operation related to the response message.
• the output interface 1200 may output an audio signal, a video signal, or a vibration signal, and may include a display 1210, a speaker 1220, and a vibration motor 1230.
• the display 1210 may display and output information processed by the electronic apparatus 10. For example, the display 1210 may output a broadcast program received from a set-top box or a broadcast station. Also, when the user uses a remote control to input a control command for controlling the electronic apparatus 10, the display 1210 may display an execution screen corresponding to the control command.
• the speaker 1220 may output audio data received from the communication interface 1500 or stored in the memory 1700. Also, the speaker 1220 may output audio signals related to functions (e.g., call signal reception, message reception, and notification) performed by the electronic apparatus 10. When a broadcast program received from a set-top box or a broadcast station is output through the display 1210, the speaker 1220 may output an audio signal of the broadcast program.
• functions e.g., call signal reception, message reception, and notification
• the processor 1300 may control an overall operation of the electronic apparatus 10.
• the processor 1300 may control the overall operations of the user input interface 1100, the output interface 1200, the sensor 1400, the communication interface 1500, and the A/V input interface 1600 by executing one or more instructions or programs stored in the memory 1700.
• the processor 1300 may perform the functions of the electronic apparatus 10 illustrated in FIGS. 1 to 15.
• the processor 1300 may extract a fingerprint of content displayed on a display. Based on the fingerprint of the content, the processor 1300 may recognize a first broadcast channel corresponding to the content. Specifically, the processor 1300 may transmit the extracted fingerprint of the content to a server and receive information of the first broadcast channel corresponding to the content from the server.
• the first broadcast channel may be determined based on a comparison result between the fingerprint of the content and a fingerprint of an image of each of broadcast channels.
• the processor 1300 may extract a fingerprint of the content at predetermined time intervals and determine, based on the fingerprint extracted at the predetermined time intervals, whether the first broadcast channel is continuously output on the display. For example, the processor 1300 may extract a fingerprint of the content 5 times at intervals of 3 seconds and determine whether there is a fingerprint of a broadcast channel that matches the fingerprints extracted 5 times at intervals of 3 seconds. When the fingerprints of the broadcast channel matching the fingerprints extracted 5 times at intervals of 3 seconds are identical to each other, the processor 1300 may determine that the broadcast channel corresponding to the content is continuously output.
• the processor 1300 may request information of a broadcast fingerprint of the first broadcast channel from the server.
• the processor 1300 may receive a notification indicating a broadcast schedule of a replacement target existing advertisement in the first broadcast channel from the server.
• the broadcast schedule of the replacement target existing advertisement may be determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.
• the processor 1300 may receive a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server.
• the processor 1300 may download a replacement advertisement from the server based on a start point of the replacement target existing advertisement.
• the processor 1300 may determine a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display.
• the processor 1300 may download at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.
• the processor 1300 may reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.
• the processor 1300 may set a second layer on a first layer where a broadcast of the first broadcast channel is output and reproduce the replacement advertisement on the second layer.
• the processor 1300 may acquire a difference image between an image of only the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen.
• the processor 1300 may display the execution screen overlappingly on an image of the replacement advertisement based on the difference image.
• the processor 1300 may interrupt the reproduction of the replacement advertisement and display a screen broadcasted on the second broadcast channel on the display.
• the processor 1300 may set a plurality of regions in an image of the content and extract a fingerprint of the content based on a pixel value of the plurality of regions.
• the processor 1300 may be implemented by an array of logic gates, or may be implemented by a combination of a general-purpose microprocessor and a memory that stores a program executable in the general-purpose microprocessor. Also, those of ordinary skill in the art will understand that the processor 1300 may be implemented by other types of hardware.
• the sensor 1400 may detect a state of the electronic apparatus 10 or a peripheral state of the electronic apparatus 10 and transmit the detected information to the processor 1300.
• the sensor 1400 may include, but is not limited to, at least one of a magnetic sensor 1410, an acceleration sensor 1420, a temperature/humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, a position sensor (e.g., GPS sensor) 1460, a pressure sensor 1470, a proximity sensor 1480, and an RGB sensor (illuminance sensor) 1490. Because those of ordinary skill in the art may intuitively infer the respective functions of the sensors from the respective names thereof, detailed descriptions thereof will be omitted for conciseness.
• the communication interface 1500 may include one or more components for allowing the electronic apparatus 10 to communicate with another apparatus or the server 20.
• the other apparatus may be, but is not limited to, a sensing apparatus or a computing apparatus such as the electronic apparatus 10.
• the communication interface 1500 may include a short-range wireless communication interface 1510, a mobile communication interface 1520, and a broadcast receiver 1530.
• the short-range wireless communication interface 1510 may include, but is not limited to, a Bluetooth communication interface, a Bluetooth Low Energy (BLE) communication interface, a near field communication interface, a WLAN (WiFi) communication interface, a ZigBee communication interface, an infrared data association (IrDA) communication interface, a WiFi Direct (WFD) communication interface, a ultra wideband (UWB) communication interface, and an Ant+ communication interface.
• BLE Bluetooth Low Energy
• WiFi Wireless Fidelity
• ZigBee ZigBee communication interface
• IrDA infrared data association
• WFD WiFi Direct
• UWB ultra wideband
• the mobile communication interface 1520 may communicate wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network.
• the wireless signals may include voice call signals, video call signals, or various types of data for transmission and reception of text/multimedia messages.
• the broadcast receiver 1530 may receive broadcast signals and/or broadcast-related information from external devices through broadcast channels.
• the broadcast channels may include satellite channels and terrestrial channels.
• the electronic apparatus 10 may not include the broadcast receiver 1530.
• the communication interface 1500 may request a response message with respect to a voice input of the user and communicate information, which is necessary to execute an operation related to the response message, with another apparatus or the server 20.
• the A/V input interface 1600 may be used to input audio signals or video signals and may include, for example, a camera 1610 and a microphone 1620.
• the camera 1610 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a photographing mode.
• the image captured through the image sensor may be processed by the processor 1300 or a separate image processing unit.
• the image captured by the camera 1610 may be used as context information of the user.
• the microphone 1620 may receive an input of an external audio signal and process the same into electrical audio data.
• the microphone 1620 may receive an audio signal from an external device or the user.
• the microphone 1620 may receive a voice input of the user.
• the microphone 1620 may use various noise cancellation algorithms for canceling a noise that may be generated in the process of receiving an input of an external audio signal.
• the memory 1700 may store one or more instructions for processing and controlling operations of the processor 1300, and may store data that is input to the electronic apparatus 10 or output from the electronic apparatus 10.
• the memory 1700 may include at least one type of storage medium from among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD and XD memories), random-access memory (RAM), static random-access memory (SRAM), read-only memory (ROM), electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.
• card type memory e.g., SD and XD memories
• RAM random-access memory
• SRAM static random-access memory
• ROM read-only memory
• EEPROM electronically erasable programmable read-only memory
• PROM programmable read-only memory
• magnetic memory magnetic disk, and optical disk.
• the programs stored in the memory 1700 may be classified into a plurality of modules according to their functions and may be classified into, for example, a user interface (UI) module 1710, a touchscreen module 1720, and a notification module 1730.
• UI user interface
• the UI module 1710 may provide, for example, a specialized UI and a graphical user interface (GUI) that interlock with the electronic apparatus 10 for each application.
• the touchscreen module 1720 may detect a touch gesture of the user on the touchscreen and transmit information about the touch gesture to the processor 1300. According to some exemplary embodiments, the touchscreen module 1720 may recognize and analyze a touch code.
• the touchscreen module 1720 may include separate hardware including a controller.
• the notification module 1730 may generate a signal for notifying the occurrence of an event in the electronic apparatus 10. Examples of the event occurring in the electronic apparatus 10 may include call signal reception, message reception, key signal input, and schedule notification.
• the notification module 1730 may output a notification signal of a video signal type through the display 1210, output a notification signal of an audio signal type through the speaker 1220, and output a notification signal of a vibration signal type through the vibration motor 1230.
• FIG. 18 is a block diagram of the server 20 according to an exemplary embodiment.
• the server 20 may include a processor 21, a communication interface 22, and a storage 23. However, not all of the illustrated components are necessary components.
• the server 20 may be implemented by more components than the illustrated components, or may be implemented by less components than the illustrated components. The above components will be described below.
• the processor 21 may receive broadcast information about each of broadcast channels from a broadcast station.
• the server 20 may extract a broadcast fingerprint of each of the broadcast channels.
• the processor 21 may receive a fingerprint of content displayed on the electronic apparatus 10 from the electronic apparatus 10.
• the processor 21 may determine a first broadcast channel corresponding to the content by comparing the fingerprint of the content and a fingerprint of an image of each of the broadcast channels.
• the processor 21 may determine whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus 10. Specifically, the processor 21 may determine whether an advertisement fingerprint of the replacement target existing advertisement in the electronic apparatus 10 is included in an advertisement fingerprint of the first broadcast channel. The processor 21 may add and store start point information of the existing advertisement in a broadcast fingerprint of the first broadcast channel when it is determined that the advertisement fingerprint of the existing advertisement is included in the advertisement fingerprint of the first broadcast channel. The processor 21 may transmit the stored broadcast fingerprint of the first broadcast channel to the electronic apparatus 10.
• the processor 21 may transmit a replacement advertisement to the electronic apparatus 10 based on a start point of the existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus 10.
• the communication interface 22 may include one or more components for allowing the server 20 to communicate with another apparatus or the electronic apparatus 10.
• the other apparatus may be, but is not limited to, a sensing apparatus or a computing apparatus such as the electronic apparatus 10.
• the communication interface 22 may be connected to the electronic apparatus 10 through a wireless communication network according to WiFi or WiFi Direct.
• the wireless communication network through which the communication interface 22 is connected may include, but is not limited to, wireless LAN, WiFi, Bluetooth, ZigBee, WiFi Direct (WFD), ultra wideband (UWB), infrared data association (IrDA), Bluetooth Low Energy (BLE), and near field communication (NFC).
• the storage 23 may store, for example, information received from the electronic apparatus 10, information to be transmitted to the electronic apparatus 10, information received from the external server 20, information to be transmitted to the external server 20, and information generated in the server 20.
• the server 20 may include a central operation processor to control the overall operations of the processor 21, the communication interface 22, and the storage 23.
• the central operation processor may be implemented by an array of logic gates, or may be implemented by a combination of a general-purpose microprocessor and a memory that stores a program executable in the general-purpose microprocessor. Also, those of ordinary skill in the art will understand that the central operation processor may be implemented by other types of hardware.
• FIG. 19 is a diagram illustrating a system for replacing an advertisement of a broadcast program in the electronic apparatus 10, according to an exemplary embodiment.
• the electronic apparatus 10 may recognize a first broadcast channel corresponding to the content. Specifically, the electronic apparatus 10 may extract a fingerprint of the content. The electronic apparatus 10 may transmit the extracted fingerprint of the content to an ACR server 30.
• the ACR server 30 may acquire a fingerprint of an image of each of the broadcast channels.
• the ACR server 30 may receive a broadcast signal of each of the broadcast channels from a broadcast station and extract a fingerprint of an image of each of the broadcast channels from the broadcast signal of each of the broadcast channels. In this case, the ACR server 30 may receive a broadcast signal, which is identical to the broadcast signal received from the electronic apparatus 10, from the broadcast station a few seconds before.
• the ACR server 30 may detect a fingerprint of the first broadcast channel that matches the fingerprint of the content.
• the ACR server 30 may determine the first broadcast channel of the matched fingerprint as a broadcast channel of the content and acquire information of the first broadcast channel.
• the electronic apparatus 10 may receive the information of the first broadcast channel from the ACR server 30 and recognize the broadcast channel of the content displayed on the electronic apparatus 10 as the first broadcast channel.
• the electronic apparatus 10 may determine whether the first broadcast channel corresponding to the content displayed on the display of the electronic apparatus 10 is locked.
• the electronic apparatus 10 may extract a fingerprint of the content a predetermined number of times at predetermined time intervals. When the fingerprint of the content extracted a predetermined number of times at predetermined time intervals is identical to a broadcast fingerprint of the first broadcast channel, the electronic apparatus 10 may determine that the first broadcast channel corresponding to the content displayed on the display is locked.
• the electronic apparatus 10 may extract a broadcast fingerprint of the content displayed on the display in real time.
• the electronic apparatus 10 may receive a broadcast fingerprint of the first broadcast channel from the ACR server 30.
• the electronic apparatus 10 may receive information of a replacement advertisement and information of a replacement target existing advertisement, among the existing advertisements included in a broadcast schedule of the first broadcast channel, from an advertisement server 40.
• the electronic apparatus 10 may determine a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and the broadcast fingerprint of the content extracted in real time.
• the electronic apparatus 10 may request to download an image of the replacement target existing advertisement and an image of the replacement advertisement from the advertisement server 40 before the start point of the replacement target existing advertisement of the first broadcast channel.
• the electronic apparatus 10 may download an image of the replacement target existing advertisement and an image of the replacement advertisement from the advertisement server 40.
• the electronic apparatus 10 may reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.
• FIG. 20 is a diagram illustrating a system for replacing an advertisement of a broadcast program in the electronic apparatus 10, according to another exemplary embodiment.
• the electronic apparatus 10 may include a frame capture module that captures a screen displayed on the display of the electronic apparatus 10; a fingerprint extractor module that extracts a fingerprint; a server matching module for recognizing a station and a broadcast channel viewed by the user of the electronic apparatus 10; a channel locker that determines a broadcast channel that is currently viewed by the user of the electronic apparatus 10; a fingerprint receiver module that receives a fingerprint with a dynamic advertisement replacement (DAR) event added thereto; a broadcast fingerprint local matching module that determines a current reproduction position of the content by matching a broadcast fingerprint and a fingerprint extracted in the electronic apparatus 10; a broadcast reproduction position estimating module that estimates an accurate reproduction position by using the existing matching information; a DAR event manager that generally manages and controls a DAR event; a video loader that interlocks with a player by downloading an image file of the replacement advertisement; and a video player that reproduces the replacement advertisement.
• the electronic apparatus 10 not all of the above components of the electronic apparatus 10 are necessary components of the electronic apparatus 10.
• the server 20 may include a capture server that receives a plurality of broadcasts, receives a fingerprint, and extract a fingerprint; a matching server that recognizes a channel by matching a fingerprint transmitted by the electronic apparatus 10 and a reference broadcast fingerprint stored in a database; an advertisement matching server that recognizes a DAR target advertisement by using the fingerprint captured by the capture server; a DAR event server that transmits a DAR-related event to the electronic apparatus 10; an EPG server that provides broadcast program information; an advertisement server that provides an advertisement replacement list, a replacement advertisement, or a replacement target advertisement; and a fingerprint transmitter that transmits a DAR-related event with a DAR event of a real-time broadcast added thereto to the electronic apparatus 10.
• the server 20 may be implemented by more components than the above components, or may be implemented by less components than the above components.
• a method of replacing an advertisement displayed on the electronic apparatus 10 may include a channel locking operation for determining by the electronic apparatus 10 what broadcast channel is currently viewed; and an advertisement replacement operation for performing advertisement replacement by accurately recognizing an advertisement replacement point in a state where a broadcast channel is locked.
• the electronic apparatus 10 may determine a broadcast channel that is currently viewed by the user of the electronic apparatus 10.
• the server 20 may recognize, through the advertisement matching server, that a replacement target advertisement is scheduled to be broadcasted, notify the electronic apparatus 10 that advertisement replacement should be prepared, and allow the electronic apparatus 10 to download a broadcast fingerprint and a replacement advertisement therefrom.
• the electronic apparatus 10 may accurately detect an advertisement replacement point by matching a downloaded broadcast fingerprint and a fingerprint extracted by the electronic apparatus 10 while downloading a broadcast fingerprint in real time.
• the electronic apparatus 10 may perform advertisement replacement at the advertisement replacement point.
• the electronic apparatus 10 may continuously recognize a screen change, which is caused for example by broadcast channel switching or the display (e.g., On-Screen Display (OSD)) of an execution screen for control of a set-top box, by matching the downloaded broadcast fingerprint and the fingerprint extracted by the electronic apparatus 10, even while an advertisement is reproduced after the advertisement replacement is completed.
• the electronic apparatus 10 may stop the reproduction of a replaced advertisement. Also, the electronic apparatus 10 may transmit information about whether the advertisement replacement is normally completed to the server.
• OSD On-Screen Display
• a broadcast signal received in the capture server may be identical to a broadcast signal received in the electronic apparatus 10.
• the capture server may receive a broadcast signal earlier than the time when the electronic apparatus 10 receives a broadcast signal, and extract a broadcast fingerprint based on the broadcast signal.
• the capture server may interlock the extracted broadcast fingerprint with the broadcast metadata received from the EPG server and transmit the interlocking result to an indexing module in the advertisement matching server.
• the indexing module may index the fingerprint information and store the same in a broadcast fingerprint database (DB).
• DB broadcast fingerprint database
• the frame capture module may capture the content (e.g., audio, video frames, and images) output from the electronic apparatus 10, the fingerprint extractor module may extract a fingerprint based on the extracted content.
• the content e.g., audio, video frames, and images
• the fingerprint extractor module may extract a fingerprint based on the extracted content.
• the fingerprint extractor module may transmit the extracted fingerprint to an ACR matching client.
• the ACR matching client may transmit an ACR query to an ACR matching server to request the recognition of a broadcast channel.
• the ACR matching server may perform matching with a broadcast fingerprint of the broadcast channels stored and indexed in real time and transmit the matched broadcast channel information to the ACR matching client.
• the ACR matching client may provide the matching result (the matched broadcast channel information) to the channel locker, and the channel locker may determine whether the matched broadcast channel is continuously viewed in the electronic apparatus 10. As a result of the determination, when the matched broadcast channel is continuously viewed in the electronic apparatus 10, the channel locker may determine that the broadcast channel being viewed in the electronic apparatus 10 is in a locked state.
• the determined broadcast channel information may be transmitted to the DAR event manager, and the DAR event manager may perform a DAR event-related process.
• the components of the electronic apparatus 10 and the components of the server 20 may operate as follows.
• the advertisement server may receive information of a replacement advertisement and information about a replacement target advertisement determined based on the profile information of the electronic apparatus 10.
• the advertisement server may extract a fingerprint of the replacement target advertisement and transmit the extracted fingerprint to an on-demand indexing server, and the on-demand indexing server may index/store the fingerprint transmitted in an advertisement fingerprint database.
• the advertisement matching server may receive a broadcast fingerprint from the capture server.
• the advertisement matching server may determine whether there is a replacement target advertisement stored in the advertisement fingerprint database. When the replacement target advertisement is not included in the broadcast fingerprint information, the advertisement matching server may index/store the broadcast fingerprint information received from the capture server.
• the advertisement matching server may add information of a start point of the replacement target advertisement to the broadcast fingerprint and index/store the same in the broadcast fingerprint database.
• the advertisement matching server may notify the DAR event server that the start point of the replacement target advertisement is detected.
• the DAR event server may transmit a notification indicating that the start point of the replacement target advertisement is detected to the DAR event manager of the electronic apparatus 10.
• the DAR event manager may trigger a fingerprint receiver to download a broadcast fingerprint from the server.
• the fingerprint receiver may download a broadcast fingerprint from the server.
• a DAR event may be mapped to the received broadcast fingerprint at the position of a particular fingerprint.
• the DAR event manager when receiving the information indicating that the replacement target advertisement is started from the DAR event server, the DAR event manager may request the video loader to download a replacement advertisement.
• the video loader may download the replacement advertisement from the advertisement server.
• the video loader may download all of the replacement advertisement.
• the video loader may first download only a start portion of the replacement advertisement, download the remaining portion thereof in a streaming manner during the reproduction of an image of the replacement advertisement, and connect the same by a video player.
• a DAR event may be a preloading video event for downloading all or part of the replacement advertisement, a play video event for playing a new advertisement, an end video event for ending the advertisement play when an advertisement period ends, or a stop video event for stopping the advertisement play when a screen state changes in a state where the advertisement does not end (for example, when the channel is changed, or when an OSD is output on the screen of an existing advertisement because the user presses a remote control button of the electronic apparatus 10).
• the DAR event manager may request the broadcast fingerprint local matching module to start local matching.
• the broadcast fingerprint local matching module may match the broadcast fingerprint received from the server and the fingerprint extracted by the electronic apparatus 10 and provide the current fingerprint matching information and the DAR event information to the broadcast reproduction position estimating module.
• the broadcast reproduction position estimating module may determine an accurate broadcast reproduction point by using the fingerprint local matching information and provide suitable DAR event information to the DAR event manager at the determined point.
• the DAR event manager may request the video player to reproduce the replacement advertisement at the point of the replacement target advertisement.
• the video player may reproduce the replacement advertisement according to the request of the DAR event manager.
• Exemplary embodiments may also be implemented in the form of a computer-readable recording medium including instructions executable by a computer, such as program modules executed by a computer.
• the computer-readable recording medium may be any available medium accessible by a computer and may include all of volatile or non-volatile mediums and removable or non-removable mediums.
• the computer-readable recording medium may include all of computer storage mediums and communication mediums.
• the computer storage mediums may include all of volatile or non-volatile mediums and removable or non-removable mediums that are implemented by any method or technology to store information such as computer-readable instructions, data structures, program modules, or other data.
• the communication mediums may include any information transmission medium and may include other transmission mechanisms or other data of modulated data signals such as carriers, computer-readable instructions, data structures, or program modules.
• a "unit” may include a hardware component such as a processor or a circuit, and/or a software component executed by a hardware component such as a processor.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Databases & Information Systems (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Social Psychology (AREA)
• Marketing (AREA)
• Business, Economics & Management (AREA)
• Computer Networks & Wireless Communication (AREA)
• Human Computer Interaction (AREA)
• General Engineering & Computer Science (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Applications Claiming Priority (5)

Publications (2)

Family

ID=61199159

Family Applications (1)

Country Status (2)

Families Citing this family (12)

Family Cites Families (5)

• 2017
  • 2017-07-21 KR KR1020170092738A patent/KR102410473B1/ko active IP Right Grant
  • 2017-08-01 EP EP17837213.2A patent/EP3430811A4/de not_active Ceased

Also Published As

Similar Documents

Legal Events