WO2017113605A1 - Method and device for channel identification - Google Patents

Method and device for channel identification Download PDF

Info

Publication number
WO2017113605A1
WO2017113605A1 PCT/CN2016/084684 CN2016084684W WO2017113605A1 WO 2017113605 A1 WO2017113605 A1 WO 2017113605A1 CN 2016084684 W CN2016084684 W CN 2016084684W WO 2017113605 A1 WO2017113605 A1 WO 2017113605A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
channel
matrix
identification
images
Prior art date
Application number
PCT/CN2016/084684
Other languages
French (fr)
Chinese (zh)
Inventor
杨杰
颜业钢
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Publication of WO2017113605A1 publication Critical patent/WO2017113605A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44222Analytics of user selections, e.g. selection of programs or purchase activity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk

Definitions

  • the present invention relates to the field of smart televisions, and in particular, to a channel identification method and apparatus.
  • the main object of the present invention is to solve the problem that the existing channel identification process needs to interact with the server at all times, and the operation speed is slow and the recognition accuracy is low.
  • the present invention provides a channel identification method, the channel identification method comprising the following steps:
  • the points in the difference matrix are binarized, and the obtained binarized image is used as a feature image;
  • the similarity between the preset library images and the feature image is separately calculated, and the channel corresponding to the library image with the highest similarity is used as the channel locked by the user in the recognition period.
  • the present invention provides a channel identification method, the channel identification method comprising the following steps:
  • the similarity between the preset library images and the feature image is separately calculated, and the channel corresponding to the library image with the highest similarity is used as the channel locked by the user in the recognition period.
  • the step of performing feature extraction according to all the identification images in the identification period to obtain the feature image comprises:
  • the points in the difference matrix are binarized, and the obtained binarized image is used as the feature image.
  • the present invention further provides a channel identification apparatus, where the channel identification apparatus includes:
  • An acquisition module configured to collect multiple screen images in a preset recognition period
  • An identifier extraction module configured to respectively extract an identifier image containing a channel identifier from each of the screen images
  • a feature extraction module configured to perform feature extraction according to all the identification images in the recognition period to obtain a feature image
  • a determining module configured to separately calculate a similarity between the preset library images and the feature image, and use a channel corresponding to the library image with the highest similarity as a frequency locked by the user in the identification period Road.
  • the invention collects the screen image by timing, and extracts the identification image containing the channel identifier based on the collected screen image, and extracts the feature image based on the smaller identification image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency.
  • only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
  • by collecting the screen image and the pre-stored library image for processing there is no need to interact with the server at all times, which further improves the operation efficiency and saves the cost.
  • FIG. 1 is a schematic flow chart of a first embodiment of a channel identification method according to the present invention.
  • FIG. 2 is a schematic flow chart of a second embodiment of a channel identification method according to the present invention.
  • FIG. 3 is a schematic flow chart of a third embodiment of a channel identification method according to the present invention.
  • FIG. 4 is a schematic flow chart of a fourth embodiment of a channel identification method according to the present invention.
  • FIG. 5 is a schematic diagram of functional modules of a first embodiment of a channel identification apparatus according to the present invention.
  • FIG. 6 is a schematic diagram of functional modules of a second embodiment of a channel identification apparatus according to the present invention.
  • the invention provides a channel identification method.
  • FIG. 1 is a schematic flowchart diagram of a first embodiment of a channel identification method according to the present invention.
  • the channel identification method includes:
  • Step S10 collecting a plurality of screen images in a preset recognition period
  • the smart TV collects a plurality of screen images in a preset recognition period to analyze and determine a channel locked by the user during the recognition period.
  • the smart TV can collect the screen image with a preset sampling period; the smart TV summarizes the collected screen images according to the recognition period for analysis.
  • the sampling period can be set to 5 minutes, and the recognition period can be set to 1 hour, for example, smart TV every 5
  • the process of collecting screen images by smart TVs can be achieved by screen capture.
  • the smart TV can obtain the screen image through the screen capture; the smart TV determines whether the captured image resolution conforms to the preset reference sample specification; if the reference sample specification is met, the captured image is saved as the sample image; For the reference sample size, the captured image is interpolated to obtain an image conforming to the reference sample size, and the image obtained by the interpolation process is saved as a sample image.
  • the reference sample specification makes the channel identification method of the present invention applicable to different models.
  • the resolution and aspect ratio of 1920*1080 can be selected as the reference sample specification, and the data can be selected to not only take care of the high-end machine of 4K resolution. Type, it can also be taken care of for low-end models.
  • the screen capture specification is 1920*1080, then the direct screen capture is used as the sample image; for models other than 1920*1080, the image of the screen capture image needs to be interpolated to convert to 1920*1080. Specifications of the image.
  • the smart TV can read the resolution of the screen before collecting the screen image, and determine whether the read screen resolution conforms to the preset reference sample specification, and if the screen resolution conforms to the benchmark sample specification, The screen image is directly captured as a sample image; if the screen resolution does not conform to the reference sample specification, the interpolation process is performed each time the screen image is captured, and an image conforming to the reference sample specification is obtained for storage. It is not necessary to perform a judgment on whether or not the reference sample specification is met every time the screen image is captured, thereby improving the processing efficiency.
  • Step S20 extracting a logo image containing a channel identifier from each screen image
  • the smart TV separately extracts the identification image of each screen image to obtain a corresponding plurality of identification images.
  • the screen image is an image that conforms to a benchmark sample size.
  • the smart television can extract the identification image from the determined area by determining an area containing the channel identification in the screen image.
  • Step S30 performing feature extraction according to all the identification images in the identification period to obtain a feature image
  • the smart TV extracts features according to all the identification images in the recognition period, and extracts feature images containing feature points from the plurality of identification images, and the feature points are points at which the identification images are fixed in the recognition period.
  • the smart television extracts the feature image extracted according to the plurality of identification images into one, that is, the channel locked by the user determined within one identification period is one.
  • Step S40 respectively calculating the similarity between the preset library images and the feature image, and using the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period.
  • the smart TV separately calculates the similarity between the preset library images and the feature images; the smart TV uses the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period. Specifically, the smart TV reads the preset library image, calculates the similarity between each library image and the feature image, determines the library image with the highest similarity, reads the channel information corresponding to the determined library image, and determines the user according to the channel information. The channel that is locked during the recognition period.
  • the smart TV may further load the preset library image and the corresponding channel information to perform channel identification according to the library image and the corresponding channel information.
  • the smart television may also acquire the library image and the corresponding channel information from the server in the channel identification process.
  • the collected screen images are all one channel, and the calculation accuracy is the highest at this time; if the user switches channels a small amount in one recognition period and is collected to the screen. If the sample sampled by one of the channels A reaches a preset ratio or more, the algorithm has the fault tolerance mechanism, and the channel A can still be calculated; if the user frequently changes the station within one recognition period, and the number of sampling times of one channel does not exceed The preset number of times, this calculation loses meaning, the situation is consistent with reality, users frequently change channels quickly, and they do not have statistical characteristics, such cases are not considered.
  • the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency.
  • only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
  • by collecting the screen image and the pre-stored library image for processing there is no need to interact with the server at all times, which further improves the operation efficiency and saves the cost.
  • FIG. 2 is a schematic flowchart diagram of a second embodiment of a channel identification method according to the present invention. Based on the first embodiment of the above channel identification method, step S30 includes:
  • Step S31 calculating an average matrix according to a matrix corresponding to each identifier image
  • the smart television can generate a corresponding matrix C i (matrix corresponding to the i-th identification image) according to each identification image, and calculate an average matrix C mean based on the generated respective matrices C i . For example, if the resolution of the identification image is 480*270, the corresponding matrix C i scale is 480*270.
  • the smart television may generate a corresponding matrix S i (matrix corresponding to the i-th screen image) according to each screen image, and separately segment each matrix S i to obtain a corresponding matrix C i .
  • the obtained matrix S i has a specification of 1920*1080
  • the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
  • the smart television calculates a mean matrix C mean according to each matrix C i , wherein:
  • Step S32 respectively calculating a distance matrix of the matrix corresponding to each identifier image and the mean matrix
  • Smart TV image respectively calculated for each identifier corresponding to the distance matrix and the matrix C i D i C mean mean matrix (matrix C i corresponding to the distance matrix).
  • the smart television calculates the distance matrix D i of each matrix C i and the mean matrix C mean to obtain a distance matrix set D, where:
  • D [C 1 -C mean , C 2 -C mean ,...C i -C mean ,...,C 12 -C mean ],i ⁇ (1,12)
  • Step S33 performing feature decomposition on each distance matrix to obtain a corresponding feature vector matrix
  • the smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i (a feature vector matrix corresponding to the distance matrix D i ).
  • the smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i and obtains a feature feature vector matrix set V, wherein:
  • V [V 1 , V 2 ,...,V i ,...,V 12 ],i ⁇ (1,12)
  • Step S34 calculating an entropy matrix corresponding to each feature vector matrix
  • Step S35 calculating an average value of all entropy value matrices to obtain a difference matrix
  • the smart TV calculates the average of all entropy matrix E i to obtain the difference matrix E mean .
  • the difference matrix E mean is calculated, where:
  • step S36 the points in the difference matrix are binarized, and the obtained binarized image is used as the feature image.
  • the smart television binarizes the points in the difference matrix E mean and uses the obtained binarized image as the feature image. Specifically, the smart TV can sort the points in the difference matrix E mean by the size, the last 10,000 points are marked as white, and the remaining points are marked as black, and the corresponding binarized image is obtained.
  • the binarization process can effectively distinguish the channel identification from the background.
  • a feature image containing a feature point is obtained by extracting a fixed feature point in the identification area within the recognition period from the identification image containing the channel identifier.
  • the extracted feature image contains more information related to the channel identification, which improves the calculation accuracy.
  • by comparing the feature image and the library image to determine the channel locked by the user it is not necessary to interact with the server at any time, thereby further improving the operation efficiency and saving the cost.
  • FIG. 3 is a schematic flowchart diagram of a third embodiment of a channel identification method according to the present invention. Based on the first embodiment of the above channel identification method, step S20 includes:
  • Step S21 each screen image is separately cut into sixteen squares to obtain a corresponding area image group
  • Step S22 extracting an area image of the first row and the first column of each area image group as a corresponding identification image.
  • the smart TV divides each screen image into a corresponding 16-square grid to obtain a corresponding area image group; extracts an area image of the first row and the first column of each area image group as a corresponding identification image, and obtains a logo image corresponding to each screen image. To extract the feature image based on the obtained logo image.
  • smart television may also generate the corresponding matrix S i, respectively, each of the smart TV matrix S i for sixteen grids obtained by cutting each of the corresponding sub-matrix based on a screen image; a first row and first column of sub smart TV extraction identity matrix as the matrix C i S i of the image corresponding to the matrix.
  • the obtained matrix S i has a specification of 1920*1080
  • the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
  • the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency.
  • only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
  • FIG. 4 is a schematic flowchart diagram of a fourth embodiment of a channel identification method according to the present invention. Based on the first embodiment of the channel identification method, after step S40, the method further includes:
  • Step S51 performing statistics on channels locked by the user in each recognition period within a preset time period
  • step S52 the channel with the preset number of times of the number of locks in the statistical result is used as the preferred channel of the user within the preset time.
  • the smart TV counts the channels locked by the user in each recognition period in the preset time; the channel in which the number of locks is ranked in the preset number of times in the statistical result is used as the preferred channel of the user within the preset time.
  • the preset number of bits can be set according to the actual settings. For example, it can be set to the top three or the top ten. Further, the smart TV can also upload the top three channels in the statistical results to the server. In order to understand the user's usage habits of the smart TV and the user's preference for the television program through the server, the television content of the user's preference is provided in a targeted manner.
  • the preset time can be 24 hours, 48 hours, and the like.
  • the top three channels are used as the preferred channels of the user in the preset time, so that the service provider can understand the user's usage habits of the smart TV and the user preference television programs. Therefore, the television content of the user's preference is provided in a targeted manner.
  • the execution bodies of the channel identification methods of the above-described first to fourth embodiments may each be a smart TV or an intelligent terminal for playing a television program. Further, the channel identification method may be implemented by a client program installed on a smart TV or a smart terminal for playing a television program, wherein the smart terminal may include, but is not limited to, a mobile phone, a smart phone, a notebook computer, a PDA. Terminals (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), desktop computers, and the like.
  • the invention further provides a channel identification device.
  • FIG. 5 is a schematic diagram of functional modules of a first embodiment of a channel identification apparatus according to the present invention.
  • the channel identification device includes: an acquisition module 10, an identifier extraction module 20, a feature extraction module 30, and a determination module 40.
  • the collecting module 10 is configured to collect a plurality of screen images in a preset recognition period
  • the smart TV collects a plurality of screen images in a preset recognition period to analyze and determine a channel locked by the user during the recognition period.
  • the smart TV can collect the screen image with a preset sampling period; the smart TV summarizes the collected screen images according to the recognition period for analysis.
  • the sampling period can be set to 5 minutes, and the recognition period can be set to 1 hour.
  • the 12 screen images are analyzed as samples to determine the channel that the user has locked within 1 hour.
  • the process of collecting screen images by smart TVs can be achieved by screen capture.
  • the smart TV can obtain the screen image through the screen capture; the smart TV determines whether the resolution of the captured image conforms to the preset.
  • the reference sample specification if the reference sample specification is met, the captured image is saved as a sample image; if the reference sample specification is not met, the intercepted image is interpolated to obtain an image conforming to the reference sample specification, and the interpolation is processed.
  • the resulting image is saved as a sample image.
  • the reference sample specification makes the channel identification method of the present invention applicable to different models.
  • the resolution and aspect ratio of 1920*1080 can be selected as the reference sample specification, and the data can be selected to not only take care of the high-end machine of 4K resolution. Type, it can also be taken care of for low-end models.
  • the screen capture specification is 1920*1080, then the direct screen capture is used as the sample image; for models other than 1920*1080, the image of the screen capture image needs to be interpolated to convert to 1920*1080. Specifications of the image.
  • the smart TV can read the resolution of the screen before collecting the screen image, and determine whether the read screen resolution conforms to the preset reference sample specification, and if the screen resolution conforms to the benchmark sample specification, The screen image is directly captured as a sample image; if the screen resolution does not conform to the reference sample specification, the interpolation process is performed each time the screen image is captured, and an image conforming to the reference sample specification is obtained for storage. It is not necessary to perform a judgment on whether or not the reference sample specification is met every time the screen image is captured, thereby improving the processing efficiency.
  • the identifier extraction module 20 is configured to respectively extract the identifier image containing the channel identifier from each screen image;
  • the smart TV separately extracts the identification image of each screen image to obtain a corresponding plurality of identification images.
  • the screen image is an image that conforms to a benchmark sample size.
  • the smart television can extract the identification image from the determined area by determining an area containing the channel identification in the screen image.
  • the feature extraction module 30 is configured to perform feature extraction according to all the identification images in the recognition period to obtain a feature image
  • the smart TV extracts features according to all the identification images in the recognition period, and extracts feature images containing feature points from the plurality of identification images, and the feature points are points at which the identification images are fixed in the recognition period.
  • the smart television extracts the feature image extracted according to the plurality of identification images into one, that is, the channel locked by the user determined within one identification period is one.
  • the determining module 40 is configured to separately calculate the similarity between the preset library images and the feature image, and use the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period.
  • the smart TV separately calculates the similarity between the preset library images and the feature images; the smart TV uses the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period. specific, The smart TV reads the preset library image, calculates the similarity between each library image and the feature image, determines the library image with the highest similarity, reads the channel information corresponding to the determined library image, and determines the user in the recognition cycle according to the channel information. Internal locked channel.
  • the channel identification device may further include an initialization module, and the initialization module is configured to load the preset library image and the corresponding channel information to perform channel identification according to the library image and the corresponding channel information.
  • the smart TV can load the preset library image and the corresponding channel information through the initialization module to perform channel identification according to the library image and the corresponding channel information.
  • the smart television may also acquire the library image and the corresponding channel information from the server in the channel identification process.
  • the collected screen images are all one channel, and the calculation accuracy is the highest at this time; if the user switches channels a small amount in one recognition period and is collected to the screen. If the sample sampled by one of the channels A reaches a preset ratio or more, the algorithm has the fault tolerance mechanism, and the channel A can still be calculated; if the user frequently changes the station within one recognition period, and the number of sampling times of one channel does not exceed The preset number of times, this calculation loses meaning, the situation is consistent with reality, users frequently change channels quickly, and they do not have statistical characteristics, such cases are not considered.
  • the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency.
  • only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
  • by collecting the screen image and the pre-stored library image for processing there is no need to interact with the server at all times, which further improves the operation efficiency and saves the cost.
  • FIG. 6 is a schematic diagram of functional modules of a second embodiment of the apparatus of the present invention.
  • the feature extraction module 30 includes a calculation unit 31 and a binarization unit 32.
  • the calculating unit 31 is configured to calculate an average matrix according to a matrix corresponding to each identifier image
  • the smart television can generate a corresponding matrix C i (matrix corresponding to the i-th identification image) according to each identification image, and calculate an average matrix C mean based on the generated respective matrices C i . For example, if the resolution of the identification image is 480*270, the corresponding matrix C i scale is 480*270.
  • smart television may be the logo image extraction process, generates a corresponding matrix S i (i-th screen image corresponding to a matrix) in accordance with various screen images, respectively, each of the matrix S i dividing process to obtain the corresponding matrix C i.
  • the resolution of the screen image is 1920*1080
  • the obtained matrix S i has a specification of 1920*1080
  • the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
  • the smart television calculates a mean matrix C mean according to each matrix C i , wherein:
  • the calculating unit 31 is further configured to separately calculate a distance matrix of the matrix corresponding to each identifier image and the mean matrix;
  • Smart TV image respectively calculated for each identifier corresponding to the distance matrix and the matrix C i D i C mean mean matrix (matrix C i corresponding to the distance matrix).
  • the smart television calculates the distance matrix D i of each matrix C i and the mean matrix C mean to obtain a distance matrix set D, where:
  • D [C 1 -C mean , C 2 -C mean ,...C i -C mean ,...,C 12 -C mean ],i ⁇ (1,12)
  • the calculating unit 31 is further configured to perform feature decomposition on each distance matrix to obtain a corresponding feature vector matrix
  • the smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i (a feature vector matrix corresponding to the distance matrix D i ).
  • the smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i and obtains a feature feature vector matrix set V, wherein:
  • V [V 1 , V 2 ,...,V i ,...,V 12 ],i ⁇ (1,12)
  • the calculating unit 31 is further configured to calculate a matrix of entropy values corresponding to each feature vector matrix
  • the calculating unit 31 is further configured to calculate an average value of all entropy value matrices to obtain a difference matrix
  • the smart TV calculates the average of all entropy matrix E i to obtain the difference matrix E mean .
  • the difference matrix E mean is calculated, where:
  • the binarization unit 32 is configured to perform binarization processing on the points in the difference matrix, and use the obtained binarized image as the feature image.
  • the smart television binarizes the points in the difference matrix E mean and uses the obtained binarized image as the feature image. Specifically, the smart TV can sort the points in the difference matrix E mean by the size, the last 10,000 points are marked as white, and the remaining points are marked as black, and the corresponding binarized image is obtained.
  • the binarization process can effectively distinguish the channel identification from the background.
  • a feature image containing a feature point is obtained by extracting a fixed feature point in the identification area within the recognition period from the identification image containing the channel identifier.
  • the extracted feature image contains more information related to the channel identification, which improves the calculation accuracy.
  • by comparing the feature image and the library image to determine the channel locked by the user it is not necessary to interact with the server at any time, thereby further improving the operation efficiency and saving the cost.
  • the identification extraction module 20 includes a cutting unit 21 and an extraction unit 22;
  • a cutting unit 21 configured to perform a sixteen-square grid cut on each screen image to obtain a corresponding area image group
  • the extracting unit 22 is configured to extract an area image of the first row and the first column of each regional image group as a corresponding identification image.
  • the smart TV divides each screen image into a corresponding 16-square grid to obtain a corresponding area image group; extracts an area image of the first row and the first column of each area image group as a corresponding identification image, and obtains a logo image corresponding to each screen image. To extract the feature image based on the obtained logo image.
  • smart television may also generate the corresponding matrix S i, respectively, each of the smart TV matrix S i for sixteen grids obtained by cutting each of the corresponding sub-matrix based on a screen image; a first row and first column of sub smart TV extraction identity matrix as the matrix C i S i of the image corresponding to the matrix.
  • the obtained matrix S i has a specification of 1920*1080
  • the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
  • the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency.
  • only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
  • the channel identification device further includes a statistics module 50;
  • the statistics module 50 is configured to perform statistics on channels locked by users in each identification period within a preset time period
  • the determining module 40 is further configured to use, as the preferred channel of the user, the channel of the preset number of times of the number of locks in the statistical result.
  • the smart TV counts the channels locked by the user in each recognition period in the preset time; the channel in which the number of locks is ranked in the preset number of times in the statistical result is used as the preferred channel of the user within the preset time.
  • the preset number of bits can be set according to the actual settings. For example, it can be set to the top three or the top ten. Further, the smart TV can also upload the top three channels in the statistical results to the server. In order to understand the user's usage habits of the smart TV and the user's preference for the television program through the server, the television content of the user's preference is provided in a targeted manner.
  • the preset time can be 24 hours, 48 hours, and the like.
  • the top three channels are used as the preferred channels of the user in the preset time, so that the service provider can understand the user's usage habits of the smart TV and the user preference television programs. Therefore, the television content of the user's preference is provided in a targeted manner.

Abstract

Disclosed in the present invention is a method for channel identification, the method for channel identification comprising the following steps: capturing a plurality of screen images in a preset identification period; extracting an identification image comprising a channel identifier from each of the screen images, respectively; performing characteristic extraction according to all the identification images in the identification period, so as to obtain a characteristic image; and calculating the similarity between each preset library image and the characteristic image, respectively, and taking the channel corresponding to the library image with the highest similarity as the channel locked by a user in the identification period. Further disclosed in the present invention is a device for channel identification. By means of the present invention, the calculation amount for extracting the characteristic image is reduced, the operation efficiency is improved and meanwhile, only small identification images are processed, reducing the complexity of the images, improving the identification accuracy. In addition, the processing is performed by means of the captured screen images and the pre-stored library images, without for the necessity of interaction with a server at all times, further improving the operation efficiency, saving the cost.

Description

频道识别方法及装置Channel identification method and device 技术领域Technical field
本发明涉及智能电视领域,尤其涉及一种频道识别方法及装置。The present invention relates to the field of smart televisions, and in particular, to a channel identification method and apparatus.
背景技术Background technique
目前,随着电子技术的发展,智能电视的使用范围越来越广,而用户能够观看的频道也越来越多。为了便于厂家了解用户对智能电视的使用习惯和用户偏好电视节目,从而有针对性的提供用户偏好的电视内容。智能电视往往需要对用户观看的电视频道进行频道识别和统计。现有的频道统计过程中,需要不停的与服务器交互来确定当前的频道信息,由于与远程服务器的交互过程往往会存在延时时间,常常会造成识别不准确、运算速度慢的问题。At present, with the development of electronic technology, the use of smart TVs is becoming wider and wider, and the channels that users can watch are also increasing. In order to facilitate the manufacturer to understand the user's habits of using the smart TV and the user's preference for the television program, the television content of the user's preference is provided in a targeted manner. Smart TVs often require channel identification and statistics on the TV channels that users watch. In the existing channel statistics process, it is necessary to continuously interact with the server to determine the current channel information. Since the interaction process with the remote server often has a delay time, the problem of inaccurate recognition and slow operation is often caused.
因此,现有的频道识别过程中需时时刻刻与服务器交互、且运算速度慢以及识别准确度低的问题。此方面的问题亟待发明人解决。Therefore, in the existing channel recognition process, it is necessary to interact with the server at all times, and the operation speed is slow and the recognition accuracy is low. The problem in this regard is urgently solved by the inventors.
发明内容Summary of the invention
本发明的主要目的在于解决现有的频道识别过程中需时时刻刻与服务器交互、且运算速度慢以及识别准确度低的问题。The main object of the present invention is to solve the problem that the existing channel identification process needs to interact with the server at all times, and the operation speed is slow and the recognition accuracy is low.
为实现上述目的,本发明提供一种频道识别方法,所述频道识别方法包括以下步骤:To achieve the above object, the present invention provides a channel identification method, the channel identification method comprising the following steps:
在预设的识别周期内采集多个屏幕图像;Acquiring multiple screen images during a preset recognition period;
将各所述屏幕图像分别进行十六宫格切割得到对应的区域图像组;Performing each of the screen images into a sixteen-square grid to obtain a corresponding area image group;
抽取各所述区域图像组的第一行第一列的区域图像作为对应的标识图像;Extracting an area image of the first row and the first column of each of the regional image groups as a corresponding identification image;
根据各所述标识图像对应的矩阵计算均值矩阵;Calculating an average matrix according to a matrix corresponding to each of the identification images;
分别计算各所述标识图像对应的矩阵与所述均值矩阵的距离矩阵;Calculating a distance matrix of the matrix corresponding to each of the identifier images and the mean matrix;
将各所述距离矩阵分别进行特征分解,得到对应的特征向量矩阵;Performing feature decomposition on each of the distance matrices to obtain a corresponding feature vector matrix;
计算各所述特征向量矩阵对应的熵值矩阵;Calculating a matrix of entropy values corresponding to each of the feature vector matrices;
计算全部所述熵值矩阵的平均值,得到差值矩阵;Calculating an average of all the entropy matrixes to obtain a difference matrix;
将所述差值矩阵中的点进行二值化处理,将得到的二值化图像作为特征 图像;The points in the difference matrix are binarized, and the obtained binarized image is used as a feature image;
分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道。The similarity between the preset library images and the feature image is separately calculated, and the channel corresponding to the library image with the highest similarity is used as the channel locked by the user in the recognition period.
为实现上述目的,本发明提供一种频道识别方法,所述频道识别方法包括以下步骤:To achieve the above object, the present invention provides a channel identification method, the channel identification method comprising the following steps:
在预设的识别周期内采集多个屏幕图像;Acquiring multiple screen images during a preset recognition period;
分别从各所述屏幕图像中提取含有频道标识的标识图像;Extracting an identification image containing a channel identifier from each of the screen images;
根据所述识别周期内的所有标识图像进行特征提取,得到特征图像;Performing feature extraction according to all the identification images in the recognition period to obtain a feature image;
分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道。The similarity between the preset library images and the feature image is separately calculated, and the channel corresponding to the library image with the highest similarity is used as the channel locked by the user in the recognition period.
优选的,所述根据所述识别周期内的所有标识图像进行特征提取,得到特征图像的步骤包括:Preferably, the step of performing feature extraction according to all the identification images in the identification period to obtain the feature image comprises:
根据各所述标识图像对应的矩阵计算均值矩阵;Calculating an average matrix according to a matrix corresponding to each of the identification images;
分别计算各所述标识图像对应的矩阵与所述均值矩阵的距离矩阵;Calculating a distance matrix of the matrix corresponding to each of the identifier images and the mean matrix;
将各所述距离矩阵分别进行特征分解,得到对应的特征向量矩阵;Performing feature decomposition on each of the distance matrices to obtain a corresponding feature vector matrix;
计算各所述特征向量矩阵对应的熵值矩阵;Calculating a matrix of entropy values corresponding to each of the feature vector matrices;
计算全部所述熵值矩阵的平均值,得到差值矩阵;Calculating an average of all the entropy matrixes to obtain a difference matrix;
将所述差值矩阵中的点进行二值化处理,将得到的二值化图像作为所述特征图像。The points in the difference matrix are binarized, and the obtained binarized image is used as the feature image.
此外,为实现上述目的,本发明还提供一种频道识别装置,所述频道识别装置包括:In addition, in order to achieve the above object, the present invention further provides a channel identification apparatus, where the channel identification apparatus includes:
采集模块,用于在预设的识别周期内采集多个屏幕图像;An acquisition module, configured to collect multiple screen images in a preset recognition period;
标识提取模块,用于分别从各所述屏幕图像中提取含有频道标识的标识图像;An identifier extraction module, configured to respectively extract an identifier image containing a channel identifier from each of the screen images;
特征提取模块,用于根据所述识别周期内的所有标识图像进行特征提取,得到特征图像;a feature extraction module, configured to perform feature extraction according to all the identification images in the recognition period to obtain a feature image;
确定模块,用于分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频 道。a determining module, configured to separately calculate a similarity between the preset library images and the feature image, and use a channel corresponding to the library image with the highest similarity as a frequency locked by the user in the identification period Road.
本发明通过定时采集屏幕图像,并基于采集的屏幕图像提取含有频道标识的标识图像,基于较小的标识图像进行特征图像的提取,大大减小了提取特征图像的计算量,提高了运算效率,同时仅对较小的标识图像进行处理,减小了图像的复杂度,提高了识别的准确性。并且,通过采集屏幕图像和预先存储的库图像进行处理,无需时刻与服务器进行交互,进一步的提高了运行效率,节省了成本。The invention collects the screen image by timing, and extracts the identification image containing the channel identifier based on the collected screen image, and extracts the feature image based on the smaller identification image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency. At the same time, only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition. Moreover, by collecting the screen image and the pre-stored library image for processing, there is no need to interact with the server at all times, which further improves the operation efficiency and saves the cost.
附图说明DRAWINGS
图1为本发明频道识别方法的第一实施例的流程示意图;1 is a schematic flow chart of a first embodiment of a channel identification method according to the present invention;
图2为本发明频道识别方法的第二实施例的流程示意图;2 is a schematic flow chart of a second embodiment of a channel identification method according to the present invention;
图3为本发明频道识别方法的第三实施例的流程示意图;3 is a schematic flow chart of a third embodiment of a channel identification method according to the present invention;
图4为本发明频道识别方法的第四实施例的流程示意图;4 is a schematic flow chart of a fourth embodiment of a channel identification method according to the present invention;
图5为本发明频道识别装置的第一实施例的功能模块示意图;FIG. 5 is a schematic diagram of functional modules of a first embodiment of a channel identification apparatus according to the present invention; FIG.
图6为本发明频道识别装置的第二实施例的功能模块示意图;6 is a schematic diagram of functional modules of a second embodiment of a channel identification apparatus according to the present invention;
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明提供一种频道识别方法。The invention provides a channel identification method.
参照图1,图1为本发明频道识别方法的第一实施例的流程示意图。Referring to FIG. 1, FIG. 1 is a schematic flowchart diagram of a first embodiment of a channel identification method according to the present invention.
在本实施例中,频道识别方法包括:In this embodiment, the channel identification method includes:
步骤S10,在预设的识别周期内采集多个屏幕图像;Step S10, collecting a plurality of screen images in a preset recognition period;
智能电视在预设的识别周期内采集多个屏幕图像,以分析确定该识别周期内用户锁定的频道。具体的,智能电视可以以预设的采样周期采集屏幕图像;智能电视按照识别周期汇总采集到的屏幕图像进行分析。优选的,采样周期可以设置为5分钟,识别周期可以设置为1小时,例如,智能电视每5 分钟采集一次屏幕图像,在1小时的识别周期内采集到60/5=12个屏幕图像,将该12个屏幕图像作为样本进行分析确定该1小时内用户锁定的频道。The smart TV collects a plurality of screen images in a preset recognition period to analyze and determine a channel locked by the user during the recognition period. Specifically, the smart TV can collect the screen image with a preset sampling period; the smart TV summarizes the collected screen images according to the recognition period for analysis. Preferably, the sampling period can be set to 5 minutes, and the recognition period can be set to 1 hour, for example, smart TV every 5 The screen image was collected once every minute, 60/5=12 screen images were collected in the 1 hour recognition period, and the 12 screen images were analyzed as samples to determine the channel locked by the user within 1 hour.
智能电视采集屏幕图像的过程可以通过截屏实现。具体的,智能电视可以通过截屏获取屏幕图像;智能电视判断所截取的图像分辨率是否符合预设的基准样本规格;若符合基准样本规格,则将所截取的图像作为样本图像保存;若不符合基准样本规格,则将所截取的图像进行插值处理以得到符合基准样本规格的图像,将插值处理得到的图像作为样本图像保存。The process of collecting screen images by smart TVs can be achieved by screen capture. Specifically, the smart TV can obtain the screen image through the screen capture; the smart TV determines whether the captured image resolution conforms to the preset reference sample specification; if the reference sample specification is met, the captured image is saved as the sample image; For the reference sample size, the captured image is interpolated to obtain an image conforming to the reference sample size, and the image obtained by the interpolation process is saved as a sample image.
基准样本规格,使得本发明频道识别方法能够适用不同的机型,优选的,可以选取1920*1080的分辨率和宽高比作为基准样本规格,选取该数据不仅能照顾到4K分辨率的高端机型,对低端的机型也能很好的照顾到。例如:对分辨率为1920*1080的机型,截屏规格为1920*1080,则直接截屏作为样本图像;对于非1920*1080的机型,则需要对截屏图像进行图像插值来转换成1920*1080规格的图像。The reference sample specification makes the channel identification method of the present invention applicable to different models. Preferably, the resolution and aspect ratio of 1920*1080 can be selected as the reference sample specification, and the data can be selected to not only take care of the high-end machine of 4K resolution. Type, it can also be taken care of for low-end models. For example, for a model with a resolution of 1920*1080, the screen capture specification is 1920*1080, then the direct screen capture is used as the sample image; for models other than 1920*1080, the image of the screen capture image needs to be interpolated to convert to 1920*1080. Specifications of the image.
进一步的,为了提高处理效率,智能电视可以在采集屏幕图像之前,读取屏幕的分辨率,判断所读取的屏幕分辨率是否符合预设的基准样本规格,若屏幕分辨率符合基准样本规格,则直接截取屏幕图像作为样本图像保存;若屏幕分辨率不符合基准样本规格,则在每次截取到屏幕图像时都进行插值处理,得到符合基准样本规格的图像进行保存。无需在每次截取到屏幕图像时均进行一次是否符合基准样本规格的判断,提高处理效率。Further, in order to improve the processing efficiency, the smart TV can read the resolution of the screen before collecting the screen image, and determine whether the read screen resolution conforms to the preset reference sample specification, and if the screen resolution conforms to the benchmark sample specification, The screen image is directly captured as a sample image; if the screen resolution does not conform to the reference sample specification, the interpolation process is performed each time the screen image is captured, and an image conforming to the reference sample specification is obtained for storage. It is not necessary to perform a judgment on whether or not the reference sample specification is met every time the screen image is captured, thereby improving the processing efficiency.
步骤S20,分别从各屏幕图像中提取含有频道标识的标识图像;Step S20, extracting a logo image containing a channel identifier from each screen image;
智能电视分别对各屏幕图像进行标识图像的提取,得到对应的多个标识图像。优选的,屏幕图像为符合基准样本规格的图像。智能电视可以通过确定屏幕图像中含有频道标识的区域,从所确定的区域内提取出标识图像。The smart TV separately extracts the identification image of each screen image to obtain a corresponding plurality of identification images. Preferably, the screen image is an image that conforms to a benchmark sample size. The smart television can extract the identification image from the determined area by determining an area containing the channel identification in the screen image.
步骤S30,根据识别周期内的所有标识图像进行特征提取,得到特征图像;Step S30, performing feature extraction according to all the identification images in the identification period to obtain a feature image;
智能电视根据识别周期内的所有标识图像进行特征提取,从多个标识图像中提取出含有特征点的特征图像,特征点为该识别周期内标识图像处固定不变的点。优选的,智能电视根据多个标识图像提取的特征图像为一个,即一个识别周期内确定的用户锁定的频道为一个。The smart TV extracts features according to all the identification images in the recognition period, and extracts feature images containing feature points from the plurality of identification images, and the feature points are points at which the identification images are fixed in the recognition period. Preferably, the smart television extracts the feature image extracted according to the plurality of identification images into one, that is, the channel locked by the user determined within one identification period is one.
步骤S40,分别计算预设的各库图像与特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在识别周期内锁定的频道。 Step S40, respectively calculating the similarity between the preset library images and the feature image, and using the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period.
智能电视分别计算预设的各库图像与特征图像的相似度;智能电视将相似度最高的库图像所对应的频道作为用户在识别周期内锁定的频道。具体的,智能电视读取预设的库图像,分别计算各库图像与特征图像的相似度,确定相似度最高的库图像,读取所确定的库图像对应的频道信息,根据频道信息确定用户在识别周期内锁定的频道。The smart TV separately calculates the similarity between the preset library images and the feature images; the smart TV uses the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period. Specifically, the smart TV reads the preset library image, calculates the similarity between each library image and the feature image, determines the library image with the highest similarity, reads the channel information corresponding to the determined library image, and determines the user according to the channel information. The channel that is locked during the recognition period.
进一步的,智能电视还可以在步骤S10之前,加载预设的库图像及对应的频道信息,以根据库图像及对应的频道信息进行频道识别。或者,在本发明的另一实施例中,智能电视也可以在频道识别过程中从服务器获取库图像及对应的频道信息。Further, before the step S10, the smart TV may further load the preset library image and the corresponding channel information to perform channel identification according to the library image and the corresponding channel information. Alternatively, in another embodiment of the present invention, the smart television may also acquire the library image and the corresponding channel information from the server in the channel identification process.
应当理解的是,如果一个识别周期内用户没有切换频道,那么采集到的屏幕图像全部为一个频道,此时计算精度最高;如果用户在一个识别周期内少量切换频道,且被采集到屏幕。如果其中一个频道A被采样到的样本达到预设比例以上,该算法具有该容错机制,仍能将频道A计算出来;如果用户在一个识别周期内频繁换台,且没有一个频道的采样次数超过预设次数,则本次计算失去意义,该情况与现实相符,用户频繁快速换台,本身就不具备可统计的特性,此类情况不予考虑。It should be understood that if the user does not switch channels during an identification period, the collected screen images are all one channel, and the calculation accuracy is the highest at this time; if the user switches channels a small amount in one recognition period and is collected to the screen. If the sample sampled by one of the channels A reaches a preset ratio or more, the algorithm has the fault tolerance mechanism, and the channel A can still be calculated; if the user frequently changes the station within one recognition period, and the number of sampling times of one channel does not exceed The preset number of times, this calculation loses meaning, the situation is consistent with reality, users frequently change channels quickly, and they do not have statistical characteristics, such cases are not considered.
本实施例通过定时采集屏幕图像,并基于采集的屏幕图像提取含有频道标识的标识图像,基于较小的标识图像进行特征图像的提取,大大减小了提取特征图像的计算量,提高了运算效率,同时仅对较小的标识图像进行处理,减小了图像的复杂度,提高了识别的准确性。并且,通过采集屏幕图像和预先存储的库图像进行处理,无需时刻与服务器进行交互,进一步的提高了运行效率,节省了成本。In this embodiment, the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency. At the same time, only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition. Moreover, by collecting the screen image and the pre-stored library image for processing, there is no need to interact with the server at all times, which further improves the operation efficiency and saves the cost.
参照图2,图2为本发明频道识别方法的第二实施例的流程示意图。基于上述频道识别方法的第一实施例,步骤S30包括:Referring to FIG. 2, FIG. 2 is a schematic flowchart diagram of a second embodiment of a channel identification method according to the present invention. Based on the first embodiment of the above channel identification method, step S30 includes:
步骤S31,根据各标识图像对应的矩阵计算均值矩阵;Step S31, calculating an average matrix according to a matrix corresponding to each identifier image;
智能电视可以根据各标识图像生成对应的矩阵Ci(第i个标识图像对应的矩阵),并基于生成的各个矩阵Ci计算均值矩阵Cmean。例如:标识图像的分辨率为480*270,则对应的矩阵Ci规模就为480*270。The smart television can generate a corresponding matrix C i (matrix corresponding to the i-th identification image) according to each identification image, and calculate an average matrix C mean based on the generated respective matrices C i . For example, if the resolution of the identification image is 480*270, the corresponding matrix C i scale is 480*270.
或者,智能电视也可以在标识图像提取过程中,根据各屏幕图像生成对应的矩阵Si(第i个屏幕图像对应的矩阵),分别对各个矩阵Si进行分割处理 得到对应的矩阵Ci。例如:屏幕图像的分辨率为1920*1080,则得到的矩阵Si的规格为1920*1080,根据矩阵Si进行十六宫格切割得到的矩阵Ci规格为480*270。Alternatively, the smart television may generate a corresponding matrix S i (matrix corresponding to the i-th screen image) according to each screen image, and separately segment each matrix S i to obtain a corresponding matrix C i . For example, if the resolution of the screen image is 1920*1080, the obtained matrix S i has a specification of 1920*1080, and the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
具体的,以一个识别周期的12个标识图像为例,智能电视根据各个矩阵Ci计算均值矩阵Cmean的过程,其中:Specifically, taking 12 identification images of an identification period as an example, the smart television calculates a mean matrix C mean according to each matrix C i , wherein:
Figure PCTCN2016084684-appb-000001
Figure PCTCN2016084684-appb-000001
步骤S32,分别计算各标识图像对应的矩阵与均值矩阵的距离矩阵;Step S32, respectively calculating a distance matrix of the matrix corresponding to each identifier image and the mean matrix;
智能电视分别计算各标识图像对应的矩阵Ci与均值矩阵Cmean的距离矩阵Di(矩阵Ci对应的距离矩阵)。Smart TV image respectively calculated for each identifier corresponding to the distance matrix and the matrix C i D i C mean mean matrix (matrix C i corresponding to the distance matrix).
具体的,以12个标识图像为例,智能电视分别计算各个矩阵Ci与均值矩阵Cmean的距离矩阵Di得到距离矩阵集D,其中:Specifically, taking 12 identification images as an example, the smart television calculates the distance matrix D i of each matrix C i and the mean matrix C mean to obtain a distance matrix set D, where:
D=[C1-Cmean,C2-Cmean,...Ci-Cmean,...,C12-Cmean],i∈(1,12)D=[C 1 -C mean , C 2 -C mean ,...C i -C mean ,...,C 12 -C mean ],i∈(1,12)
步骤S33,将各距离矩阵分别进行特征分解,得到对应的特征向量矩阵;Step S33, performing feature decomposition on each distance matrix to obtain a corresponding feature vector matrix;
智能电视将各距离矩阵Di分别进行特征分解,得到对应的特征向量矩阵Vi(距离矩阵Di对应的特征向量矩阵)。The smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i (a feature vector matrix corresponding to the distance matrix D i ).
具体的,以12个标识图像为例,智能电视将各距离矩阵Di分别进行特征分解,得到对应的特征向量矩阵Vi,并得到的特征特征向量矩阵集V,其中:Specifically, taking 12 identification images as an example, the smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i and obtains a feature feature vector matrix set V, wherein:
V=[V1,V2,...,Vi,...,V12],i∈(1,12)V=[V 1 , V 2 ,...,V i ,...,V 12 ],i∈(1,12)
步骤S34,计算各特征向量矩阵对应的熵值矩阵;Step S34, calculating an entropy matrix corresponding to each feature vector matrix;
智能电视计算各特征向量矩阵Vi对应的熵值矩阵Ei(特征向量矩阵Vi对应的熵值矩阵),其中:Smart TV calculated for each feature vector matrix V i corresponding to the entropy of the matrix E i (V i eigenvectors corresponding entropy matrix), wherein:
Figure PCTCN2016084684-appb-000002
Figure PCTCN2016084684-appb-000002
步骤S35,计算全部熵值矩阵的平均值,得到差值矩阵;Step S35, calculating an average value of all entropy value matrices to obtain a difference matrix;
智能电视计算全部熵值矩阵Ei的平均值,得到差值矩阵Emean。具体的,以12个熵值矩阵Ei为例,计算差值矩阵Emean,其中:The smart TV calculates the average of all entropy matrix E i to obtain the difference matrix E mean . Specifically, taking the 12 entropy matrix E i as an example, the difference matrix E mean is calculated, where:
Figure PCTCN2016084684-appb-000003
Figure PCTCN2016084684-appb-000003
步骤S36,将差值矩阵中的点进行二值化处理,将得到的二值化图像作为特征图像。In step S36, the points in the difference matrix are binarized, and the obtained binarized image is used as the feature image.
智能电视将差值矩阵Emean中的点进行二值化处理,将得到的二值化图像 作为特征图像。具体的,智能电视可以将差值矩阵Emean中的点进行大小排序,排在最后的一万个点标为白色,其余点标为黑色,得到对应的二值化图像。通过二值化处理能够有效的将频道标识与背景区分开。The smart television binarizes the points in the difference matrix E mean and uses the obtained binarized image as the feature image. Specifically, the smart TV can sort the points in the difference matrix E mean by the size, the last 10,000 points are marked as white, and the remaining points are marked as black, and the corresponding binarized image is obtained. The binarization process can effectively distinguish the channel identification from the background.
本实施例通过从含有频道标识的标识图像中提取出识别周期内标识区域内固定不变的特征点,得到含有特征点的特征图像。使得提取的特征图像含有更多的频道标识相关的信息,提高了计算精度。并且,通过比较特征图像和库图像确定用户锁定的频道,无需时刻与服务器进行交互,进一步的提高了运行效率,节省了成本。In this embodiment, a feature image containing a feature point is obtained by extracting a fixed feature point in the identification area within the recognition period from the identification image containing the channel identifier. The extracted feature image contains more information related to the channel identification, which improves the calculation accuracy. Moreover, by comparing the feature image and the library image to determine the channel locked by the user, it is not necessary to interact with the server at any time, thereby further improving the operation efficiency and saving the cost.
参照图3,图3为本发明频道识别方法的第三实施例的流程示意图。基于上述频道识别方法的第一实施例,步骤S20包括:Referring to FIG. 3, FIG. 3 is a schematic flowchart diagram of a third embodiment of a channel identification method according to the present invention. Based on the first embodiment of the above channel identification method, step S20 includes:
步骤S21,将各屏幕图像分别进行十六宫格切割得到对应的区域图像组;Step S21, each screen image is separately cut into sixteen squares to obtain a corresponding area image group;
步骤S22,抽取各区域图像组的第一行第一列的区域图像作为对应的标识图像。Step S22, extracting an area image of the first row and the first column of each area image group as a corresponding identification image.
智能电视将各屏幕图像分别进行十六宫格切割得到对应的区域图像组;抽取各区域图像组的第一行第一列的区域图像作为对应的标识图像,得到各屏幕图像对应的一个标识图像,以根据得到的标识图像进行特征图像的提取。The smart TV divides each screen image into a corresponding 16-square grid to obtain a corresponding area image group; extracts an area image of the first row and the first column of each area image group as a corresponding identification image, and obtains a logo image corresponding to each screen image. To extract the feature image based on the obtained logo image.
优选的,智能电视还可以根据各屏幕图像分别生成对应的矩阵Si,智能电视分别对各个矩阵Si进行十六宫格切割得到对应的子矩阵;智能电视抽取第一行第一列的子矩阵作为矩阵Si对应的标识图像的矩阵Ci。例如:屏幕图像的分辨率为1920*1080,则得到的矩阵Si的规格为1920*1080,根据矩阵Si进行十六宫格切割得到的矩阵Ci规格为480*270。Preferably, smart television may also generate the corresponding matrix S i, respectively, each of the smart TV matrix S i for sixteen grids obtained by cutting each of the corresponding sub-matrix based on a screen image; a first row and first column of sub smart TV extraction identity matrix as the matrix C i S i of the image corresponding to the matrix. For example, if the resolution of the screen image is 1920*1080, the obtained matrix S i has a specification of 1920*1080, and the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
本实施例通过定时采集屏幕图像,并基于采集的屏幕图像提取含有频道标识的标识图像,基于较小的标识图像进行特征图像的提取,大大减小了提取特征图像的计算量,提高了运算效率,同时仅对较小的标识图像进行处理,减小了图像的复杂度,提高了识别的准确性。In this embodiment, the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency. At the same time, only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
参照图4,图4为本发明频道识别方法的第四实施例的流程示意图。基于上述频道识别方法的第一实施例,步骤S40之后,还包括:Referring to FIG. 4, FIG. 4 is a schematic flowchart diagram of a fourth embodiment of a channel identification method according to the present invention. Based on the first embodiment of the channel identification method, after step S40, the method further includes:
步骤S51,对预设时间内各个识别周期用户锁定的频道进行统计;Step S51, performing statistics on channels locked by the user in each recognition period within a preset time period;
步骤S52,将统计结果中锁定次数排名前预设位数的频道作为用户在预设时间内的偏好频道。 In step S52, the channel with the preset number of times of the number of locks in the statistical result is used as the preferred channel of the user within the preset time.
智能电视对预设时间内各个识别周期用户锁定的频道进行统计;将统计结果中锁定次数排名前预设位数的频道作为用户在预设时间内的偏好频道。预设位数可以根据实际具体设置,例如:可以设置为排名前三位或者排名前十位。进一步的,智能电视还可以将统计结果中排名前三的频道上传至服务器。以便于通过服务器了解用户对智能电视的使用习惯和用户偏好电视节目,从而有针对性的提供用户偏好的电视内容。预设时间可以为24小时、48小时等。The smart TV counts the channels locked by the user in each recognition period in the preset time; the channel in which the number of locks is ranked in the preset number of times in the statistical result is used as the preferred channel of the user within the preset time. The preset number of bits can be set according to the actual settings. For example, it can be set to the top three or the top ten. Further, the smart TV can also upload the top three channels in the statistical results to the server. In order to understand the user's usage habits of the smart TV and the user's preference for the television program through the server, the television content of the user's preference is provided in a targeted manner. The preset time can be 24 hours, 48 hours, and the like.
本实施例通过汇总统计用户在预设时间内锁定的频道,将排名前三的频道作为用户在预设时间内的偏好频道,便于服务商了解用户对智能电视的使用习惯和用户偏好电视节目,从而有针对性的提供用户偏好的电视内容。In this embodiment, by referring to the channels that the user locks in the preset time, the top three channels are used as the preferred channels of the user in the preset time, so that the service provider can understand the user's usage habits of the smart TV and the user preference television programs. Therefore, the television content of the user's preference is provided in a targeted manner.
上述第一至第四实施例的频道识别方法的执行主体均可以为智能电视或用于播放电视节目的智能终端。更进一步地,该频道识别方法可以由安装在智能电视或用于播放电视节目的智能终端上的客户端程序实现,其中,该智能终端可以包括但不限于移动电话、智能电话、笔记本电脑、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、台式计算机等等的终端。The execution bodies of the channel identification methods of the above-described first to fourth embodiments may each be a smart TV or an intelligent terminal for playing a television program. Further, the channel identification method may be implemented by a client program installed on a smart TV or a smart terminal for playing a television program, wherein the smart terminal may include, but is not limited to, a mobile phone, a smart phone, a notebook computer, a PDA. Terminals (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), desktop computers, and the like.
本发明进一步提供一种频道识别装置。The invention further provides a channel identification device.
参照图5,图5为本发明频道识别装置的第一实施例的功能模块示意图。Referring to FIG. 5, FIG. 5 is a schematic diagram of functional modules of a first embodiment of a channel identification apparatus according to the present invention.
在本实施例中,频道识别装置包括:采集模块10、标识提取模块20、特征提取模块30及确定模块40。In this embodiment, the channel identification device includes: an acquisition module 10, an identifier extraction module 20, a feature extraction module 30, and a determination module 40.
采集模块10,用于在预设的识别周期内采集多个屏幕图像;The collecting module 10 is configured to collect a plurality of screen images in a preset recognition period;
智能电视在预设的识别周期内采集多个屏幕图像,以分析确定该识别周期内用户锁定的频道。具体的,智能电视可以以预设的采样周期采集屏幕图像;智能电视按照识别周期汇总采集到的屏幕图像进行分析。优选的,采样周期可以设置为5分钟,识别周期可以设置为1小时,例如,智能电视每5分钟采集一次屏幕图像,在1小时的识别周期内采集到60/5=12个屏幕图像,将该12个屏幕图像作为样本进行分析确定该1小时内用户锁定的频道。The smart TV collects a plurality of screen images in a preset recognition period to analyze and determine a channel locked by the user during the recognition period. Specifically, the smart TV can collect the screen image with a preset sampling period; the smart TV summarizes the collected screen images according to the recognition period for analysis. Preferably, the sampling period can be set to 5 minutes, and the recognition period can be set to 1 hour. For example, the smart TV collects the screen image every 5 minutes, and collects 60/5=12 screen images in the 1 hour recognition period. The 12 screen images are analyzed as samples to determine the channel that the user has locked within 1 hour.
智能电视采集屏幕图像的过程可以通过截屏实现。具体的,智能电视可以通过截屏获取屏幕图像;智能电视判断所截取的图像分辨率是否符合预设 的基准样本规格;若符合基准样本规格,则将所截取的图像作为样本图像保存;若不符合基准样本规格,则将所截取的图像进行插值处理以得到符合基准样本规格的图像,将插值处理得到的图像作为样本图像保存。The process of collecting screen images by smart TVs can be achieved by screen capture. Specifically, the smart TV can obtain the screen image through the screen capture; the smart TV determines whether the resolution of the captured image conforms to the preset. The reference sample specification; if the reference sample specification is met, the captured image is saved as a sample image; if the reference sample specification is not met, the intercepted image is interpolated to obtain an image conforming to the reference sample specification, and the interpolation is processed. The resulting image is saved as a sample image.
基准样本规格,使得本发明频道识别方法能够适用不同的机型,优选的,可以选取1920*1080的分辨率和宽高比作为基准样本规格,选取该数据不仅能照顾到4K分辨率的高端机型,对低端的机型也能很好的照顾到。例如:对分辨率为1920*1080的机型,截屏规格为1920*1080,则直接截屏作为样本图像;对于非1920*1080的机型,则需要对截屏图像进行图像插值来转换成1920*1080规格的图像。The reference sample specification makes the channel identification method of the present invention applicable to different models. Preferably, the resolution and aspect ratio of 1920*1080 can be selected as the reference sample specification, and the data can be selected to not only take care of the high-end machine of 4K resolution. Type, it can also be taken care of for low-end models. For example, for a model with a resolution of 1920*1080, the screen capture specification is 1920*1080, then the direct screen capture is used as the sample image; for models other than 1920*1080, the image of the screen capture image needs to be interpolated to convert to 1920*1080. Specifications of the image.
进一步的,为了提高处理效率,智能电视可以在采集屏幕图像之前,读取屏幕的分辨率,判断所读取的屏幕分辨率是否符合预设的基准样本规格,若屏幕分辨率符合基准样本规格,则直接截取屏幕图像作为样本图像保存;若屏幕分辨率不符合基准样本规格,则在每次截取到屏幕图像时都进行插值处理,得到符合基准样本规格的图像进行保存。无需在每次截取到屏幕图像时均进行一次是否符合基准样本规格的判断,提高处理效率。Further, in order to improve the processing efficiency, the smart TV can read the resolution of the screen before collecting the screen image, and determine whether the read screen resolution conforms to the preset reference sample specification, and if the screen resolution conforms to the benchmark sample specification, The screen image is directly captured as a sample image; if the screen resolution does not conform to the reference sample specification, the interpolation process is performed each time the screen image is captured, and an image conforming to the reference sample specification is obtained for storage. It is not necessary to perform a judgment on whether or not the reference sample specification is met every time the screen image is captured, thereby improving the processing efficiency.
标识提取模块20,用于分别从各屏幕图像中提取含有频道标识的标识图像;The identifier extraction module 20 is configured to respectively extract the identifier image containing the channel identifier from each screen image;
智能电视分别对各屏幕图像进行标识图像的提取,得到对应的多个标识图像。优选的,屏幕图像为符合基准样本规格的图像。智能电视可以通过确定屏幕图像中含有频道标识的区域,从所确定的区域内提取出标识图像。The smart TV separately extracts the identification image of each screen image to obtain a corresponding plurality of identification images. Preferably, the screen image is an image that conforms to a benchmark sample size. The smart television can extract the identification image from the determined area by determining an area containing the channel identification in the screen image.
特征提取模块30,用于根据识别周期内的所有标识图像进行特征提取,得到特征图像;The feature extraction module 30 is configured to perform feature extraction according to all the identification images in the recognition period to obtain a feature image;
智能电视根据识别周期内的所有标识图像进行特征提取,从多个标识图像中提取出含有特征点的特征图像,特征点为该识别周期内标识图像处固定不变的点。优选的,智能电视根据多个标识图像提取的特征图像为一个,即一个识别周期内确定的用户锁定的频道为一个。The smart TV extracts features according to all the identification images in the recognition period, and extracts feature images containing feature points from the plurality of identification images, and the feature points are points at which the identification images are fixed in the recognition period. Preferably, the smart television extracts the feature image extracted according to the plurality of identification images into one, that is, the channel locked by the user determined within one identification period is one.
确定模块40,用于分别计算预设的各库图像与特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在识别周期内锁定的频道。The determining module 40 is configured to separately calculate the similarity between the preset library images and the feature image, and use the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period.
智能电视分别计算预设的各库图像与特征图像的相似度;智能电视将相似度最高的库图像所对应的频道作为用户在识别周期内锁定的频道。具体的, 智能电视读取预设的库图像,分别计算各库图像与特征图像的相似度,确定相似度最高的库图像,读取所确定的库图像对应的频道信息,根据频道信息确定用户在识别周期内锁定的频道。The smart TV separately calculates the similarity between the preset library images and the feature images; the smart TV uses the channel corresponding to the library image with the highest similarity as the channel locked by the user in the recognition period. specific, The smart TV reads the preset library image, calculates the similarity between each library image and the feature image, determines the library image with the highest similarity, reads the channel information corresponding to the determined library image, and determines the user in the recognition cycle according to the channel information. Internal locked channel.
进一步的,频道识别装置还可以包括初始化模块;初始化模块,用于加载预设的库图像及对应的频道信息,以根据库图像及对应的频道信息进行频道识别。Further, the channel identification device may further include an initialization module, and the initialization module is configured to load the preset library image and the corresponding channel information to perform channel identification according to the library image and the corresponding channel information.
智能电视可以通过初始化模块加载预设的库图像及对应的频道信息,以根据库图像及对应的频道信息进行频道识别。或者,在本发明的另一实施例中,智能电视也可以在频道识别过程中从服务器获取库图像及对应的频道信息。The smart TV can load the preset library image and the corresponding channel information through the initialization module to perform channel identification according to the library image and the corresponding channel information. Alternatively, in another embodiment of the present invention, the smart television may also acquire the library image and the corresponding channel information from the server in the channel identification process.
应当理解的是,如果一个识别周期内用户没有切换频道,那么采集到的屏幕图像全部为一个频道,此时计算精度最高;如果用户在一个识别周期内少量切换频道,且被采集到屏幕。如果其中一个频道A被采样到的样本达到预设比例以上,该算法具有该容错机制,仍能将频道A计算出来;如果用户在一个识别周期内频繁换台,且没有一个频道的采样次数超过预设次数,则本次计算失去意义,该情况与现实相符,用户频繁快速换台,本身就不具备可统计的特性,此类情况不予考虑。It should be understood that if the user does not switch channels during an identification period, the collected screen images are all one channel, and the calculation accuracy is the highest at this time; if the user switches channels a small amount in one recognition period and is collected to the screen. If the sample sampled by one of the channels A reaches a preset ratio or more, the algorithm has the fault tolerance mechanism, and the channel A can still be calculated; if the user frequently changes the station within one recognition period, and the number of sampling times of one channel does not exceed The preset number of times, this calculation loses meaning, the situation is consistent with reality, users frequently change channels quickly, and they do not have statistical characteristics, such cases are not considered.
本实施例通过定时采集屏幕图像,并基于采集的屏幕图像提取含有频道标识的标识图像,基于较小的标识图像进行特征图像的提取,大大减小了提取特征图像的计算量,提高了运算效率,同时仅对较小的标识图像进行处理,减小了图像的复杂度,提高了识别的准确性。并且,通过采集屏幕图像和预先存储的库图像进行处理,无需时刻与服务器进行交互,进一步的提高了运行效率,节省了成本。In this embodiment, the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency. At the same time, only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition. Moreover, by collecting the screen image and the pre-stored library image for processing, there is no need to interact with the server at all times, which further improves the operation efficiency and saves the cost.
参照图6,图6为本发明装置的第二实施例的功能模块示意图。基于上述频道识别装置的第一实施例,特征提取模块30包括计算单元31和二值化单元32。Referring to FIG. 6, FIG. 6 is a schematic diagram of functional modules of a second embodiment of the apparatus of the present invention. Based on the first embodiment of the above channel identification device, the feature extraction module 30 includes a calculation unit 31 and a binarization unit 32.
计算单元31,用于根据各标识图像对应的矩阵计算均值矩阵;The calculating unit 31 is configured to calculate an average matrix according to a matrix corresponding to each identifier image;
智能电视可以根据各标识图像生成对应的矩阵Ci(第i个标识图像对应的矩阵),并基于生成的各个矩阵Ci计算均值矩阵Cmean。例如:标识图像的分辨率为480*270,则对应的矩阵Ci规模就为480*270。 The smart television can generate a corresponding matrix C i (matrix corresponding to the i-th identification image) according to each identification image, and calculate an average matrix C mean based on the generated respective matrices C i . For example, if the resolution of the identification image is 480*270, the corresponding matrix C i scale is 480*270.
或者,智能电视也可以在标识图像提取过程中,根据各屏幕图像生成对应的矩阵Si(第i个屏幕图像对应的矩阵),分别对各个矩阵Si进行分割处理得到对应的矩阵Ci。例如:屏幕图像的分辨率为1920*1080,则得到的矩阵Si的规格为1920*1080,根据矩阵Si进行十六宫格切割得到的矩阵Ci规格为480*270。Alternatively, smart television may be the logo image extraction process, generates a corresponding matrix S i (i-th screen image corresponding to a matrix) in accordance with various screen images, respectively, each of the matrix S i dividing process to obtain the corresponding matrix C i. For example, if the resolution of the screen image is 1920*1080, the obtained matrix S i has a specification of 1920*1080, and the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
具体的,以一个识别周期的12个标识图像为例,智能电视根据各个矩阵Ci计算均值矩阵Cmean的过程,其中:Specifically, taking 12 identification images of an identification period as an example, the smart television calculates a mean matrix C mean according to each matrix C i , wherein:
Figure PCTCN2016084684-appb-000004
Figure PCTCN2016084684-appb-000004
计算单元31,还用于分别计算各标识图像对应的矩阵与均值矩阵的距离矩阵;The calculating unit 31 is further configured to separately calculate a distance matrix of the matrix corresponding to each identifier image and the mean matrix;
智能电视分别计算各标识图像对应的矩阵Ci与均值矩阵Cmean的距离矩阵Di(矩阵Ci对应的距离矩阵)。Smart TV image respectively calculated for each identifier corresponding to the distance matrix and the matrix C i D i C mean mean matrix (matrix C i corresponding to the distance matrix).
具体的,以12个标识图像为例,智能电视分别计算各个矩阵Ci与均值矩阵Cmean的距离矩阵Di得到距离矩阵集D,其中:Specifically, taking 12 identification images as an example, the smart television calculates the distance matrix D i of each matrix C i and the mean matrix C mean to obtain a distance matrix set D, where:
D=[C1-Cmean,C2-Cmean,...Ci-Cmean,...,C12-Cmean],i∈(1,12)D=[C 1 -C mean , C 2 -C mean ,...C i -C mean ,...,C 12 -C mean ],i∈(1,12)
计算单元31,还用于将各距离矩阵分别进行特征分解,得到对应的特征向量矩阵;The calculating unit 31 is further configured to perform feature decomposition on each distance matrix to obtain a corresponding feature vector matrix;
智能电视将各距离矩阵Di分别进行特征分解,得到对应的特征向量矩阵Vi(距离矩阵Di对应的特征向量矩阵)。The smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i (a feature vector matrix corresponding to the distance matrix D i ).
具体的,以12个标识图像为例,智能电视将各距离矩阵Di分别进行特征分解,得到对应的特征向量矩阵Vi,并得到的特征特征向量矩阵集V,其中:Specifically, taking 12 identification images as an example, the smart television separately decomposes each distance matrix D i to obtain a corresponding feature vector matrix V i and obtains a feature feature vector matrix set V, wherein:
V=[V1,V2,...,Vi,...,V12],i∈(1,12)V=[V 1 , V 2 ,...,V i ,...,V 12 ],i∈(1,12)
计算单元31,还用于计算各特征向量矩阵对应的熵值矩阵;The calculating unit 31 is further configured to calculate a matrix of entropy values corresponding to each feature vector matrix;
智能电视计算各特征向量矩阵Vi对应的熵值矩阵Ei(特征向量矩阵Vi对应的熵值矩阵),其中:Smart TV calculated for each feature vector matrix V i corresponding to the entropy of the matrix E i (V i eigenvectors corresponding entropy matrix), wherein:
Figure PCTCN2016084684-appb-000005
Figure PCTCN2016084684-appb-000005
计算单元31,还用于计算全部熵值矩阵的平均值,得到差值矩阵;The calculating unit 31 is further configured to calculate an average value of all entropy value matrices to obtain a difference matrix;
智能电视计算全部熵值矩阵Ei的平均值,得到差值矩阵Emean。具体的,以12个熵值矩阵Ei为例,计算差值矩阵Emean,其中: The smart TV calculates the average of all entropy matrix E i to obtain the difference matrix E mean . Specifically, taking the 12 entropy matrix E i as an example, the difference matrix E mean is calculated, where:
Figure PCTCN2016084684-appb-000006
Figure PCTCN2016084684-appb-000006
二值化单元32,用于将差值矩阵中的点进行二值化处理,将得到的二值化图像作为特征图像。The binarization unit 32 is configured to perform binarization processing on the points in the difference matrix, and use the obtained binarized image as the feature image.
智能电视将差值矩阵Emean中的点进行二值化处理,将得到的二值化图像作为特征图像。具体的,智能电视可以将差值矩阵Emean中的点进行大小排序,排在最后的一万个点标为白色,其余点标为黑色,得到对应的二值化图像。通过二值化处理能够有效的将频道标识与背景区分开。The smart television binarizes the points in the difference matrix E mean and uses the obtained binarized image as the feature image. Specifically, the smart TV can sort the points in the difference matrix E mean by the size, the last 10,000 points are marked as white, and the remaining points are marked as black, and the corresponding binarized image is obtained. The binarization process can effectively distinguish the channel identification from the background.
本实施例通过从含有频道标识的标识图像中提取出识别周期内标识区域内固定不变的特征点,得到含有特征点的特征图像。使得提取的特征图像含有更多的频道标识相关的信息,提高了计算精度。并且,通过比较特征图像和库图像确定用户锁定的频道,无需时刻与服务器进行交互,进一步的提高了运行效率,节省了成本。In this embodiment, a feature image containing a feature point is obtained by extracting a fixed feature point in the identification area within the recognition period from the identification image containing the channel identifier. The extracted feature image contains more information related to the channel identification, which improves the calculation accuracy. Moreover, by comparing the feature image and the library image to determine the channel locked by the user, it is not necessary to interact with the server at any time, thereby further improving the operation efficiency and saving the cost.
基于上述频道识别装置的第一实施例,标识提取模块20包括切割单元21和抽取单元22;Based on the first embodiment of the above channel identification device, the identification extraction module 20 includes a cutting unit 21 and an extraction unit 22;
切割单元21,用于将各屏幕图像分别进行十六宫格切割得到对应的区域图像组;a cutting unit 21, configured to perform a sixteen-square grid cut on each screen image to obtain a corresponding area image group;
抽取单元22,用于抽取各区域图像组的第一行第一列的区域图像作为对应的标识图像。The extracting unit 22 is configured to extract an area image of the first row and the first column of each regional image group as a corresponding identification image.
智能电视将各屏幕图像分别进行十六宫格切割得到对应的区域图像组;抽取各区域图像组的第一行第一列的区域图像作为对应的标识图像,得到各屏幕图像对应的一个标识图像,以根据得到的标识图像进行特征图像的提取。The smart TV divides each screen image into a corresponding 16-square grid to obtain a corresponding area image group; extracts an area image of the first row and the first column of each area image group as a corresponding identification image, and obtains a logo image corresponding to each screen image. To extract the feature image based on the obtained logo image.
优选的,智能电视还可以根据各屏幕图像分别生成对应的矩阵Si,智能电视分别对各个矩阵Si进行十六宫格切割得到对应的子矩阵;智能电视抽取第一行第一列的子矩阵作为矩阵Si对应的标识图像的矩阵Ci。例如:屏幕图像的分辨率为1920*1080,则得到的矩阵Si的规格为1920*1080,根据矩阵Si进行十六宫格切割得到的矩阵Ci规格为480*270。Preferably, smart television may also generate the corresponding matrix S i, respectively, each of the smart TV matrix S i for sixteen grids obtained by cutting each of the corresponding sub-matrix based on a screen image; a first row and first column of sub smart TV extraction identity matrix as the matrix C i S i of the image corresponding to the matrix. For example, if the resolution of the screen image is 1920*1080, the obtained matrix S i has a specification of 1920*1080, and the matrix C i obtained by performing the sixteen-square grid cutting according to the matrix S i is 480*270.
本实施例通过定时采集屏幕图像,并基于采集的屏幕图像提取含有频道标识的标识图像,基于较小的标识图像进行特征图像的提取,大大减小了提取特征图像的计算量,提高了运算效率,同时仅对较小的标识图像进行处理,减小了图像的复杂度,提高了识别的准确性。 In this embodiment, the screen image is collected periodically, and the identifier image containing the channel identifier is extracted based on the collected screen image, and the feature image is extracted based on the smaller logo image, thereby greatly reducing the calculation amount of the extracted feature image and improving the operation efficiency. At the same time, only the small logo image is processed, which reduces the complexity of the image and improves the accuracy of the recognition.
基于上述频道识别装置的第一实施例,频道识别装置还包括统计模块50;Based on the first embodiment of the channel identification device, the channel identification device further includes a statistics module 50;
统计模块50,用于对预设时间内各个识别周期用户锁定的频道进行统计;The statistics module 50 is configured to perform statistics on channels locked by users in each identification period within a preset time period;
确定模块40,还用于将统计结果中锁定次数排名前预设位数的频道作为用户在预设时间内的偏好频道。The determining module 40 is further configured to use, as the preferred channel of the user, the channel of the preset number of times of the number of locks in the statistical result.
智能电视对预设时间内各个识别周期用户锁定的频道进行统计;将统计结果中锁定次数排名前预设位数的频道作为用户在预设时间内的偏好频道。预设位数可以根据实际具体设置,例如:可以设置为排名前三位或者排名前十位。进一步的,智能电视还可以将统计结果中排名前三的频道上传至服务器。以便于通过服务器了解用户对智能电视的使用习惯和用户偏好电视节目,从而有针对性的提供用户偏好的电视内容。预设时间可以为24小时、48小时等。The smart TV counts the channels locked by the user in each recognition period in the preset time; the channel in which the number of locks is ranked in the preset number of times in the statistical result is used as the preferred channel of the user within the preset time. The preset number of bits can be set according to the actual settings. For example, it can be set to the top three or the top ten. Further, the smart TV can also upload the top three channels in the statistical results to the server. In order to understand the user's usage habits of the smart TV and the user's preference for the television program through the server, the television content of the user's preference is provided in a targeted manner. The preset time can be 24 hours, 48 hours, and the like.
本实施例通过汇总统计用户在预设时间内锁定的频道,将排名前三的频道作为用户在预设时间内的偏好频道,便于服务商了解用户对智能电视的使用习惯和用户偏好电视节目,从而有针对性的提供用户偏好的电视内容。In this embodiment, by referring to the channels that the user locks in the preset time, the top three channels are used as the preferred channels of the user in the preset time, so that the service provider can understand the user's usage habits of the smart TV and the user preference television programs. Therefore, the television content of the user's preference is provided in a targeted manner.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个......”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。 The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims (20)

  1. 一种频道识别方法,其特征在于,所述频道识别方法包括以下步骤:A channel identification method, characterized in that the channel identification method comprises the following steps:
    在预设的识别周期内采集多个屏幕图像;Acquiring multiple screen images during a preset recognition period;
    将各所述屏幕图像分别进行十六宫格切割得到对应的区域图像组;Performing each of the screen images into a sixteen-square grid to obtain a corresponding area image group;
    抽取各所述区域图像组的第一行第一列的区域图像作为对应的标识图像;Extracting an area image of the first row and the first column of each of the regional image groups as a corresponding identification image;
    根据各所述标识图像对应的矩阵计算均值矩阵;Calculating an average matrix according to a matrix corresponding to each of the identification images;
    分别计算各所述标识图像对应的矩阵与所述均值矩阵的距离矩阵;Calculating a distance matrix of the matrix corresponding to each of the identifier images and the mean matrix;
    将各所述距离矩阵分别进行特征分解,得到对应的特征向量矩阵;Performing feature decomposition on each of the distance matrices to obtain a corresponding feature vector matrix;
    计算各所述特征向量矩阵对应的熵值矩阵;Calculating a matrix of entropy values corresponding to each of the feature vector matrices;
    计算全部所述熵值矩阵的平均值,得到差值矩阵;Calculating an average of all the entropy matrixes to obtain a difference matrix;
    将所述差值矩阵中的点进行二值化处理,将得到的二值化图像作为特征图像;Performing binarization processing on the points in the difference matrix, and using the obtained binarized image as a feature image;
    分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道。The similarity between the preset library images and the feature image is separately calculated, and the channel corresponding to the library image with the highest similarity is used as the channel locked by the user in the recognition period.
  2. 如权利要求1所述的频道识别方法,其特征在于,所述在预设的识别周期内采集多个屏幕图像的步骤之前,还包括:The channel identification method according to claim 1, wherein before the step of acquiring a plurality of screen images in a preset recognition period, the method further comprises:
    加载预设的库图像及对应的频道信息,以根据所述库图像及对应的频道信息进行频道识别。Loading a preset library image and corresponding channel information to perform channel identification according to the library image and corresponding channel information.
  3. 如权利要求1所述的频道识别方法,其特征在于,所述分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道的步骤之后,还包括:The channel identification method according to claim 1, wherein the calculating the similarity between the preset library images and the feature image respectively, and using the channel corresponding to the library image with the highest similarity as the user After the step of identifying the channel locked in the period, the method further includes:
    对预设时间内各个识别周期用户锁定的频道进行统计;Statistics on the channels locked by the users in each recognition period within a preset time period;
    将统计结果中锁定次数排名前预设位数的频道作为用户在所述预设时间内的偏好频道。The channel in which the number of locks in the statistical result is ranked as the preset number of bits is used as the preferred channel of the user within the preset time.
  4. 如权利要求1所述的频道识别方法,其特征在于,所述屏幕图像由截 取获得,所述在预设的识别周期内采集多个屏幕图像的步骤之前,还包括:The channel identification method according to claim 1, wherein said screen image is cut by Before the step of acquiring a plurality of screen images in a preset recognition period, the method further includes:
    读取屏幕的分辨率,判断所读取的屏幕分辨率是否符合预设的基准样本规格,若所述屏幕分辨率符合所述基准样本规格,则在预设的识别周期内采集多个屏幕图像;Reading the resolution of the screen, determining whether the read screen resolution meets a preset reference sample specification, and if the screen resolution meets the reference sample specification, acquiring multiple screen images in a preset recognition period ;
    若所述屏幕分辨率不符合所述基准样本规格,则在每次截取到屏幕图像时都进行插值处理,将插值处理后的屏幕图像作为采集到的图像。If the screen resolution does not conform to the reference sample specification, interpolation processing is performed each time the screen image is captured, and the screen image after the interpolation processing is taken as the collected image.
  5. 如权利要求1所述的频道识别方法,其特征在于,根据各所述标识图像对应的矩阵计算均值矩阵的步骤包括:The channel identification method according to claim 1, wherein the step of calculating an average matrix according to a matrix corresponding to each of the identification images comprises:
    在标识图像提取过程中,根据各所述屏幕图像生成对应的矩阵,分别对生成的各个矩阵进行分割处理得到所述标识图像生成对应的矩阵,并基于所述标识图像的矩阵计算所述均值矩阵。In the process of the identification image extraction, a corresponding matrix is generated according to each of the screen images, and the generated matrix is separately subjected to segmentation processing to obtain a matrix corresponding to the identification image, and the mean matrix is calculated based on the matrix of the identification image. .
  6. 一种频道识别方法,其特征在于,所述频道识别方法包括以下步骤:A channel identification method, characterized in that the channel identification method comprises the following steps:
    在预设的识别周期内采集多个屏幕图像;Acquiring multiple screen images during a preset recognition period;
    分别从各所述屏幕图像中提取含有频道标识的标识图像;Extracting an identification image containing a channel identifier from each of the screen images;
    根据所述识别周期内的所有标识图像进行特征提取,得到特征图像;Performing feature extraction according to all the identification images in the recognition period to obtain a feature image;
    分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道。The similarity between the preset library images and the feature image is separately calculated, and the channel corresponding to the library image with the highest similarity is used as the channel locked by the user in the recognition period.
  7. 如权利要求6所述的频道识别方法,其特征在于,所述根据所述识别周期内的所有标识图像进行特征提取,得到特征图像的步骤包括:The channel identification method according to claim 6, wherein the step of performing feature extraction according to all the identification images in the recognition period to obtain the feature image comprises:
    根据各所述标识图像对应的矩阵计算均值矩阵;Calculating an average matrix according to a matrix corresponding to each of the identification images;
    分别计算各所述标识图像对应的矩阵与所述均值矩阵的距离矩阵;Calculating a distance matrix of the matrix corresponding to each of the identifier images and the mean matrix;
    将各所述距离矩阵分别进行特征分解,得到对应的特征向量矩阵;Performing feature decomposition on each of the distance matrices to obtain a corresponding feature vector matrix;
    计算各所述特征向量矩阵对应的熵值矩阵;Calculating a matrix of entropy values corresponding to each of the feature vector matrices;
    计算全部所述熵值矩阵的平均值,得到差值矩阵;Calculating an average of all the entropy matrixes to obtain a difference matrix;
    将所述差值矩阵中的点进行二值化处理,将得到的二值化图像作为所述特征图像。 The points in the difference matrix are binarized, and the obtained binarized image is used as the feature image.
  8. 如权利要求7所述的频道识别方法,其特征在于,所述分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道的步骤之后,还包括:The channel identification method according to claim 7, wherein the calculating the similarity between the preset library images and the feature image respectively, and using the channel corresponding to the library image with the highest similarity as the user After the step of identifying the channel locked in the period, the method further includes:
    对预设时间内各个识别周期用户锁定的频道进行统计;Statistics on the channels locked by the users in each recognition period within a preset time period;
    将统计结果中锁定次数排名前预设位数的频道作为用户在所述预设时间内的偏好频道。The channel in which the number of locks in the statistical result is ranked as the preset number of bits is used as the preferred channel of the user within the preset time.
  9. 如权利要求7所述的频道识别方法,其特征在于,所述根据各所述标识图像对应的矩阵计算均值矩阵的步骤包括:The channel identification method according to claim 7, wherein the step of calculating an average matrix according to a matrix corresponding to each of the identification images comprises:
    在标识图像提取过程中,根据各所述屏幕图像生成对应的矩阵,分别对生成的各个矩阵进行分割处理得到所述标识图像生成对应的矩阵,并基于所述标识图像的矩阵计算所述均值矩阵。In the process of the identification image extraction, a corresponding matrix is generated according to each of the screen images, and the generated matrix is separately subjected to segmentation processing to obtain a matrix corresponding to the identification image, and the mean matrix is calculated based on the matrix of the identification image. .
  10. 如权利要求6所述的频道识别方法,其特征在于,所述分别从各所述屏幕图像中提取含有频道标识的标识图像的步骤包括:The channel identification method according to claim 6, wherein the step of extracting the identification image containing the channel identification from each of the screen images respectively comprises:
    将各所述屏幕图像分别进行十六宫格切割得到对应的区域图像组;Performing each of the screen images into a sixteen-square grid to obtain a corresponding area image group;
    抽取各所述区域图像组的第一行第一列的区域图像作为对应的标识图像。An area image of the first row and the first column of each of the area image groups is extracted as a corresponding identification image.
  11. 如权利要求6所述的频道识别方法,其特征在于,所述在预设的识别周期内采集多个屏幕图像的步骤之前,还包括:The channel identification method according to claim 6, wherein the step of collecting a plurality of screen images in a preset recognition period further comprises:
    加载预设的库图像及对应的频道信息,以根据所述库图像及对应的频道信息进行频道识别。Loading a preset library image and corresponding channel information to perform channel identification according to the library image and corresponding channel information.
  12. 如权利要求6所述的频道识别方法,其特征在于,所述分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道的步骤之后,还包括:The channel identification method according to claim 6, wherein the calculating the similarity between the preset library images and the feature image respectively, and using the channel corresponding to the library image with the highest similarity as the user After the step of identifying the channel locked in the period, the method further includes:
    对预设时间内各个识别周期用户锁定的频道进行统计;Statistics on the channels locked by the users in each recognition period within a preset time period;
    将统计结果中锁定次数排名前预设位数的频道作为用户在所述预设时间内的偏好频道。 The channel in which the number of locks in the statistical result is ranked as the preset number of bits is used as the preferred channel of the user within the preset time.
  13. 如权利要求6所述的频道识别方法,其特征在于,所述屏幕图像由截取获得,所述在预设的识别周期内采集多个屏幕图像的步骤之前,还包括:The channel identification method according to claim 6, wherein the screen image is obtained by intercepting, and the step of collecting a plurality of screen images in a preset recognition period further comprises:
    读取屏幕的分辨率,判断所读取的屏幕分辨率是否符合预设的基准样本规格,若所述屏幕分辨率符合所述基准样本规格,则在预设的识别周期内采集多个屏幕图像;Reading the resolution of the screen, determining whether the read screen resolution meets a preset reference sample specification, and if the screen resolution meets the reference sample specification, acquiring multiple screen images in a preset recognition period ;
    若所述屏幕分辨率不符合所述基准样本规格,则在每次截取到屏幕图像时都进行插值处理,将插值处理后的屏幕图像作为采集到的图像。If the screen resolution does not conform to the reference sample specification, interpolation processing is performed each time the screen image is captured, and the screen image after the interpolation processing is taken as the collected image.
  14. 一种频道识别装置,其特征在于,所述频道识别装置包括:A channel identification device, characterized in that the channel identification device comprises:
    采集模块,用于在预设的识别周期内采集多个屏幕图像;An acquisition module, configured to collect multiple screen images in a preset recognition period;
    标识提取模块,用于分别从各所述屏幕图像中提取含有频道标识的标识图像;An identifier extraction module, configured to respectively extract an identifier image containing a channel identifier from each of the screen images;
    特征提取模块,用于根据所述识别周期内的所有标识图像进行特征提取,得到特征图像;a feature extraction module, configured to perform feature extraction according to all the identification images in the recognition period to obtain a feature image;
    确定模块,用于分别计算预设的各库图像与所述特征图像的相似度,并将相似度最高的库图像所对应的频道作为用户在所述识别周期内锁定的频道。And a determining module, configured to separately calculate a similarity between the preset library images and the feature image, and use a channel corresponding to the library image with the highest similarity as a channel locked by the user in the recognition period.
  15. 如权利要求14所述的频道识别装置,其特征在于,所述特征提取模块包括计算单元和二值化单元;The channel identification device according to claim 14, wherein the feature extraction module comprises a calculation unit and a binarization unit;
    所述计算单元,用于根据各所述标识图像对应的矩阵计算均值矩阵;The calculating unit is configured to calculate an average matrix according to a matrix corresponding to each of the identifier images;
    所述计算单元,还用于分别计算各所述标识图像对应的矩阵与所述均值矩阵的距离矩阵;The calculating unit is further configured to separately calculate a distance matrix of the matrix corresponding to each of the identification images and the mean matrix;
    所述计算单元,还用于将各所述距离矩阵分别进行特征分解,得到对应的特征向量矩阵;The calculating unit is further configured to separately perform feature decomposition on each of the distance matrices to obtain a corresponding feature vector matrix;
    所述计算单元,还用于计算各所述特征向量矩阵对应的熵值矩阵;The calculating unit is further configured to calculate a matrix of entropy values corresponding to each of the feature vector matrices;
    所述计算单元,还用于计算全部所述熵值矩阵的平均值,得到差值矩阵;The calculating unit is further configured to calculate an average value of all the entropy value matrices to obtain a difference matrix;
    所述二值化单元,用于将所述差值矩阵中的点进行二值化处理,将得到的二值化图像作为所述特征图像。 The binarization unit is configured to perform binarization processing on the points in the difference matrix, and use the obtained binarized image as the feature image.
  16. 如权利要求15所述的频道识别装置,其特征在于,所述计算单元,还用于在标识图像提取过程中,根据各所述屏幕图像生成对应的矩阵,分别对生成的各个矩阵进行分割处理得到所述标识图像生成对应的矩阵,并基于所述标识图像的矩阵计算所述均值矩阵。The channel identification device according to claim 15, wherein the calculation unit is further configured to generate a corresponding matrix according to each of the screen images in the process of extracting the image, and separately perform segmentation processing on each of the generated matrices. Obtaining a matrix corresponding to the identification image, and calculating the mean matrix based on the matrix of the identification image.
  17. 如权利要求14所述的频道识别装置,其特征在于,所述标识提取模块包括切割单元和抽取单元;The channel identification device according to claim 14, wherein the identification extraction module comprises a cutting unit and an extraction unit;
    所述切割单元,用于将各所述屏幕图像分别进行十六宫格切割得到对应的区域图像组;The cutting unit is configured to perform a sixteen-square grid cut on each of the screen images to obtain a corresponding area image group;
    所述抽取单元,用于抽取各所述区域图像组的第一行第一列的区域图像作为对应的标识图像。The extracting unit is configured to extract an area image of the first row and the first column of each of the regional image groups as a corresponding identification image.
  18. 如权利要求14所述的频道识别装置,其特征在于,所述频道识别装置还包括初始化模块;The channel identification device according to claim 14, wherein said channel identification device further comprises an initialization module;
    所述初始化模块,用于加载预设的库图像及对应的频道信息,以根据所述库图像及对应的频道信息进行频道识别。The initialization module is configured to load a preset library image and corresponding channel information to perform channel identification according to the library image and corresponding channel information.
  19. 如权利要求14所述的频道识别装置,其特征在于,所述频道识别装置还包括统计模块;The channel identifying apparatus according to claim 14, wherein said channel identifying means further comprises a statistic module;
    所述统计模块,用于对预设时间内各个识别周期用户锁定的频道进行统计;The statistic module is configured to perform statistics on channels locked by users in each identification period within a preset time period;
    所述确定模块,还用于将统计结果中锁定次数排名前预设位数的频道作为用户在所述预设时间内的偏好频道。The determining module is further configured to use a channel in which the number of locks in the statistical result is ranked as a preset channel as a preference channel of the user within the preset time.
  20. 如权利要求14所述的频道识别装置,其特征在于,所述屏幕图像由截取获得,所述频道识别装置还包括:The channel identification device according to claim 14, wherein the screen image is obtained by intercepting, and the channel identification device further comprises:
    读取模块,用于读取屏幕的分辨率;a reading module for reading the resolution of the screen;
    判断模块,用于判断所读取的屏幕分辨率是否符合预设的基准样本规格;a judging module, configured to determine whether the read screen resolution meets a preset reference sample specification;
    所述采集模块,还用于若所述屏幕分辨率符合所述基准样本规格,则在 预设的识别周期内采集多个屏幕图像,以及若所述屏幕分辨率不符合所述基准样本规格,则在每次截取到屏幕图像时都进行插值处理,将插值处理后的屏幕图像作为采集到的图像。 The collecting module is further configured to: if the screen resolution meets the reference sample specification, Collecting a plurality of screen images in a preset recognition period, and if the screen resolution does not conform to the reference sample specification, performing interpolation processing each time the screen image is captured, and using the screen image after the interpolation processing as the collection To the image.
PCT/CN2016/084684 2015-12-28 2016-06-03 Method and device for channel identification WO2017113605A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510999595.0 2015-12-28
CN201510999595.0A CN105635750B (en) 2015-12-28 2015-12-28 Channel recognition methods and device

Publications (1)

Publication Number Publication Date
WO2017113605A1 true WO2017113605A1 (en) 2017-07-06

Family

ID=56050178

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084684 WO2017113605A1 (en) 2015-12-28 2016-06-03 Method and device for channel identification

Country Status (2)

Country Link
CN (1) CN105635750B (en)
WO (1) WO2017113605A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210054618A (en) 2019-11-05 2021-05-14 (주)일리드 Method for designing interior design

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105635750B (en) * 2015-12-28 2018-07-03 深圳Tcl数字技术有限公司 Channel recognition methods and device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101324923A (en) * 2008-08-05 2008-12-17 北京中星微电子有限公司 Method and apparatus for extracting human face recognition characteristic
WO2009073895A1 (en) * 2007-12-07 2009-06-11 Verimatrix, Inc. Systems and methods for performing semantic analysis of media objects
CN103634652A (en) * 2013-11-06 2014-03-12 小米科技有限责任公司 Station caption identification method, station caption identification device, TV (Television) and station caption identification system
CN104023249A (en) * 2014-06-12 2014-09-03 腾讯科技(深圳)有限公司 Method and device of identifying television channel
CN104598910A (en) * 2015-01-16 2015-05-06 科大讯飞股份有限公司 Gradient direction matching algorithm based intelligent television station caption recognition method and system
CN104639952A (en) * 2015-01-23 2015-05-20 小米科技有限责任公司 Method and device for identifying station logo
CN105635750A (en) * 2015-12-28 2016-06-01 深圳Tcl数字技术有限公司 Channel identification method and apparatus

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009073895A1 (en) * 2007-12-07 2009-06-11 Verimatrix, Inc. Systems and methods for performing semantic analysis of media objects
CN101324923A (en) * 2008-08-05 2008-12-17 北京中星微电子有限公司 Method and apparatus for extracting human face recognition characteristic
CN103634652A (en) * 2013-11-06 2014-03-12 小米科技有限责任公司 Station caption identification method, station caption identification device, TV (Television) and station caption identification system
CN104023249A (en) * 2014-06-12 2014-09-03 腾讯科技(深圳)有限公司 Method and device of identifying television channel
CN104598910A (en) * 2015-01-16 2015-05-06 科大讯飞股份有限公司 Gradient direction matching algorithm based intelligent television station caption recognition method and system
CN104639952A (en) * 2015-01-23 2015-05-20 小米科技有限责任公司 Method and device for identifying station logo
CN105635750A (en) * 2015-12-28 2016-06-01 深圳Tcl数字技术有限公司 Channel identification method and apparatus

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210054618A (en) 2019-11-05 2021-05-14 (주)일리드 Method for designing interior design

Also Published As

Publication number Publication date
CN105635750B (en) 2018-07-03
CN105635750A (en) 2016-06-01

Similar Documents

Publication Publication Date Title
US11132555B2 (en) Video detection method, server and storage medium
CN111881913A (en) Image recognition method and device, storage medium and processor
US9596520B2 (en) Method and system for pushing information to a client
US20160196478A1 (en) Image processing method and device
WO2017012418A1 (en) Image processing method and apparatus
CN110460838B (en) Lens switching detection method and device and computer equipment
US20180189557A1 (en) Human detection in high density crowds
WO2017166597A1 (en) Cartoon video recognition method and apparatus, and electronic device
CN112001362A (en) Image analysis method, image analysis device and image analysis system
US9117132B2 (en) System and method facilitating designing of classifier while recognizing characters in a video
CN110765903A (en) Pedestrian re-identification method and device and storage medium
WO2017113605A1 (en) Method and device for channel identification
CN110717806A (en) Product information pushing method, device, equipment and storage medium
Ma et al. Multiscale 2-D singular spectrum analysis and principal component analysis for spatial–spectral noise-robust feature extraction and classification of hyperspectral images
CN109711287B (en) Face acquisition method and related product
CN112653928B (en) Video filtering method, system and equipment based on same content
US8988219B2 (en) Alert system based on camera identification
CN106971150B (en) Queuing abnormity detection method and device based on logistic regression
CN112364918A (en) Abnormality recognition method, terminal, and computer-readable storage medium
CN112418271A (en) Target detection method, device, system and storage medium
JP4967045B2 (en) Background discriminating apparatus, method and program
CN110796071A (en) Behavior detection method, system, machine-readable medium and device
CN115474091A (en) Motion capture method and device based on decomposition metagraph
CN115546736A (en) River channel sand collection monitoring processing method and system based on image collection
Li et al. Autocorrelation and dct based quality metrics for fingerprint samples generated by smartphones

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16880413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09/11/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16880413

Country of ref document: EP

Kind code of ref document: A1