CN117041675A - Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium - Google Patents

Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium Download PDF

Info

Publication number
CN117041675A
CN117041675A CN202310990397.2A CN202310990397A CN117041675A CN 117041675 A CN117041675 A CN 117041675A CN 202310990397 A CN202310990397 A CN 202310990397A CN 117041675 A CN117041675 A CN 117041675A
Authority
CN
China
Prior art keywords
television
terminal
program
mobile terminal
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310990397.2A
Other languages
Chinese (zh)
Inventor
杜学亮
王飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guoxin Baowei Beijing Technology Co ltd
Original Assignee
Guoxin Baowei Beijing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guoxin Baowei Beijing Technology Co ltd filed Critical Guoxin Baowei Beijing Technology Co ltd
Priority to CN202310990397.2A priority Critical patent/CN117041675A/en
Publication of CN117041675A publication Critical patent/CN117041675A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer

Abstract

The invention relates to the technical field of television signal transmission, in particular to a multi-terminal linkage television signal transmission method, a system, equipment and a readable storage medium, wherein a preview album is generated by extracting key frames of television programs, television program on-demand information and the preview album are transmitted to a mobile terminal for display, and after a user plays television programs through a mobile end, a server terminal transmits television program signals to a specific television terminal according to identification information of the television programs on-demand by the user and equipment information of the television terminal bound with the mobile terminal, and the television terminal plays television programs, so that multi-terminal linkage between the mobile terminal and the television terminal is realized, the user can conveniently play television programs on-demand by using a mobile phone without using an unfriendly and easily-blocked television on-demand interface, and the user can browse the preview album of television programs, thereby being beneficial to the user to select favorite television programs.

Description

Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium
Technical Field
The present invention relates to the field of television signal transmission technologies, and in particular, to a method, a system, an apparatus, and a readable storage medium for multi-terminal linkage television signal transmission.
Background
Tv anytime is an emerging television broadcast mode that enables viewers to select and watch television programs according to their own needs and schedule. The advent of television on demand changed the mode in which traditional television programs were played in a fixed time and sequence, enabling viewers to watch television programs more flexibly and freely. The advent and development of tv anytime provides a more personalized and convenient viewing experience for viewers, and also brings new development opportunities to the tv industry. The technical implementation of tv anytime mainly depends on network and digitizing technologies. Real-time transmission and playing of television programs can be realized through network technology.
The existing television on-demand is directly carried out on the television end, the on-demand television programs can be directly displayed on an on-demand interface of the television end, and a user uses a remote controller to carry out operation of the on-demand interface to order the programs which the user wants to watch. However, many users find that the user interface of the tv-on-demand service is not friendly enough, such as complex navigation, not powerful search function and troublesome input of search keywords through a remote controller, and the processor of many tv devices has weak functions, which results in easy occurrence of a click on the on-demand interface, thereby greatly affecting the experience of the user using the tv-on-demand service.
The information disclosed in the background section of the application is only for enhancement of understanding of the general background of the application and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.
Disclosure of Invention
The embodiment of the application provides a multi-terminal linkage television signal transmission method, which comprises the following steps:
extracting a plurality of key frames according to the change between adjacent frames of the preprocessing video, and generating a preview album according to the key frames;
transmitting the video program on-demand information and the preview album to a mobile terminal;
the mobile terminal displays the on-demand information and the preview album to a user, and the user can perform on-demand on television programs corresponding to the on-demand information through the mobile terminal;
transmitting the identification information of the television program requested by the user and the equipment information of the television terminal bound with the mobile terminal to a server terminal;
and the server transmits the television program signal corresponding to the identification information to the television terminal corresponding to the equipment information according to the identification information and the television terminal equipment information.
In some embodiments of the application, further comprising:
recording a play record of the television end, and transmitting the play record to a mobile end with play record viewing authority;
The play records comprise the title, the content brief introduction, the play time, the total play time length and the preview album of the television program.
In some embodiments of the invention, further comprising:
the television program can be controlled to be on demand by a remote controller, program recommendation information is transmitted to the mobile terminal and the television terminal according to the mobile terminal or the television program on demand, and the mobile terminal and the television terminal display the program recommendation information.
In some embodiments of the present invention, the "transmitting program recommendation information to the mobile terminal and the television terminal according to the television program on demand of the mobile terminal or the television terminal, and displaying the program recommendation information by the mobile terminal and the television terminal" specifically includes:
generating first program recommendation information associated with a mobile terminal according to a television program on demand by the mobile terminal;
producing second program recommendation information associated with the television end according to the program information of the television end-on-demand;
if the user is using the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal and the television terminal, and displaying the first program recommendation information by the mobile terminal and the television terminal;
If the user does not use the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal, and displaying the first program recommendation information by the mobile terminal;
and if the user uses the remote controller to control the television terminal, transmitting the second program recommendation information to the television terminal, and displaying the second program recommendation information by the television terminal.
In some embodiments of the invention, further comprising:
extracting content features from the keyframe set by using a pre-trained content feature extraction model;
extracting text labels from the content features by using a text label extraction model which is completed through pre-training;
associating the text label with the television program;
the user can search the television programs associated with the text labels through the mobile terminal and request the searched television programs.
In some embodiments of the present invention, the extracting key frames according to the variation between adjacent frames of the pre-processed video specifically includes:
reading each frame of a television program frame by frame, and converting each frame of the television program into a gray image;
dividing each frame of gray level image into a foreground image and a background image;
Subtracting the gray value of the foreground image of the previous frame from the gray value of the foreground image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the foreground image of the previous frame to obtain a differential foreground image;
subtracting the gray value of the background image of the previous frame from the gray value of the background image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the background image of the previous frame to obtain a differential background image;
performing binarization processing on the differential foreground image and the differential background image to obtain a binarized foreground image and a binarized background image;
and respectively calculating the duty ratio of the pixel point with the gray value of 255 in the two-part foreground image and the binary background image, and if the duty ratio of the pixel point with the gray value of 255 in any one of the two-part foreground image and the binary background image is larger than a preset threshold value, extracting the original frame of the television program corresponding to the gray image of the next frame as a key frame.
In some embodiments of the present invention, the pixel gray values of the binarized foreground image and the binarized background image are determined according to the following formula:
wherein DeltaA (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, delta B (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, A' (x,y) A is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the previous frame, B' (x,y) B is the gray value of the pixel point with coordinates of (x, y) in the background image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the background image of the previous frame,the gray value mean value of all pixel points in the foreground image of the previous frame is +.>The gray value average value of all pixel points in the background image of the previous frame is obtained.
The invention also provides a multi-terminal linkage television signal transmission system, which comprises:
the preview generation module is used for extracting a plurality of key frames according to the change between adjacent frames of the preprocessing video and generating a preview album according to the key frames;
the program information transmission module is used for transmitting the video-on-demand information of the television program and the preview album to the mobile terminal;
the program display module is used for displaying the on-demand information and the preview album to a user by the mobile terminal, and the user can perform on-demand on television programs corresponding to the on-demand information through the mobile terminal;
the on-demand information transmission module is used for transmitting the identification information of the television program on demand by the user and the equipment information of the television terminal bound with the mobile terminal to the server terminal;
And the program signal transmission module is used for transmitting the television program signal corresponding to the identification information to the television terminal corresponding to the equipment information by the server terminal according to the identification information and the television terminal equipment information.
The invention also provides a multi-terminal linkage television signal transmission device, which comprises:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to invoke the instructions stored in the memory to perform the method according to any of the embodiments described above.
The invention also provides a readable storage medium having stored thereon computer program instructions which when executed by a processor implement the method according to any of the embodiments described above.
According to the multi-terminal linkage television signal transmission method, system, equipment and computer readable storage medium, the preview album is generated by extracting the key frames of the television programs, the television program on-demand information and the preview album are transmitted to the mobile terminal for display, after the user plays the television programs through the mobile terminal, the server terminal transmits television program signals to the specific television terminal according to the identification information of the television programs on-demand by the user and the equipment information of the television terminal bound with the mobile terminal, and the television terminal plays the television programs, so that multi-terminal linkage between the mobile terminal and the television terminal is realized, the user can conveniently play the television programs on-demand by using the mobile terminal without using an unfriendly and easily-blocked television on-demand interface, and the user can browse the preview album of the television programs, thereby being beneficial to the user to select favorite television programs.
Drawings
Fig. 1 schematically illustrates a flow chart of a multi-terminal linkage television signal transmission method according to an embodiment of the present invention;
fig. 2 schematically illustrates a block diagram of a multi-terminal ganged television signal transmission system in accordance with an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein.
It should be understood that, in various embodiments of the present invention, the sequence number of each process does not mean that the execution sequence of each process should be determined by its functions and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
It should be understood that in the present invention, "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements that are expressly listed or inherent to such process, method, article, or apparatus.
It should be understood that in the present invention, "plurality" means two or more. "and/or" is merely an association relationship describing an association object, and means that three relationships may exist, for example, and/or B may mean: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. "comprising A, B and C", "comprising A, B, C" means that all three of A, B, C comprise, "comprising A, B or C" means that one of the three comprises A, B, C, and "comprising A, B and/or C" means that any 1 or any 2 or 3 of the three comprises A, B, C.
It should be understood that in the present invention, "B corresponding to a", "a corresponding to B", or "B corresponding to a" means that B is associated with a, from which B can be determined. Determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information. The matching of A and B is that the similarity of A and B is larger than or equal to a preset threshold value.
As used herein, "if" may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to detection" depending on the context.
The technical scheme of the invention is described in detail below by specific examples. The following embodiments may be combined with each other, and some embodiments may not be repeated for the same or similar concepts or processes.
Fig. 1 schematically illustrates a flowchart of a multi-terminal linkage television signal transmission method according to an embodiment of the present invention, as shown in fig. 1, where the method includes:
and step S101, extracting a plurality of key frames according to the change between adjacent frames of the preprocessing video, and generating a preview album according to the key frames.
Key frames are important frames in video and typically represent the beginning or end of a scene. The preview album is a series of key frame pictures that are used to provide an overview of the program content when the user selects a program on demand. The selection of a key frame is typically based on the degree of variation in the picture content, and if the difference between two consecutive frames is large enough, then this frame may be selected as the key frame. The specific difference metric may be a change in pixel values or a more complex visual perception metric.
After the key frames are extracted, a preview album can be generated. A preview album is a set of key frames representing video content. The preview album may help the user to have a rough understanding of the video content prior to on-demand. There are many ways to generate a preview album, for example, the center region of each key frame may be selected as the preview image, as this region typically contains the most important visual information. The key frames may also be scored using a machine learning algorithm, with some frames with highest scores being selected as preview albums.
Step S102, the video program on-demand information and the preview album are transmitted to a mobile terminal.
This step sends on-demand information of the television program, such as title, actor, duration, introduction, year of production, etc., and preview album to the user's mobile device, such as a smart phone or tablet computer, via a network.
Step S102 may be subdivided into several steps:
in step S1021, on-demand information of the television program is generated, which may be manually edited in advance or acquired from a network.
In step S1022, data is encoded, and these data are required to be encoded in order to enable efficient transmission of the on-demand information and the preview album. The on-demand information may be encoded in JSON or XML format, and the preview album may be encoded in JPEG or PNG format. In addition, video data may also be compression encoded to save transmission bandwidth.
In step S1023, the data after encoding can be transmitted to the mobile terminal through various network protocols (such as HTTP, FTP, etc.). In the transmission process, network protocols such as TCP/IP, UDP and the like may need to be used in consideration of bandwidth, delay and the like of the network.
Step S103, the mobile terminal displays the on-demand information and the preview album to a user, and the user can perform on-demand on the television program corresponding to the on-demand information through the mobile terminal.
The user can browse the video program on-demand information and preview album on the mobile device and then select the program they want to watch for on-demand. For example, through a mobile application, a user may order a movie or a television show that they want to watch on a cell phone.
After the mobile terminal receives the on-demand information and the preview album transmitted from the server, it is necessary to decode the data. The decoded on-demand information (including program title, description, duration, etc.) and preview album (key frame generated image) will be loaded onto the user interface of the mobile application. This step may require the use of user interface development techniques to Android or iOS.
The user can select the program of interest to them by browsing the on-demand information and previewing the album.
Step S104, the identification information of the television program requested by the user and the equipment information of the television terminal bound with the mobile terminal are transmitted to a server terminal.
After the user selects a program, the mobile application sends an on-demand request to the server, where the request includes identification information of the selected television program, such as a program ID or other unique identifier, and also includes device information of the television end bound to the user's mobile end, such as a network address (e.g., IP address) and a device type (e.g., supported video coding format) of the device.
Step S105, the server transmits the television program signal corresponding to the identification information to the television terminal corresponding to the device information according to the identification information and the television terminal device information.
After receiving the request of the user, the server finds out the corresponding program video file and then sends the video data stream to the television equipment of the user through the network.
The server first needs to identify the identification information of the television program, where the identification information is included in the on-demand request sent by the user through the mobile terminal. This identification information is a unique identifier of the television program.
The server also needs to identify the television end device information to determine to which device to transmit the television program signal. This device information typically includes the network address (e.g., IP address) and the device type (e.g., supported video encoding format) of the device.
The server finds the corresponding television program according to the identification information, and then directionally transmits the television program signal to the television terminal according to the equipment information of the television terminal. And after receiving the television program signal, the television terminal equipment decodes and plays the television program signal.
Through the method, multi-terminal linkage of the mobile terminal and the television terminal is realized, so that a user can conveniently use the mobile phone to order television programs without using an unfriendly and easy-to-click television end-play interface, and the user can browse a preview album of the television programs, thereby being beneficial to the user to select the favorite television programs.
In some embodiments of the invention, the method further comprises:
recording a play record of the television end, and transmitting the play record to a mobile end with play record viewing authority;
the play records comprise the title, the content brief introduction, the play time, the total play time length and the preview album of the television program.
In the process of playing the television program, the television terminal equipment records playing information of the program, including the title, the content brief introduction, the playing time, the total playing time, the preview album and the like of the television program. This information may be stored in a local store on the device.
The television end device transmits the play record to the mobile end device with the viewing authority through the network, and the process can be realized through a cloud service, for example, the television end device uploads the play record to a cloud server, and then the mobile end device downloads the play record from the cloud server. It may also be implemented by direct device-to-device communication, e.g., the television end device and the mobile end device communicate directly via Wi-Fi or bluetooth.
This may be used for parental control functions, where parents can clearly see what programs the child is watching during periods when they are not at home.
In some embodiments of the invention, the method further comprises:
the television program can be controlled to be on demand by a remote controller, program recommendation information is transmitted to the mobile terminal and the television terminal according to the mobile terminal or the television program on demand, and the mobile terminal and the television terminal display the program recommendation information.
Many old people are very unaccustomed to using a mobile phone to control a television, so that like a conventional television on demand, users can use a remote controller to select television programs which the users want to watch and order the television programs besides a mobile terminal. The system uses a recommendation algorithm to generate relevant program recommendation information according to the television program requested by the user. Then, the recommended information can be transmitted to the mobile terminal or the television terminal for display through the network, and can also be simultaneously transmitted to the mobile terminal and the television terminal for display.
A plurality of members commonly share one television in a family, so that personalized production is also required when related program recommendation information is generated, although a recommendation algorithm cannot directly know which user is watching a certain on-demand television program, mobile terminal equipment is often not shared, and therefore a mobile terminal of the on-demand television program can indirectly know which user is watching the certain on-demand television program. In addition, even if the remote controller is shared by households, in consideration of the fact that users often have own use habits, people who often use the remote controller are likely to be only one person in the households, so even if the remote controller is inaccurate, television programs which are requested by using the remote controller to control television terminals can be approximately corresponding to one user, or all users which are requested by using the remote controller to control the television terminals can be regarded as one user to conduct program recommendation.
In some embodiments of the present invention, the "transmitting program recommendation information to the mobile terminal and the television terminal according to the television program on demand of the mobile terminal or the television terminal, and displaying the program recommendation information by the mobile terminal and the television terminal" specifically includes:
Generating first program recommendation information associated with a mobile terminal according to a television program on demand by the mobile terminal;
producing second program recommendation information associated with the television end according to the program information of the television end-on-demand;
if the user is using the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal and the television terminal, and displaying the first program recommendation information by the mobile terminal and the television terminal;
if the user does not use the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal, and displaying the first program recommendation information by the mobile terminal;
and if the user uses the remote controller to control the television terminal, transmitting the second program recommendation information to the television terminal, and displaying the second program recommendation information by the television terminal.
For example, if the mobile terminal a requests a science fiction movie, the program recommendation information (first program recommendation information) related to the science fiction movie may be generated, and the program recommendation information may be transmitted to the mobile terminal a and displayed.
The mobile terminal can not only perform video program on demand, but also control the television to replace the function of a television remote controller. If the user is using the mobile terminal to control the television terminal, the user is likely to watch the television at the moment, and then the program recommendation information (first program recommendation information) related to the science fiction movies can be transmitted to the mobile terminal and the television terminal at the same time, and the program recommendation information and the first program recommendation information are displayed at the same time, so that the user can be further ensured to see the program recommendation information. However, if the user is not using the mobile terminal to control the television terminal, it is indicated that the television terminal may not be turned on, or even if the television terminal is turned on, the user is not concerned with the content displayed by the television terminal, and the program recommendation information is not necessarily displayed.
For another example, the television end requests the popular science programs, so that the program recommendation information related to the popular science programs can be generated, and the program recommendation information is transmitted to the television end and displayed. If the user is using the remote controller to control the television terminal, the user is required to watch the television, and then the program recommendation information (second program recommendation information) related to the popular science program can be transmitted to the television terminal, and displayed by the television terminal, so that the user can see the program recommendation information with high probability.
In some embodiments of the invention, the method further comprises:
and extracting the content characteristics of the key frame set by using the pre-trained content characteristic extraction model.
Extracting text labels from the content features by using a text label extraction model which is completed through pre-training;
associating the text label with the television program;
the user can search the television programs associated with the text labels through the mobile terminal and request the searched television programs.
And extracting the content characteristics of the key frame set by using the content characteristic extraction AI which is completed through pre-training. The content feature extraction AI may be a trained deep learning model such as CNN, R-CNN, etc. The extracted content features may be high-dimensional vectors.
And inputting the content characteristics into the pre-trained label to extract an AI model, and outputting a text label corresponding to the television program. The tag extraction AI model can be a trained deep learning model such as CNN, LSTM, etc.
The text label television programs are associated, so that the user can search the television program content instead of just searching the title, and the mobile terminal is facilitated to search the television programs more conveniently through the search word.
In some embodiments of the present invention, the extracting key frames according to the variation between adjacent frames of the pre-processed video specifically includes:
reading each frame of a television program frame by frame, and converting each frame of the television program into a gray image;
dividing each frame of gray level image into a foreground image and a background image;
subtracting the gray value of the foreground image of the previous frame from the gray value of the foreground image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the foreground image of the previous frame to obtain a differential foreground image;
subtracting the gray value of the background image of the previous frame from the gray value of the background image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the background image of the previous frame to obtain a differential background image;
performing binarization processing on the differential foreground image and the differential background image to obtain a binarized foreground image and a binarized background image;
And respectively calculating the duty ratio of the pixel point with the gray value of 255 in the two-part foreground image and the binary background image, and if the duty ratio of the pixel point with the gray value of 255 in any one of the two-part foreground image and the binary background image is larger than a preset threshold value, extracting the original frame of the television program corresponding to the gray image of the next frame as a key frame.
First, each frame of a television program that needs to be acquired can be implemented by reading a video file. Then, the image data of each frame is subjected to graying treatment, and is converted into a gray image, and the method for converting the image into the gray image is described in more detail, which is not described herein.
The division of the gray scale image of each frame into a foreground image and a background image can be achieved by a number of different methods, one of which is the background subtraction method, which is described in more detail and not described in detail herein.
Next, the gray values of the foreground image and the background image of the previous frame are subtracted from the gray values of the foreground image and the background image of the next frame, respectively, to obtain a differential foreground image. The gray values of the corresponding coordinate pixels of the foreground images or the background images of the front frame and the rear frame are subtracted, and the absolute value is taken for the difference value, so that the gray values of the corresponding coordinate pixels of the differential foreground images or the differential background images are obtained, and each pixel point forms the differential foreground images or the differential background images.
Then, binarizing the differential foreground image and the differential background image, namely setting a threshold value, resetting the gray value of the pixel point with the gray value larger than the threshold value to 255 in the image, and resetting the pixel point with the gray value smaller than the threshold value to 0, thereby obtaining the two foreground images and the binarized background image. The specific size of the threshold value can be selected according to actual conditions, and can be a fixed value, can be determined according to the gray value mean value of the image, or can be determined according to a function.
And finally, respectively calculating the duty ratio of the pixel point with the gray value of 255 in the differential foreground image and the differential background image, and if the duty ratio of any one of the two is larger than a preset threshold value, extracting the original frame of the television program corresponding to the gray image of the next frame as a key frame. This has the advantage that both foreground and background images can be identified, so that key frames can be extracted more accurately. The threshold of the duty ratio may be determined according to the actual situation, for example, may be determined according to the number of key frames required, and generally, the larger the value of the threshold is, the fewer the number of key frames extracted is.
In some embodiments of the present invention, the pixel gray values of the binarized foreground image and the binarized background image are determined according to the following formula:
Wherein DeltaA (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, delta B (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, A' (x,y) A is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the previous frame, B' (x,y) B is the gray value of the pixel point with coordinates of (x, y) in the background image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the background image of the previous frame,the gray value mean value of all pixel points in the foreground image of the previous frame is +.>The gray value average value of all pixel points in the background image of the previous frame is obtained.
In the above formula, different binarization thresholds are respectively adopted for the binarized foreground image and the binarized background image, that is, for the binarized foreground image, the gray value average value of all pixels in the foreground image of the previous frame is adopted in the previous and subsequent frames, and for the binarized background image, the gray value average value of all pixels in the background image of the previous frame is adopted in the previous and subsequent frames. Compared with the method adopting a fixed function value, the method can reduce the key frame identification error caused by the overlarge or undersize gray value mean value of the image, and improve the accuracy of key frame identification and extraction.
According to the multi-terminal linkage television signal transmission method provided by the embodiment of the invention, the preview album is generated by extracting the key frames of the television programs, the television program on-demand information and the preview album are transmitted to the mobile terminal for display, and after the user plays the television programs by the mobile terminal, the server terminal transmits television program signals to the specific television terminal according to the identification information of the television programs on-demand by the user and the equipment information of the television terminal bound with the mobile terminal, and the television terminal plays the television programs, so that multi-terminal linkage of the mobile terminal and the television terminal is realized, the user can conveniently play the television programs by using the mobile terminal without using an unfriendly and easily-blocked television on-demand interface, and the user can browse the preview album of the television programs, thereby being beneficial to the user to select favorite television programs. Solves the problems existing in the prior art.
Fig. 2 schematically illustrates a block diagram of a multi-terminal ganged television signal transmission system according to an embodiment of the present invention, the multi-terminal ganged television signal transmission system comprising:
and the preview generation module 201 is configured to extract a plurality of key frames according to the changes between adjacent frames of the preprocessed video, and generate a preview album according to the key frames.
Key frames are important frames in video and typically represent the beginning or end of a scene. The preview album is a series of key frame pictures that are used to provide an overview of the program content when the user selects a program on demand. The selection of a key frame is typically based on the degree of variation in the picture content, and if the difference between two consecutive frames is large enough, then this frame may be selected as the key frame. The specific difference metric may be a change in pixel values or a more complex visual perception metric.
After the key frames are extracted, a preview album can be generated. A preview album is a set of key frames representing video content. The preview album may help the user to have a rough understanding of the video content prior to on-demand. There are many ways to generate a preview album, for example, the center region of each key frame may be selected as the preview image, as this region typically contains the most important visual information. The key frames may also be scored using a machine learning algorithm, with some frames with highest scores being selected as preview albums.
The program information transmission module 202 is configured to transmit the on-demand information of the television program and the preview album to the mobile terminal.
This step sends on-demand information of the television program, such as title, actor, duration, introduction, year of production, etc., and preview album to the user's mobile device, such as a smart phone or tablet computer, via a network.
Can be subdivided into several steps:
the on-demand information of the television program can be generated by manual pre-editing or can be obtained from a network.
Data encoding, these data need to be encoded in order to enable efficient transmission of on-demand information and preview albums. The on-demand information may be encoded in JSON or XML format, and the preview album may be encoded in JPEG or PNG format. In addition, video data may also be compression encoded to save transmission bandwidth.
Data transmission, the coded data can be transmitted to the mobile terminal through various network protocols (such as HTTP, FTP, etc.). In the transmission process, network protocols such as TCP/IP, UDP and the like may need to be used in consideration of bandwidth, delay and the like of the network.
The program display module 203 is configured to display the on-demand information and the preview album to a user by using the mobile terminal, where the user can perform on-demand on a television program corresponding to the on-demand information by using the mobile terminal.
The user can browse the video program on-demand information and preview album on the mobile device and then select the program they want to watch for on-demand. For example, through a mobile application, a user may order a movie or a television show that they want to watch on a cell phone.
After the mobile terminal receives the on-demand information and the preview album transmitted from the server, it is necessary to decode the data. The decoded on-demand information (including program title, description, duration, etc.) and preview album (key frame generated image) will be loaded onto the user interface of the mobile application. This step may require the use of user interface development techniques to Android or iOS.
The user can select the program of interest to them by browsing the on-demand information and previewing the album.
The on-demand information transmission module 204 is configured to transmit identification information of a television program on demand by a user and device information of a television terminal bound to the mobile terminal to a server terminal.
After the user selects a program, the mobile application sends an on-demand request to the server, where the request includes identification information of the selected television program, such as a program ID or other unique identifier, and also includes device information of the television end bound to the user's mobile end, such as a network address (e.g., IP address) and a device type (e.g., supported video coding format) of the device.
And the program signal transmission module 205 is configured to transmit, by the server, a television program signal corresponding to the identification information to a television terminal corresponding to the device information according to the identification information and the television terminal device information.
After receiving the request of the user, the server finds out the corresponding program video file and then sends the video data stream to the television equipment of the user through the network.
The server first needs to identify the identification information of the television program, where the identification information is included in the on-demand request sent by the user through the mobile terminal. This identification information is a unique identifier of the television program.
The server also needs to identify the television end device information to determine to which device to transmit the television program signal. This device information typically includes the network address (e.g., IP address) and the device type (e.g., supported video encoding format) of the device.
The server finds the corresponding television program according to the identification information, and then directionally transmits the television program signal to the television terminal according to the equipment information of the television terminal. And after receiving the television program signal, the television terminal equipment decodes and plays the television program signal.
Through the method, multi-terminal linkage of the mobile terminal and the television terminal is realized, so that a user can conveniently use the mobile phone to order television programs without using an unfriendly and easy-to-click television end-play interface, and the user can browse a preview album of the television programs, thereby being beneficial to the user to select the favorite television programs.
In some embodiments of the invention, the system further comprises a play-recording module for:
recording a play record of the television end, and transmitting the play record to a mobile end with play record viewing authority;
the play records comprise the title, the content brief introduction, the play time, the total play time length and the preview album of the television program.
In the process of playing the television program, the television terminal equipment records playing information of the program, including the title, the content brief introduction, the playing time, the total playing time, the preview album and the like of the television program. This information may be stored in a local store on the device.
The television end device transmits the play record to the mobile end device with the viewing authority through the network, and the process can be realized through a cloud service, for example, the television end device uploads the play record to a cloud server, and then the mobile end device downloads the play record from the cloud server. It may also be implemented by direct device-to-device communication, e.g., the television end device and the mobile end device communicate directly via Wi-Fi or bluetooth.
This may be used for parental control functions, where parents can clearly see what programs the child is watching during periods when they are not at home.
In some embodiments of the present invention, the system further includes a program recommendation module configured to:
the television program can be controlled to be on demand by a remote controller, program recommendation information is transmitted to the mobile terminal and the television terminal according to the mobile terminal or the television program on demand, and the mobile terminal and the television terminal display the program recommendation information.
Many old people are very unaccustomed to using a mobile phone to control a television, so that like a conventional television on demand, users can use a remote controller to select television programs which the users want to watch and order the television programs besides a mobile terminal. The system uses a recommendation algorithm to generate relevant program recommendation information according to the television program requested by the user. Then, the recommended information can be transmitted to the mobile terminal or the television terminal for display through the network, and can also be simultaneously transmitted to the mobile terminal and the television terminal for display.
A plurality of members commonly share one television in a family, so that personalized production is also required when related program recommendation information is generated, although a recommendation algorithm cannot directly know which user is watching a certain on-demand television program, mobile terminal equipment is often not shared, and therefore a mobile terminal of the on-demand television program can indirectly know which user is watching the certain on-demand television program. In addition, even if the remote controller is shared by households, in consideration of the fact that users often have own use habits, people who often use the remote controller are likely to be only one person in the households, so even if the remote controller is inaccurate, television programs which are requested by using the remote controller to control television terminals can be approximately corresponding to one user, or all users which are requested by using the remote controller to control the television terminals can be regarded as one user to conduct program recommendation.
In some embodiments of the present invention, the "transmitting program recommendation information to the mobile terminal and the television terminal according to the television program on demand of the mobile terminal or the television terminal, and displaying the program recommendation information by the mobile terminal and the television terminal" specifically includes:
generating first program recommendation information associated with a mobile terminal according to a television program on demand by the mobile terminal;
producing second program recommendation information associated with the television end according to the program information of the television end-on-demand;
if the user is using the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal and the television terminal, and displaying the first program recommendation information by the mobile terminal and the television terminal;
if the user does not use the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal, and displaying the first program recommendation information by the mobile terminal;
and if the user uses the remote controller to control the television terminal, transmitting the second program recommendation information to the television terminal, and displaying the second program recommendation information by the television terminal.
For example, if the mobile terminal a requests a science fiction movie, the program recommendation information (first program recommendation information) related to the science fiction movie may be generated, and the program recommendation information may be transmitted to the mobile terminal a and displayed.
The mobile terminal can not only perform video program on demand, but also control the television to replace the function of a television remote controller. If the user is using the mobile terminal to control the television terminal, it is stated that the user is likely to watch the television at the moment, and the program recommendation information (first program recommendation information) related to the science fiction movie can be transmitted to the mobile terminal and the television terminal at the same time, and the program recommendation information and the first program recommendation information are displayed at the same time, so that the user can be further ensured to see the program recommendation information. However, if the user is not using the mobile terminal to control the television terminal, it is indicated that the television terminal may not be turned on, or even if the television terminal is turned on, the user is not concerned with the content displayed by the television terminal, and the program recommendation information is not necessarily displayed.
For another example, the television end requests the popular science programs, so that the program recommendation information related to the popular science programs can be generated, and the program recommendation information is transmitted to the television end and displayed. If the user is using the remote controller to control the television terminal, the user is required to watch the television, and then the program recommendation information (second program recommendation information) related to the popular science program can be transmitted to the television terminal, and displayed by the television terminal, so that the user can see the program recommendation information with high probability.
In some embodiments of the invention, the system further comprises a text label module for:
and extracting the content characteristics of the key frame set by using the pre-trained content characteristic extraction model.
Extracting text labels from the content features by using a text label extraction model which is completed through pre-training;
associating the text label with the television program;
the user can search the television programs associated with the text labels through the mobile terminal and request the searched television programs.
And extracting the content characteristics of the key frame set by using the content characteristic extraction AI which is completed through pre-training. The content feature extraction AI may be a trained deep learning model such as CNN, R-CNN, etc. The extracted content features may be high-dimensional vectors.
And inputting the content characteristics into the pre-trained label to extract an AI model, and outputting a text label corresponding to the television program. The tag extraction AI model can be a trained deep learning model such as CNN, LSTM, etc.
The text label television programs are associated, so that the user can search the television program content instead of just searching the title, and the mobile terminal is facilitated to search the television programs more conveniently through the search word.
In some embodiments of the present invention, the extracting key frames according to the variation between adjacent frames of the pre-processed video specifically includes:
reading each frame of a television program frame by frame, and converting each frame of the television program into a gray image;
dividing each frame of gray level image into a foreground image and a background image;
subtracting the gray value of the foreground image of the previous frame from the gray value of the foreground image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the foreground image of the previous frame to obtain a differential foreground image;
subtracting the gray value of the background image of the previous frame from the gray value of the background image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the background image of the previous frame to obtain a differential background image;
performing binarization processing on the differential foreground image and the differential background image to obtain a binarized foreground image and a binarized background image;
and respectively calculating the duty ratio of the pixel point with the gray value of 255 in the two-part foreground image and the binary background image, and if the duty ratio of the pixel point with the gray value of 255 in any one of the two-part foreground image and the binary background image is larger than a preset threshold value, extracting the original frame of the television program corresponding to the gray image of the next frame as a key frame.
First, each frame of a television program that needs to be acquired can be implemented by reading a video file. Then, the image data of each frame is subjected to graying treatment, and is converted into a gray image, and the method for converting the image into the gray image is described in more detail, which is not described herein.
The division of the gray scale image of each frame into a foreground image and a background image can be achieved by a number of different methods, one of which is the background subtraction method, which is described in more detail and not described in detail herein.
Next, the gray values of the foreground image and the background image of the previous frame are subtracted from the gray values of the foreground image and the background image of the next frame, respectively, to obtain a differential foreground image. The gray values of the corresponding coordinate pixels of the foreground images or the background images of the front frame and the rear frame are subtracted, and the absolute value is taken for the difference value, so that the gray values of the corresponding coordinate pixels of the differential foreground images or the differential background images are obtained, and each pixel point forms the differential foreground images or the differential background images.
Then, binarizing the differential foreground image and the differential background image, namely setting a threshold value, resetting the gray value of the pixel point with the gray value larger than the threshold value to 255 in the image, and resetting the pixel point with the gray value smaller than the threshold value to 0, thereby obtaining the two foreground images and the binarized background image. The specific size of the threshold value can be selected according to actual conditions, and can be a fixed value, can be determined according to the gray value mean value of the image, or can be determined according to a function.
And finally, respectively calculating the duty ratio of the pixel point with the gray value of 255 in the differential foreground image and the differential background image, and if the duty ratio of any one of the two is larger than a preset threshold value, extracting the original frame of the television program corresponding to the gray image of the next frame as a key frame. This has the advantage that both foreground and background images can be identified, so that key frames can be extracted more accurately. The threshold of the duty ratio may be determined according to the actual situation, for example, may be determined according to the number of key frames required, and generally, the larger the value of the threshold is, the fewer the number of key frames extracted is.
In some embodiments of the present invention, the pixel gray values of the binarized foreground image and the binarized background image are determined according to the following formula:
wherein,ΔA (x,y) is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, delta B (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, A' (x,y) A is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the previous frame, B' (x,y) B is the gray value of the pixel point with coordinates of (x, y) in the background image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the background image of the previous frame,the gray value mean value of all pixel points in the foreground image of the previous frame is +.>The gray value average value of all pixel points in the background image of the previous frame is obtained.
In the above formula, different binarization thresholds are respectively adopted for the binarized foreground image and the binarized background image, that is, for the binarized foreground image, the gray value average value of all pixels in the foreground image of the previous frame is adopted in the previous and subsequent frames, and for the binarized background image, the gray value average value of all pixels in the background image of the previous frame is adopted in the previous and subsequent frames. Compared with the method adopting a fixed function value, the method can reduce the key frame identification error caused by the overlarge or undersize gray value mean value of the image, and improve the accuracy of key frame identification and extraction.
The embodiment of the invention also provides multi-terminal linkage television signal transmission equipment, which comprises:
a processor:
a memory for storing processor-executable instructions;
wherein the processor is configured to invoke the instructions stored in the memory to perform the method according to any of the embodiments described above.
The embodiment of the present invention further provides a readable storage medium, on which computer program instructions are stored, which when executed by a processor implement the method according to any one of the embodiments above.
The present invention may be a method, apparatus, system, and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for performing various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.
The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.
Computer program instructions for carrying out operations of the present invention may be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information for computer readable program instructions, which can execute the computer readable program instructions.
Various aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer readable program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Note that all features disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic set of equivalent or similar features. Where used, further, preferably, still further and preferably, the brief description of the other embodiment is provided on the basis of the foregoing embodiment, and further, preferably, further or more preferably, the combination of the contents of the rear band with the foregoing embodiment is provided as a complete construct of the other embodiment. A further embodiment is composed of several further, preferably, still further or preferably arrangements of the strips after the same embodiment, which may be combined arbitrarily.
It will be appreciated by persons skilled in the art that the embodiments of the invention described above and shown in the drawings are by way of example only and are not limiting. The objects of the present invention have been fully and effectively achieved. The functional and structural principles of the present invention have been shown and described in the examples and embodiments of the invention may be modified or practiced without departing from the principles described.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.

Claims (10)

1. A multi-terminal linkage television signal transmission method, comprising:
extracting a plurality of key frames according to the change between adjacent frames of the preprocessing video, and generating a preview album according to the key frames;
transmitting the video program on-demand information and the preview album to a mobile terminal;
the mobile terminal displays the on-demand information and the preview album to a user, and the user can perform on-demand on television programs corresponding to the on-demand information through the mobile terminal;
transmitting the identification information of the television program requested by the user and the equipment information of the television terminal bound with the mobile terminal to a server terminal;
And the server transmits the television program signal corresponding to the identification information to the television terminal corresponding to the equipment information according to the identification information and the television terminal equipment information.
2. The multi-terminal ganged television signal transmission method of claim 1, further comprising:
recording a play record of the television end, and transmitting the play record to a mobile end with play record viewing authority;
the play records comprise the title, the content brief introduction, the play time, the total play time length and the preview album of the television program.
3. The multi-terminal ganged television signal transmission method of claim 1, further comprising:
the television program can be controlled to be on demand by a remote controller, program recommendation information is transmitted to the mobile terminal and the television terminal according to the mobile terminal or the television program on demand, and the mobile terminal and the television terminal display the program recommendation information.
4. The multi-terminal linkage television signal transmission method according to claim 3, wherein the transmitting program recommendation information to the mobile terminal and the television terminal according to the television program broadcasted by the mobile terminal or the television terminal, and displaying the program recommendation information by the mobile terminal and the television terminal, specifically comprises:
Generating first program recommendation information associated with a mobile terminal according to a television program on demand by the mobile terminal;
producing second program recommendation information associated with the television end according to the program information of the television end-on-demand;
if the user is using the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal and the television terminal, and displaying the first program recommendation information by the mobile terminal and the television terminal;
if the user does not use the mobile terminal to control the television terminal, transmitting the first program recommendation information to the mobile terminal, and displaying the first program recommendation information by the mobile terminal;
and if the user uses the remote controller to control the television terminal, transmitting the second program recommendation information to the television terminal, and displaying the second program recommendation information by the television terminal.
5. The multi-terminal ganged television signal transmission method of claim 1, further comprising:
extracting content features from the keyframe set by using a pre-trained content feature extraction model;
extracting text labels from the content features by using a text label extraction model which is completed through pre-training;
Associating the text label with the television program;
the user can search the television programs associated with the text labels through the mobile terminal and request the searched television programs.
6. The multi-terminal linkage television signal transmission method according to claim 1, wherein the extracting a plurality of key frames according to the variation between adjacent frames of the pre-processed video comprises:
reading each frame of a television program frame by frame, and converting each frame of the television program into a gray image;
dividing each frame of gray level image into a foreground image and a background image;
subtracting the gray value of the foreground image of the previous frame from the gray value of the foreground image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the foreground image of the previous frame to obtain a differential foreground image;
subtracting the gray value of the background image of the previous frame from the gray value of the background image of the next frame, and taking the absolute value of the difference value of the gray value and the gray value of the background image of the previous frame to obtain a differential background image;
performing binarization processing on the differential foreground image and the differential background image to obtain a binarized foreground image and a binarized background image;
and respectively calculating the duty ratio of the pixel point with the gray value of 255 in the two-part foreground image and the binary background image, and if the duty ratio of the pixel point with the gray value of 255 in any one of the two-part foreground image and the binary background image is larger than a preset threshold value, extracting the original frame of the television program corresponding to the gray image of the next frame as a key frame.
7. The multi-terminal linkage television signal transmission method of claim 6, wherein the pixel gray values of the binarized foreground image and the binarized background image are determined according to the following formula:
wherein DeltaA (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, delta B (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the differential foreground image, A' (x,y) A is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the foreground image of the previous frame, B' (x,y) B is the gray value of the pixel point with coordinates of (x, y) in the background image of the following frame (x,y) Is the gray value of the pixel point with coordinates of (x, y) in the background image of the previous frame,the gray value mean value of all pixel points in the foreground image of the previous frame is +.>The gray value average value of all pixel points in the background image of the previous frame is obtained.
8. A multi-terminal ganged television signal transmission system, comprising:
the preview generation module is used for extracting a plurality of key frames according to the change between adjacent frames of the preprocessing video and generating a preview album according to the key frames;
the program information transmission module is used for transmitting the video-on-demand information of the television program and the preview album to the mobile terminal;
The program display module is used for displaying the on-demand information and the preview album to a user by the mobile terminal, and the user can perform on-demand on television programs corresponding to the on-demand information through the mobile terminal;
the on-demand information transmission module is used for transmitting the identification information of the television program on demand by the user and the equipment information of the television terminal bound with the mobile terminal to the server terminal;
and the program signal transmission module is used for transmitting the television program signal corresponding to the identification information to the television terminal corresponding to the equipment information by the server terminal according to the identification information and the television terminal equipment information.
9. A multi-terminal ganged television signal transmission apparatus, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to invoke the instructions stored in the memory to perform the method of any of claims 1 to 7.
10. A readable storage medium, having stored thereon computer program instructions which, when executed by a processor, implement the method of any of claims 1 to 7.
CN202310990397.2A 2023-08-08 2023-08-08 Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium Pending CN117041675A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310990397.2A CN117041675A (en) 2023-08-08 2023-08-08 Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310990397.2A CN117041675A (en) 2023-08-08 2023-08-08 Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN117041675A true CN117041675A (en) 2023-11-10

Family

ID=88627408

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310990397.2A Pending CN117041675A (en) 2023-08-08 2023-08-08 Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN117041675A (en)

Similar Documents

Publication Publication Date Title
JP6735927B2 (en) Video content summarization
US10368123B2 (en) Information pushing method, terminal and server
US11521608B2 (en) Methods and systems for correcting, based on speech, input generated using automatic speech recognition
US9892324B1 (en) Actor/person centric auto thumbnail
US20140052696A1 (en) Systems and methods for visual categorization of multimedia data
US20160378762A1 (en) Methods and systems for identifying media assets
KR20170010378A (en) Text detection in video
KR20120099034A (en) Automatic media asset update over an online social network
US20180068188A1 (en) Video analyzing method and video processing apparatus thereof
CN103475935A (en) Method and device for retrieving video segments
CN104639993A (en) Video program recommending method and server thereof
US11665409B2 (en) Systems and methods for discovery of, identification of, and ongoing monitoring of viral media assets
KR20220000758A (en) Image detection apparatus and method thereof
US9398343B2 (en) Methods and systems for providing objects that describe media assets
US9544656B1 (en) Systems and methods for recognition of sign language for improved viewing experiences
US10560730B2 (en) Electronic apparatus and operating method thereof
US20180096221A1 (en) Systems and methods for receiving a segment of a media asset relating to a user image
EP3839874B1 (en) Apparatus and method to compress an image
CN117041675A (en) Multi-terminal linkage television signal transmission method, system, equipment and readable storage medium
US20210081655A1 (en) Systems and methods for alerting a user to published undesirable images depicting the user
US20230319376A1 (en) Display device and operating method thereof
KR20180068121A (en) Method and device for recognizing content
US20160179803A1 (en) Augmenting metadata using commonly available visual elements associated with media content
EP3533231B1 (en) Electronic apparatus and operating method thereof
JP4989506B2 (en) Character recognition device and program thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination