CN111787376B

CN111787376B - Display device, server and video recommendation method

Info

Publication number: CN111787376B
Application number: CN202010710776.8A
Authority: CN
Inventors: 王光强
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2020-07-22
Filing date: 2020-07-22
Publication date: 2022-10-14
Anticipated expiration: 2040-07-22
Also published as: CN111787376A

Abstract

The present application relates to the field of intelligent devices and video detection technologies, and in particular, to a display device, a server, and a video recommendation method. The problem that the video cannot be automatically recommended to the user when the user television uses the set top box and the cable television of an operator can be solved to a certain extent. The display device includes: the display is used for displaying a user interface, and a playing window is arranged in the user interface; a first controller configured to determine whether a first media file having the same content as a first program can be provided in the server when a video source of the first program is not a preset application; when the first media file exists in the server, displaying a prompt control on the playing window, wherein the prompt control is used for jumping to a description interface of the first media file provided by the server after receiving confirmation operation of a user; and when the server does not store the first media file, not displaying the prompt control.

Description

Display device, server and video recommendation method

Technical Field

The present application relates to the field of intelligent devices and video detection technologies, and in particular, to a display device, a server, and a video recommendation method.

Background

The video recommendation system automatically recommends and presents videos related to the videos watched by the user according to the records of the videos watched by the user or the videos watched by the user, so that manual searching by the user can be avoided, the user can be helped to find interested videos, and the stay time of the user on a video website is prolonged.

In some video recommendation implementations, a user watches videos through a pre-installed application program of a television, then watching records of the user are obtained in the application program, and the videos are recommended to the user according to the similarity by searching related videos and determining the similarity between the videos.

However, since a large number of televisions use cable digital television services or set-top boxes given by telecom operators, users do not access to pre-installed applications of the televisions under normal conditions, and thus video recommendation for the users cannot be achieved.

Disclosure of Invention

In order to solve the problem that a user television cannot automatically recommend videos to a user when using a set top box and a cable television of an operator, the application provides display equipment, a server and a video recommendation method.

The embodiment of the application is realized as follows:

a first aspect of embodiments of the present application provides a display device, including: the display is used for displaying a user interface, and a playing window is arranged in the user interface; a first controller configured to: when the video source of a first program is not a preset application, determining whether a first media file with the same content as the first program can be provided in a server or not; when the first media file exists in the server, displaying a prompt control on the playing window, wherein the prompt control is used for jumping to a description interface of the first media file provided by the server after receiving confirmation operation of a user; and when the server stores the first media file, not displaying the prompt control.

A second aspect of embodiments of the present application provides a server, including: a second controller configured to: when a map-identifying recommendation request sent by a display device is received, determining whether a first media file which has the same content as a first program played by a playing window of the display device can be provided in the server; feeding back to a display device a message characterizing that the first media file can be provided, or a message characterizing that the first media file cannot be provided.

According to some embodiments of the present application, the server, wherein the second controller, in determining whether the server can provide the first media file with the same content as the first program played by the display device playing window, includes: the second controller receives a map recognizing request sent by a display device, wherein the map recognizing request comprises a screenshot of an image of the first program; identifying the screenshot according to the image identifying request and determining a first name of a first program corresponding to the screenshot; and determining whether the server can provide the media file corresponding to the first name or not according to the first name.

A third aspect of an embodiment of the present application provides a method for video recommendation, where the method includes: the method comprises the steps of screenshot an image of a first program to obtain a first feature corresponding to the first program; analyzing based on the first characteristic to obtain a first name of the first program, and sending the first name to a server; and displaying a prompt control containing a recommendation list, wherein the recommendation list and the programs contained in the recommendation list are from a server.

A fourth aspect of the embodiments of the present application provides a method for generating a video highlight, where the method includes: retrieving in a media asset library of a server based on a first name of a first program sent from a display device, and generating a recommendation list if the first program with the same first name exists; and sending the recommendation list to a display device.

The beneficial effect of this application: the video recommendation function can be automatically started by acquiring the states of a video source and a map recognition recommendation switch of the display equipment; furthermore, by detecting a video source through frequency reduction, the optimization of the television system resource can be realized; furthermore, complaints of the user can be processed independently at a server side by remotely configuring a recommendation strategy; further, by obtaining the first name of the program, whether the first program exists in the server can be searched and confirmed; further, by constructing the first media file, the acquisition of the recommended video can be realized; further, by constructing a prompt control, the operation and instant acquisition of the recommended video by the user can be realized, the competitive media resources of the television self-contained application can be accessed by the user, the frequency of accessing the television application by the user is improved, and the recall of the off-network user is realized.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and those skilled in the art can obtain other drawings without inventive labor.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;

fig. 2 is a block diagram exemplarily showing a hardware configuration of a display device 200 according to an embodiment;

fig. 3 is a block diagram exemplarily showing a hardware configuration of the control apparatus 100 according to the embodiment;

fig. 4 is a diagram exemplarily showing a functional configuration of the display device 200 according to the embodiment;

fig. 5a schematically shows a software configuration in the display device 200 according to an embodiment;

fig. 5b schematically illustrates a configuration of an application in the display device 200 according to an embodiment;

FIG. 6A is a schematic UI diagram of a TV play screen according to an embodiment of the application;

FIG. 6B is a schematic UI diagram of a TV play screen according to another embodiment of the present application;

FIG. 6C is a schematic diagram illustrating a UI of a video recommendation prompt in accordance with an embodiment of the application;

FIG. 6D is a UI diagram illustrating a video recommendation prompt according to another embodiment of the application;

FIG. 6E is a UI diagram illustrating a video recommendation prompt according to another embodiment of the application;

FIG. 6F is a UI diagram illustrating a television recommendation list according to an embodiment of the application;

FIG. 6G is a UI diagram illustrating a television recommendation list according to another embodiment of the present application;

fig. 7 is a schematic flowchart illustrating a video recommendation method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a portion of a TV station icon in accordance with an embodiment of the present application;

FIG. 9 is a flow chart illustrating a video recommendation method according to another embodiment of the present application;

FIG. 10 is a logic diagram illustrating a video recommendation method according to an embodiment of the present application;

FIG. 11 is a schematic diagram illustrating a timing sequence of operations of a display device and a server in video recommendation according to an embodiment of the present application;

fig. 12 is a schematic diagram illustrating a timing sequence of operations of a display device and a server in video recommendation according to another embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive step, are within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary embodiment or embodiments, it is to be understood that each aspect of the disclosure can independently be implemented as a single unitary embodiment.

It should be understood that the terms "first," "second," "third," and the like in the description and claims of this application and in the foregoing drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Reference throughout this specification to "embodiments," "some embodiments," "one embodiment," or "an embodiment," etc., means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, appearances of the phrases "in various embodiments," "in some embodiments," "in at least one other embodiment," or "in an embodiment," or the like, throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Thus, the particular features, structures, or characteristics shown or described in connection with one embodiment may be combined, in whole or in part, with the features, structures, or characteristics of one or more other embodiments, without limitation. Such modifications and variations are intended to be included within the scope of the present application.

The term "remote control" as used in this application refers to a component of an electronic device, such as the display device disclosed in this application, that is typically wirelessly controllable over a short distance. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to interface with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. functional modules. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.

The control device 100 may control the display device 200 in a wireless or other wired manner by using a remote controller, including infrared protocol communication, bluetooth protocol communication, other short-distance communication manners, and the like. The user may input a user command through a key on a remote controller, a voice input, a control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the display device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be one or more servers, and may be one or more servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, the display device 200 includes a controller 210, a tuning demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

A display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting a picture, and a driving assembly for driving image display. The video content may be displayed from broadcast television content, or may be broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from a network communication protocol and transmitted from a network server side can be displayed.

Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.

The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).

The display apparatus 200 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communication interface 230. And an infrared receiver, an interface device for receiving an infrared control signal for controlling the apparatus 100 (e.g., an infrared remote controller, etc.).

The detector 240 is a signal used by the display device 200 to collect an external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, and parameters such as parameter changes can be adaptively displayed by collecting the ambient light.

The image acquisition device 241, such as a camera and a camera, may be used to acquire an external environment scene, acquire attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize gestures of the user, so as to implement an interaction function with the user.

In some other exemplary embodiments, the detector 240, a temperature sensor, etc. may also be used, for example, by sensing the ambient temperature, and the display device 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is high, the display device 200 may be adjusted to display a color temperature of the image in a cool tone, or when the temperature is low, the display device 200 may be adjusted to display a warm tone.

In some other exemplary embodiments, the detector 240, a sound collector, etc., such as a microphone, may be used to receive a user's voice, a voice signal including a control instruction for the user to control the display device 200, or collect environmental sounds for identifying an environmental scene type, and the display device 200 may adapt to the environmental noise.

The input/output interface 250 controls data transmission between the display device 200 of the controller 210 and other external devices. Such as receiving video and audio signals or command instructions from an external device.

The input/output interface 250 may include, but is not limited to, the following: any one or more of high definition multimedia interface HDMI interface 251, analog or data high definition component input interface 253, composite video input interface 252, USB input interface 254, RGB ports (not shown in the figures), etc.

In other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned plurality of interfaces.

The tuning demodulator 220 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, frequency mixing, resonance, and the like, and demodulates the television audio and video signals carried in the television channel frequency selected by the user and the EPG data signals from a plurality of wireless or wired broadcast television signals.

The tuner demodulator 220 is responsive to the user-selected television signal frequency and the television signal carried by the frequency, as selected by the user and controlled by the controller 210.

The tuner-demodulator 220 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation mode can be digital modulation or analog modulation. Depending on the type of television signal received, both analog and digital signals are possible.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the input/output interface 250.

The video processor 260-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the directly displayable device 200.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is used for converting an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and a common format is implemented by using a frame interpolation method, for example.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain an audio signal that can be played in the speaker.

In other exemplary embodiments, the video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with the controller 210 in one or more chips.

An audio output 272, which receives the sound signal output from the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and the external sound output terminal 274 of the generating device that can output to the external device, in addition to the speaker 272 carried by the display device 200 itself, such as: an external sound interface or an earphone interface and the like.

The power supply provides power supply support for the display device 200 from the power input from the external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply interface installed outside the display device 200 to provide an external power supply in the display device 200.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210 according to the user input, and the display device 200 responds to the user input.

In some embodiments, the user may input a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The controller 210 controls the operation of the display device 200 and responds to the user's operation through various software control programs stored on the memory 290.

As shown in fig. 2, the controller 210 includes a RAM213 and a ROM214, and a graphic processor 216, a CPU processor 212, a communication interface 218, such as: a first interface 218-1 through an nth interface 218-n, and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the display apparatus 200 starts power-on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM, copies the operating system stored in the memory 290 to the RAM213, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM213, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.

The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command for selecting a UI object displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation of connecting to a hyperlink page, document, image, etc., or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

Wherein the basic module is a bottom layer software module for signal communication among the various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A block diagram of the configuration of the control apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 3. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display apparatus 200 according to user demands.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similar to the control device 100 after installing an application that manipulates the display device 200. Such as: a user may implement the functions of controlling the physical keys of device 100 by installing applications, various function keys or virtual buttons of a graphical user interface that may be provided on mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then modulated according to an rf control signal modulation protocol, and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

Fig. 4 is a diagram schematically illustrating a functional configuration of the display device 200 according to an exemplary embodiment. As shown in fig. 4, the memory 290 stores an operating system, an application program, contents, user data, and the like, and performs system operations for driving the display device 200 and various operations in response to a user under the control of the controller 210. The memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically configured to store an operating program for driving the controller 210 in the display device 200, and to store various application programs installed in the display device 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically configured to store drivers and related data such as the audio/video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner demodulator 220, the input/output interface of the detector 240, etc.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The memory 290, for example, includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, and the like. The controller 210 performs functions such as: a broadcast television signal reception demodulation function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction recognition function, a communication control function, an optical signal reception function, an electric power control function, a software control platform supporting various functions, a browser function, and the like.

A block diagram of a configuration of a software system in a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 5 a.

As shown in fig. 5a, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary for data processing performed between application programs and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The driver may contain code to operate video, audio and/or other multimedia components. Examples include a display screen, a camera, flash, wiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility of the application program and operability of the displayed content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

User interface modules 2911-3, which are used to provide objects for displaying user interfaces for access by various applications, enable user operability.

Control applications 2911-4 for controllable process management, including runtime applications and the like.

The event transmission system 2914, which may be implemented within the operating system 2911 or within the application programs 2912, in some embodiments, on the one hand within the operating system 2911, and in the same time within the application programs 2912, is adapted to listen for various user input events, to refer to handlers that implement one or more predefined sets of operations in response to the identification of various types of events or sub-events, depending on the various events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control device 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting gestures through gesture recognition, inputting sub-events through remote control key commands of the control equipment and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout manager 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, and other various execution operations related to the layout of the interface.

As shown in fig. 5b, the application layer 2912 contains various applications that may also be executed at the display device 200. The applications may include, but are not limited to, one or more applications such as: live television applications, video-on-demand applications, media center applications, application centers, gaming applications, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

The embodiment of the application can be applied to various types of display devices (including but not limited to smart televisions, set-top boxes and the like). The following describes the technical solution with respect to the UI related to generating video recommendations at the tv end.

6A-6G show schematic UI diagrams of video recommendation in a display device according to an embodiment of the application.

Fig. 6A shows a UI diagram of a television broadcast screen according to an embodiment of the present application.

The smart tv device may play video of different physical channel video sources, such as ATV (analog television), DTV (digital television), HDMI (high definition multimedia interface), and tv application, etc.

The figure shows that the first program being played is a television play, "my first half," which plays a television station as a television play channel of central view, and the television station mark is located at the upper left corner of the playing picture, wherein the first program is a television program currently being played by a television.

It should be noted that, when the video source of the tv broadcast program is DTV, the broadcast screen necessarily includes a tv station icon. The display device comprises a display and a first controller, wherein the display is used for displaying a user interface, and a playing window is arranged in the user interface; the first controller is configured to detect and identify a video source of a display device. For example, the first controller may identify that the video source of the first program currently being played by the television of fig. 6A is DTV, wherein the first controller may be implemented as the controller 210, for example.

In some embodiments, while the first program is being played, the display device is also configured to present other interactive elements, which may include, for example, television home page controls, search controls, message button controls, mailbox controls, browser controls, favorites controls, signal bar controls, and the like.

To improve the convenience and the visualization of the UI of the television, in some embodiments, the first controller of the television in the embodiments of the present application controls the television and its UI in response to the manipulation of the interactive element. For example, a user clicking on the search control through a controller such as a remote control may expose the search UI on top of other UIs, i.e., the UI controlling the application components to which the interactive elements are mapped can be made large, or run and displayed full screen. In some embodiments, the interactive element may also be operated by a sensor, which may be, but is not limited to, an acoustic input sensor, such as a microphone, that may detect a voice command including an indication of the desired interactive element. For example, a user may identify a desired interactive element, such as a search control, using a "recognition recommendation" or any other suitable identification, and may also describe a desired action to be performed in relation to the desired interactive element. The first controller may recognize the voice command and submit data characterizing the interaction to the UI or its processing component or engine.

Fig. 6B shows a UI diagram of a television broadcast screen according to another embodiment of the present application.

The display device plays the first program, the video source of the first program is ATV, and the fact that no television station icon exists on the playing picture of the first program in the picture can be found. When the video source is an ATV, the broadcast frame of the first program may also include a tv station icon. In some embodiments, when the video source of the tv is HDMI, the tv playing screen may also be implemented without tv station icon as shown in fig. 6B, or may also be implemented with tv station icon as shown in fig. 6A.

It should be noted that, when the video source of the first program of the television is DTV, the playing screen necessarily includes a television station icon; when the video source of the first program is ATV or HDMI, the broadcast frame may or may not include the tv station icon.

In some embodiments, when the video source of the first program of the display device is not a predetermined application, the first controller determines whether the first media file having the same content as the first program can be provided in the server.

The first controller continuously detects the video source of the first program, and the preset application may be implemented as a video application pre-installed in the factory of the display device in some embodiments. According to the display device provided by the embodiment of the application, the first controller can detect a video source of a user when the user watches a program, so that the preset application, the DTV, the ATV and the HDMI can be identified. It can be understood that, when the video source of the first program played in the playing window of the tv user interface is DTV or ATV, the playing progress of the first program cannot be controlled and on-demand cannot be realized, so it is valuable to provide and recommend the first media file of the same program with progress control and on-demand functions for the user.

The video source of the first program is continuously detected through the first controller, and the video source type of the first program currently played by the television can be immediately acquired so as to further detect the triggering condition of video recommendation.

In some embodiments, the first controller identifies the video source by reading identification information characterizing the video source channel in a database. The first controller reads identification information used for representing the video source from a preset database, and then determines the video source of the first program according to the corresponding relation between the identification information and the video source. For example, in the android-based system architecture, the video source of the system is recorded in the database during the use process. For example, the symbol 1 represents an ATV channel; the identifier 2 represents a DTV channel, the identifier 3 represents an HDMI channel, etc., and if the user is currently watching a DTV digital television program, the identifier information of its usage video source is stored in the database, and the first controller identifies the information by detecting the video source recorded in the database. For example, if the video source identification information recorded in the current database is 2, the first controller may determine that the current video source is the DTV according to the corresponding relationship between the identification information and the video source.

In some embodiments, when the video source of the first program is detected and acquired for the first time as the preset application, the first controller reduces the detection frequency of the video source after a preset number of times. When the video source of the first program is a preset application, the first controller can normally acquire user information through the application program to recommend the video.

For example, during the normal playing period of the first program, the video source is usually not changed, and in order to reduce the occupation of the system resource of the display device by the detected video source, the detection frequency of the video source after a preset number of times can be reduced, so as to improve the efficiency of the video source detection. For example, when the preset number of times is set to 5, the first program video source is identified as the preset application 1 time, and when the identification results of 4 consecutive times at the frequency of 3 times/minute are all the preset applications, the first controller reduces the video source detection frequency to 1 time/minute from the 6 th time, so as to reduce the occupation of system resources.

In some embodiments, the first controller detects the video source of the first program immediately after the user switches the programs.

The first program after switching may be program switching in an original video source channel, or program switching by switching a video source.

For example, the video source of the current program is a DTV, and a user inserts a memory for storing a first program into an HDMI port of the television, so that the first program in the memory is automatically played, and the first controller immediately executes video source detection to acquire the video source of the first program after the display device switches programs, so as to further detect a trigger condition for video recommendation.

FIG. 6C is a schematic diagram of a UI for a video recommendation prompt according to an embodiment of the application.

Taking the first program played in fig. 6A as an example, after the display device executes the video recommendation, the first controller displays a graphical control, i.e., a first interactive element, in a playing window of the display to prompt the user that the video recommendation has been generated.

When a first media file with the same content as the first program exists in the server, a prompt control is displayed on the playing window, and the prompt control is used for jumping to a description interface of the first media file provided by the server after receiving confirmation operation of a user.

In some embodiments, the first media file is sent to the display device in the form of a recommendation list, and the first controller displays a prompt control, i.e., a first interactive element, containing the recommendation list at a predetermined message display location. In some embodiments, the first interactive element is a non-full screen window, such as may be implemented as a small window hovering over the first programming UI interface, displayed in the lower right corner of the television screen interface. After receiving the confirmation operation of the user, the prompt control or the first interactive element jumps to a description interface of the first media file provided by the server, where the description interface may include, for example, a name, a brief introduction, a cover page diagram, and other contents of the first media file.

The prompt control is configured to be a high-level television application message, is directly displayed at a preset message display position, only blocks a small area of a first program playing UI, and can be configured to display the prompt control in any scene, so that the video recommendation experience of a user is ensured.

In some embodiments, the prompt control may also be implemented as a location coordinate of a preset message prompt box on the television screen interface. The hinting control can, for example, occupy a square area with 100 pixels in the lower right corner.

In some embodiments, the prompt control may include a picture and text, and the user may be prompted to perform different operations on the prompt control through the text information, for example, selecting and confirming operations.

For example, as shown in fig. 6D, if the prompt control is implemented as "click more wonderful," the user may activate the interactive UI of the prompt control by controlling the position of the display focus to highlight the prompt control and then click confirmation, so as to enter the description interface of the first media file. For another example, as shown in fig. 6E, if the text information of the prompt control is "the right key is more wonderful," the user may activate the interactive UI of the prompt control by operating the right key of the display device corresponding to the remote controller, and enter the description interface of the first media file.

The method for video recommendation will be described below with reference to the above-mentioned UI interface for generating video recommendations.

Fig. 7 shows a flowchart of a video recommendation method according to an embodiment of the present application.

In step 701, a screenshot is performed on an image of a first program to obtain a first feature corresponding to the first program.

The display device comprises a display and a first controller, wherein the display is used for displaying a user interface and playing a video program.

When the video source of the first program is not a preset application, the first controller determines whether a first media file having the same content as the first program can be provided in the server.

The first controller acquires a first name of the first program; and determining whether the server can provide the media file corresponding to the first name or not according to the first name.

In some embodiments, the first controller captures an image of a first program played by the display to obtain the first feature. The first characteristic is the whole or partial content of the image in the first program playing picture and is used for identifying the name of the first program currently played by the television.

For example, when the video source of the first program is a DTV, the first controller intercepts a station icon of the image as a first feature; when the video source of the first program is ATV or HDMI, the first controller takes the intercepted image as a first feature.

In some embodiments, when the video source of the first program is a DTV, a map identifying request is sent to a server according to the screenshot, the map identifying request includes the screenshot and a first identifier that the video source representing the first program is a DTV video source, wherein the map identifying request is used for enabling the server to identify a station logo in the screenshot corresponding to the first identifier, and determine a first name of the first program according to a program list of a station corresponding to the station logo, and the server further determines whether a first media file with the same content as the first program can be provided in the server according to the first name.

For example, when a video source of a first program played by a television is a DTV video source, a name of the first program can be obtained by querying by obtaining station information of the first program, so that the first controller can capture a station icon in an image of the first program as a first feature of the first program, and fig. 8 illustrates a schematic diagram of a part of the station icon in an embodiment of the present application. For example, the first controller may intercept a television station icon at the upper left corner of the UI interface in fig. 6A as a first feature of the first program "my first half-life", and according to the first feature, it may be known that the television station played by the first program "my first half-life" is a starry tv drama channel CCTV8. Then, a first name of the first program is determined according to the open CCTV8 program list, and the server searches whether a first media file with the same content as the first program can be provided in the server or not according to the first name.

In some embodiments, when the video source of the first program is an ATV video source or an HDMI video source, the first controller sends, according to the screenshot, an image recognition request to the server, where the image recognition request includes the screenshot and a second identifier indicating that the program source of the first program is an ATV or HDMI video source, where the image recognition request is used to enable the server to identify, corresponding to the second identifier, text and/or images in the screenshot, and query, according to the identified text and/or images, a first name of the first program, and the server further determines, according to the first name, whether a first media file with the same content as the first program can be provided in the server.

For example, when a video source of a first program played by a television is an ATV or an HDMI, a first controller captures an image of the first program in a playing process, where the captured image is used as a first feature of the first program, and obtains a first name of the first program by performing image recognition on the first feature. The screenshot serving as the first feature may include a character image or text information. It is to be understood that the text information may include, for example: video title, or director's title, or actor's title, or program line words, etc.

The first controller intercepts an image of the UI in FIG. 6B, and the acquired screenshot serves as a first feature of the first program "My first half life", which includes a word serving as text information, and a character spammer and Mayier 29709. In some embodiments, the screenshot may also include first name text information, the first name being generally located at a right edge position of the screenshot.

With continued reference to fig. 7, in step 702, a first name of the first program is obtained through parsing based on the first characteristic, and the first name is sent to a server.

After the first characteristic of the first program is obtained, the first controller analyzes and obtains a first name of the first program based on the first characteristic, and sends the first name to a server.

In some embodiments, the first controller obtaining the first name of the first program comprises: the first controller captures the image of the first program played by the playing window; and determining a first name of the first program according to the screenshot.

The first controller identifies characters or images in the screenshot; and determining a first name corresponding to the identified characters or images according to the identified characters or images and a preset mapping relation, wherein the preset mapping relation is the mapping of program names and characters/images. For example, the first controller identifies the station logo in the screenshot; and determining a first name of the first program according to the station caption and a program list of a radio station corresponding to the station caption. When the video source of the first program is the DTV, the first controller captures a station icon in the first program image as a first feature, for example, a station icon in the upper left corner of the UI in fig. 6A. For another example, the first controller may further perform image recognition on the tv station icon to obtain text information thereof, for example, recognize that the tv station icon in the tv UI of fig. 6A is a "central tv drama channel", then retrieve and obtain a program list of the central tv drama channel in the network according to the tv station icon, and/or the text information "central tv drama channel" and the current date and time, and further compare the program list to obtain the first name of the first program. It can be understood that, the program list of the tv channel of the tv is obtained by the tv station icon of the tv channel of the tv, and then the program list is compared according to the current time and date of the first program playing, the name of the program scheduled to be played at the current time in the program list of the tv drama channel, i.e. the first name of the first program, can be obtained.

In some embodiments, determining the first name of the first program from the screenshot is performed as follows: the first controller sends a picture recognition request to the server according to the screenshot, wherein the picture recognition request comprises the screenshot, and the picture recognition request is used for enabling the server to recognize the screenshot and determine a first name corresponding to the screenshot; and receiving the first name fed back by the server.

For example, when the video source of the first program is ATV or HDMI, the first controller performs image recognition, comparison and retrieval on the first feature to obtain the name of the first program.

The first controller analyzes the first characteristic, can obtain basic description information of the first program, and then obtains the name of the first program through comparison and retrieval in the database based on the obtained basic description information. In some embodiments, through the analysis of the first feature, the main feature and all the secondary features of the first program can be obtained; then searching a feature video subset with the main feature from the feature video combination according to the main feature; then searching videos with the same secondary characteristics as the first program video from the characteristic video subset, and taking the videos as related videos of the first program video; and calculating the content similarity of the related video and the video of the first program, and determining the name of the video with the highest similarity as the name of the first program. The main feature is a typical video label, and the rest video labels except the main feature are used as secondary features. For example, the video type tag in the video tags is taken as a main feature, and the rest of the video tags, such as the actor, director, actor, lines, etc., are taken as secondary features.

The video label can be obtained by performing word segmentation processing on basic description information of a video, wherein the basic description information comprises a video name, a video type, a country, an actor name, a director name, a movie introduction, lines and the like. And performing word segmentation on the basic description information, and generating a video label after the processing result is de-duplicated.

In some embodiments, determining the first name of the first program from the screenshot is performed as follows: the first controller identifies characters or images in the screenshot; and determining a first name corresponding to the identified characters or images according to the identified characters or images and a preset mapping relation, wherein the preset mapping relation is the mapping of program names and characters/images.

For example, the first controller intercepts an image of a UI interface of a first program, and the acquired screenshot is used as a first feature of the first program, where the screenshot includes a speech, a first name, a character image, and the like as text information; the first name of the first program is usually located at a right edge position of the screenshot, and the first controller may determine, according to an identified text, for example, the first name of the right edge position of the screenshot of the first program, the first name of the text corresponding to the identification according to a preset mapping relationship, where the preset mapping relationship is a mapping of a program name and a text/image.

In some embodiments, the first controller determines whether the display device turns on a map recognition recommendation function before determining whether the first media file with the same content as the first program can be provided in the server; if the server is started, determining whether a first media file with the same content as the first program can be provided in the server; if not, continuing to play the first program, and not executing the step of determining whether the server can provide the first media file with the same content as the first program. It can be understood that the display device carries out video recommendation only when the graph recognition recommendation function is started and the recommendation strategy is met.

And only when the first controller of the display device detects that the image recognition and recommendation function of the display device is started and meets the recommendation strategy, the display device carries out video recommendation so as to prevent user complaints. It can also be understood that the first controller needs to detect the on state of the graph recognition recommendation function of the television first, and if the graph recognition recommendation function is off, the television does not perform video recommendation even when the video source of the first program of the television is not a preset application.

In some embodiments, when the graph recognition recommendation function is turned on, the first controller further needs to detect whether a recommendation policy is satisfied, and the television will start to perform video recommendation only when the television satisfies the recommendation policy.

In some embodiments, the recommendation policy may be configured remotely by the server; the recommendation strategy comprises at least one or more of the combination of setting recommendation forbidding date, setting recommendation forbidding time interval and setting maximum daily recommendation times.

The server corresponding to the display device comprises a second controller, and the second controller can configure the recommendation strategy through remote operation of the display device.

For example, a recommendation prohibition date is set, and the television prohibits video recommendation every saturday and sunday; for example, a recommendation prohibition period is set, night 7:00-7: video recommendation is prohibited in a news simulcast period of 30 minutes; for example, a maximum daily number of video recommendations is set, and video recommendations are not performed any more after the daily number of video recommendations exceeds 5 times, for example. The recommendation strategy can be one or a combination of multiple strategies. Therefore, when the user recommends too many complaints due to videos, a television manufacturer or a service provider can remotely configure and independently adjust the video recommendation setting of the complaint client, the complaint problem is solved, and the video recommendation strategy of other television users cannot be influenced.

In some embodiments, the recommendation policy may also be configured locally by the first controller. The recommendation strategy comprises at least one or more of the combination of setting recommendation forbidding date, setting recommendation forbidding time interval and setting maximum daily recommendation times.

In some embodiments, the first controller detects the on state of the map recognition recommendation function only when the video source of the first program is a non-preset application. That is, when the first program video source of the television is a preset application, the first controller will not detect whether the image recognition recommendation function of the television is turned on.

It can be understood that the first program video source is a prerequisite for detecting the on state of the map recognition recommendation function for the non-preset application, and the satisfaction of the on state of the map recognition recommendation function is a prerequisite for executing video recommendation for the display device.

With continued reference to fig. 7, in step 703, a prompt control is displayed that contains a recommendation list, with the programs it contains, from the server.

A first controller of the display device displays a prompt control containing a recommendation list, that is, a first interactive element, in a display user interface, where a play window is arranged, the prompt control is as shown in the lower right corner of the tv UI interfaces in fig. 6C to 6E, and a user can further enter a description interface of a first media file by operating the prompt control.

In some embodiments, the recommended video is identical to the first program, for example, the first program of the display device is the "my first half" set 3, and the recommended videos in the recommendation list are also the "my first half" set 3.

In some embodiments, the recommended video first media file has the same name as the first program, but the recommended video contains all diversity, or staging, content of a television series, or art, and the user may enter his sub-menu, or description interface, via the interactive interface, to perform the selection operation. For example, the first program of the display device is "my first half" set 3, and the recommended video in the recommendation list is also "my first half", but the recommended video, when clicked, may display all diversity content contained in the series.

In some embodiments, the recommendation list may include a first program and a second program. Wherein the first program is configured to contain text information for free prompts, or full set prompts; the second program is configured to specify a program, or ad slot.

Fig. 6F shows a UI diagram of a television recommendation list according to an embodiment of the present application.

The user can display the recommendation list on the top layer of the television UI through operating a prompt control of the UI. For example, the recommendation list in the figure includes 4 programs, a first program (1), a first program (2), a second program (1), and a second program (1). It should be noted that the number of the first program and the second program in the recommendation list may be changed according to actual situations.

It can be understood that the first program is a recommended video generated by the server according to the video recommendation algorithm by sending the name of the currently played first program through the display device, that is, the first media file, and the number or content of the recommended video is determined by the video recommendation algorithm. The second program is specified by the display equipment manufacturer or the display service provider, for example, the second program (1) may be specified as a commercial, and the television program (2) may be specified as a television program promoted by the manufacturer or the service provider. In some embodiments, the positions of the first program and the second program in the recommendation list may be configured by a manufacturer or a service provider according to actual needs, or may be configured intelligently through an algorithm, which is not limited in this application.

FIG. 6G is a schematic diagram illustrating a UI for a television recommendation list according to another embodiment of the application.

In the figure, video recommendation is performed by taking the first program "my first half of life" being played by the television as an example, and comparing fig. 6F, in the recommendation list:

FIG. 6F shows the second program (1) as manually recommended as (1) in FIG. 6G;

FIG. 6F shows the second program (2) as manually recommended as (2) in FIG. 6G;

fig. 6F shows the first program (1) as my first half (season one) free in fig. 6G, wherein the free prompt text information, i.e. the first message, indicates that the user can view the diversity content of the first season of the first program by clicking the icon compared with the first program of the DTV video source, and the playing progress of the first program can be controlled, and the functions of on-demand, actor identification, etc. can be realized.

Fig. 6F the first program (2) is shown in fig. 6G as my first half (second season) corpus, wherein the corpus prompt text information, i.e., the second message indicates that the user can view the second season full diversity content of the first program by clicking on the icon as compared to the first program from the DTV video source, it is noted that in some embodiments the recommended video with corpus prompt text information requires pay-per-view.

Based on the above description of the video recommendation performed by the display device, the following description will discuss a method for performing video recommendation on the server side.

Fig. 9 is a flowchart illustrating a video recommendation method according to another embodiment of the present application.

In step 901, a search is performed in a media asset library of a server based on a first name of a first program transmitted from a display device, and if there is a first program identical to the first name, a recommendation list is generated.

The server for realizing video recommendation comprises a second controller, the server receives a first name of a first program sent by display equipment, the second controller searches media asset information in a media asset library of the server based on the first name, and if video resources identical to the first name of the first program exist in the self media asset library of the server, a corresponding recommendation list is generated according to whether the video resources are updated to a complete set or whether the video resources are free.

In some embodiments, when receiving a map-identifying recommendation request sent by a display device, a server determines whether a first media file having the same content as a first program played by a play window of the display device can be provided in the server; feeding back to a display device a message characterizing that the first media file can be provided, or a message characterizing that the first media file cannot be provided.

For example, the server receives a map recognition request sent from a display device, wherein the map recognition request comprises a screenshot of an image of the first program; identifying the screenshot according to the image identifying request and determining a first name of a first program corresponding to the screenshot; and determining whether the server can provide the media file corresponding to the first name or not according to the first name.

For another example, when the image recognition request received by the server includes a first identifier indicating that a video source of the first program is a DTV video source, identifying a station caption in the screenshot, determining a first name of the first program according to a program list of a station corresponding to the station caption, and determining whether a first media file with the same content as the first program can be provided in the server according to the first name; when the received image recognizing request comprises a second identifier representing that a video source of the first program is an ATV video source or an HDMI video source, recognizing characters and/or images in the screenshot, inquiring a first name of the first program according to the recognized characters and/or images, and determining whether a first media file with the same content as the first program can be provided in the server according to the first name. The detailed UI interface, operation, or description thereof has been set forth in the above display device section, and is not repeated here.

In some embodiments, the server-generated recommendation list includes the first program and the second program. Wherein the first program is configured by the second controller to include text information for free prompts, or for full set prompts; a second program configured by the second controller to specify a program, or ad slot. The detailed UI interface, operation, or description thereof has been set forth in the above display device section, and is not repeated here.

In some embodiments, if a first media file video resource with the same first name as the first program does not exist in the media asset library of the server, the second controller generates an identifier that no recommended video exists, and sends the identifier to the display device, and the display device continues to play the video program of the original video source channel.

In step 902, the recommendation list is sent to a display device.

The second controller will send the generated recommendation list to the display device and in some embodiments will also send the presence recommendation list identification to the display device. In some embodiments, when the display device provided by the present application receives a recommendation list and a recommendation list identifier sent by a server, a first controller displays a prompt control, that is, a first interactive element, as a prompt on a top layer of a television UI, and prompts a user to perform an operation.

Fig. 10 shows a logic diagram of a video recommendation method according to an embodiment of the present application.

When detecting that a video source of a first program of a currently watched video is a non-preset application, a first controller detects whether a switch of a picture recognition recommendation function of a display device is turned on or not;

if the switch of the graph identifying recommendation function is in an off state, continuously watching a first program of an original video source; otherwise, video recommendation is executed according to different video sources;

when a video source for playing a first program is a DTV (digital television), a first controller acquires a television station icon of the first program as a first characteristic, and acquires a program list of the television station according to the icon to further acquire a first name of the first program; when the video source is an ATV or HDMI, the first controller performs video screenshot on the first program, and then performs program identification through video image identification to obtain a first name of the first program. It is noted that, in some embodiments, identifying the first name of the first program based on the first characteristic may be implemented at the display device side; in other embodiments, identifying the first name of the first program based on the first characteristic may be implemented at a server side.

In some embodiments, the first controller displays a prompt control on the playing window, including the first controller loading a first message on the prompt control on the playing window when the first media file is characterized as a free resource according to the feedback from the server; or loading a second message on the prompt control on the playing window according to the characteristic that the first media file fed back by the server is the paid resource.

The server inquires in a cloud-side medium resource base based on a first name of a first program sent by the display device so as to determine whether medium resources corresponding to the first program exist.

If the corresponding media assets do not exist in the cloud media asset library, namely the first media file, the display equipment continues to play the video program of the original video source; otherwise, whether the media assets of the first media file of the cloud recommended video are free or not is detected.

If the information is free, prompting the free-of-charge viewing complete set in a recommendation list or a prompt control to serve as the first information; otherwise, prompting to click to see the complete set as the second message.

Fig. 11 is a schematic diagram illustrating operation timing sequences of a display device and a server in video recommendation according to an embodiment of the present application.

In step 1101, when the video source of the first program is not a preset application, first, the first controller of the display device needs to determine the video source of the current first program, for example, determine that the video source is DTV, ATV, or HDMI.

In step 1102, a first controller of the display device determines that a map recognition recommendation function is in an on state, and executes video recommendation; otherwise, no video recommendation is made.

In step 1103, the first controller determines a video source type identifier and performs a screenshot on the first program.

In some embodiments, the video source type is identified as the video source detection result in step 1101. According to different detection results of the video source, 1104-1 or 1104-2 steps are respectively executed.

In step 1104-1, when a video source of the first program played by the display device is a DTV, the first controller identifies a tv station icon through a screenshot, and determines a program list corresponding to the tv station to obtain a first name of the first program; in step 1104-2, when the video source of the first program played by the display device is ATV or HDMI, the first controller obtains the first name of the first program by performing image recognition and retrieval on the screenshot.

In step 1105, the server receives a first name of a first program from the display device, and a second controller of the server queries whether the same program asset exists in the server based on the first program name. If the same program assets exist, the second controller generates a recommendation list and a recommendation list existence identifier; if the same program asset does not exist, the second controller only generates an absence of recommendation list identification.

In some embodiments, when a first media file with the same content as the first program exists in the server, a prompt control is displayed on the playing window, and the prompt control is used for jumping to a description interface of the first media file provided by the server after receiving a confirmation operation of a user; and when the server does not store the first media file, not displaying the prompt control.

In step 1106, when a video recommendation is generated, the second controller of the server sends the generated recommendation list and the identification of the existing recommendation list to the display device; and when the video recommendation is not generated, the second controller of the server sends the non-existing recommendation list identification to the display equipment.

In some embodiments, a first controller of a display device captures an image of the first program played by the play window; the first controller sends a picture-identifying request to a server according to the screenshot, wherein the picture-identifying request comprises the screenshot, and the picture-identifying request is used for enabling the server to identify the screenshot and determine whether a first media file which is the same as the first program content can be provided in the server or not; and the server feeds back a message which represents that the first media file can be provided or a message which represents that the first media file cannot be provided to the display device.

In step 1107, the first controller of the display device controls the display to display a prompt control, where the prompt control is used to jump to a description interface of the first media file provided by the preset server after receiving a confirmation operation from the user.

Based on the embodiments described above, the present application further provides a display device, where the same parts as the above embodiments are not described again in the following embodiments, and the differences from the above embodiments will be explained below.

In some embodiments, the present application provides a display device comprising: a display for displaying a user interface; the first controller is configured to intercept an image of a first program played by the display to obtain a first characteristic and send the first characteristic to a server; a first interactive element including a recommendation list is displayed on the display, the recommendation list and programs included therein being from a server.

Compared with the foregoing, in this embodiment, the first controller sends the first feature of the first program to the server, that is, the server parses the first name of the first program according to the first feature of the first program. The first controller obtains the first characteristic, displays the first interactive element, and displays other similar technical characteristics of the display device, which are described in detail above and are not described herein again.

Based on the embodiments described above, the present application further provides a server, where the following embodiments are not described again where the same as the above embodiments, and the following differences from the above embodiments will be explained.

In some embodiments, the server provided herein comprises a second controller configured to: when a map-identifying recommendation request sent by a display device is received, determining whether a first media file which has the same content as a first program played by a playing window of the display device can be provided in the server; feeding back to a display device a message characterizing that the first media file can be provided, or a message characterizing that the first media file cannot be provided.

In some embodiments, the second controller, in determining whether the server can provide the first media file with the same content as the first program played by the display device playing window, comprises: the second controller receives a map recognizing request sent by a display device, wherein the map recognizing request comprises a screenshot of an image of the first program; identifying the screenshot according to the image identifying request and determining a first name of a first program corresponding to the screenshot; and determining whether the server can provide the media file corresponding to the first name or not according to the first name.

For example, when the received map recognizing request includes a first identifier that a video source representing the first program is a DTV video source, a station caption in the screenshot is recognized, a first name of the first program is determined according to a program list of a station corresponding to the station caption, and whether a first media file with the same content as the first program can be provided in the server is determined according to the first name.

When the received image recognizing request comprises a second identifier representing that a video source of the first program is an ATV video source or an HDMI video source, recognizing characters and/or images in the screenshot, inquiring a first name of the first program according to the recognized characters and/or images, and determining whether a first media file with the same content as the first program can be provided in the server according to the first name.

In some embodiments, the server provided by the present application includes a second controller configured to parse a first name of a first program based on a first feature sent from a display device; searching in a media asset library based on the first name, and if a first program with the same name exists, generating a recommendation list; and sending the recommendation list to a display device.

In contrast to the foregoing, in the embodiment, the second controller parses the first name of the first program according to the first feature of the first program sent by the display device. The second controller obtains the name of the first program, generates the recommendation list, retrieves the recommended media assets, and other similar and similar technical features of the server, which have been described in detail above, and are not described herein again.

Fig. 12 is a schematic timing diagram illustrating operations of a display device and a server in video recommendation according to another embodiment of the present application.

In step 1201, when the video source of the first program is not the preset application, first the first controller of the display device needs to determine that the current video source is the non-preset application, for example, determine that the video source is DTV, ATV, or HDMI.

In step 1202, if the first controller of the display device determines that the map recognition recommendation function is in an on state, video recommendation is performed; otherwise, no video recommendation is made.

In step 1203, the first controller determines a video source type identifier, captures a video source type identifier and plays a program, and then sends the video source identifier and the captured video to the server.

In some embodiments, the video source type is identified as the video source detection result in step 1101. The server second controller will perform steps 1104-1 or 1104-2, respectively, depending on the video source detection results.

In step 1204-1, when the video source of the first program played by the display device is the DTV, the second controller of the server identifies the tv station icon through the screenshot, and determines the program list corresponding to the tv station, thereby obtaining the first name of the first program; in step 1104-2, when the video source of the first program played by the display device is an ATV or an HDMI, the second controller of the server obtains the first name of the first program by performing image recognition and retrieval on the screenshot.

In step 1205, the server queries whether the same program asset, i.e., the first media file, exists in the server based on the first name of the first program. If the same program assets exist, the second controller generates a recommendation list and a recommendation list identifier; if the same program asset does not exist, the second controller only generates an absence of a recommendation list identification.

In step 1206, when a video recommendation is generated, the second controller of the server sends the generated recommendation list and the identification of the existing recommendation list to the display device; and when the video recommendation is not generated, the second controller of the server sends the non-existing recommendation list identification to the display equipment.

In step 1207, the first controller of the display device controls the display device to display a prompt control, where the prompt control is configured to jump to a description interface of the first media file provided by the preset server after receiving a confirmation operation of the user.

The method and the device have the advantages that the video recommendation function can be automatically started by acquiring the states of the video source and the image recognition recommendation switch of the display equipment; furthermore, by detecting a video source through frequency reduction, the optimization of the television system resource can be realized; furthermore, by remotely configuring a recommendation strategy, complaints to the user can be independently processed at the server side; further, by obtaining the first name of the program, whether the first program exists in the server can be searched and confirmed; further, by constructing the first media file, the acquisition of the recommended video can be realized; and further, by constructing a prompt control, the operation and the instant acquisition of the recommended video by the user can be realized, the competitive media assets of the television self-contained application can be accessed by the user, the frequency of accessing the television application by the user is improved, and the recall of the off-network user is realized.

Moreover, those skilled in the art will appreciate that aspects of the present application may be illustrated and described in terms of several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereon. Accordingly, various aspects of the present application may be embodied entirely in hardware, entirely in software (including firmware, resident software, micro-code, etc.) or in a combination of hardware and software. The above hardware or software may be referred to as "data block," controller, "" engine, "" unit, "" component, "or" system. Furthermore, aspects of the present application may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.

The computer storage medium may comprise a propagated data signal with the computer program code embodied therewith, for example, on baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, etc., or any suitable combination. A computer storage medium may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code located on a computer storage medium may be propagated over any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or any combination of the preceding.

Computer program code required for operation of various portions of the present application may be written in any one or more programming languages, including an object oriented programming language such as Java, scala, smalltalk, eiffel, JADE, emerald, C + +, C #, VB.NET, python, and the like, a conventional programming language such as C, visual Basic, fortran 2003, perl, COBOL 2002, PHP, ABAP, a dynamic programming language such as Python, ruby, and Groovy, or other programming languages, and the like. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any form of network, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service using, for example, software as a service (SaaS).

Additionally, the order in which elements and sequences of the processes described herein are processed, the use of alphanumeric characters, or the use of other designations, is not intended to limit the order of the processes and methods described herein, unless explicitly claimed. While various presently contemplated embodiments of the invention have been discussed in the foregoing disclosure by way of example, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements that are within the spirit and scope of the embodiments herein. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described system on an existing server or mobile device.

Similarly, it should be noted that in the foregoing description of embodiments of the application, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the embodiments. This method of disclosure, however, is not intended to imply that more features are required than are expressly recited in the claims. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.

Each patent, patent application publication, and other material, such as articles, books, specifications, publications, documents, and the like, cited in this application is hereby incorporated by reference in its entirety. Except where the application is filed in a manner inconsistent or contrary to the present disclosure, and except where the claim is filed in its broadest scope (whether present or later appended to the application) as well. It is to be understood that the descriptions, definitions and/or uses of terms in the attached materials of this application shall control if they are inconsistent or inconsistent with the statements and/or uses of this application.

Claims

1. A display apparatus, wherein video sources of the display apparatus include a preset application and other video sources, the other video sources being any one of ATV, DTV and HDMI, the display apparatus comprising:

the display is used for displaying a user interface, and a playing window is arranged in the user interface;

a first controller configured to:

when a first program is played, detecting a video source of the first program;

when the video source of the first program is the preset application, not performing a video recommendation step, wherein the video recommendation step is used for recommending a server corresponding to the preset application to perform video recommendation;

when the video source of the first program is other video sources, executing the video recommending step;

wherein the video recommendation step comprises: capturing a picture of a first program, and sending the captured picture to the server corresponding to the preset application, wherein the captured picture is used for enabling the server to determine whether a first media file with the same content as the first program can be provided or not;

receiving feedback sent by the server after responding to the screenshot;

when the feedback indicates that the first media file exists in the server, displaying a prompt control on a playing window according to the feedback, wherein the prompt control is used for jumping to the preset application after receiving confirmation operation of a user so as to display a description interface of the first media file provided by the server;

and when the feedback indicates that the first media file does not exist in the server, not displaying the prompt control.

2. The display device of claim 1, wherein the first controller determining whether the first media file having the same content as the first program can be provided in the server comprises:

the first controller acquires a first name of the first program;

determining whether the server can provide the media file corresponding to the first name or not according to the first name;

the first name of the first program is determined from the screenshot.

3. The display device of claim 2, wherein the first controller to determine the first name of the first program from the screenshot comprises: the first controller

Identifying a station caption in the screenshot;

and determining the first name of the first program according to the station caption and the program list of the radio station corresponding to the station caption.

4. The display device of claim 2, wherein the first controller determining the first name of the first program from the screenshot comprises: the first controller

Sending a picture-reading request to the server according to the screenshot, wherein the picture-reading request comprises the screenshot, and the picture-reading request is used for enabling the server to identify the screenshot and determine a first name corresponding to the screenshot;

and receiving the first name fed back by the server.

5. The display device of claim 2, wherein the first controller determining the first name of the first program from the screenshot comprises: the first controller

Identifying characters or images in the screenshot;

and determining a first name corresponding to the identified characters or images according to the identified characters or images and a preset mapping relation, wherein the preset mapping relation is the mapping of program names and characters/images.

6. The display device of claim 1, wherein the first controller determining whether the first media file having the same content as the first program can be provided in the server comprises: the first controller

Capturing the image of the first program played by the playing window;

sending a picture identifying request to the server according to the screenshot, wherein the picture identifying request comprises the screenshot, and the picture identifying request is used for enabling the server to identify the screenshot and determine whether a first media file with the same content as the first program can be provided in the server or not;

receiving a message fed back by the server indicating that the first media file can be provided or a message indicating that the first media file cannot be provided.

7. The display device as claimed in claim 4, wherein the first controller sends a map recognition request to the server according to the screenshot, the map recognition request including the screenshot, the map recognition request being used for enabling the server to recognize the screenshot and determine whether a first media file with the same content as the first program can be provided in the server, including: the first controller

When the video source of the first program is a DTV video source, sending a map identifying request to the server according to the screenshot, wherein the map identifying request comprises the screenshot and a first identifier indicating that the video source of the first program is the DTV video source, the map identifying request is used for enabling the server to respond to the first identifier, identify a station logo in the screenshot, and determine a first name of the first program according to a program list of a station corresponding to the station logo, and the server is further used for determining whether a first media file with the same content as the first program can be provided in the server according to the first name;

when the video source of the first program is an ATV video source or an HDMI video source, sending an image recognizing request to the server according to the screenshot, wherein the image recognizing request comprises the screenshot and a second identifier representing that the program source of the first program is the ATV or the HDMI video source, the image recognizing request is used for enabling the server to respond to the second identifier, recognize characters and/or images in the screenshot, query a first name of the first program according to the recognized characters and/or images, and the server is further used for determining whether the server can provide a first media file with the same content as the first program according to the first name.

8. The display device of claim 1, wherein said displaying a prompt control on the play window in accordance with the feedback comprises:

and displaying a prompt control containing a recommendation list on the playing window, wherein the first media file exists in a recommendation list form.

9. The display device of claim 1, wherein the first controller, prior to determining whether the first media file having the same content as the first program is available in the server, the first controller

Determining whether the display equipment starts a function of image recognition recommendation;

if the server is started, detecting whether the current time and/or the recommendation frequency meet the recommendation strategy, and if the television meets the recommendation strategy, starting to execute a video recommendation step by the television to determine whether a first media file with the same content as the first program can be provided in the server; wherein the recommendation policy is remotely configurable by a server; the recommendation strategy comprises at least one or more of the combination of the recommendation forbidding date, the recommendation forbidding time interval and the maximum daily recommendation times;

if not, continuing to play the first program, and not executing the step of determining whether the server can provide the first media file with the same content as the first program.

10. The display device of claim 1, wherein the first controller displays a prompt control on the play window, comprising: the first controller

Loading a first message on a prompt control on the playing window according to the fact that the first media file is a free resource and is characterized by being fed back by a server; or the like, or a combination thereof,

and loading a second message on a prompt control on the playing window according to the characteristic that the first media file is a paid resource fed back by the server.

11. A server, comprising:

a second controller configured to:

receiving a first program screenshot sent by a display device, wherein the first program screenshot is sent by the display device when detecting that a video source of a played first program is other video sources, the other video sources are any one of an ATV (advanced television), a DTV (digital television) and an HDMI (high definition multimedia interface), and the other video sources are different from a preset application; the display device is further configured to not make a video recommendation when the video source of the first program is the preset application;

responding to the screenshot, and determining whether a first media file which has the same content as a first program played by a playing window of the display equipment can be provided in the server or not;

sending feedback to the display device, so that when the first media file exists in the feedback representation server, the feedback is used for enabling the display device to display a prompt control on a playing window, and the prompt control is used for skipping to the preset application after receiving confirmation operation of a user, so as to display a description interface of the first media file provided by the server; and when the feedback characterization server does not exist the first media file, the display device does not display the prompt control.

12. The server according to claim 11, wherein the second controller, in determining whether the server can provide the first media file having the same content as the first program played in the play window of the display device, comprises: the second controller

Receiving a map recognizing request sent by a display device, wherein the map recognizing request comprises a screenshot of an image of the first program;

identifying the screenshot according to the image identifying request and determining a first name of a first program corresponding to the screenshot;

and determining whether the server can provide the media file corresponding to the first name or not according to the first name.

13. The server of claim 12, wherein the second controller receives a map recognition request sent from a display device, the map recognition request including a screenshot of an image of the first program; identifying the screenshot according to the image identifying request and determining a first name of a first program corresponding to the screenshot; determining whether the server can provide the media file corresponding to the first name according to the first name comprises: the second controller

When the received image recognizing request comprises a first identifier for representing that a video source of the first program is a DTV video source, recognizing a station caption in the screenshot, determining a first name of the first program according to a program list of a radio station corresponding to the station caption, and determining whether a first media file with the same content as the first program can be provided in the server according to the first name;

14. A method for video recommendation, the method comprising:

when a first program is played, detecting a video source of the first program; the video source of the display device comprises a preset application and other video sources, wherein the other video sources are any one of ATV, DTV and HDMI;

wherein the video recommendation step comprises: screenshot is conducted on an image of a first program, and the screenshot is sent to the server corresponding to the preset application, wherein the screenshot is used for enabling the server to determine whether a first media file with the same content as the first program can be provided or not;

receiving feedback sent by the server after responding to the screenshot;

when the feedback indicates that the first media file exists in the server, displaying a prompt control on a playing window according to the feedback; the prompt control is used for jumping to the preset application after receiving a confirmation operation of a user so as to display a description interface of the first media file provided by the server;

15. The method of video recommendation of claim 14, wherein said screenshot is used to capture a first feature corresponding to said first program;

when the video source of the first program is a DTV, the first characteristic is a TV station icon in a screenshot;

when the video source of the first program is an ATV or an HDMI, the first feature is the screenshot.

16. A method for video recommendation, the method comprising: