CN112804567B

CN112804567B - Display equipment, server and video recommendation method

Info

Publication number: CN112804567B
Application number: CN202110003302.4A
Authority: CN
Inventors: 黄山山; 王宝云
Original assignee: Qingdao Jukanyun Technology Co ltd
Current assignee: Qingdao Jukanyun Technology Co ltd
Priority date: 2021-01-04
Filing date: 2021-01-04
Publication date: 2023-04-21
Anticipated expiration: 2041-01-04
Also published as: CN112804567A

Abstract

The present disclosure relates to the field of communications technologies, and in particular, to a display device, a server, and a video recommendation method. The problem of poor accuracy of video recommendation to specific users can be solved to a certain extent. The display device includes: a display; a first controller configured to: sending a second video recommendation request comprising first video information and the display equipment binding account to a server, wherein the first video information represents a first video which is played in response to user operation in a current time period, and is used for enabling the server to determine a first user portrait according to the video type of the first video information and determine a second recommendation media file, the first user portrait is one of a plurality of user portraits corresponding to the display equipment binding account, and time periods corresponding to different user portraits are different; receiving the second recommended media file information sent by the server; and displaying the recommended media file information by a recommendation control in a user interface.

Description

Display equipment, server and video recommendation method

Technical Field

The present disclosure relates to the field of communications technologies, and in particular, to a display device, a server, and a video recommendation method.

Background

The video recommendation is to automatically recommend and present the video related to the video watched by the user to the user according to the watching record of the television of the user, so that the manual searching of the user can be avoided, the user can be helped to find the video of interest, and the stay time of the user on a video website is prolonged.

In some video recommendation implementations, a user views a video through a pre-installed application program of a television, then obtains a viewing record of the user in the application program, searches related videos, determines similarity between the videos, and then recommends the video to the user according to the similarity.

However, at present, most of the households use an account corresponding to the smart television, one account is commonly used by a plurality of household members, such as executive parents, old people and children, interests of different household members are quite different, video is recommended based on the history play record completely, and video liked by the A member is recommended to the B member.

Disclosure of Invention

In order to solve the problem that video recommendation is poor in accuracy for specific users, the application provides display equipment, a server and a video recommendation method.

Embodiments of the present application are implemented as follows:

a first aspect of an embodiment of the present application provides a server, including: a second controller configured to: receiving a second video recommendation request which is sent by display equipment and contains first video information and an account number bound by the display equipment, wherein the first video information represents a first video which is played in response to user operation in a current time period; determining a first user portrait according to the video type represented by the first video information, wherein the first user portrait is one of a plurality of user portraits corresponding to the binding account of the display equipment, and the time periods corresponding to different user portraits are different; determining a second recommended media file according to the historical operation information of the first user portrait when the first user portrait is different from the user portrait corresponding to the current time period; when the first user portrait is the same as the user portrait corresponding to the current time period, determining a second recommended media file according to the historical operation information of the user portrait corresponding to the current time period; and sending the second recommended media file information to the display equipment so that the display equipment displays the second recommended media file information.

A second aspect of embodiments of the present application provides a display device, including: a display; a first controller configured to: sending a second video recommendation request containing first video information and the display equipment binding account to a server, wherein the first video information represents a first video which is played in response to user operation in a current time period, the second video recommendation request is used for enabling the server to determine a first user portrait according to the video type represented by the first video information, and determine a second recommendation media file according to historical operation information of the first user portrait, the first user portrait is one of a plurality of user portraits corresponding to the display equipment binding account, and time periods corresponding to different user portraits are different; receiving the second recommended media file information sent by the server; and displaying the recommended media file information by a recommendation control in a user interface.

A third aspect of embodiments of the present application provides a method for video recommendation, the method comprising: receiving a second video recommendation request which is sent by display equipment and contains first video information and an account number bound by the display equipment, wherein the first video information represents a first video which is played in response to user operation in a current time period; determining a first user portrait according to the video type represented by the first video information, wherein the first user portrait is one of a plurality of user portraits corresponding to the binding account of the display equipment, and the time periods corresponding to different user portraits are different; determining a second recommended media file according to the historical operation information of the first user portrait when the first user portrait is different from the user portrait corresponding to the current time period; when the first user portrait is the same as the user portrait corresponding to the current time period, determining a second recommended media file according to the historical operation information of the user portrait corresponding to the current time period; and sending the second recommended media file information to the display equipment so that the display equipment displays the second recommended media file information.

A fourth aspect of an embodiment of the present application provides a method for video recommendation, the method including: sending a second video recommendation request containing first video information and the display equipment binding account to a server, wherein the first video information represents a first video which is played in response to user operation in a current time period, the second video recommendation request is used for enabling the server to determine a first user portrait according to the video type represented by the first video information, and determine a second recommendation media file according to historical operation information of the first user portrait, the first user portrait is one of a plurality of user portraits corresponding to the display equipment binding account, and time periods corresponding to different user portraits are different; receiving the second recommended media file information sent by the server; and displaying the recommended media file information by a recommendation control in a user interface.

The beneficial effects of this application: by constructing the first video recommendation request, the video recommendation file based on the time period can be timely acquired after the display equipment is started; further, by constructing a second video recommendation request, the server can judge whether the display equipment is shared or not and recognize the current first user portrait; further, by constructing the third video recommendation request, the server can identify more accurate first user portraits based on more video information, divide multiple interests, recall the user interests according to the current user based on the user real-time behaviors, recommend videos based on the user interests updated in real time, and improve accuracy of video recommendation.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the prior art descriptions, it being obvious that the drawings in the following description are some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.

FIG. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment;

fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment;

fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment;

fig. 4 shows a system configuration block diagram of the display device 200 in accordance with an exemplary embodiment;

FIG. 5 illustrates a schematic diagram of an application interface in a display device 200 in accordance with an exemplary embodiment;

FIG. 6 shows a schematic diagram of a display device application user interface according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a display device video recommendation user interface according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a display device video recommendation user interface according to another embodiment of the present application;

FIG. 9 is a schematic diagram of a display device video recommendation user interface according to another embodiment of the present application;

FIG. 10 is a logic diagram of a display device video recommendation according to an embodiment of the present application;

fig. 11 shows a logic schematic diagram of a display device and a server implementing video recommendation according to an embodiment of the present application.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above drawings are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet, computer, notebook, AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. For example, software steps executed by the server may migrate to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAMRandom Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode according to a standard codec protocol of an input signal, and at least one of noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (simply "application layer"), an application framework layer (Application Framework) layer (simply "framework layer"), a An Zhuoyun row (Android run) and a system library layer (simply "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the display device may directly enter the preset vod program interface after being started, where the vod program interface may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change with the change of the selected control in the navigation bar. The program in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter the display interface of the signal source selected last time after being started, or the signal source selection interface, where the signal source may be a preset video on demand program, or may be at least one of an HDMI interface, a live tv interface, etc., and after the user selects a different signal source, the display may display the content obtained from the different signal source.

The embodiment of the application can be applied to various display devices and servers (including but not limited to devices such as intelligent televisions, mobile terminals, tablet computers, set top boxes and the like). The following describes a display device, a server, and a method for recommending video by taking a technical scheme and a user interface for realizing video recommendation in an interaction process of the smart television and the server as an example.

FIG. 6 shows a schematic diagram of a display device application user interface according to an embodiment of the present application.

The display device provided by the application comprises a display and a first controller. The display is used for displaying a user interface, and the user interface comprises a playing window for playing video.

In some embodiments the application UI interface includes 4 applications installed on the television, news headlines, theatre on demand, video on demand, K songs, etc., respectively. By moving the focus on the display screen using a controller such as a remote control, a different application, or other function buttons, may be selected. .

In some embodiments, the user interface may also present interactive elements, which may include, for example, a television home control, a search control, a message button control, a mailbox control, a browser control, a favorites control, a signal bar control, etc., and different applications, function buttons may be selected by moving focus on the display screen using a controller such as a remote control.

In order to improve convenience and visualization of a television UI, in some embodiments, a first controller of the display device in embodiments of the present application controls the UI of the television in response to an operation on the interactive element. For example, the user clicks the network connection icon through a controller such as a remote controller, so that a network setting interface can be activated, and a UI thereof is displayed on the top of the global UI, so that an application component UI for controlling the mapping of the interactive elements becomes larger, or the application component UI runs and is displayed in a full screen.

In some embodiments, the interactive elements may also be operated by sensors, which may be but are not limited to acoustic input sensors, such as microphones configured by a display device, that may detect voice commands including indications of desired interactive elements. For example, the user may identify a desired interactive element, such as a video-on-demand application, using "video-on-demand" or any other suitable identification, and may also describe that a desired action associated with the desired interactive element is to be performed. The first controller may recognize the voice command and submit data characterizing the interaction to the UI or a processing component or engine thereof.

In some embodiments, the present application provides a display device, where after the display device is turned on, and when a user does not perform an operation of video playing, a first controller of the display device sends a first video recommendation request including a binding account of the display device.

The server comprises a second controller, wherein the second controller receives a first video recommendation request which is sent by the display equipment and contains the display equipment binding account number, and provides a first recommended media file according to historical operation information of a user portrait corresponding to a current period.

For example, when a user watches a video through a pre-installed video application of the smart television, the historical operation information, i.e. the historical play record, of the user can be stored locally on the smart television; in some embodiments, the history play record may also be uploaded to a server, where the binding account number of the history play record has a mapping relationship with the history play record, and the history play record corresponding to the current display device may be determined by the binding account number; and performing video recommendation based on the historical play record and the user interests corresponding to the current binding account in the current period through a video recommendation algorithm.

In the case that there are a plurality of users, or individual users, for a real device, each user corresponds to a user portrait corresponding to a type of video played by the display device for a specific time period. Therefore, when the display device is started up and does not perform any video-on-demand operation, the second controller of the server determines the first recommended media file according to the historical operation information of the user portrait corresponding to the current period of time of the first video recommendation request.

In some embodiments, the first controller responds to the startup operation, and makes a user interest consistency judgment based on a historical play record corresponding to the binding account to determine the type of the binding account; or responding to the starting operation, sending an account type judging instruction containing the binding account to a server, wherein the account type judging instruction is used for enabling the server to judge the user interest consistency according to the historical play record corresponding to the binding account so as to determine the type of the binding account and issue the binding account.

In some embodiments, after receiving a second video recommendation request including first video information and a binding account of the display device, which is sent by the display device, if the second controller identifies that a user portrait corresponding to the binding account is one, determining a providable recommended media file according to historical operation information of the binding account;

and the second controller executes the step of determining the first user portrait according to the video type represented by the first video information when the second controller identifies the user portrait corresponding to the binding account as a plurality of user portraits.

For example, the server receives a second video recommendation request which is sent by the display device and contains the binding account, and the server judges the type of the binding account, wherein the type comprises an independent account type, namely the binding account corresponds to 1 user portrait; and when the type of the binding account is a shared account, the binding account corresponds to a plurality of user portraits.

When the server determines the type of the binding account according to the binding account, the second controller can determine the type of the binding account by performing user interest consistency determination according to the historical play record corresponding to the binding account, for example, whether a plurality of family members are likely to exist in the account bound by the television or not is determined based on the user viewing behavior and the viewing historical play record, and different video recommendation logics are executed according to the account types.

In some embodiments, the server or display device may determine the display device binding account type by measuring user interest consistency using the following method.

Where a represents the user, ia represents the set of movies that user a likes, sim (i, j) represents the similarity of movie i and movie j, which can be derived based on the cosine function similarity of the movie's ebedding vector.

coh (a) represents the degree of uniformity of interest of user a, and when coh (a) is closer to 1, it represents that the user interest is more concentrated, and when coh (a) is closer to 0, it represents that the user interest is more dispersed, that is, a plurality of family members may be included.

Arranging coh (a) from large to small, for example, considering that 30% of households at the tail part contain a plurality of family members, and binding accounts into shared accounts; the rest are considered as single family members whose bound accounts are independent accounts.

In machine learning or deep learning models, the correlation of data is essentially obtained, and the embedding vector can map the characteristics of multimedia into a vector space and represent the characteristics by vectors. Conceptually, it involves mathematical embedding from a single feature one-dimensional space to a continuous vector space with lower dimensions. Methods of generating such mappings include neural network models, dimensionality reduction of word co-occurrence matrices, probabilistic models, and the like.

It should be noted that, the above multimedia data may include, but is not limited to, one or more of a picture, a video, or a moving picture file; the text information may be one or more keywords, long sentences or articles, or the like.

FIG. 7 is a schematic diagram of a display device video recommendation user interface according to an embodiment of the present application.

In some embodiments, the first controller sends a second video recommendation request including the first video information and the display device binding account to the server, the second video recommendation request for causing the server to determine a first user representation based on the video type characterized by the first video information and to determine a second recommended media file based on historical operating information of the first user representation.

And the first video information characterizes a first video which is played in a current time period in response to user operation, the first user portrait is one of a plurality of user portraits corresponding to the binding account of the display equipment, and the time periods corresponding to different user portraits are different.

For example, the user views a first video after the display device is powered on, which may be implemented as a movie, a television show, or other variety of shows; at this time, the first controller of the television sends a second video recommendation request to the server, where the video recommendation request carries the binding account number of the television and first video information, and the first video information may be implemented as a name, an ID, a code, or other media information capable of identifying the first video, for example.

And a second controller of the server receives a second video recommendation request which is sent by the display equipment and contains the first video information and the display equipment binding account number, and determines a first user portrait according to the video type represented by the first video information, wherein the first user portrait is one of a plurality of user portraits corresponding to the display equipment binding account number, and different user portraits correspond to different time periods.

For example, when the first video is a cartoon, its corresponding first user portrait is a child in a household, where other members may also be present, such as father, mother, grandpa, milk, etc.; each user in the home corresponds to a separate and distinct user representation, such as a second user representation, etc.

The user portraits correspond to the user's usage characteristics of the television, including film viewing type, viewing time period, viewing frequency, etc. The second controller can identify a first portrait user corresponding to the first video type through an algorithm according to the received first video information.

In some embodiments, when the first user portrait is different from the user portrait corresponding to the current time period, determining a second recommended media file according to the historical operation information of the first user portrait; and when the first user portrait is the same as the user portrait corresponding to the current time period, determining a second recommended media file according to the historical operation information of the user portrait corresponding to the current time period.

For example, when the type of the bound account is a shared account, the second controller compares the identified first user portrait with the user portrait corresponding to the current period, if the first user portrait can be matched with the user portrait, the second controller can conduct algorithm recommendation according to the historical operation information of the identified first user portrait, and the determined second recommended media file is sent to the display device.

The technical scheme is that the user behavior is assumed to have periodicity, the time of day is divided into fixed time periods by adopting a time period division mode, the user interest of each time period is analyzed, the user portraits are identified based on the time period information of the video recommendation request, then the available recommended media files are determined according to the user interest of the user portraits in the current time period, and then the recommended media files are sent to the display equipment.

In some embodiments, when multiple family members use the binding account of the smart tv, the server's fate controller classifies the user's interests based on the user's viewing behavior and time period characteristics.

For example, timestamp information of the root bound account historical play record divides the user viewing record into a plurality of specified time periods. This can be implemented as a 24 hour division: 5 to 10 points in the morning, 10 to 13 points, 13 to 15 points, 15 to 17 points, 17 to 19 points, 19 to 22 points and 22 to 4 points in the morning.

The method for extracting the user interest of each time period based on the historical play record of the time period comprises a plurality of methods, and the method is not limited by the method for extracting the user interest.

For another example, the smart tv is a shared account, and the home user includes baby, dad, and mom. In general, the television time is 16:00 pm, the user portrait corresponding to the time period is a baby, the user interface of the recommended media file acquired by the television at the time is shown in fig. 7, and the description information of the recommended media file provided by the server second controller according to the historical play record of the user portrait baby corresponding to the current time period can comprise cartoon type films and intelligent type films.

Typically, dad uses television time around 20:00 a.m., and a user interface for recommending media files at this time is shown in fig. 8, and film types are history and anti-day types.

But 4 pm on day: 30 dad uses the television, and the second controller of the server provides recommended media file description information according to the historical play record and the time period corresponding to the user interest, which can include historical movies and anti-day movies, and the implementation process will be described below.

FIG. 9 shows a schematic diagram of a display device video recommendation user interface in accordance with another embodiment of the present application.

For example, the description is based on the user interface shown in FIG. 7, at 16:30, when father does not have any operation, a first video recommendation request containing a television binding account number is sent to a server by the display device, the server identifies the corresponding user portrait as a baby according to the current period, and then historical operation information of the user portrait identified by the second controller determines a first recommendation media file which can be provided through an algorithm;

and displaying the first recommended media file information sent by the television receiving server in a recommendation control in a user interface, wherein the recommended media file information comprises 3 intelligent movies and 3 cartoon movies, as shown in fig. 7.

In some embodiments, if dad clicks on the video and after playing, for example, dad clicks on an action movie, i.e. the first video, the display device will send a second video recommendation request containing the first video information to the server; the second controller identifies whether the binding account number contained in the second video recommendation request corresponds to a plurality of user portraits, if the user portraits are a plurality of, the corresponding first user portraits are identified as dad according to the first video information contained in the second controller, and the first user portraits are different from the user portraits baby usually corresponding to the television in the period, so that the server carries out video recommendation according to the first portraits as dad.

In some embodiments, the second controller matches the closest interest history of the movie vector from the clustered interest library according to the vector of the movie, and changes the results of the recommended media file based on the current recalled interest assuming the recalled interest history is similar to an action, history.

In some embodiments, the second controller of the server reconfirms the first user portrait based on the second video information contained in the received third video recommendation request and/or the first video information received at the time of powering on the display device, wherein the more video information received in the current period, the higher the accuracy of the determined first user portrait.

For example, assuming that dad clicks a war tv show again, and the interest history recalled from the clustered interest library according to the movie vector is a spy war and a daily resistant, weighting calculation is performed based on actions, history, spy war and daily resistant interests, the second controller will send the determined second recommended media file information to the display device, so that the display device displays the second recommended media file information, and the recommended media file may be displayed as shown in fig. 9, for example.

In some embodiments, the second controller may implement an item2vec network model training movie ebedding vector based on user viewing behavior to calculate movie similarity and movie clustering.

There is a correlation between videos, and the historical behavior data of the user viewing the videos reflects the correlation between videos. This is because the real-time interests generated at the current time when the user views the video are related to the video being viewed at that time, and the user is more inclined to search for video viewing similar to the current video type, similar to actors, similar to directors, or the like when the user views the current video.

A plurality of video sequences with front-to-back relevance are determined in all user historical behavior data to be used as samples for training the neural network model, and after the neural network model is trained by adopting the video sequence samples, article vectors for each video can be determined, so that each video is represented by a vector.

The user vectors are related to the object vectors, which videos each user tends to watch are shown, and in consideration of the real-time interests and time correlation of the users, the correlation of the current interests and the recently watched videos of the users can be far greater than the correlation of the videos watched earlier, so that the user vectors corresponding to the users are determined according to the video sequences of the videos watched from near to far in time and the object vectors corresponding to the videos in the video sequences, which videos the users tend to watch, and the real-time interests of the users can be shown.

In some embodiments, for a plurality of family members corresponding to the bound account numbers, the server automatically classifies user interests based on user historical play records, and movie viewing behavior, based on clusters.

For example, the second controller clusters according to the user's viewing behavior and the video casting vector clicked by the user, wherein each cluster represents a history record of a virtual family member, user interest is extracted based on the clusters, each cluster has a cluster center, and the cluster center vector is represented by the cluster.

FIG. 10 is a logic diagram of a display device video recommendation according to an embodiment of the present application.

In some embodiments, when the display device is turned on, the server determines, according to the received account type determination instruction including the user binding account ID, whether the binding account is a shared account of multiple family members;

if the bound account is an independent account, executing a left-side general video recommendation flow, and determining available recommended media files according to a historical play record of the bound account;

if the binding account is a shared account, executing the following flow:

because the user is started for the first time and does not have any real-time video click watching behavior, the server obtains the user interests of the time period according to the current time period, namely, the user portraits corresponding to the current time period are identified and serve as basic interests to conduct video recommendation;

when a user plays a film, a play log of the user is sent to a back-end server in real time, the server obtains a film ID played by the user, obtains a film casting vector according to the film ID, calculates the similarity between the film casting vector and the center vector of each cluster, obtains the most similar cluster, obtains the user interest of the cluster to identify a first user portrait, and carries out video recommendation based on the user interest;

The steps of playing the film and updating the user interests according to the film played by the user are repeatedly performed, namely, as long as the film is played by the user, the server recalculates the updated user interests and the corresponding first user portraits, and then updates the recommended media file;

the more the user plays the film, the more votes of each cluster are obtained, the voting duty ratio is used as the weight, and the user interests of a plurality of clusters are weighted to be used as the user interests recommended by the user;

therefore, as the user plays the movie, the user interests can be updated in real time, and the recommended media files determined by the server second controller can also be updated in real time.

It can be understood that the intelligent television provided by the application can identify account sharing or be used independently, so that inaccuracy of regarding all television terminals as account sharing is avoided.

The television with account sharing is specially processed, interests of multiple people are segmented through time periods and a clustering mode, the user interests of multiple family members can be implicitly segmented through the clustering mode, the influence of the time periods is avoided, inaccuracy of video recommendation caused by the fact that the time period segmentation mode is simply utilized can be overcome, and the time period segmentation method depends on strict periodicity of playing behaviors of the users.

After the user interests of different users are segmented, the method conforming to the user interests of the current user can be recalled based on the user real-time behaviors, and the method can continuously identify the most similar historical user interests by utilizing the current behaviors according to the continuous real-time behaviors of the users, so that the current user interests are identified more accurately, and further more accurate video recommendation results are obtained.

Firstly, after a television is started, and when a user does not input video playing operation, the television sends a first video recommendation request containing a binding account number to a server;

the server receives the first video recommendation request, provides a first recommendation media file according to historical operation information of the user portrait corresponding to the current period, and sends the first recommendation media file to the television;

the television receives the first recommended media file information and displays the first recommended media file information;

the television responds to a first video which is played by user operation, and sends a second video recommendation request containing first video information and the display equipment binding account number to a server;

The server receives a second video recommendation request, and when the user portraits corresponding to the binding account number are identified as one, a recommendation media file is provided according to the historical operation information of the user portraits corresponding to the current period of time and the information is issued to the television; when the user portraits corresponding to the binding account number are identified to be a plurality of, determining a first user portraits according to the video type characterized by the first video information;

when the first user portrait is different from the user portrait corresponding to the current time period, the server determines a second recommended media file according to the historical operation information of the first user portrait; when the first user portrait is the same as the user portrait corresponding to the current time period, the server determines a second recommended media file according to the historical operation information of the user portrait corresponding to the current time period;

the server sends the second recommended media file information to the television so that the television displays the second recommended media file information;

responding to the second video which is played by the user operation, and sending a third video recommendation request containing second video information and a television binding account number to a server by the television;

the server receives a third video recommendation request, and reconfirms the first user portrait according to the second video information and/or the first video information; the more video information is received in the current period, the higher the accuracy of the first user portrait determined by the server.

Based on the above description of the video recommendation scheme implemented by the server, the application also provides a video recommendation method applied to the server, which comprises the following steps: receiving a second video recommendation request which is sent by display equipment and contains first video information and an account number bound by the display equipment, wherein the first video information represents a first video which is played in response to user operation in a current time period; determining a first user portrait according to the video type represented by the first video information, wherein the first user portrait is one of a plurality of user portraits corresponding to the binding account of the display equipment, and the time periods corresponding to different user portraits are different; determining a second recommended media file according to the historical operation information of the first user portrait when the first user portrait is different from the user portrait corresponding to the current time period; when the first user portrait is the same as the user portrait corresponding to the current time period, determining a second recommended media file according to the historical operation information of the user portrait corresponding to the current time period; and sending the second recommended media file information to the display equipment so that the display equipment displays the second recommended media file information. Specific operations and steps of the video recommendation method are described in detail in the above description of the server implementation scheme, and are not described herein.

In some embodiments, after receiving a second video recommendation request sent by a display device and including the first video information and the display device binding account, the method further includes: when the user portraits corresponding to the binding account are identified as one, determining available recommended media files according to the historical operation information of the binding account; and when the user portraits corresponding to the binding account number are identified to be a plurality of, executing the step of determining the first user portraits according to the video types characterized by the first video information. Specific operations and steps of the video recommendation method are described in detail in the above description of the server implementation scheme, and are not described herein.

In some embodiments, the method further comprises: receiving a first video recommendation request which is sent by display equipment and contains a display equipment binding account, wherein the first video recommendation request is sent when the display equipment is started and no operation for video playing is performed in response to user operation; and providing a first recommended media file according to the historical operation information of the user portrait corresponding to the current period. Specific operations and steps of the video recommendation method are described in detail in the above description of the server implementation scheme, and are not described herein.

In some embodiments, after receiving a second video recommendation request including the first video information sent by the display device, the method further includes: receiving a third video recommendation request which is sent by the display equipment and contains second video information, wherein the third video recommendation request is sent by the display equipment after the second video is confirmed to be played; and re-confirming the first user portrait according to the second video information and/or the first video information, wherein the more video information is received in the current period, the higher the accuracy of the determined first user portrait. Specific operations and steps of the video recommendation method are described in detail in the above description of the server implementation scheme, and are not described herein.

Based on the above description of the video recommendation scheme implemented by the display device, the application also provides a video recommendation method applied to the display device, which comprises the following steps: sending a second video recommendation request containing first video information and the display equipment binding account to a server, wherein the first video information represents a first video which is played in response to user operation in a current time period, the second video recommendation request is used for enabling the server to determine a first user portrait according to the video type represented by the first video information, and determine a second recommendation media file according to historical operation information of the first user portrait, the first user portrait is one of a plurality of user portraits corresponding to the display equipment binding account, and time periods corresponding to different user portraits are different; receiving the second recommended media file information sent by the server; and displaying the recommended media file information by a recommendation control in a user interface. Specific operations and steps of the video recommendation method are described in detail in the implementation scheme of the display device, and are not described herein.

The method and the device have the advantages that the video recommendation file based on the time period can be timely obtained after the display equipment is started up by constructing the first video recommendation request; further, by constructing a second video recommendation request, the server can judge whether the display equipment is shared or not and recognize the current first user portrait; further, by constructing the third video recommendation request, the server can identify more accurate first user portraits based on more video information, divide multiple interests, recall the user interests according to the current user based on the user real-time behaviors, recommend videos based on the user interests updated in real time, and improve accuracy of video recommendation.

Furthermore, those skilled in the art will appreciate that the various aspects of the invention are illustrated and described in the context of a number of patentable categories or circumstances, including any novel and useful procedures, machines, products, or materials, or any novel and useful modifications thereof. Accordingly, aspects of the present application may be performed entirely by hardware, entirely by software (including firmware, resident software, micro-code, etc.) or by a combination of hardware and software. The above hardware or software may be referred to as a "data block", "controller", "engine", "unit", "component" or "system". Furthermore, aspects of the present application may take the form of a computer product, comprising computer-readable program code, embodied in one or more computer-readable media.

The computer storage medium may contain a propagated data signal with the computer program code embodied therein, for example, on a baseband or as part of a carrier wave. The propagated signal may take on a variety of forms, including electro-magnetic, optical, etc., or any suitable combination thereof. A computer storage medium may be any computer readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code located on a computer storage medium may be propagated through any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or a combination of any of the foregoing.

The computer program code necessary for operation of portions of the present application may be written in any one or more programming languages, including an object oriented programming language such as Java, scala, smalltalk, eiffel, JADE, emerald, C ++, c#, vb net, python, etc., a conventional programming language such as C language, visual Basic, fortran 2003, perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, ruby and Groovy, or other programming languages, etc. The program code may execute entirely on the user's computer or as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any form of network, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service, for example, software as a service (SaaS).

Furthermore, the order in which the elements and sequences are presented, the use of numerical letters, or other designations are used in the application and are not intended to limit the order in which the processes and methods of the application are performed unless explicitly recited in the claims. While certain presently useful inventive embodiments have been discussed in the foregoing disclosure, by way of various examples, it is to be understood that such details are merely illustrative and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements included within the spirit and scope of the embodiments of the present application. For example, while the system components described above may be implemented by hardware devices, they may also be implemented solely by software solutions, such as installing the described system on an existing server or mobile device.

Likewise, it should be noted that in order to simplify the presentation disclosed herein and thereby aid in understanding one or more inventive embodiments, various features are sometimes grouped together in a single embodiment, figure, or description thereof. This method of disclosure, however, is not intended to imply that more features than are presented in the claims are required for the subject application. Indeed, less than all of the features of a single embodiment disclosed above.

Each patent, patent application publication, and other material, such as articles, books, specifications, publications, documents, etc., cited in this application is hereby incorporated by reference in its entirety. Except for application history documents that are inconsistent or conflicting with the present application, documents that are currently or later attached to this application for which the broadest scope of the claims to the present application is limited. It is noted that the descriptions, definitions, and/or terms used in the subject matter of this application are subject to such descriptions, definitions, and/or terms if they are inconsistent or conflicting with such descriptions, definitions, and/or terms.

Claims

1. A server, comprising:

a second controller configured to:

receiving a first video recommendation request which is sent after a display device is started and when video playing operation is not performed and contains a binding account, determining that the binding account corresponds to a plurality of user portraits when the interest consistency degree corresponding to the binding account is smaller than a threshold value, wherein the interest consistency degree is obtained according to the film similarity in a historical playing record of the binding account, and a calculation formula comprises:

Wherein a represents a user, ia represents a favorite film set of the user a, sim (i, j) represents similarity of film i and film j, the film similarity is obtained based on cosine function similarity of an ebedding vector of the film, coh (a) represents interest consistency of the user a, different time periods corresponding to different user images are different, and the first video recommendation request is used for enabling the second controller to determine a first recommendation media file according to the user images corresponding to the current time period;

transmitting first recommended media file information to the display device, so that the display device displays the first recommended media file information;

receiving a second video recommendation request which is sent by display equipment and contains first video information and the binding account, wherein the first video information represents a first video which is played in response to user operation in a current time period;

determining a first user portrait according to the video type represented by the first video information, wherein the first user portrait is one of a plurality of user portraits corresponding to the binding account of the display equipment;

determining a second recommended media file according to the historical operation information of the first user portrait when the first user portrait is different from the user portrait corresponding to the current time period; when the first user portrait is the same as the user portrait corresponding to the current time period, determining a second recommended media file according to the historical operation information of the user portrait corresponding to the current time period;

And sending the second recommended media file information to the display equipment so that the display equipment displays the second recommended media file information.

2. The server of claim 1, wherein the second controller is further configured to:

receiving a third video recommendation request which is sent by the display equipment and contains second video information, wherein the third video recommendation request is sent by the display equipment after the second video is confirmed to be played, and the second video information is video information corresponding to the first user portrait;

determining a third recommended media file according to the second video information, wherein the second video information is used for redefining the first user portrait, and the third recommended media file is determined based on the first user portrait;

and sending the third recommended media file information to the display device.

3. The server of claim 1, wherein the second controller, upon receiving a second video recommendation request containing the first video information sent by the display device, is further configured to:

receiving a third video recommendation request which is sent by the display equipment and contains second video information, wherein the third video recommendation request is sent by the display equipment after the second video is confirmed to be played, so that the real-time behavior recall of a user accords with the user interest of the current user, and the user interest is updated in real time to conduct video recommendation;

And re-confirming the first user portrait according to the second video information and the first video information, wherein the more video information is received in the current period, the higher the accuracy of the determined first user portrait.

4. A display device, characterized by comprising:

a display;

a first controller configured to:

after starting up and when video playing operation is not performed, a first video recommendation request containing a binding account of a display device is sent to a server, wherein the binding account corresponds to a plurality of user portraits, different time periods corresponding to the user portraits are different, the first video recommendation request is used for enabling the server to determine that the binding account corresponds to a plurality of user portraits when the interest consistency corresponding to the binding account is smaller than a threshold value, and the interest consistency is according to historical playing records of the binding accountThe similarity of the films is obtained, and the calculation formula comprises:

wherein a represents a user, ia represents a favorite film set of the user a, sim (i, j) represents similarity of film i and film j, the film similarity is obtained based on cosine function similarity of an ebedding vector of the film, coh (a) represents interest consistency of the user a, and a first recommended media file is determined according to a user portrait corresponding to a current time period;

Receiving the first recommended media file information sent by the server, and controlling a user interface to display the first recommended media file information;

sending a second video recommendation request containing first video information and the binding account number to a server, wherein the first video information represents a first video which is played in response to user operation in a current time period, the second video recommendation request is used for enabling the server to determine a first user portrait according to a video type represented by the first video information, and determine a second recommendation media file according to historical operation information of the first user portrait, and the first user portrait is one of a plurality of user portraits corresponding to the binding account number of the display equipment;

receiving the second recommended media file information sent by the server;

a recommendation control in the user interface displays the second recommended media file information.

5. The display device of claim 4, wherein the first controller, upon receiving the second recommended media file information sent by the server, is further configured to:

transmitting a third video recommendation request containing second video information to the server, wherein the third video recommendation request is used for enabling the server to determine a third recommended media file according to the first user portrait, the second video information is video information corresponding to the first user portrait, the more video information corresponding to the first user portrait is received by the server in the current period, the higher the accuracy of the determined first user portrait is, the third video recommendation request is transmitted after the second video is confirmed to be played, so that real-time behavior recall of a user accords with the user interest of the user corresponding to the first user portrait, and the user interest is updated in real time to conduct video recommendation;

And receiving the third recommended media file information sent by the server.

6. A method of video recommendation, the method comprising:

wherein a represents a user, ia represents a favorite film set of the user a, sim (i, j) represents similarity of film i and film j, the film similarity is obtained based on cosine function similarity of an ebedding vector of the film, coh (a) represents interest consistency of the user a, different time periods corresponding to the user images are different, and the first video recommendation request is used for determining a first recommendation media file according to the user images corresponding to the current time period;

transmitting the first recommended media file information to the display device so that the display device displays the first recommended media file information;

receiving a second video recommendation request which is sent by the display equipment and contains first video information and the binding account, wherein the first video information represents a first video which is played in response to user operation in a current time period;

7. The method of video recommendation of claim 6, wherein the method further comprises:

determining a third recommended media file according to the second video information, wherein the second video information is used for reconfirming the first user portrait, and the third recommended media file is determined based on the first user portrait;

And sending the third recommended media file information to the display device.

8. The method of video recommendation according to claim 6, wherein upon receiving a second video recommendation request containing first video information sent by the display device, the method further comprises:

9. A method of video recommendation, the method comprising:

after starting up and when video playing operation is not performed, a first video recommendation request containing a binding account of a display device is sent to a server, the binding account corresponds to a plurality of user portraits, different time periods corresponding to the user portraits are different, the first video recommendation request is used for enabling the server to determine that the binding account corresponds to a plurality of user portraits when the interest consistency corresponding to the binding account is smaller than a threshold value, and the interest consistency is obtained according to film similarity in a historical playing record of the binding account, and a calculation formula comprises:

receiving the second recommended media file information sent by the server;

10. The method of video recommendation according to claim 9, wherein upon receiving the second recommended media file information sent by the server, the method further comprises:

and receiving the third recommended media file information sent by the server.