CN112702635A - Picture screen projection method and system based on face recognition and smart television - Google Patents

Picture screen projection method and system based on face recognition and smart television Download PDF

Info

Publication number
CN112702635A
CN112702635A CN202011581601.8A CN202011581601A CN112702635A CN 112702635 A CN112702635 A CN 112702635A CN 202011581601 A CN202011581601 A CN 202011581601A CN 112702635 A CN112702635 A CN 112702635A
Authority
CN
China
Prior art keywords
head portrait
mobile terminal
intelligent television
image data
screen projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011581601.8A
Other languages
Chinese (zh)
Other versions
CN112702635B (en
Inventor
刘家敏
龙兴华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Konka Electronic Technology Co Ltd
Original Assignee
Shenzhen Konka Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Konka Electronic Technology Co Ltd filed Critical Shenzhen Konka Electronic Technology Co Ltd
Priority to CN202011581601.8A priority Critical patent/CN112702635B/en
Publication of CN112702635A publication Critical patent/CN112702635A/en
Application granted granted Critical
Publication of CN112702635B publication Critical patent/CN112702635B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/535—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Library & Information Science (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a picture screen projection method and system based on face recognition and a smart television, wherein the method comprises the following steps: after receiving a first TCP message which is sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user; the intelligent television generates a head portrait data downloading link, and pushes the head portrait data downloading link to the mobile terminal through a second TCP message; the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link; and after receiving the image data, the intelligent television performs screen projection on a screen of the intelligent television to play the image data. According to the invention, the head portrait data of the user is generated by scanning all the head portraits of the user in front of the television, so that the user is helped to screen out the pictures related to the head portrait data of the user for television screen projection, and the time for manually screening the pictures by the user is saved.

Description

Picture screen projection method and system based on face recognition and smart television
Technical Field
The invention relates to the technical field of picture screen projection, in particular to a picture screen projection method and system based on face recognition and an intelligent television.
Background
Ai (artificial intelligence) represents artificial intelligence, and is a new technical science for researching and developing theories, methods, techniques and application systems for simulating, extending and expanding human intelligence. Artificial intelligence is a branch of computer science, producing a new intelligent machine that can react in a manner similar to human intelligence, and research in this field includes robotics, language recognition, image recognition, natural language processing, and expert systems, among others. Since birth, the theory and technology of artificial intelligence are becoming mature day by day, the application field is expanding, the scientific and technological products brought by the artificial intelligence in the future will be the 'container' of human intelligence, and the artificial intelligence can simulate the information process of human consciousness and thinking.
Along with the development of AI technology, present high-end TV has all possessed the AI camera, can carry out face identification to the picture is thrown the screen function and has also become the standard and join in marriage of present smart television almost, and people can throw the picture on the cell-phone on the TV, and make things convenient for everybody to watch on the large screen together.
However, the existing picture screen projection function is only to mechanically project pictures at the mobile phone end one by one on a television, when a user shares pictures with his family or friends, the user may want to see the pictures related to the user, and in the face of thousands of pictures of the mobile phone, the user needs to select one picture for sharing, which is too hard and hard, and the intelligent requirement is not met.
Accordingly, the prior art is yet to be improved and developed.
Disclosure of Invention
The invention mainly aims to provide a picture screen projection method and system based on face recognition and an intelligent television, and aims to solve the problem that in the prior art, only pictures manually selected by a user can be mechanically projected or all pictures can be projected in sequence when the pictures are projected on the television, and the intelligent requirements of the user cannot be met.
In order to achieve the above object, the present invention provides a picture screen projection method based on face recognition, which comprises the following steps:
after receiving a first TCP message which is sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user;
the intelligent television generates a head portrait data downloading link, and pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link;
and after receiving the image data, the intelligent television performs screen projection on a screen of the intelligent television to play the image data.
The picture screen projection method based on face recognition, wherein after receiving a first TCP message sent by a mobile terminal and used for opening an AI camera, the intelligent television opens the AI camera to acquire the head portrait data of the current user, and the method further comprises the following steps:
the intelligent television and the mobile terminal establish communication connection through a TCP service, and the intelligent television and the mobile terminal perform data communication through a TCP message.
The picture screen projection method based on face recognition, wherein after receiving a first TCP message for opening an AI camera sent by a mobile terminal, the smart television opens the AI camera to obtain the head portrait data of the current user, specifically comprising:
the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service;
the intelligent television starts the AI camera according to the first TCP message, acquires the head portrait data of the current user through the AI camera, and stores the head portrait data to the local of the intelligent television;
wherein, the current users are one or more; the first TCP message carries a command for opening the AI camera.
The picture screen projection method based on face recognition, wherein the smart television generates a head portrait data download link, and pushes the head portrait data download link to the mobile terminal through a second TCP message, and the method specifically comprises the following steps:
the smart television starts http service and generates a head portrait data downloading link;
the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
wherein the second TCP packet carries the avatar data download link.
The picture screen projection method based on face recognition, wherein the smart television receives image data sent by the mobile terminal according to the head portrait data download link, and the method specifically comprises the following steps:
after the intelligent television pushes the head portrait data downloading link to the mobile terminal, the mobile terminal is controlled to download image data of a local album, the downloaded image data is filtered according to the head portrait of the current user, and only the image data containing the head portrait of the current user is reserved;
and the intelligent television receives image data which is sent by the mobile terminal and only contains the head portrait of the current user.
The picture screen projection method based on the face recognition, wherein after receiving the image data, the smart television projects a screen on a screen of the smart television to play the image data, and specifically comprises the following steps:
the intelligent television judges whether one or more pictures in the image data are available according to the received image data only retaining the head portrait of the current user;
and when the number of the pictures in the image data is multiple, screen projection playing is sequentially performed on the screen of the intelligent television according to the sequence of the multiple pictures.
In addition, to achieve the above object, the present invention further provides a smart tv, wherein the smart tv includes: the image projection system comprises a memory, a processor and an image projection program based on face recognition, wherein the image projection program based on face recognition is stored on the memory and can run on the processor, and when being executed by the processor, the image projection program based on face recognition realizes the steps of the image projection method based on face recognition.
In addition, in order to achieve the above object, the present invention further provides a picture screen projection system based on face recognition, wherein the system includes the smart television set as described above, and the system further includes:
the mobile terminal establishes communication connection with the intelligent television through a TCP (transmission control protocol) service;
the mobile terminal is used for sending a first TCP message for opening an AI camera to the intelligent television, receiving a head portrait data download link sent by the intelligent television through a second TCP message, analyzing the head portrait data download link according to the second TCP message, downloading image data of a local photo album in the mobile terminal, filtering the downloaded image data according to a head portrait of a current user, only keeping the image data containing the head portrait of the current user, and sending the image data to the intelligent television.
The picture screen projection system based on the face recognition is characterized in that the mobile terminal comprises a smart phone.
In addition, in order to achieve the above object, the present invention further provides a storage medium, wherein the storage medium stores a picture screen projection program based on face recognition, and the picture screen projection program based on face recognition realizes the steps of the picture screen projection method based on face recognition when being executed by a processor.
After receiving a first TCP message which is sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire the head portrait data of a current user; the intelligent television generates a head portrait data downloading link, and pushes the head portrait data downloading link to the mobile terminal through a second TCP message; the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link; and after receiving the image data, the intelligent television performs screen projection on a screen of the intelligent television to play the image data. According to the invention, the head portrait data of the user is generated by scanning all the head portraits of the user in front of the television, so that the user is helped to screen out the pictures related to the head portrait data of the user for television screen projection, the time for manually screening the pictures by the user is saved, the interest of the screen projection function is increased, and the intellectualization of screen projection is improved.
Drawings
FIG. 1 is a flowchart of a preferred embodiment of a method for projecting a screen based on face recognition according to the present invention;
FIG. 2 is a flowchart of step S10 in the preferred embodiment of the method for projecting a picture based on face recognition according to the present invention;
FIG. 3 is a flowchart of step S20 in the preferred embodiment of the method for projecting a picture based on face recognition according to the present invention;
FIG. 4 is a flowchart of step S30 in the preferred embodiment of the method for projecting a picture based on face recognition according to the present invention;
FIG. 5 is a flowchart of step S40 in the preferred embodiment of the method for projecting a picture based on face recognition according to the present invention;
fig. 6 is a schematic operating environment diagram of a smart tv according to a preferred embodiment of the present invention;
FIG. 7 is a schematic diagram of a preferred embodiment of a system for screen projection based on face recognition according to the present invention;
FIG. 8 is a diagram of an AI face recognition television picture screen projection architecture in accordance with a preferred embodiment of the face recognition based picture screen projection system of the present invention;
FIG. 9 is a diagram illustrating a TCP message format in a preferred embodiment of the image projection system based on face recognition according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, the image screen projection method based on face recognition according to the preferred embodiment of the present invention includes the following steps:
and step S10, after the smart television receives the first TCP message which is sent by the mobile terminal and used for starting the AI camera, the AI camera is started to acquire the head portrait data of the current user.
Please refer to fig. 2, which is a flowchart of step S10 in the method for projecting a picture based on face recognition according to the present invention.
As shown in fig. 2, the step S10 includes:
s11, the smart television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service;
and S12, the intelligent television starts the AI camera according to the first TCP message, acquires the head portrait data of the current user through the AI camera, and stores the head portrait data to the local of the intelligent television.
Wherein, the current users are one or more; the first TCP message carries a command for opening the AI camera.
Specifically, the method further includes, before the step S10: the smart television and the mobile terminal establish communication connection through a TCP (Transmission Control Protocol), which is a connection-oriented, reliable transport layer communication Protocol based on byte streams, the TCP aims to adapt to a layered Protocol hierarchy supporting multi-network applications, a pair of processes in a host computer connected to different but interconnected computer communication networks provides reliable communication services by means of the TCP, the TCP assumes that it can obtain simple and possibly unreliable datagram services from lower-level protocols, and in principle, the TCP should be able to operate on various communication systems connected from a hard line to a packet-switched or circuit-switched network), and the smart television and the mobile terminal perform data communication through TCP messages (messages are data units exchanged and transmitted in the network, i.e. data blocks to be sent by the stations at one time).
After the smart television and the mobile terminal (the mobile terminal refers to a terminal device similar to a smart phone) successfully establish a TCP service connection, the smart tv and the mobile terminal can perform normal data communication (transmission), for example, the smart television starts a TCP service first, the mobile terminal establishes a TCP connection with the smart television, the mobile terminal may send a first TCP message to the smart tv through a TCP service, the first TCP message opening an AI camera (the camera here refers to an AI camera set on the smart tv), the intelligent television starts an AI camera according to the received first TCP message, and acquiring the head portrait data of the current user (one or more users in front of the intelligent television) of the intelligent television through the AI camera, and storing the head portrait data in the local of the intelligent television.
And step S20, the smart television generates an avatar data download link, and the avatar data download link is pushed to the mobile terminal through a second TCP message.
Please refer to fig. 3, which is a flowchart of step S20 in the method for projecting a picture based on face recognition according to the present invention.
As shown in fig. 3, the step S20 includes:
s21, starting http service by the smart television, and generating an avatar data downloading link;
s22, the smart television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
wherein the second TCP packet carries the avatar data download link.
Specifically, the smart television starts an HTTP service (HTTP is a simple request-response Protocol, which generally operates on TCP, and HTTP Protocol, which is called HyperText Transfer Protocol in the full name and is called HyperText Transfer Protocol, which is a most commonly used network Protocol in the internet), and then generates a avatar data download link for the mobile terminal to download pictures according to the download link, and the smart television pushes the avatar data download link to the mobile terminal through a second TCP message.
And step S30, the intelligent television receives the image data sent by the mobile terminal according to the avatar data download link.
Please refer to fig. 4, which is a flowchart of step S30 in the method for projecting a picture based on face recognition according to the present invention.
As shown in fig. 4, the step S30 includes:
s31, after the intelligent television pushes the head portrait data downloading link to the mobile terminal, the mobile terminal is controlled to download image data of a local album, the downloaded image data are filtered according to the head portrait of the current user, and only the image data containing the head portrait of the current user are reserved;
and S32, the intelligent television receives the image data which is sent by the mobile terminal and only contains the head portrait of the current user.
Specifically, after the smart television pushes the head portrait data download link to the mobile terminal through a second TCP packet (the second TCP packet carries the head portrait data download link), the mobile terminal parses the head portrait data download link according to the second TCP packet, downloads image data of a local album in the mobile terminal (that is, pictures stored in the local album of the mobile terminal, such as pictures taken by a user at ordinary times), filters the downloaded image data according to the head portrait of the current user (screens pictures related to the current user, filters pictures unrelated to the current user, and only retains the image data including the head portrait of the current user and sends the image data to the smart television, and then the smart television receives the image data sent by the mobile terminal and only retains the image data including the head portrait of the current user if the pictures unrelated to the current user are thrown into the screen and cannot attract the interest of the current user to watch, preparation is made for screen projection.
And step S40, after the intelligent television receives the image data, projecting the image data on a screen of the intelligent television and playing the image data.
Please refer to fig. 5, which is a flowchart of step S40 in the method for projecting a picture based on face recognition according to the present invention.
As shown in fig. 5, the step S40 includes:
s41, the intelligent television judges whether one or more pictures in the image data are available according to the received image data only retaining the head portrait of the current user;
and S42, when the number of the pictures in the image data is one, directly performing screen projection display on the screen of the intelligent television, and when the number of the pictures in the image data is multiple, sequentially performing screen projection display on the screen of the intelligent television according to the sequence of the multiple pictures.
Specifically, the smart television receives image data which only retains the head portrait of the current user, namely, receives pictures which are sent by the mobile terminal and are related to the current user, and judges whether the pictures in the image data are one or more than one, if not, the mobile terminal does not send the pictures to the smart television, and prompts the user that no matched pictures exist; when the number of the pictures in the image data is multiple (the probability that the number of the pictures is multiple is higher), screen-casting playing is sequentially performed on the screen of the intelligent television according to the sequence of the multiple pictures, and a user does not need to manually select and control the pictures.
Based on the AI face recognition technology, the method filters out relevant pictures in the local photo album of the mobile phone by scanning all the head portraits of the user in front of the television, helps the user to screen out the pictures relevant to the user for screen projection, saves the time for manually screening the pictures for the user, increases the interest of the screen projection function, and embodies the intellectualization of the screen projection.
Further, as shown in fig. 6, based on the above image projection method based on face recognition, the present invention also provides a smart television, which includes a processor 10, a memory 20, and a display 30. Fig. 6 shows only some of the components of the smart television, but it is to be understood that not all of the shown components are required to be implemented, and that more or fewer components may be implemented instead.
The storage 20 may be an internal storage unit of the smart tv in some embodiments, for example, a hard disk or a memory of the smart tv. In other embodiments, the memory 20 may also be an external storage device of the Smart tv, such as a plug-in hard disk provided on the Smart tv, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and so on. Further, the memory 20 may also include both an internal storage unit and an external storage device of the smart tv. The memory 20 is used for storing application software installed in the smart television and various types of data, such as program codes for installing the smart television. The memory 20 may also be used to temporarily store data that has been output or is to be output. In an embodiment, the memory 20 stores a picture screen projection program 40 based on face recognition, and the picture screen projection program 40 based on face recognition can be executed by the processor 10, so as to implement the picture screen projection method based on face recognition in the present application.
The processor 10 may be a Central Processing Unit (CPU), a microprocessor or other data Processing chip in some embodiments, and is used to run program codes stored in the memory 20 or process data, such as executing the picture projection method based on face recognition.
The display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch panel, or the like in some embodiments. The display 30 is used for displaying information on the smart television and for displaying a visual user interface. The components 10-30 of the smart television communicate with each other via a system bus.
In one embodiment, the following steps are implemented when the processor 10 executes the face recognition based picture projection program 40 in the memory 20:
after receiving a first TCP message which is sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user;
the intelligent television generates a head portrait data downloading link, and pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link;
and after receiving the image data, the intelligent television performs screen projection on a screen of the intelligent television to play the image data.
The picture screen projection method based on face recognition, wherein after receiving a first TCP message sent by a mobile terminal and used for opening an AI camera, the intelligent television opens the AI camera to acquire the head portrait data of the current user, and the method further comprises the following steps:
the intelligent television and the mobile terminal establish communication connection through a TCP service, and the intelligent television and the mobile terminal perform data communication through a TCP message.
The picture screen projection method based on face recognition, wherein after receiving a first TCP message for opening an AI camera sent by a mobile terminal, the smart television opens the AI camera to obtain the head portrait data of the current user, specifically comprising:
the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service;
the intelligent television starts the AI camera according to the first TCP message, acquires the head portrait data of the current user through the AI camera, and stores the head portrait data to the local of the intelligent television;
wherein, the current users are one or more; the first TCP message carries a command for opening the AI camera.
The picture screen projection method based on face recognition, wherein the smart television generates a head portrait data download link, and pushes the head portrait data download link to the mobile terminal through a second TCP message, and the method specifically comprises the following steps:
the smart television starts http service and generates a head portrait data downloading link;
the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
wherein the second TCP packet carries the avatar data download link.
The picture screen projection method based on face recognition, wherein the smart television receives image data sent by the mobile terminal according to the head portrait data download link, and the method specifically comprises the following steps:
after the intelligent television pushes the head portrait data downloading link to the mobile terminal, the mobile terminal is controlled to download image data of a local album, the downloaded image data is filtered according to the head portrait of the current user, and only the image data containing the head portrait of the current user is reserved;
and the intelligent television receives image data which is sent by the mobile terminal and only contains the head portrait of the current user.
The picture screen projection method based on the face recognition, wherein after receiving the image data, the smart television projects a screen on a screen of the smart television to play the image data, and specifically comprises the following steps:
the intelligent television judges whether one or more pictures in the image data are available according to the received image data only retaining the head portrait of the current user;
and when the number of the pictures in the image data is multiple, screen projection playing is sequentially performed on the screen of the intelligent television according to the sequence of the multiple pictures.
Further, as shown in fig. 7 and 8, the present invention further provides a picture screen projection system based on face recognition, the system further includes: the mobile terminal comprises an intelligent television (namely a television end in fig. 7 and 8) and a mobile terminal (namely a mobile phone end in fig. 7 and 8) which establishes communication connection with the intelligent television through a TCP service; the mobile terminal is used for sending a first TCP message for opening an AI camera to the intelligent television, receiving a head portrait data download link sent by the intelligent television through a second TCP message, analyzing the head portrait data download link according to the second TCP message, downloading image data of a local photo album in the mobile terminal, filtering the downloaded image data according to a head portrait of a current user, only keeping the image data containing the head portrait of the current user, and sending the image data to the intelligent television.
The television end and the mobile phone end complete the intelligent screen projection process as follows:
the television side (namely television side application) and the mobile phone side (namely mobile phone side application) establish communication connection through TCP service; the television end receives a first TCP message which is sent by the mobile phone end and used for starting an AI camera, and the television end starts the AI camera according to the first TCP message to obtain the head portrait data of the current user and stores the head portrait data to the local; the television end starts an http service to generate an avatar data download link, and the avatar data download link is pushed (for example, pushed by socket) to the mobile phone end through a second TCP message; the mobile phone terminal analyzes the head portrait data downloading link according to the second TCP message, downloads image data of a local photo album in the mobile phone terminal, filters the downloaded image data according to the head portrait of the current user, only retains the image data containing the head portrait of the current user, and sends (for example, pushes through a socket) the image data to the television terminal; and after receiving the image data which is sent by the mobile phone end and only keeps the head portrait of the current user, the television end carries out screen projection playing on a screen of the television end.
As shown in fig. 9, the format of the TCP message is shown, where len represents two bytes, that is, the length of body content is shown; cmd represents two bytes, namely, represents the instruction of the message, such as pushing a download link or opening an AI camera; body represents the message content.
Based on the AI face recognition technology, the invention generates the head portrait data of the user by scanning all the head portraits of the user in front of the television on the basis of the prior screen projection of the picture, helps the user to screen out the picture related to the head portrait data of the user for screen projection, saves the time for manually screening the picture by the user, and embodies the intellectualization and high-tech feeling of the product.
The invention also provides a storage medium, wherein the storage medium stores a picture screen projection program based on face recognition, and the picture screen projection program based on face recognition realizes the steps of the picture screen projection method based on face recognition when being executed by a processor.
In summary, the present invention provides a picture screen projection method, a system and a smart television based on face recognition, wherein the method includes: after receiving a first TCP message which is sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user; the intelligent television generates a head portrait data downloading link, and pushes the head portrait data downloading link to the mobile terminal through a second TCP message; the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link; and after receiving the image data, the intelligent television performs screen projection on a screen of the intelligent television to play the image data. According to the invention, the head portrait data of the user is generated by scanning all the head portraits of the user in front of the television, so that the user is helped to screen out the pictures related to the head portrait data of the user for television screen projection, the time for manually screening the pictures by the user is saved, the interest of the screen projection function is increased, and the intellectualization of screen projection is improved.
Of course, it will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program instructing relevant hardware (such as a processor, a controller, etc.), and the program may be stored in a computer readable storage medium, and when executed, the program may include the processes of the above method embodiments. The storage medium may be a memory, a magnetic disk, an optical disk, etc.
It is to be understood that the invention is not limited to the examples described above, but that modifications and variations may be effected thereto by those of ordinary skill in the art in light of the foregoing description, and that all such modifications and variations are intended to be within the scope of the invention as defined by the appended claims.

Claims (10)

1. A picture screen projection method based on face recognition is characterized by comprising the following steps:
after receiving a first TCP message which is sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user;
the intelligent television generates a head portrait data downloading link, and pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link;
and after receiving the image data, the intelligent television performs screen projection on a screen of the intelligent television to play the image data.
2. The picture screen projection method based on face recognition according to claim 1, wherein after receiving a first TCP message sent by a mobile terminal and used for opening an AI camera, the smart television opens the AI camera to obtain the head portrait data of the current user, and the method further comprises the following steps:
the intelligent television and the mobile terminal establish communication connection through a TCP service, and the intelligent television and the mobile terminal perform data communication through a TCP message.
3. The picture screen projection method based on face recognition according to claim 2, wherein after receiving a first TCP message sent by a mobile terminal and used for opening an AI camera, the smart television opens the AI camera to obtain the head portrait data of the current user, and specifically comprises:
the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service;
the intelligent television starts the AI camera according to the first TCP message, acquires the head portrait data of the current user through the AI camera, and stores the head portrait data to the local of the intelligent television;
wherein, the current users are one or more; the first TCP message carries a command for opening the AI camera.
4. The picture screen projection method based on face recognition according to claim 3, wherein the smart television generates a head portrait data download link, and pushes the head portrait data download link to the mobile terminal through a second TCP message, and the method specifically comprises:
the smart television starts http service and generates a head portrait data downloading link;
the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
wherein the second TCP packet carries the avatar data download link.
5. The picture screen projection method based on face recognition according to claim 4, wherein the smart television receives image data sent by the mobile terminal according to the avatar data download link, and specifically comprises:
after the intelligent television pushes the head portrait data downloading link to the mobile terminal, the mobile terminal is controlled to download image data of a local album, the downloaded image data is filtered according to the head portrait of the current user, and only the image data containing the head portrait of the current user is reserved;
and the intelligent television receives image data which is sent by the mobile terminal and only contains the head portrait of the current user.
6. The picture screen projection method based on face recognition according to claim 5, wherein after receiving the image data, the smart television performs screen projection on a screen of the smart television to play the image data, and specifically comprises:
the intelligent television judges whether one or more pictures in the image data are available according to the received image data only retaining the head portrait of the current user;
and when the number of the pictures in the image data is multiple, screen projection playing is sequentially performed on the screen of the intelligent television according to the sequence of the multiple pictures.
7. An intelligent television, characterized in that the intelligent television comprises: a memory, a processor and a picture screen projection program based on face recognition stored on the memory and operable on the processor, the picture screen projection program based on face recognition realizing the steps of the picture screen projection method based on face recognition according to any one of claims 1-6 when executed by the processor.
8. A picture screen projection system based on face recognition, wherein the picture screen projection system based on face recognition comprises the smart television set according to claim 7, and the system further comprises:
the mobile terminal establishes communication connection with the intelligent television through a TCP (transmission control protocol) service;
the mobile terminal is used for sending a first TCP message for opening an AI camera to the intelligent television, receiving a head portrait data download link sent by the intelligent television through a second TCP message, analyzing the head portrait data download link according to the second TCP message, downloading image data of a local photo album in the mobile terminal, filtering the downloaded image data according to a head portrait of a current user, only keeping the image data containing the head portrait of the current user, and sending the image data to the intelligent television.
9. The system of claim 8, wherein the mobile terminal comprises a smart phone.
10. A storage medium, wherein the storage medium stores a picture screen projection program based on face recognition, and the picture screen projection program based on face recognition realizes the steps of the picture screen projection method based on face recognition according to any one of claims 1 to 6 when being executed by a processor.
CN202011581601.8A 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium Active CN112702635B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011581601.8A CN112702635B (en) 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011581601.8A CN112702635B (en) 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium

Publications (2)

Publication Number Publication Date
CN112702635A true CN112702635A (en) 2021-04-23
CN112702635B CN112702635B (en) 2023-10-27

Family

ID=75512828

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011581601.8A Active CN112702635B (en) 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium

Country Status (1)

Country Link
CN (1) CN112702635B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679832A (en) * 2015-02-05 2015-06-03 四川长虹电器股份有限公司 System and method for searching single or multi-body combined picture based on face recognition
CN105760461A (en) * 2016-02-04 2016-07-13 上海卓易科技股份有限公司 Automatic album establishing method and device
CN108763597A (en) * 2018-07-12 2018-11-06 太仓煜和网络科技有限公司 A kind of photograph album photo display system based on artificial intelligence
CN110727808A (en) * 2018-06-29 2020-01-24 华为技术有限公司 Image processing method and device and terminal equipment
KR102160128B1 (en) * 2020-02-04 2020-09-25 주식회사 더우리 Method and apparatus for creating smart albums based on artificial intelligence
CN111966314A (en) * 2020-08-11 2020-11-20 北京小米移动软件有限公司 Image projection method, image projection device, mobile terminal and projection equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679832A (en) * 2015-02-05 2015-06-03 四川长虹电器股份有限公司 System and method for searching single or multi-body combined picture based on face recognition
CN105760461A (en) * 2016-02-04 2016-07-13 上海卓易科技股份有限公司 Automatic album establishing method and device
CN110727808A (en) * 2018-06-29 2020-01-24 华为技术有限公司 Image processing method and device and terminal equipment
CN108763597A (en) * 2018-07-12 2018-11-06 太仓煜和网络科技有限公司 A kind of photograph album photo display system based on artificial intelligence
KR102160128B1 (en) * 2020-02-04 2020-09-25 주식회사 더우리 Method and apparatus for creating smart albums based on artificial intelligence
CN111966314A (en) * 2020-08-11 2020-11-20 北京小米移动软件有限公司 Image projection method, image projection device, mobile terminal and projection equipment

Also Published As

Publication number Publication date
CN112702635B (en) 2023-10-27

Similar Documents

Publication Publication Date Title
CN111629240B (en) Multi-screen interactive display method and device
CN109816447A (en) Intelligent control method, device and the storage medium of cabinet-type air conditioner advertisement
CN105637472B (en) The frame of screen content shared system with the description of broad sense screen
CN113835649B (en) Screen projection method and terminal
CN112073754B (en) Cloud game screen projection method and device, computer equipment, computer readable storage medium and cloud game screen projection interaction system
CN111629151B (en) Video co-shooting method and device, electronic equipment and computer readable medium
CN113542902B (en) Video processing method and device, electronic equipment and storage medium
CN112492203A (en) Virtual photographing method, device, equipment and storage medium
CN111818354A (en) Animation configuration method, animation playback method, animation configuration device, animation playback device, animation system and animation media
CN109976922A (en) Discovery method, equipment and computer storage medium between small routine platform
CN113434105A (en) Screen projection control method and device, storage medium and electronic equipment
CN112702635B (en) Picture screen-throwing method and system based on face recognition, intelligent television and medium
CN111787221B (en) Image acquisition method, device, system, equipment and computer storage medium
CN112540816A (en) Remote page rendering method, device and equipment and computer storage medium
WO2023279898A1 (en) Service processing method and apparatus, electronic device, computer-readable storage medium, and computer program product
CN104967551A (en) Method for picture transmission interaction, related equipment thereof, and communication system
CN1758231A (en) Digital media receiver having a reader
WO2022001192A1 (en) Method for transmitting application data, and terminal and system
CN114374456A (en) Outdoor LED screen adaptation method, device and medium
US9055235B2 (en) Video output apparatus and video input determination method
CN112351201A (en) Multimedia data processing method, system, device, electronic equipment and storage medium
CN115396522B (en) Method, device, equipment and medium for processing data of looking-around camera
CN221042931U (en) Resource downloading system based on USB flash disk
EP4283464A1 (en) Distributed device capability virtualization method, medium, and electronic device
CN115955665A (en) Data transmission method, device, equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant