CN112702635B - Picture screen-throwing method and system based on face recognition, intelligent television and medium - Google Patents

Picture screen-throwing method and system based on face recognition, intelligent television and medium Download PDF

Info

Publication number
CN112702635B
CN112702635B CN202011581601.8A CN202011581601A CN112702635B CN 112702635 B CN112702635 B CN 112702635B CN 202011581601 A CN202011581601 A CN 202011581601A CN 112702635 B CN112702635 B CN 112702635B
Authority
CN
China
Prior art keywords
intelligent television
mobile terminal
image data
head portrait
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011581601.8A
Other languages
Chinese (zh)
Other versions
CN112702635A (en
Inventor
刘家敏
龙兴华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Konka Electronic Technology Co Ltd
Original Assignee
Shenzhen Konka Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Konka Electronic Technology Co Ltd filed Critical Shenzhen Konka Electronic Technology Co Ltd
Priority to CN202011581601.8A priority Critical patent/CN112702635B/en
Publication of CN112702635A publication Critical patent/CN112702635A/en
Application granted granted Critical
Publication of CN112702635B publication Critical patent/CN112702635B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/535—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Library & Information Science (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)

Abstract

The application discloses a picture screen projection method and system based on face recognition and an intelligent television, wherein the method comprises the following steps: after receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user; the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message; the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link; and after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data. The application generates the user head portrait data by scanning all the user head portraits in front of the television, helps the user to screen out pictures related to the user head portrait data for television screen casting, and saves the time of manually screening pictures by the user.

Description

Picture screen-throwing method and system based on face recognition, intelligent television and medium
Technical Field
The application relates to the technical field of picture screen projection, in particular to a picture screen projection method and system based on face recognition and an intelligent television.
Background
AI (Artificial Intelligence) is a new technical science for researching and developing theories, methods, techniques and application systems for simulating, extending and expanding human intelligence. Artificial intelligence is a branch of computer science that has produced a new type of intelligent machine that can react in a manner similar to human intelligence, and research in this field has included robotics, language recognition, image recognition, natural language processing, and expert systems. Since birth, theories and technologies are mature, application fields are expanded continuously, and technological products brought by artificial intelligence in the future are "containers" of human intelligence, so that the artificial intelligence can simulate the information process of consciousness and thinking of people.
Along with the development of AI technology, the existing high-end televisions are all provided with AI cameras, face recognition can be carried out, the picture screen-throwing function almost becomes the standard of the existing intelligent televisions, and people can throw pictures on mobile phones to the televisions, so that people can watch pictures on large screens together conveniently.
However, the existing picture screen-throwing function is only to mechanically screen a Zhang Tou picture of a mobile phone end on a television, when you share pictures with your family or friends, people may want to see pictures related to the people, and thousands of pictures of the mobile phone are faced with, one Zhang Tiaoxuan picture is needed to share, and the pictures are too hard to meet the intelligent requirement.
Accordingly, the prior art is still in need of improvement and development.
Disclosure of Invention
The application mainly aims to provide a picture screen projection method and system based on face recognition and an intelligent television, and aims to solve the problem that in the prior art, only pictures manually selected by a user can be mechanically projected or all pictures can be projected in sequence when the pictures are projected onto the television, so that the intelligent requirement of the user cannot be met.
In order to achieve the above purpose, the present application provides a picture screen projection method based on face recognition, which comprises the following steps:
after receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user;
the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link;
and after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data.
The method for projecting the picture based on the face recognition comprises the steps that after the intelligent television receives a first TCP message sent by the mobile terminal and used for opening an AI camera, the AI camera is opened to acquire head portrait data of a current user, and the method further comprises the following steps:
the intelligent television and the mobile terminal establish communication connection through TCP service, and the intelligent television and the mobile terminal perform data communication through TCP message.
The method for projecting the picture based on the face recognition, wherein after the intelligent television receives a first TCP message sent by the mobile terminal and used for opening an AI camera, the AI camera is opened to acquire the head portrait data of the current user, specifically comprises the following steps:
the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service;
the intelligent television starts the AI camera according to the first TCP message, acquires head portrait data of a current user through the AI camera, and stores the head portrait data to the local of the intelligent television;
wherein the current user is one or more; the first TCP message carries a command for starting the AI camera.
The picture screen projection method based on face recognition, wherein the intelligent television generates an avatar data download link and pushes the avatar data download link to the mobile terminal through a second TCP message, specifically comprises the following steps:
the intelligent television starts an http service and generates an avatar data downloading link;
the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the second TCP message carries the head portrait data downloading link.
The picture screen projection method based on face recognition, wherein the intelligent television receives image data sent by the mobile terminal according to the head portrait data download link, specifically comprises the following steps:
after pushing the head portrait data downloading link to the mobile terminal, the intelligent television controls the mobile terminal to download the image data of the local album, and filters the downloaded image data according to the current user head portrait, and only retains the image data containing the current user head portrait;
and the intelligent television receives the image data which is sent by the mobile terminal and only contains the current user head portrait.
The method for projecting the picture based on the face recognition, wherein after the intelligent television receives the image data, projecting the picture on the screen of the intelligent television to play the image data, specifically comprises the following steps:
the intelligent television judges whether the pictures in the image data are one or a plurality of pictures according to the received image data which only keep the current user head portrait;
and when the number of the pictures in the image data is multiple, performing screen projection display on the screen of the intelligent television in sequence according to the sequence of the multiple pictures.
In addition, in order to achieve the above object, the present application further provides a smart television, where the smart television includes: the system comprises a memory, a processor and a face recognition based picture screen projection program which is stored in the memory and can be run on the processor, wherein the face recognition based picture screen projection program realizes the steps of the face recognition based picture screen projection method when being executed by the processor.
In addition, in order to achieve the above purpose, the present application further provides a picture projection system based on face recognition, wherein the system comprises the smart television as described above, and the system further comprises:
a mobile terminal which establishes communication connection with the intelligent television through TCP service;
the mobile terminal is used for sending a first TCP message for starting an AI camera to the intelligent television, receiving an avatar data downloading link sent by the intelligent television through a second TCP message, analyzing the avatar data downloading link according to the second TCP message, downloading the image data of the local album in the mobile terminal, filtering the downloaded image data according to the current user avatar, only retaining the image data containing the current user avatar, and sending the image data to the intelligent television.
The picture screen projection system based on face recognition, wherein the mobile terminal comprises a smart phone.
In addition, in order to achieve the above object, the present application further provides a storage medium, wherein the storage medium stores a picture projection program based on face recognition, and the picture projection program based on face recognition realizes the steps of the picture projection method based on face recognition as described above when executed by a processor.
After receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user; the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message; the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link; and after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data. The application generates the user head portrait data by scanning all the user head portraits in front of the television, helps the user to screen out pictures related to the user head portrait data for television screen casting, saves the time of manually screening pictures by the user, increases the interestingness of the screen casting function and improves the intellectualization of screen casting.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of the picture projection method based on face recognition of the present application;
FIG. 2 is a flowchart of step S10 in a preferred embodiment of the face recognition-based picture projection method of the present application;
FIG. 3 is a flowchart of step S20 in a preferred embodiment of the face recognition-based picture projection method of the present application;
FIG. 4 is a flowchart of step S30 in a preferred embodiment of the face recognition-based picture projection method of the present application;
FIG. 5 is a flowchart of step S40 in a preferred embodiment of the face recognition-based picture projection method of the present application;
FIG. 6 is a schematic diagram of an operating environment of a smart television according to a preferred embodiment of the present application;
FIG. 7 is a schematic diagram of a preferred embodiment of a face recognition based picture projection system of the present application;
FIG. 8 is a diagram of the picture projection architecture of the AI face recognition television in the preferred embodiment of the face recognition based picture projection system of the present application;
fig. 9 is a schematic diagram of a TCP message format in a preferred embodiment of a face recognition-based picture projection system of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clear and clear, the present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
The image projection method based on face recognition according to the preferred embodiment of the present application, as shown in fig. 1, comprises the following steps:
and step S10, after receiving a first TCP message sent by the mobile terminal and used for starting the AI camera, the intelligent television starts the AI camera to acquire head portrait data of the current user.
Referring to fig. 2, a flowchart of step S10 in the face recognition-based picture projection method according to the present application is shown.
As shown in fig. 2, the step S10 includes:
s11, the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through TCP service;
and S12, the intelligent television starts the AI camera according to the first TCP message, acquires head portrait data of the current user through the AI camera, and stores the head portrait data to the local of the intelligent television.
Wherein the current user is one or more; the first TCP message carries a command for starting the AI camera.
Specifically, before the step S10, the method further includes: the intelligent tv establishes a communication connection with the mobile terminal via TCP (Transmission Control Protocol, transmission control protocol, a connection-oriented, reliable, byte-stream based transport layer communication protocol, TCP is intended to accommodate a layered protocol hierarchy supporting multiple network applications, reliable communication services are provided by means of TCP between pairs of processes in host computers connected to different but interconnected computer communication networks, TCP assumes that it can obtain simple, possibly unreliable datagram services from a lower level protocol, TCP should in principle be able to operate on top of various communication systems from hard-wired to packet-switched or circuit-switched networks) services, and the intelligent tv communicates data with the mobile terminal via TCP messages (messages are data units exchanged and transmitted in the network, i.e. data blocks to be transmitted at one time by a station).
After the intelligent television and the mobile terminal (the mobile terminal refers to terminal equipment similar to a smart phone) are successfully connected with each other, normal data communication (transmission) can be performed between the intelligent television and the mobile terminal, for example, the intelligent television starts TCP service first, the mobile terminal establishes TCP connection with the intelligent television, the mobile terminal can send a first TCP message for starting an AI camera (the camera refers to the AI camera arranged on the intelligent television here) to the intelligent television through the TCP service, and the intelligent television starts the AI camera of the intelligent television according to the received first TCP message, acquires head image data of a current user (one or more users in front of the intelligent television) of the intelligent television through the AI camera and stores the head image data in the local area of the intelligent television.
And S20, the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message.
Refer to fig. 3 for a flowchart of step S20 in the face recognition-based picture projection method according to the present application.
As shown in fig. 3, the step S20 includes:
s21, the intelligent television starts an http service to generate an avatar data downloading link;
s22, the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the second TCP message carries the head portrait data downloading link.
Specifically, the smart tv starts an HTTP service (HTTP is a simple request-response protocol, which is usually run on top of TCP, the HTTP protocol is called HyperText Transfer Protocol, chinese name is hypertext transfer protocol, which is a network protocol most commonly used in the internet), and then generates an avatar data download link for the mobile terminal to download a picture according to the download link, and pushes the avatar data download link to the mobile terminal through a second TCP message.
And step S30, the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link.
Referring to fig. 4, a flowchart of step S30 in the face recognition-based picture projection method according to the present application is shown.
As shown in fig. 4, the step S30 includes:
s31, after pushing the head portrait data downloading link to the mobile terminal, the intelligent television controls the mobile terminal to download the image data of the local album, and filters the downloaded image data according to the current user head portrait, and only retains the image data containing the current user head portrait;
s32, the intelligent television receives image data which is sent by the mobile terminal and only contains the current user head portrait.
Specifically, after the smart television pushes the head portrait data download link to the mobile terminal through a second TCP packet (the second TCP packet carries the head portrait data download link), the mobile terminal analyzes the head portrait data download link according to the second TCP packet, downloads image data of a local album in the mobile terminal (i.e., a picture stored in the local album of the mobile terminal, such as a picture taken by a user at ordinary times), and filters the downloaded image data according to the head portrait of the current user (screens a picture related to the current user, filters out a picture unrelated to the current user, because the picture unrelated to the current user cannot attract the interest of the current user if the screen is performed), only retains the image data including the head portrait of the current user, and sends the image data to the smart television, and then the smart television receives the image data sent by the mobile terminal and only retains the image data including the head portrait of the current user, so as to prepare for the screen.
And S40, after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data.
Referring to fig. 5, a flowchart of step S40 in the face recognition-based picture projection method according to the present application is shown.
As shown in fig. 5, the step S40 includes:
s41, the intelligent television judges whether the pictures in the image data are one or a plurality of pictures according to the received image data which only keep the current user head portrait;
and S42, when the number of pictures in the image data is one, directly performing screen-casting display on the screen of the intelligent television, and when the number of pictures in the image data is multiple, sequentially performing screen-casting display on the screen of the intelligent television according to the sequence of the multiple pictures.
Specifically, the intelligent television only keeps the image data of the current user head portrait according to the received image data, namely, receives the image which is sent by the mobile terminal and related to the current user, judges whether the image in the image data is one or more or can be one or more, if not, the mobile terminal does not send the image to the intelligent television, and prompts the user that the image is not matched; when the number of the pictures in the image data is one, the screen projection display is directly performed on the screen of the intelligent television, namely, the screen projection display is performed on the screen, and when the number of the pictures in the image data is multiple (the possibility that the number of the pictures is greater), the screen projection display is sequentially performed on the screen of the intelligent television according to the sequence of the multiple pictures, so that the user does not need to manually select and control.
Based on the AI face recognition technology, the related pictures in the local photo album of the mobile phone are filtered by scanning all the user head portraits in front of the television, so that the user is helped to screen out pictures related to the user for screen projection, the time for manually screening the pictures by the user is saved, the interestingness of the screen projection function is increased, and the intelligent screen projection is embodied.
Further, as shown in fig. 6, the present application further provides a smart television based on the above-mentioned face recognition-based picture screen projection method, and the smart television includes a processor 10, a memory 20 and a display 30. Fig. 6 shows only some of the components of the intelligent television, but it should be understood that not all of the illustrated components are required to be implemented, and more or fewer components may alternatively be implemented.
The memory 20 may be an internal storage unit of the smart tv, such as a hard disk or a memory of the smart tv, in some embodiments. The memory 20 may also be an external storage device of the Smart tv in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like. Further, the memory 20 may also include both an internal storage unit and an external storage device of the smart tv. The memory 20 is used for storing application software and various data installed on the smart tv, for example, program codes for installing the smart tv. The memory 20 may also be used to temporarily store data that has been output or is to be output. In an embodiment, the memory 20 stores a face recognition based picture screening program 40, and the face recognition based picture screening program 40 can be executed by the processor 10, so as to implement the face recognition based picture screening method in the present application.
The processor 10 may in some embodiments be a central processing unit (Central Processing Unit, CPU), microprocessor or other data processing chip for executing program code or processing data stored in the memory 20, for example, for performing the face recognition based picture screening method, etc.
The display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like in some embodiments. The display 30 is used for displaying information on the smart television and for displaying a visual user interface. The components 10-30 of the smart television communicate with each other via a system bus.
In one embodiment, the following steps are implemented when the processor 10 executes the face recognition based picture projection program 40 in the memory 20:
after receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user;
the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link;
and after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data.
The method for projecting the picture based on the face recognition comprises the steps that after the intelligent television receives a first TCP message sent by the mobile terminal and used for opening an AI camera, the AI camera is opened to acquire head portrait data of a current user, and the method further comprises the following steps:
the intelligent television and the mobile terminal establish communication connection through TCP service, and the intelligent television and the mobile terminal perform data communication through TCP message.
The method for projecting the picture based on the face recognition, wherein after the intelligent television receives a first TCP message sent by the mobile terminal and used for opening an AI camera, the AI camera is opened to acquire the head portrait data of the current user, specifically comprises the following steps:
the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service;
the intelligent television starts the AI camera according to the first TCP message, acquires head portrait data of a current user through the AI camera, and stores the head portrait data to the local of the intelligent television;
wherein the current user is one or more; the first TCP message carries a command for starting the AI camera.
The picture screen projection method based on face recognition, wherein the intelligent television generates an avatar data download link and pushes the avatar data download link to the mobile terminal through a second TCP message, specifically comprises the following steps:
the intelligent television starts an http service and generates an avatar data downloading link;
the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the second TCP message carries the head portrait data downloading link.
The picture screen projection method based on face recognition, wherein the intelligent television receives image data sent by the mobile terminal according to the head portrait data download link, specifically comprises the following steps:
after pushing the head portrait data downloading link to the mobile terminal, the intelligent television controls the mobile terminal to download the image data of the local album, and filters the downloaded image data according to the current user head portrait, and only retains the image data containing the current user head portrait;
and the intelligent television receives the image data which is sent by the mobile terminal and only contains the current user head portrait.
The method for projecting the picture based on the face recognition, wherein after the intelligent television receives the image data, projecting the picture on the screen of the intelligent television to play the image data, specifically comprises the following steps:
the intelligent television judges whether the pictures in the image data are one or a plurality of pictures according to the received image data which only keep the current user head portrait;
and when the number of the pictures in the image data is multiple, performing screen projection display on the screen of the intelligent television in sequence according to the sequence of the multiple pictures.
Further, as shown in fig. 7 and fig. 8, the present application further provides a picture projection system based on face recognition, and the system further includes: a smart television (i.e., the television end in fig. 7 and 8) and a mobile terminal (i.e., the mobile phone end in fig. 7 and 8) which establishes communication connection with the smart television through a TCP service; the mobile terminal is used for sending a first TCP message for starting an AI camera to the intelligent television, receiving an avatar data downloading link sent by the intelligent television through a second TCP message, analyzing the avatar data downloading link according to the second TCP message, downloading the image data of the local album in the mobile terminal, filtering the downloaded image data according to the current user avatar, only retaining the image data containing the current user avatar, and sending the image data to the intelligent television.
The process of completing intelligent screen throwing by the television end and the mobile phone end is as follows:
the television end (namely, the television end application) and the mobile phone end (namely, the mobile phone end application) establish communication connection through TCP service; the television end receives a first TCP message which is sent by the mobile phone end and used for starting an AI camera, and starts the AI camera according to the first TCP message to acquire head portrait data of a current user and stores the head portrait data to a local; the television end starts http service to generate an avatar data downloading link, and pushes the avatar data downloading link (such as pushing through a socket) to the mobile phone end through a second TCP message; the mobile phone end analyzes the head portrait data downloading link according to the second TCP message, downloads the image data of the local album in the mobile phone end, filters the downloaded image data according to the current user head portrait, only retains the image data containing the current user head portrait, and sends the image data (pushed by a socket for example) to the television end; and the television receives the image data which is sent by the mobile phone and only retains the current user head portrait, and then performs screen casting and playing on a screen of the television.
As shown in fig. 9, the format of a TCP packet is represented, where len represents the length that occupies two bytes, i.e., represents the body content; cmd represents an instruction that takes two bytes, i.e., represents the message, such as pushing a download link or opening an AI camera; body represents the message content.
Based on the AI face recognition technology, the application generates the user head portrait data by scanning all the user head portraits in front of the television on the basis of the existing picture screen, helps the user screen out pictures related to the user head portrait data for screen projection, saves the time of manually screening pictures by the user, and shows the intelligentization and high-tech sense of the product.
The application also provides a storage medium, wherein the storage medium stores a picture screen projection program based on face recognition, and the picture screen projection program based on face recognition realizes the steps of the picture screen projection method based on face recognition when being executed by a processor.
In summary, the application provides a picture screen projection method and system based on face recognition and an intelligent television, wherein the method comprises the following steps: after receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user; the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message; the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link; and after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data. The application generates the user head portrait data by scanning all the user head portraits in front of the television, helps the user to screen out pictures related to the user head portrait data for television screen casting, saves the time of manually screening pictures by the user, increases the interestingness of the screen casting function and improves the intellectualization of screen casting.
Of course, those skilled in the art will appreciate that implementing all or part of the above-described methods may be implemented by a computer program for instructing relevant hardware (such as a processor, a controller, etc.), where the program may be stored in a computer-readable storage medium, and where the program may include the steps of the above-described method embodiments when executed. The storage medium may be a memory, a magnetic disk, an optical disk, or the like.
It is to be understood that the application is not limited in its application to the examples described above, but is capable of modification and variation in light of the above teachings by those skilled in the art, and that all such modifications and variations are intended to be included within the scope of the appended claims.

Claims (7)

1. The picture screen projection method based on the face recognition is characterized by comprising the following steps of:
after receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user;
after receiving a first TCP message sent by a mobile terminal and used for starting an AI camera, the intelligent television starts the AI camera to acquire head portrait data of a current user, and specifically comprises the following steps:
the intelligent television receives a first TCP message which is sent by the mobile terminal and used for starting an AI camera through a TCP service; the intelligent television starts the AI camera according to the first TCP message, acquires head portrait data of a current user through the AI camera, and stores the head portrait data to the local of the intelligent television;
wherein the current user is one or more; the first TCP message carries a command for starting an AI camera;
the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message;
the intelligent television generates an avatar data downloading link and pushes the avatar data downloading link to the mobile terminal through a second TCP message, and the method specifically comprises the following steps:
the intelligent television starts an http service and generates an avatar data downloading link;
the intelligent television pushes the head portrait data downloading link to the mobile terminal through a second TCP message;
the second TCP message carries the head portrait data downloading link;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link;
the intelligent television receives image data sent by the mobile terminal according to the head portrait data downloading link, and specifically comprises the following steps:
after pushing the head portrait data downloading link to the mobile terminal, the intelligent television controls the mobile terminal to download the image data of the local album, and filters the downloaded image data according to the current user head portrait, and only retains the image data containing the current user head portrait;
the intelligent television receives image data which is sent by the mobile terminal and only contains the current user head portrait;
and after the intelligent television receives the image data, performing screen projection on a screen of the intelligent television to play the image data.
2. The method for projecting a picture based on face recognition according to claim 1, wherein after the smart television receives a first TCP message sent by the mobile terminal and used for opening an AI camera, the method for opening the AI camera to obtain the head portrait data of the current user further comprises:
the intelligent television and the mobile terminal establish communication connection through TCP service, and the intelligent television and the mobile terminal perform data communication through TCP message.
3. The method for projecting a picture based on face recognition according to claim 1, wherein after the smart television receives the image data, projecting a screen on a screen of the smart television to play the image data, specifically comprising:
the intelligent television judges the image data according to the received image data which only keeps the current user head portrait
Whether the pictures are one or a plurality of pictures;
and when the number of the pictures in the image data is multiple, performing screen projection display on the screen of the intelligent television in sequence according to the sequence of the multiple pictures.
4. An intelligent television, characterized in that, the intelligent television includes: memory, a processor and a face recognition based picture screening program stored on the memory and running on the processor, which when executed by the processor, implements the steps of the face recognition based picture screening method according to any one of claims 1-3.
5. A face recognition-based picture projection system, wherein the face recognition-based picture projection system comprises the intelligent television set according to claim 4, and the system further comprises:
a mobile terminal which establishes communication connection with the intelligent television through TCP service;
the mobile terminal is used for sending a first TCP message for starting an AI camera to the intelligent television, receiving an avatar data downloading link sent by the intelligent television through a second TCP message, analyzing the avatar data downloading link according to the second TCP message, downloading the image data of the local album in the mobile terminal, filtering the downloaded image data according to the current user avatar, only retaining the image data containing the current user avatar, and sending the image data to the intelligent television.
6. The face recognition based picture projection system of claim 5, wherein the mobile terminal comprises a smart phone.
7. A storage medium, wherein the storage medium stores a face recognition based picture screening program, which when executed by a processor, implements the steps of the face recognition based picture screening method according to any one of claims 1-3.
CN202011581601.8A 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium Active CN112702635B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011581601.8A CN112702635B (en) 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011581601.8A CN112702635B (en) 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium

Publications (2)

Publication Number Publication Date
CN112702635A CN112702635A (en) 2021-04-23
CN112702635B true CN112702635B (en) 2023-10-27

Family

ID=75512828

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011581601.8A Active CN112702635B (en) 2020-12-28 2020-12-28 Picture screen-throwing method and system based on face recognition, intelligent television and medium

Country Status (1)

Country Link
CN (1) CN112702635B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679832A (en) * 2015-02-05 2015-06-03 四川长虹电器股份有限公司 System and method for searching single or multi-body combined picture based on face recognition
CN105760461A (en) * 2016-02-04 2016-07-13 上海卓易科技股份有限公司 Automatic album establishing method and device
CN108763597A (en) * 2018-07-12 2018-11-06 太仓煜和网络科技有限公司 A kind of photograph album photo display system based on artificial intelligence
CN110727808A (en) * 2018-06-29 2020-01-24 华为技术有限公司 Image processing method and device and terminal equipment
KR102160128B1 (en) * 2020-02-04 2020-09-25 주식회사 더우리 Method and apparatus for creating smart albums based on artificial intelligence
CN111966314A (en) * 2020-08-11 2020-11-20 北京小米移动软件有限公司 Image projection method, image projection device, mobile terminal and projection equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679832A (en) * 2015-02-05 2015-06-03 四川长虹电器股份有限公司 System and method for searching single or multi-body combined picture based on face recognition
CN105760461A (en) * 2016-02-04 2016-07-13 上海卓易科技股份有限公司 Automatic album establishing method and device
CN110727808A (en) * 2018-06-29 2020-01-24 华为技术有限公司 Image processing method and device and terminal equipment
CN108763597A (en) * 2018-07-12 2018-11-06 太仓煜和网络科技有限公司 A kind of photograph album photo display system based on artificial intelligence
KR102160128B1 (en) * 2020-02-04 2020-09-25 주식회사 더우리 Method and apparatus for creating smart albums based on artificial intelligence
CN111966314A (en) * 2020-08-11 2020-11-20 北京小米移动软件有限公司 Image projection method, image projection device, mobile terminal and projection equipment

Also Published As

Publication number Publication date
CN112702635A (en) 2021-04-23

Similar Documents

Publication Publication Date Title
CN111629240B (en) Multi-screen interactive display method and device
CN109816447A (en) Intelligent control method, device and the storage medium of cabinet-type air conditioner advertisement
US10929460B2 (en) Method and apparatus for storing resource and electronic device
CN112492203A (en) Virtual photographing method, device, equipment and storage medium
EP2492791A1 (en) Augmented reality-based file transfer method and file transfer system thereof
CN109587536A (en) A kind of long-distance remote-control method, equipment, server and system
US20140189726A1 (en) Image viewing system, receiver mobile terminal, image server, and image viewing method
Wu et al. A practical home security system via mobile phones
CN113434105A (en) Screen projection control method and device, storage medium and electronic equipment
CN112163993A (en) Image processing method, device, equipment and storage medium
CN110415318B (en) Image processing method and device
CN112702635B (en) Picture screen-throwing method and system based on face recognition, intelligent television and medium
CN113452931B (en) Screen splicing interaction method and system based on image recognition and smart screen
CN110865981A (en) File access method for mobile terminal and mobile terminal thereof
CN110855736A (en) File transfer method, file transfer apparatus, and computer-readable storage medium
CN111787221B (en) Image acquisition method, device, system, equipment and computer storage medium
CN109086401A (en) Paster acquisition methods, device, storage medium and electronic equipment
CN113617020A (en) Game control method, device, storage medium, server and terminal
WO2015053568A1 (en) Multimedia card service system and service method
GB2365177A (en) System and method for exchange of digital data from personal appliances
CN116611985A (en) Method and device for image watermarking, electronic equipment and storage medium
CN114374456A (en) Outdoor LED screen adaptation method, device and medium
JP4415227B2 (en) Information processing apparatus, information processing method, and recording medium
CN114039968A (en) Resource package uploading method and device, electronic equipment and storage medium
CN115396522B (en) Method, device, equipment and medium for processing data of looking-around camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant