CN110545234B - Social or information interaction method based on face recognition and scene sharing - Google Patents
Social or information interaction method based on face recognition and scene sharing Download PDFInfo
- Publication number
- CN110545234B CN110545234B CN201910748279.4A CN201910748279A CN110545234B CN 110545234 B CN110545234 B CN 110545234B CN 201910748279 A CN201910748279 A CN 201910748279A CN 110545234 B CN110545234 B CN 110545234B
- Authority
- CN
- China
- Prior art keywords
- user
- scene
- information
- client
- demand
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000003993 interaction Effects 0.000 title claims abstract description 28
- 238000004891 communication Methods 0.000 claims abstract description 10
- 239000000284 extract Substances 0.000 claims abstract description 5
- 230000000007 visual effect Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 13
- 239000011521 glass Substances 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9536—Search customisation based on social or collaborative filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9538—Presentation of query results
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/21—Monitoring or handling of messages
- H04L51/222—Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services
Abstract
The invention provides a social or information interaction method based on face recognition and scene sharing, which is characterized in that a scene demand user or a scene providing user sends scene demand information or scene providing information to a device client of a system user through a system server for the system user to check, and a connection button is clicked to establish communication connection with the corresponding scene demand user or scene providing user. And the scene providing user sends the pictures of the current scene acquired by the equipment camera to the scene demand user client to display and play in real time, acquires the face image of the target user of the current scene, extracts the face feature data to be compared and matched with the face feature data of the user of the database, judges whether the user is a system registration user, and sends the information of the target user at least comprising the head portrait to the scene demand user and displays the information on the equipment client according to the matching result so as to be checked by the scene demand user and further performs social or information interaction with the target user according to the requirement.
Description
Technical Field
The invention relates to a social or information interaction method, in particular to a social or information interaction method based on face recognition and scene sharing.
Background
At present, the application of the internet communication technology is more and more widespread, users can realize remote video and voice communication through social platforms such as WeChat, QQ, strange, facebook and the like, can watch remote live broadcast through a live broadcast platform, and can share pictures on the social platform. However, in the prior art, the remote pictures or video acquisition is performed between friends, for example, a user communicates with his friends through a social platform or sends pictures to the friends. The strangers send pictures or videos only through social circles or communities, live broadcasting or watching live broadcasting is carried out on a live broadcasting platform, the pictures or videos in different places are transmitted passively, what is sent by others, what you see is what, and the strangers want to see a certain real scene in different places at the current moment and acquire information of the scene and conduct social or information interaction with users of the scene cannot be achieved in the prior art. Therefore, how to satisfy the situation that a user in a real scene can see a scene image which the user wants to see by using the device of the user in a different place, social or information interaction with more users in the scene is realized, and the problems that information is acquired and pictures or videos of the scene are included become the problems to be solved.
Disclosure of Invention
The invention aims to solve the technical problem of providing a social or information interaction method based on face recognition and scene sharing, which overcomes the problems in the prior art. The technical scheme is as follows:
a social or information interaction method based on face recognition and scene sharing is characterized in that:
the system user extracts the face characteristic data of the user at the equipment client through a camera, binds the face characteristic data with the registered ID of the user and stores the face characteristic data in a database;
the method comprises the steps that a scene demand user or a scene providing user sends scene demand information or scene providing information comprising at least one of a demanded or provided scene name, a geographic position or a place name to a device client of a system user through a system server at a device client of the scene demand user or the scene providing user;
or, the scene demand user or the scene provision sends a scene demand request or a scene provision request comprising at least one of a demanded or provided scene name, a geographic position or a place name to the system server at the device client thereof;
the user checks the scene demand information or scene providing information of the system user pushed by the system at the equipment client thereof, clicks a connection button, and establishes communication connection with the equipment client of the scene demand user or scene providing user corresponding to the button;
or the system server matches the user according to a scene demand request or a scene providing request which is sent to the system server by the equipment client of the system server and comprises at least one of a required or provided scene name, a geographic position or a place name, and if the matching is successful, the communication connection between the scene demand user client and the scene providing user client is established;
the scene providing user sends the current scene picture obtained in real time to the scene demand user client for real-time display and play through the equipment camera thereof;
a device camera of a scene providing user acquires a target user face image of a current scene, and face feature data is extracted;
comparing and matching the extracted face feature data with the face feature data of the user in the database, and judging whether the user is a registered user of the system;
if so, sending the information of the target user at least comprising the head portrait to a scene demand user according to the matching result and displaying the information at the equipment client side of the scene demand user so as to be checked by the scene demand user and further conduct social or information interaction with the target user according to the requirement.
And the scene demand user clicks the information of the target user at least comprising the head portrait at the equipment client thereof, pops up an information interaction window and sends information to the target user.
And the target user receives the information sent by the scene demand user and displays the information at the equipment client side, at least one of the head portrait and the nickname of the scene demand user is displayed at the equipment client side, or at least one of the head portrait and the nickname of the scene demand user is displayed at the equipment client side, and at least one of the head portrait and the nickname of the scene supply user is additionally displayed.
The target user receives the information sent by the scene demand user, displays the information on the equipment client, displays at least one of the head portrait and the nickname of the scene demand user on the equipment client, and simultaneously displays the same or similar text description of 'providing user connection through the scene' as a mark, or marks the head portrait or the nickname of the scene providing user by using a mark symbol representing the meaning as the mark.
When a scene demand user is matched with more than one user information through the face recognition of a device camera of the scene supply user, the more than one information at least comprising head portraits is displayed on a device client of the scene demand user in a horizontal or vertical list mode.
And setting a collection button on the information at least comprising the head portrait of the user, and clicking the collection button to collect the information of the target user or the scene providing user.
And setting a target user matched with the current scene through the face recognition of the scene providing user at the equipment client of the scene requiring user, and only pushing the information of at least the head portrait of the target user to the equipment client of the scene requiring user, or simultaneously pushing the information of at least the head portrait of the target user to the equipment clients of the scene requiring user and the scene providing user.
According to the setting of the scene demand user, the scene providing user and the target user, the scene demand user, the scene providing user and the target user are divided into the same temporary group, so that the three parties send messages in the group, and social or information interaction is carried out.
The scene demand user sends a shot direction control instruction to the scene providing user in real time through the client thereof so as to facilitate the scene demand user to find a target user or a scene;
the lens direction control instruction comprises a lens direction control panel and a control button displayed on a client of the scene demand user equipment and a visual operation instruction or a voice instruction of a lens direction indication frame and an indication mark displayed on the client of the scene supply user equipment;
the method comprises the steps that the offset direction and offset of a lens direction indicator displayed by a scene providing user equipment client relative to an indication frame and the offset direction and offset of a lens direction control button of the equipment client of a scene demand user relative to a control panel are synchronously displayed through a system server, and the scene providing user controls a device camera to acquire the direction of a current scene and stop moving according to the offset direction and offset of the direction indicator displayed by the equipment client;
and setting a photographing/video button at the equipment client of the scene requirement user, binding the photographing/video button with the photographing/video button of the equipment client of the scene requirement user, sending a photographing/video instruction to the equipment client of the scene requirement user in real time through a system server when the scene requirement user presses the photographing/video button at the equipment client of the scene requirement user, controlling the equipment camera of the scene requirement user to photograph/video, and then sending the photographed/video to the scene requirement user.
The scene demand user sends a walking direction control instruction to the scene providing user in real time through the client thereof so as to facilitate the scene demand user to find the target user or the scene;
the lens direction control instruction comprises a walking direction control panel displayed on a client of the user equipment required by the scene and a visual operation instruction or a voice instruction of a walking direction indication frame displayed on the client of the user equipment provided by the scene;
the method comprises the steps that the offset direction and the offset of a walking direction indicator displayed by a scene providing user equipment client side relative to an indication frame and the offset direction and the offset of a walking direction control button of the equipment client side of a scene demand user relative to a control panel are synchronously displayed through a system server, and the scene providing user controls the walking movement track of the scene providing user according to the offset direction and the offset of the direction indicator displayed by the equipment client side of the scene providing user, so that a scene and a target user required by the scene demand user can be conveniently obtained by an equipment camera.
The invention also comprises a scene browsing interface and a demand publishing interface, wherein a scene demand user or a scene providing user publishes scene demands or scene providing information on the scene demand interface, and the user browses and searches own demands on the scene browsing interface.
The scene browsing interface comprises an information icon issued by a scene demand user or a scene providing user, wherein the information icon comprises at least one of a head portrait, a nickname and a provided scene picture or video of the user, scene information of the user is displayed on the information icon or beside the information icon by using characters, the information icon or the scene information is clicked, and scene sharing connection is established with the user;
or, the scene browsing interface comprises an information icon issued by a scene demand user or a scene providing user, wherein the information icon comprises at least one of a head portrait, a nickname, a provided scene picture or a video of the user, the scene information of the user is displayed on the information icon or beside the information icon by text, the information icon or the scene information is clicked, a message window is popped up, a message is sent to the user, a scene connection button is arranged in the message window, the scene connection button is clicked, and a scene sharing connection is established with the user.
The invention also comprises a map interface, a scene requirement user or a scene providing user marks the position of the user on the map interface, issues the requirement on the map interface, and the user searches the requirement on the map interface. The map interface comprises an information icon of a user displayed on the geographic position of the user, wherein the information icon comprises at least one of a head portrait and a nickname of the user, scene information of the user is displayed beside the user icon, the user icon or the scene information is clicked, and scene sharing connection is established with the user;
or displaying the scene information of the user beside the user icon, clicking the user icon or the scene information, popping up a message window, sending a message to the user, setting a scene connection button in the message window, clicking the scene connection button, and establishing scene sharing connection with the user.
The invention also comprises a appreciation setting button and/or a appreciation button; the reward setting button is arranged on the demand release interface, and the user sets the reward amount; the appreciation button is arranged on an information icon or scene information issued by the scene browsing interface or on a pop-up message window for clicking the information icon or the scene information, or the appreciation button is not arranged, and the appreciation is directly deducted after the scene sharing is finished, or the appreciation button is still arranged, and after the scene sharing is finished, the user is required to click the appreciation button according to the scene sharing condition after the scene sharing is finished, so that the appreciation is paid.
The invention also comprises an exhibition interface or conference interface, taking an exhibition as an example and collectively referring to the exhibition interface, comprising interfaces and modules corresponding to the following methods, including registration and binding boundary surfaces and modules of internal exhibitors and exhibition positions of exhibition users, and head portraits, company information and product information interfaces and modules of the exhibition users;
the method comprises the steps that an exhibitor of each exhibitor is taken as a target user of a system exhibitor field audience user and a scene demand user outside the exhibitor field, after each worker in the exhibitor user is registered as a registered user of the system through a face, face registration information of each worker is bound with the name of the exhibitor and the name of the exhibitor, the face registration information is stored in a database to form an exhibitor user, and head images, company information and product information of the exhibitor user are uploaded and set;
when a scene providing user walks to the exhibition stand, the equipment camera of the scene providing user obtains a staff of the exhibition stand, the face recognition feature data is obtained and is compared and matched with face data of the exhibition user in the database, if the face data is the exhibition user, the head portrait of the exhibition user and the information of the exhibition user are sent to the equipment client of the scene requiring user for the view of the scene requiring user, and further social or information interaction is carried out with the exhibition user.
The interfaces and corresponding modules included in the method of the present invention should exist in the present invention according to the description of the above method, and each interface and button implement a corresponding method to be technically supported by the corresponding module, which is not described in detail herein.
The user equipment comprises a mobile phone with a camera, a tablet personal computer, intelligent glasses, AR glasses, MR glasses and wearable equipment, and also comprises a digital camera, a video camera, an unmanned aerial vehicle with a camera or a video camera and other professional or non-professional photographic and photographic equipment which can be connected and communicated with a client.
The invention provides a social or information interaction method based on face recognition and scene sharing, which is characterized in that a scene demand user or a scene providing user sends scene demand information or scene providing information comprising at least one of a required or provided scene name, a geographic position or a place name to a device client of a system user through a system server at a device client of the scene demand user or the scene providing user, the user views the scene demand information or the scene providing information at the device client of the scene demand user, clicks a connection button, and communication connection is established between the scene demand user or the device client of the scene providing user corresponding to the connection button. And the scene providing user sends the pictures of the current scene acquired in real time to the scene demand user client for real-time display and play through the equipment camera of the scene providing user, the equipment camera of the scene providing user acquires the face image of the target user of the current scene, the face feature data is extracted, the extracted face feature data is compared and matched with the face feature data of the user of the database, whether the user is a system registration user is judged, if yes, the information of the target user at least comprising the head portrait is sent to the scene demand user according to the matching result and is displayed on the equipment client of the scene demand user, so that the scene demand user can view and further conduct social or information interaction with the target user according to the requirement.
According to the invention, the scene image acquired by the equipment camera of the scene providing user in one scene is sent to the equipment client of the scene requiring user in the other scene in real time to be displayed, the scene acquired by the equipment camera of the scene providing user is controlled by the lens direction control panel, the lens direction indication frame, the walking direction control panel and the walking direction indication frame, people or objects favored in the scene are found, the target user registered in the system in the current scene is identified by the face recognition technology, the information displayed by the target user is pushed to the scene requiring user, the target user head is clicked further, a message window can be popped up, social contact or information interaction between the scene requiring user and the target user is realized by help of the scene providing user in the scene, and photographing or video of the current scene is also realized. The exhibition scene interface enables scene demand users to obtain the information of exhibitors and the information of products of the exhibition which are interested by the users through the equipment provided by the users in the scene of the exhibition scene, take the pictures or videos which are interested by the users, and perform social or information interaction with a plurality of target users in the exhibition scene, thereby providing a better updated experience for the users. Therefore, the invention represents a significant technical advance over the prior art.
Drawings
FIG. 1 is a flow chart of the method of the present invention.
Fig. 2 is a flow chart of the method of the present invention.
Fig. 3 is a flow chart three of the method of the present invention.
Fig. 4 is a flow chart four of the method of the present invention.
Fig. 5 is a flow chart five of the method of the present invention.
Fig. 6 is a flow chart six of the method of the present invention.
Fig. 7 is a flow chart seven of the method of the present invention.
Fig. 8 is a flow chart eight of the method of the present invention.
Fig. 9 is a flow chart nine of the method of the present invention.
Fig. 10 is a flow chart of the method of the present invention.
FIG. 11 is a flow chart eleven of the method of the present invention
FIG. 12 is a schematic diagram of the method of the present invention.
FIG. 13 is a schematic diagram of a second method of the present invention.
FIG. 14 is a schematic diagram III of the method of the present invention.
FIG. 15 is a schematic diagram of a method of the present invention.
FIG. 16 is a schematic diagram of a method of the present invention.
FIG. 17 is a schematic diagram of the method of the present invention.
Fig. 18 is a schematic diagram seven of the method of the present invention.
FIG. 19 is a schematic diagram eight of the method of the present invention.
FIG. 20 is a schematic diagram of the method of the present invention.
FIG. 21 is a schematic illustration of the method of the present invention.
FIG. 22 is a schematic diagram eleven of the method of the present invention.
FIG. 23 is a schematic diagram of a method of the present invention.
FIG. 24 is a schematic representation of thirteen of the method of the present invention.
FIG. 25 is a schematic diagram fourteen of the method of the present invention.
Fig. 26 is a schematic diagram fifteen of the method of the present invention.
Fig. 27 is a schematic illustration sixteen of the method of the present invention.
FIG. 28 is a schematic seventeen of the method of the present invention.
Detailed Description
The invention is further described below with reference to the drawings and embodiments.
The invention discloses a social or information interaction method based on face recognition and scene sharing, which comprises the following steps:
as shown in fig. 1, 12, 27 and 28, the system user extracts the face feature data of the user at the device client through the camera, binds with the registration ID of the user, and stores the data in the database. The method comprises the steps that a scene demand user or a scene providing user sends scene demand information or scene providing information comprising at least one of a demanded or provided scene name, a geographic position or a place name to a device client of a system user through a system server at a device client of the scene demand user or the scene providing user; or, the scene demand user or scene provision sends a scene demand request or scene provision request including at least one of a demanded or provided scene name, geographic location or place name to the system server at its device client. The user views the scene requirement information or scene providing information 514 or 614 of the system user pushed by the system at the device client 501 or 601 thereof, clicks the connection button 510 or 514 or 615 or 614, and establishes communication connection with the device client of the scene requirement user or scene providing user corresponding to the button, as shown in fig. 27 and 28; or in another embodiment, the system server matches the user according to a scene demand request or a scene providing request including at least one of a required or provided scene name, a geographic position or a place name, which is sent to the system server at the device client thereof, and if the matching is successful, the scene demand user client and the scene providing user client establish communication connection. The scene providing user sends the current scene picture obtained in real time to the scene demand user client 101 for real-time display and play through the device camera thereof, as shown in fig. 6. As shown in fig. 12, a device camera of a scene providing user acquires a face image 102 of a target user 30u of a current scene, and extracts face feature data; comparing and matching the extracted face feature data with the face feature data of the user in the database, and judging whether the user is a registered user of the system; if so, the information of the target user 30u including at least the avatar 310 and the nickname 311 is sent to the scene demand user 210 according to the matching result and displayed on the device client 201 thereof, as shown in fig. 13, so that the scene demand user views and performs social or information interaction with the target user as required.
As shown in fig. 2 and 13, the scene requiring user 210 clicks the information of the target user 30u including at least the avatar 310 at the device client 201 thereof, pops up the information interaction window 202, and sends the information to the target user.
As shown in fig. 3 and 14, the target user 30u receives the information sent by the scene requiring user, and displays at the device client 301 thereof, and also displays at least one of the head portrait 210 and the nickname 211 of the scene requiring user at the device client thereof, or displays at least one of the head portrait 210 and the nickname 211 of the scene requiring user and additionally displays at least one of the head portrait 110 and the nickname 111 of the scene providing user at the device client 301 thereof.
As shown in fig. 4 and 14, the difference from the above embodiment is that the target user 30u receives the information sent by the scene requiring user, and displays the information on the device client 301 thereof, and also displays at least one of the avatar 210 and the nickname 211 of the scene requiring user on the device client thereof, and simultaneously displays the same or similar text description as "providing user connection through the scene" as a mark, or marks the avatar 110 or nickname 111 of the scene providing user with the mark symbol 112 representing the above meaning as a mark.
As shown in fig. 14 and 15, depending on the setting of the scene providing user or the target user, only the nickname 112 or only the nickname 111 and the nickname 112 may be displayed without displaying the avatar and the nickname of the scene providing user at the client interface 301 of the target user.
As shown in fig. 5 and 19, when a scene demand user recognizes that more than one user information is matched through the face recognition of the device camera of the scene providing user, the more than one information including at least the head portrait is displayed on the device client 201 of the scene demand user in a horizontal or vertical list manner.
As shown in fig. 16, the avatar 210 and nickname 211 of the scene requiring user displayed on the target user device client interface 301 may be placed in distinct positions, such as in the first left or front, while the avatar 110 and nickname 111 of the scene providing user may be placed in the second or rear, and distinguished by a small avatar, omitting the logo 112 of the scene providing.
As shown in fig. 17, another embodiment of the present invention is to click on the avatar 110 of the scene providing user to enlarge or locate in front of the scene requiring user avatar 210 when the target user needs to send a message to the scene providing user.
As shown in fig. 6, a collection button is set on the information including at least the user head portrait, and the information of the target user or the scene providing user is collected by clicking the collection button.
As shown in fig. 7, the scene demand user sets, at the device client thereof, information that only includes at least an avatar to the device client of the scene demand user when the target user of the current scene is matched through face recognition of the scene supply user, or information that at least includes an avatar to the device clients of the scene demand user and the scene supply user at the same time.
As shown in fig. 8 and 18, according to the settings of the scene demand user, the scene providing user and the target user, the scene demand user, the scene providing user and the target user are divided into the same temporary group, so that three parties send messages in the group, and social or information interaction is performed.
As shown in fig. 9, 20 to 24, the scene demand user sends a shot direction control instruction to the scene providing user in real time through the client thereof so as to facilitate the scene demand user to find a target user or scene; the lens direction control instruction comprises a lens direction control panel 203, a control button 204 displayed on the client 201 of the scene demand user equipment, and a visual operation instruction or a voice instruction of a lens direction indication box 103 and an indication mark 104 displayed on the client of the scene provision user equipment; the offset direction and offset of the lens direction indicator 104 displayed by the scene providing user equipment client 101 relative to the indicator frame 103 and the offset direction and offset of the lens direction control button of the equipment client 201 of the scene requiring user relative to the control panel are synchronously displayed through the system server, and the scene providing user controls the direction of the equipment camera to acquire the current scene and stops moving according to the offset direction and offset of the direction indicator 104 displayed by the equipment client 101; the photographing/video button 210 is set at the device client 201 of the scene requiring user and is bound with the photographing/video button of the camera of the device client 101 of the scene providing user, when the scene requiring user presses the photographing/video button 210 at the device client 201 thereof, a photographing/video instruction is sent to the device client of the scene providing user in real time through the system server, the device camera of the scene providing user is controlled to photograph/video, and then the photographed/video is sent to the scene requiring user.
As shown in fig. 10, 25 and 26, the scene requiring user sends a walking direction control instruction to the scene providing user in real time through the client 201 thereof so that the scene requiring user can find the target user or scene; the walking direction control instruction includes a walking direction control panel 206 and a control button 207 displayed on the scene requiring user equipment client 201 and a visual operation instruction of the walking direction indication frame 103 and the indication mark 104 displayed on the scene providing user equipment client 101, or a voice instruction; the offset direction and offset of the walking direction indicator 104 displayed by the scene providing user equipment client 101 relative to the indicator frame 103 and the offset direction and offset of the walking direction control button 207 of the equipment client 201 of the scene requiring user relative to the control panel 206 are synchronously displayed by the system server, and the scene providing user controls the walking movement track according to the offset direction and offset of the direction indicator displayed by the equipment client thereof, so that the equipment camera can acquire the scene and the target user required by the scene requiring user.
As shown in fig. 11, the present invention further includes an exhibition interface or conference interface, for example, the following general exhibition interface includes interfaces and modules corresponding to the following methods, including a registration and binding boundary surface and modules of internal exhibitors and exhibition positions of the users of the exhibition, and an head portrait of the users of the exhibition, company information and product information interfaces and modules; the method comprises the steps that an exhibitor of each exhibitor is taken as a target user of a system exhibitor field audience user and a scene demand user outside the exhibitor field, after each worker in the exhibitor user is registered as a registered user of the system through a face, face registration information of each worker is bound with the name of the exhibitor and the name of the exhibitor, the face registration information is stored in a database to form an exhibitor user, and head images, company information and product information of the exhibitor user are uploaded and set; when a scene providing user walks to the exhibition stand, the equipment camera of the scene providing user obtains a staff of the exhibition stand, the face recognition feature data is obtained and is compared and matched with face data of the exhibition user in the database, if the face data is the exhibition user, the head portrait of the exhibition user and the information of the exhibition user are sent to the equipment client of the scene requiring user for the view of the scene requiring user, and further social or information interaction is carried out with the exhibition user.
As shown in fig. 27 and 28, the present invention further includes a scene browsing interface and a requirement publishing interface, where a scene requirement user or a scene providing user publishes a scene requirement or scene providing information on the scene requirement interface, and the user browses and searches for own requirement on the scene browsing interface.
The scene browsing interface 501 or 601 includes an information icon issued by a scene requiring user or a scene providing user, the information icon including at least one of a head portrait 510, a nickname 511, a provided scene picture or video 615, and a provided scene symbol 512 and a required scene symbol 513 of the user, and displaying scene information 514 or 614 of the user on or beside the information icon with text, clicking the information icon or scene information, and establishing a scene sharing connection with the user.
In another embodiment, the scene browsing interface 501 or 601 includes an information icon published by a scene requiring user or a scene providing user, where the information icon includes at least one of a head portrait 510, a nickname 511, a provided scene picture or video 615, and a provided scene symbol 512 and a required scene symbol 513 of the user, and displays scene information of the user on the information icon or beside the information icon with text, clicks the information icon or the scene information, pops up a message window, sends a message to the user, sets a scene connection button in the message window, clicks the scene connection button, and establishes a scene sharing connection with the user.
The invention also comprises a map interface, a scene requirement user or a scene providing user marks the position of the user on the map interface, issues the requirement on the map interface, and the user searches the requirement on the map interface. The map interface comprises an information icon of a user displayed on the geographic position of the user, wherein the information icon comprises at least one of a head portrait and a nickname of the user, scene information of the user is displayed beside the user icon, the user icon or the scene information is clicked, and scene sharing connection is established with the user;
in another embodiment, the scene information of the user is displayed beside the user icon, the user icon or the scene information is clicked, a message window is popped up, a message is sent to the user, a scene connection button is set in the message window, the scene connection button is clicked, and a scene sharing connection is established with the user.
The invention also comprises a appreciation setting button and/or a appreciation button; the reward setting button is arranged on the demand release interface, and the user sets the reward amount; the appreciation button is arranged on an information icon or scene information issued by the scene browsing interface or on a pop-up message window for clicking the information icon or the scene information, or the appreciation button is not arranged, and the appreciation is directly deducted after the scene sharing is finished, or the appreciation button is still arranged, and after the scene sharing is finished, the user is required to click the appreciation button according to the scene sharing condition after the scene sharing is finished, so that the appreciation is paid.
As shown in fig. 27 and 28, the present invention further includes a scene requirement search box located at an upper end of the scene requirement information interface or the scene providing information interface, for a user to search for required scene information.
The foregoing is merely a preferred embodiment of the present invention, and it should be noted that it will be apparent to those skilled in the art that variations and modifications can be made without departing from the spirit of the invention.
Claims (9)
1. A social or information interaction method based on face recognition and scene sharing is characterized in that:
the system user extracts the face characteristic data of the user at the equipment client through a camera, binds the face characteristic data with the registered ID of the user and stores the face characteristic data in a database;
the method comprises the steps that a scene demand user or a scene providing user sends scene demand information or scene providing information comprising at least one of a demanded or provided scene name, a geographic position or a place name to a device client of a system user through a system server at a device client of the scene demand user or the scene providing user;
or, the scene demand user or the scene provision sends a scene demand request or a scene provision request comprising at least one of a demanded or provided scene name, a geographic position or a place name to the system server at the device client thereof;
the user checks the scene demand information or scene providing information of the system user pushed by the system at the equipment client thereof, clicks a connection button, and establishes communication connection with the equipment client of the scene demand user or scene providing user corresponding to the button;
or the system server matches the user according to a scene demand request or a scene providing request which is sent to the system server by the equipment client of the system server and comprises at least one of a required or provided scene name, a geographic position or a place name, and if the matching is successful, the communication connection between the scene demand user client and the scene providing user client is established;
the scene providing user sends the current scene picture obtained in real time to the scene demand user client for real-time display and play through the equipment camera thereof;
a device camera of a scene providing user acquires a target user face image of a current scene, and face feature data is extracted;
comparing and matching the extracted face feature data with the face feature data of the user in the database, and judging whether the user is a registered user of the system;
if yes, sending the information of the target user at least comprising the head portrait to a scene demand user according to a matching result and displaying the information on a device client of the scene demand user so as to be checked by the scene demand user and further conduct social or information interaction with the target user according to requirements;
the lens direction control instructions comprise a lens direction control panel and a control button displayed on a scene demand user equipment client, a visual operation instruction of a lens direction indication frame and an indication mark displayed on a scene providing user equipment client, or a voice instruction;
the walking direction control instruction comprises a walking direction control panel displayed on the client side of the user equipment required by the scene and a visual operation instruction or a voice instruction of a walking direction indication frame displayed on the client side of the user equipment provided by the scene;
the exhibition system also comprises an exhibition interface or a meeting interface, wherein the exhibition interface comprises a registration and binding boundary surface and a module of an internal exhibition staff and an exhibition booth of an exhibition user, and an exhibition user head portrait, company information and product information interface and a module;
the method comprises the steps that an exhibitor of each exhibitor is taken as a target user of a system exhibitor field audience user and a scene demand user outside the exhibitor field, after each worker in the exhibitor user is registered as a registered user of the system through a face, face registration information of each worker is bound with the name of the exhibitor and the name of the exhibitor, the face registration information is stored in a database to form an exhibitor user, and head images, company information and product information of the exhibitor user are uploaded and set;
when a scene providing user walks to the exhibition stand, the equipment camera of the scene providing user obtains a staff of the exhibition stand, the face recognition feature data is obtained and is compared and matched with face data of the exhibition user in the database, if the face data is the exhibition user, the head portrait of the exhibition user and the information of the exhibition user are sent to the equipment client of the scene requiring user for the view of the scene requiring user, and further social or information interaction is carried out with the exhibition user.
2. The method of claim 1, wherein:
and the scene demand user clicks the information of the target user at least comprising the head portrait at the equipment client thereof, pops up an information interaction window and sends information to the target user.
3. The method of claim 2, wherein:
the target user receives the information sent by the scene demand user and displays the information on the equipment client side, at least one of the head portrait and the nickname of the scene demand user is displayed on the equipment client side, or at least one of the head portrait and the nickname of the scene demand user is displayed on the equipment client side and at least one of the head portrait and the nickname of the scene supply user is additionally displayed on the equipment client side;
or the target user receives the information sent by the scene demand user, displays the information on the equipment client side of the target user, displays at least one of the head portrait and the nickname of the scene demand user on the equipment client side of the target user, and simultaneously displays the same or similar text description of 'providing user connection through the scene' as a mark, or marks the head portrait or the nickname of the scene providing user by using a mark symbol representing the meaning as the mark.
4. A method according to claim 1 or 2, characterized in that:
when a scene demand user is matched with more than one user information through the face recognition of a device camera of the scene supply user, the more than one information at least comprising head portraits is displayed on a device client of the scene demand user in a horizontal or vertical list mode.
5. A method according to any one of claims 1-3, wherein:
and setting a collection button on the information at least comprising the head portrait of the user, and clicking the collection button to collect the information of the target user or the scene providing user.
6. A method according to claim 1 or 2, characterized in that:
and setting a target user matched with the current scene through the face recognition of the scene providing user at the equipment client of the scene requiring user, and only pushing the information of at least the head portrait of the target user to the equipment client of the scene requiring user, or simultaneously pushing the information of at least the head portrait of the target user to the equipment clients of the scene requiring user and the scene providing user.
7. A method according to claim 1 or 2, characterized in that:
according to the setting of the scene demand user, the scene providing user and the target user, the scene demand user, the scene providing user and the target user are divided into the same temporary group, so that the three parties send messages in the group, and social or information interaction is carried out.
8. A method according to claim 1 or 2, characterized in that:
the scene demand user sends a shot direction control instruction to the scene providing user in real time through the client thereof so as to facilitate the scene demand user to find a target user or a scene;
the method comprises the steps that the offset direction and offset of a lens direction indicator displayed by a scene providing user equipment client relative to an indication frame and the offset direction and offset of a lens direction control button of the equipment client of a scene demand user relative to a control panel are synchronously displayed through a system server, and the scene providing user controls a device camera to acquire the direction of a current scene and stop moving according to the offset direction and offset of the direction indicator displayed by the equipment client;
and setting a photographing/video button at the equipment client of the scene requirement user, binding the photographing/video button with the photographing/video button of the equipment client of the scene requirement user, sending a photographing/video instruction to the equipment client of the scene requirement user in real time through a system server when the scene requirement user presses the photographing/video button at the equipment client of the scene requirement user, controlling the equipment camera of the scene requirement user to photograph/video, and then sending the photographed/video to the scene requirement user.
9. A method according to claim 1 or 2, characterized in that:
the scene demand user sends a walking direction control instruction to the scene providing user in real time through the client thereof so as to facilitate the scene demand user to find the target user or the scene;
the method comprises the steps that a direction indication mark of a walking direction indication frame displayed by a user equipment client side of a scene providing user and a control direction and offset of a walking direction control wheel of the equipment client side of a scene requiring user are synchronously displayed through a system server, and the scene providing user controls a walking movement track of the scene providing user according to the offset direction and the offset of the direction indication mark displayed by the equipment client side of the scene providing user, so that a scene and a target user required by the scene requiring user can be conveniently acquired by an equipment camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910748279.4A CN110545234B (en) | 2019-08-05 | 2019-08-05 | Social or information interaction method based on face recognition and scene sharing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910748279.4A CN110545234B (en) | 2019-08-05 | 2019-08-05 | Social or information interaction method based on face recognition and scene sharing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110545234A CN110545234A (en) | 2019-12-06 |
| CN110545234B true CN110545234B (en) | 2024-03-01 |
Family
ID=68710947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910748279.4A Active CN110545234B (en) | 2019-08-05 | 2019-08-05 | Social or information interaction method based on face recognition and scene sharing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110545234B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102694826A (en) * | 2011-03-22 | 2012-09-26 | 百度在线网络技术（北京）有限公司 | Device and method for obtaining shared object related to real scene |
| CN103412953A (en) * | 2013-08-30 | 2013-11-27 | 苏州跨界软件科技有限公司 | Social contact method on the basis of augmented reality |
| CN106844677A (en) * | 2017-01-24 | 2017-06-13 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method and device of Information Sharing |
| CN108668174A (en) * | 2017-03-28 | 2018-10-16 | 张克 | It is a kind of to realize video resource and the social method blended and video social activity emerging system |
| CN108734595A (en) * | 2017-04-17 | 2018-11-02 | 金德奎 | A kind of photograph taking and acquisition methods and its social contact method |
| CN109005099A (en) * | 2017-06-06 | 2018-12-14 | 金德奎 | A kind of reality scene sharing method and its social activity or method for gaming |
| CN109120504A (en) * | 2017-06-26 | 2019-01-01 | 金德奎 | A kind of image documentation equipment sharing method and its social contact method |
| CN109461003A (en) * | 2018-11-30 | 2019-03-12 | 阿里巴巴集团控股有限公司 | Plurality of human faces scene brush face payment risk preventing control method and equipment based on multi-angle of view |
| CN109508523A (en) * | 2017-09-11 | 2019-03-22 | 金德奎 | A kind of social contact method based on recognition of face |
-
2019
- 2019-08-05 CN CN201910748279.4A patent/CN110545234B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102694826A (en) * | 2011-03-22 | 2012-09-26 | 百度在线网络技术（北京）有限公司 | Device and method for obtaining shared object related to real scene |
| CN103412953A (en) * | 2013-08-30 | 2013-11-27 | 苏州跨界软件科技有限公司 | Social contact method on the basis of augmented reality |
| CN106844677A (en) * | 2017-01-24 | 2017-06-13 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method and device of Information Sharing |
| CN108668174A (en) * | 2017-03-28 | 2018-10-16 | 张克 | It is a kind of to realize video resource and the social method blended and video social activity emerging system |
| CN108734595A (en) * | 2017-04-17 | 2018-11-02 | 金德奎 | A kind of photograph taking and acquisition methods and its social contact method |
| CN109005099A (en) * | 2017-06-06 | 2018-12-14 | 金德奎 | A kind of reality scene sharing method and its social activity or method for gaming |
| CN109120504A (en) * | 2017-06-26 | 2019-01-01 | 金德奎 | A kind of image documentation equipment sharing method and its social contact method |
| CN109508523A (en) * | 2017-09-11 | 2019-03-22 | 金德奎 | A kind of social contact method based on recognition of face |
| CN109461003A (en) * | 2018-11-30 | 2019-03-12 | 阿里巴巴集团控股有限公司 | Plurality of human faces scene brush face payment risk preventing control method and equipment based on multi-angle of view |
Non-Patent Citations (1)
| Title |
|---|
| 移动互联时代社交媒体场景化应用分析;袁雨晴;;中国传媒科技(第03期) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110545234A (en) | 2019-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3238445B1 (en) | Interactive binocular video display | |
| CN102194007B (en) | System and method for acquiring mobile augmented reality information | |
| US20180300097A1 (en) | Communication to an Audience at an Event | |
| CN103620600B (en) | Method and apparatus for enabling virtual tags | |
| CN103635954B (en) | Strengthen the system of viewdata stream based on geographical and visual information | |
| CN106548517B (en) | Method and device for carrying out video conference based on augmented reality technology | |
| US20140178029A1 (en) | Novel Augmented Reality Kiosks | |
| EP2207113A1 (en) | Automated annotation of a view | |
| US9264474B2 (en) | System and method of portraying the shifting level of interest in an object or location | |
| CN107870962B (en) | Method and system for remotely managing local space objects | |
| CN109120504B (en) | Image equipment sharing method and social contact method thereof | |
| CN107870961B (en) | Method and system for searching and sorting space objects and computer readable storage device | |
| CN110336829B (en) | Data processing method and system, server and client | |
| WO2021218547A1 (en) | Method for superimposing live image of person onto real scene, and electronic device | |
| WO2008016083A1 (en) | Overlay information presentation device and overlay information presentation system | |
| CN108733272B (en) | Method and system for managing visible range of location-adaptive space object | |
| JP2022008888A (en) | Server, terminal, distribution system, distribution method, and information processing method | |
| CN110545234B (en) | Social or information interaction method based on face recognition and scene sharing | |
| CN110750155B (en) | Method, device, medium and electronic equipment for interacting with image | |
| US11847297B2 (en) | Method of providing real-time VR service through avatar | |
| CN112437332B (en) | Playing method and device of target multimedia information | |
| JP7466213B2 (en) | Imaging method and system | |
| CN115062207A (en) | Data acquisition method and system | |
| CN115114501A (en) | Method and system for acquiring application data | |
| JP2002232858A (en) | Document processing method, document processor and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240131 Address after: 107, 1st floor, Tsinghua Information Port scientific research building, Nanshan District, Shenzhen, Guangdong 518000 Applicant after: Shenzhen Facebook Technology Co.,Ltd. Country or region after: China Address before: 107, 1st floor, Tsinghua Information Port scientific research building, Nanshan District, Shenzhen, Guangdong 518000 Applicant before: Jin Dekui Country or region before: China |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |