CN110598088A - Searching method and system based on environmental information - Google Patents

Searching method and system based on environmental information Download PDF

Info

Publication number
CN110598088A
CN110598088A CN201810521244.2A CN201810521244A CN110598088A CN 110598088 A CN110598088 A CN 110598088A CN 201810521244 A CN201810521244 A CN 201810521244A CN 110598088 A CN110598088 A CN 110598088A
Authority
CN
China
Prior art keywords
user
information
search
service platform
cloud service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201810521244.2A
Other languages
Chinese (zh)
Inventor
程曦
霍俊杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Haode Translation Information Technology Co Ltd
Original Assignee
Chongqing Haode Translation Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Haode Translation Information Technology Co Ltd filed Critical Chongqing Haode Translation Information Technology Co Ltd
Priority to CN201810521244.2A priority Critical patent/CN110598088A/en
Publication of CN110598088A publication Critical patent/CN110598088A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/52Network services specially adapted for the location of the user terminal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/029Location-based management or tracking services

Abstract

The invention relates to a searching method and a searching system based on environmental information, wherein the searching method comprises the following steps: acquiring facial image information of a user through a plurality of mobile computing devices of the user and uploading the facial image information to a facial recognition system; analyzing and processing facial image information uploaded by a user, analyzing and comparing the facial image information with data information in a database of a cloud service platform, and authorizing the user to enable the user to enter a search window configured in the user; after a user enters a search window configured to the user, a cloud service platform acquires a search request input by the user and generates a first search result; when the search request is obtained, the cloud service platform obtains first environment information of the user from the plurality of mobile computing devices, and generates a second search result containing the preference of the user in the first environment based on the first environment information and the user configuration file; and the cloud service platform provides the first search result and the second search result to the user together.

Description

Searching method and system based on environmental information
Technical Field
The invention belongs to the technical field of communication, and particularly relates to a searching method and system based on environmental information.
Background
Currently, most search engines rank search results mainly based on indexes such as semantics, matching degree, website click rate, website quality, website ranking and the like of websites and search keywords.
For example, chinese patent publication No. CN101620625 discloses a search keyword ranking method, apparatus and search engine, the method comprising: collecting search log information and attribute information of a user, wherein the search log information comprises a user identifier and a search keyword, and the attribute information comprises the user identifier and a user attribute; establishing a corresponding relation between the user attribute and the search keyword according to the search log information and the attribute information of the user; calculating the attribute weighted value of each search keyword by adopting a preset search keyword weighted formula according to the corresponding relation between the user attribute and the search keyword; and sequencing the search keywords according to the attribute weighted values of the search keywords. The embodiment of the invention can accurately and quickly mine the data information which not only has higher searching heat, but also represents the searching habits of various user groups, thereby obtaining the information which can truly reflect the searching habits of network users and providing data support for further understanding and meeting the user requirements. However, the patent cannot provide the user with the search result aiming at the environment according to the external environment condition of the user, because the user's preference for the search result is different under different environments.
For example, chinese patent publication No. CN104462557A discloses an instant search method and device based on search history, the method includes: receiving a current search keyword from a user; searching whether a historical search word matched with the current search keyword exists in a search history record to obtain a search result; and if the search result is that the historical search words matched with the current search keywords exist, initiating instant search based on the current search keywords. The invention can search the historical search words matched with the current search keywords from the search historical records based on the current search keywords, further initiate instant search, realize quick search, and does not need a user to trigger a search button to initiate search, thereby saving the time of the user, realizing the purpose that a search engine conveniently and efficiently interacts with the user, simplifying the operation of the user, and improving the user experience. However, the invention does not consider the environment in which the user is in searching using the search keywords of the history, and the user's preference may be different under different environmental conditions.
The same user has different requirements for search results in different environments. Different users have different requirements for search results in the same environment. However, the current search engine and the current search result ranking method do not consider the environment of the user and the preference of the user under the environment when ranking the search results. When a user searches in different environments, search results presented to the user by a search engine are uniform, and personalized requirements of the user are not met. Moreover, after the user searches by the search engine, the user may leave a search record, which is not favorable for protecting the security and privacy of the user's information.
Therefore, a method for providing search service according to the environment of the user when the user performs online activities or offline activities and the preference of the user under the environment condition is needed, and independence, privacy and safety of search records of each user can be ensured, so that the search requirements of the user can be better met, and the search experience of the user can be improved.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a searching method and a searching system based on environmental information, and the invention provides a searching window with privacy and safety protection functions based on facial recognition for each user; the method comprises the steps of tracking a first specific event and/or a second specific event, and acquiring surrounding environment information when the first specific event and/or the second specific event occur, so that the preference of a user for the specific event under the environment information is analyzed, the accuracy of providing search service later by a cloud service platform is improved, and the user experience is greatly improved.
According to a preferred embodiment, a search method based on environmental information, the method comprising: the method comprises the steps that facial image information of a user is obtained through at least one of a plurality of mobile computing devices carried and/or worn by the user, and the facial image information is uploaded to a facial recognition system; the facial recognition system and cloud service platform are configured to: analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of a cloud service platform, and if data information similar to or identical to the facial image information based on the user is not searched in the cloud database, creating a search window configured for the user and authorizing the search window to enable the user to enter the search window; if data information similar/identical to the facial image information based on the user is searched in the cloud database, authorizing the user so that the user can enter a search window configured in the user; after a user enters a search window configured on the cloud service platform, the cloud service platform acquires a search request which is input by the user and comprises search parameters corresponding to expected information, and generates a first search result based on the search parameters; when the search request is obtained, the cloud service platform obtains first environment information of the user through at least one of the mobile computing devices, and generates a second search result which is in accordance with the preference of the user in the first environment based on the first environment information and a user configuration file; and the cloud service platform provides the first search result and the second search result to the user together.
According to a preferred embodiment, the user profile is set as follows: tracking online activity of a user by at least one of a number of mobile computing devices carried and/or worn by the user to obtain a relevant first specific event; when at least one first specific event occurs, acquiring and recording second environment information of the user when the first specific event occurs through at least one of the mobile computing devices; the cloud service platform acquires and processes the corresponding first specific event and the corresponding second environment information to analyze the preference of the user for the corresponding first specific event under the corresponding second environment information and update the user configuration file accordingly.
According to a preferred embodiment, the user profile is set as follows: recording the body form, the four-limb state, the movement speed and the movement acceleration of the user through at least one of a plurality of mobile computing devices carried and/or worn by the user to acquire the offline activity of the user, and analyzing according to the offline activity to obtain a related second specific event; when at least one second specific event occurs, acquiring and recording third environment information of the user when the first specific event occurs through at least one of the plurality of mobile computing devices; the cloud service platform acquires the corresponding second specific event and the third environment information corresponding to the second specific event for processing, so that the preference of the user for the corresponding second specific event under the corresponding third environment information is analyzed, and the user configuration file is updated accordingly.
According to a preferred embodiment, the cloud service platform is set as follows: after the cloud service platform generates a first search result and a second search result, acquiring content reactions of a user to displayed parts of the first search result and the second search result; and dynamically adjusting the display sequence of the undisplayed parts of the subsequently provided first search result and the second search result according to the reaction so as to fit the requirement of the user on the first search result or the second search result.
According to a preferred embodiment, the reaction is identified by the user's action on the displayed portions of the first and second search results in combination with at least one of the following collected information: capturing, by at least one of the number of mobile computing devices through its image capturing element, a user's facial expression during the user's browsing of the content of the displayed portions of the first and second search results; the reaction is a gesture and a physical action of the user captured by at least one of the number of mobile computing devices through its motion sensor during the user's browsing of the content of the displayed portions of the first and second search results; galvanic skin responses of the user captured by at least one of the number of mobile computing devices through its galvanic skin sensor during browsing by the user of the content of the displayed portions of the first and second search results.
According to a preferred embodiment, the online activity comprises at least one of an email, web content, instant messaging, browsing history, online gaming, and online transactions.
According to a preferred embodiment, the offline activity comprises at least one of public transportation, supermarket shopping, outdoor sports, dining, sitting and resting, and walking.
According to a preferred embodiment, the environmental information includes at least one of environmental properties, time information, light information, location conditions, humidity information, ambient temperature information, and sound information.
According to a preferred embodiment, the cloud service platform presents a movement track created based on geographic location information for the user on a GIS map through at least one of the plurality of mobile computing devices, and labels the corresponding first specific event and/or second specific event and the second environment information and/or the third environment information corresponding to the corresponding first specific event and/or second specific event in association on the movement track, and labels a corresponding preference weight index in association at the corresponding first specific event and/or second specific event, the preference weight index representing a weight of the corresponding specific event on analyzing the preference of the user for the corresponding first specific event and/or second specific event under the corresponding environment information, the cloud service platform provides modification authority of the preference weight index for the user, to enable a user to modify the preference weight index within a predetermined modification range; the cloud service platform is configured to: and providing the modification authority for the user only in a preset time range after the corresponding first specific event and/or second specific event occurs, and canceling the modification authority after the preset time range is exceeded.
According to a preferred embodiment, the present invention also discloses a search system based on environmental information, the system comprising: the method comprises the steps that facial image information of a user is obtained through at least one of a plurality of mobile computing devices carried and/or worn by the user, and the facial image information is uploaded to a facial recognition system; the facial recognition system and cloud service platform are configured to: analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of a cloud service platform, and if data information similar to or identical to the facial image information based on the user is not searched in the cloud database, creating a search window configured for the user and authorizing the search window to enable the user to enter the search window; if data information similar/identical to the facial image information based on the user is searched in the cloud database, authorizing the user so that the user can enter a search window configured in the user; after a user enters a search window configured on the cloud service platform, the cloud service platform acquires a search request which is input by the user and comprises search parameters corresponding to expected information, and generates a first search result based on the search parameters; when the search request is obtained, the cloud service platform obtains first environment information of the user through at least one of the mobile computing devices, and generates a second search result which is in accordance with the preference of the user in the first environment based on the first environment information and a user configuration file; the cloud service platform provides the first search result and the second search result to the user together; the user profile is set to: tracking online activity of a user by at least one of a number of mobile computing devices carried and/or worn by the user to obtain a relevant first specific event; when at least one first specific event occurs, acquiring and recording second environment information of the user when the first specific event occurs through at least one of the mobile computing devices; the cloud service platform acquires and processes the corresponding first specific event and the corresponding second environment information to analyze the preference of the user for the corresponding first specific event under the corresponding second environment information and update the user configuration file; and/or recording the body shape, the limb state, the movement speed and the movement acceleration of the user through at least one of a plurality of mobile computing devices carried and/or worn by the user to acquire the offline activity of the user, and analyzing according to the offline activity to obtain a related second specific event; when at least one second specific event occurs, acquiring and recording third environment information of the user when the first specific event occurs through at least one of the plurality of mobile computing devices; the cloud service platform acquires the corresponding second specific event and the third environment information corresponding to the second specific event for processing, so that the preference of the user for the corresponding second specific event under the corresponding third environment information is analyzed, and the user configuration file is updated accordingly.
The searching method and the searching system based on the environmental information provided by the invention at least have the following advantages:
(1) according to the method, the system and the device, when a specific event is tracked and an offline activity or an online activity occurs, surrounding environment information is obtained, and the cloud service platform analyzes the preference of a user for the specific event under the environment information, so that the accuracy of providing search service for the cloud service platform later is improved, and the user experience is improved;
(2) according to the invention, through the means that the user carries out facial recognition before entering the search window, the privacy and the safety of information when the user uses the search engine are protected, the user experience is further improved, and the crossing or confusion of the preference of the user for events caused by the fact that the same search engine is used by multiple people is avoided.
(3) According to the method, the mobile track and the label on the GIS map are used for quickly and accurately helping the user to recall the current environmental conditions and the psychological state when a specific event occurs, and the preference weight index is artificially modified by combining the understanding of the preference of the user, so that the second search result is more accurate; in addition, the invention also sets the preset time range capable of being modified, and under the condition that the preset time range is exceeded, the cloud service platform 10 cancels the modification authority of the preference weight index of the user, so that the reduction of the searching precision caused by the random modification of the preference weight index by the user is prevented, and the searching quality is ensured.
Drawings
FIG. 1 is a block schematic diagram of a preferred embodiment of the system of the present invention; and
FIG. 2 is a schematic flow diagram of a preferred embodiment of the method of the present invention.
List of reference numerals
10: cloud service platform 20: number of mobile computing devices
Detailed Description
The following detailed description is made with reference to fig. 1 and 2.
Example 1
The embodiment discloses a searching method and a searching system based on environmental information, and under the condition of not causing conflict or contradiction, the whole and/or part of the contents of the preferred implementation modes of other embodiments can be used as a supplement of the embodiment. Preferably, the method may be implemented by the system of the present invention and/or other alternative modules. For example, the method of the present invention is implemented by using various modules in the system of the present invention.
According to an alternative embodiment, the method may comprise at least one of the following steps:
obtaining facial image information of a user through at least one of a number of mobile computing devices 20 carried and/or worn by the user and uploading the facial image information to a facial recognition system;
the facial recognition system and cloud service platform 10 are configured to: analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of the cloud service platform 10, if data information similar to or identical to the facial image information of the user is not searched in the cloud database, creating a search window configured for the user and authorizing the search window to enable the user to enter the search window; if data information similar to or identical to the facial image information of the user is searched in the cloud database, authorizing the user so that the user can enter a search window configured in the user;
preferably, the face recognition system and/or system may comprise: the method comprises the steps of face image acquisition and detection, face image preprocessing, face image feature extraction and face image matching and identification. When the face image is collected, different face images, such as static images, dynamic images, different positions, different expressions and the like, can be collected through the camera lens, and when a user is in the shooting range of the collecting device, the collecting device can automatically search and shoot the face image of the user; when detecting the human face, useful information of the features such as histogram feature, color feature, template feature, structural feature and the like is picked out, and the human face detection is realized by using the features. When the human face image is preprocessed, the human face image is subjected to light compensation, gray level transformation, histogram equalization, normalization, geometric correction, filtering, sharpening and the like. When extracting the face image features, extracting feature data of face classification according to shape description of face organs and distance characteristics between the face organs, wherein feature components of the feature data generally comprise Euclidean distance, curvature, angle and the like between feature points. When the face images are matched and identified, the extracted feature data of the face images are searched and matched with the feature template stored in the database, and a threshold value is set, and when the similarity exceeds the threshold value, the result obtained by matching is output.
After a user enters a search window configured on the cloud service platform, the cloud service platform acquires a search request which is input by the user and comprises search parameters corresponding to expected information, and generates a first search result based on the search parameters; while acquiring the search request, the cloud service platform 10 acquires first environment information of the user through at least one of the mobile computing devices 20, and generates a second search result containing a preference that is in accordance with the user in the first environment based on the first environment information and a user profile; the cloud service platform 10 provides the first search result and the second search result to the user together.
According to a preferred embodiment, the user profile is set as follows: tracking online activity of a user by at least one of a number of mobile computing devices 20 carried and/or worn by the user to obtain a relevant first particular event; at the time of occurrence of at least one first specific event, acquiring and recording, by at least one of the mobile computing devices 20, second environmental information of the user at the time of occurrence of the first specific event; the cloud service platform 10 obtains the corresponding first specific event and the second environment information corresponding to the first specific event to process, so as to analyze the preference of the user for the corresponding first specific event under the corresponding second environment information and update the user profile accordingly.
Preferably, the first specific event may include various online events performed by the user on the network. Such as at least one of playing music, playing video, online gaming, physical product transactions, and virtual product transactions.
Preferably, the first specific event may include an event type and an event attribute. The event type and the event attribute may be specified by the cloud service platform 10. For example, the event type may include at least one of browsing a web page, playing music, playing a video, an online game, a physical product transaction, and a virtual product transaction. When the event type is playing music, its corresponding event attribute may include at least one of a music name, a tone color, a music genre, a singer, and an album. The physical product transaction is, for example, at least one of a restaurant checkout, purchasing accessories, purchasing books, purchasing beverages, purchasing takeoffs. The virtual product transaction is, for example, at least one of a stock transaction, a bond transaction, a bulk commodity transaction, and a virtual currency transaction.
According to a preferred embodiment, the number of mobile computing devices 20 may be at least one of a smartphone, smart glasses, smart bracelet, smart watch, smart headset, and smart apparel.
Preferably, the cloud service platform 10 may be a server or a server cluster.
Preferably, the cloud service provider may be an operator providing a search service for the user through the cloud service platform 10.
Preferably, the environmental information includes at least one of environmental properties, time information, light information, location conditions, humidity information, environmental temperature information, and sound information. Preferably, the environmental property is of a custom environmental type. For example, the environmental property may be classified as at least one of a workplace, a road, a sporting venue, an entertainment venue, a tourist attraction, and a residential venue. Preferably, the time information, the light information, the location condition, the humidity information, the ambient temperature information, and the sound information may be classified and counted according to the size of the dynamically changing particle size. Preferably, the granularity gradually becomes smaller as the amount of information for analyzing the preference of the user obtained by the cloud service platform 10 is larger. Preferably, the size of the granularity may vary in steps according to the number of pieces of information. For example, taking time information as an example, when the corresponding information amount is less than 100, the classification statistics can be performed according to the morning, afternoon, evening and late night. The morning may correspond to 06: 00-12: 00, which may correspond to 12: 00-18: 00, evening may correspond to 18: 00-24: 00, late at night may correspond to 00: 00-06: 00. the specific events that the user does at 12:45 may be used to analyze the user's preferences in the afternoon. When the corresponding information amount is more than 100 and less than 1000, the classification and statistics can be carried out according to twelve hours, namely the classification and statistics can be carried out according to son, ugly, tiger, fourth of twelve earthly branches, twelve heaves, six branches, noon, unfinished, Shen, you, and Hai. And when the corresponding information quantity is more than 1000 and less than 10000, performing classification statistics according to hours. When the corresponding information amount is more than 10000 pieces, classification statistics can be carried out according to minutes. For another example, taking the light ray information as an example, when the corresponding information amount is less than 200, the classification statistics may be performed according to the illuminance of less than 100Lux, greater than or equal to 100Lux, less than 200Lux, and greater than 200 Lux. When the corresponding information amount is more than 200 and less than 2000, the classification statistics can be performed by taking each 10Lux as a granularity. And when the corresponding information amount is more than 1000 and less than 10000, performing classification statistics by taking each 1Lux as one granularity. When the corresponding information amount is more than 10000 pieces, classification statistics can be carried out according to every 0.5 Lux. For another example, also taking the light ray information as an example, when the corresponding information amount is less than 100, the classification statistics may be performed according to the illuminance of less than 100Lux, greater than or equal to 100Lux, less than 200Lux, and greater than 200 Lux. When the corresponding information amount is more than 100, classifying and counting according to the illumination range of [ 0-0.5 ], [ 0.5-1 ], [ 1-3 ], [ 3-5 ], [ 5-10 ], [ 10-15 ], [ 15-20 ], [ 20-30 ], [ 30-50 ], [ 50-75 ], [ 75-100 ], [ 100-150 ], [ 150-200 ], [ 200-300 ], [ 300-500 ], [ 500-750 ], [ 750-1000 ], [ 1000-1500 ], [ 1500-2000 ], [ 2000-3000 ], [ 3000-5000 ], and [5000 ∞) ], wherein the illumination unit is Lux. According to the illumination range, grading statistics is carried out on the illumination, and preference changes of users corresponding to visual changes brought by light intensity can be more accurately counted. Since the user can clearly perceive the minimum change of the illumination in the subjective effect of the change of each range here, the statistically analyzed preference can be more reflected by the light cause. For another example, the sound information is divided into musical tones and noises. The musical tones can be classified and counted according to the type and decibel level of the played music. The noise can be counted in decibel scale.
According to a preferred embodiment, the cloud service platform is set as follows: after the cloud service platform 10 generates the first search result and the second search result, acquiring content reactions of the displayed parts of the first search result and the second search result from the user; and dynamically adjusting the display sequence of the undisplayed parts of the subsequently provided first search result and the second search result according to the reaction so as to fit the requirement of the user on the first search result or the second search result.
According to a preferred embodiment, the reaction is identified by the user's action on the displayed portions of the first and second search results in combination with at least one of the following collected information: facial expressions of the user captured by at least one of the number of mobile computing devices 20 through its image capturing element during browsing by the user of the content of the displayed portions of the first and second search results; the reaction is a gesture and a physical action of the user captured by at least one of the number of mobile computing devices 20 through its motion sensor during the user's browsing of the content of the displayed portions of the first and second search results; galvanic skin responses of the user captured by at least one of the number of mobile computing devices 20 through its galvanic skin sensor during browsing of the content of the displayed portions of the first and second search results by the user.
Preferably, the reaction may include like, neutral and dislike. Preferably, the cloud service platform 10 can also assign different grades for like, neutral and dislike respectively. For example, like, neutral, and dislike may have two levels, respectively. When a user searches for music, if ten pieces of classical music that have been displayed are browsed five times and played four times and ten pieces of rock music that have been displayed are browsed ten times and played ten times, the classical music is assigned to a first level of liking and the rock music is assigned to a second level of liking. If ten pieces of jazz music that have been displayed are played twice through zero, they are assigned to the neutral first rank. If ten pieces of heavy metal music that have been displayed are browsed once and played once, they are assigned to the neutral second level. If ten pieces of country music have been displayed without browsing, they are assigned to the disliked first rank. If ten punk music pieces are displayed without browsing and are actively deleted from the search results or are skipped at a higher rate than country music, they are assigned a second level of dislike.
According to a preferred embodiment, the cloud service platform 10 presents a movement track created based on the geographic location information for the user on the GIS map through at least one of the mobile computing devices 20, and labels the corresponding first specific event and/or second specific event and the second environment information and/or the third environment information corresponding to the corresponding first specific event and/or second specific event on the movement track in association, and marks a corresponding preference weight index at the corresponding first specific event and/or second specific event in association, the preference weight index representing a weight of the corresponding specific event to a preference of the analysis user for the corresponding first specific event and/or second specific event under the corresponding environment information, the cloud service platform 10 provides the user with a modification authority of the preference weight index, to enable a user to modify the preference weight index within a predetermined modification range; the cloud service platform 10 is configured to: and providing the modification authority for the user only in a preset time range after the corresponding first specific event and/or second specific event occurs, and canceling the modification authority after the preset time range is exceeded. Because although a corresponding specific event sometimes occurs under a certain environmental condition, the analyzed preferences may deviate from the actual preferences of the user due to special reasons. For example, when the user may be simply bored, a large number of specific events may have occurred without purpose for a short time, which is not a preference of the user in the environmental condition. However, in this case, if the cloud service platform 10 performs analysis in this way, the user preference under the environmental condition is deviated from the actual one. At this point, the user should be provided with an opportunity to correct. However, if the user is corrected, it is difficult for the user to reproduce the current environmental conditions in mind and to correctly associate each specific event with the current environmental conditions if the user is only form data. Therefore, through the method and the device, a user can quickly and accurately recall the current environmental conditions and the psychological states when the first and/or second specific events occur by the aid of the moving tracks and the marks on the GIS map, and the preference weight index is artificially modified by combining the understanding of the preference of the user, so that the second search result is more accurate.
According to a preferred embodiment, the number of mobile computing devices 20 may include at least one of a smart watch, a smart bracelet, smart glasses, smart headphones, a smart phone, smart apparel, and smart footwear. For example, the number of mobile computing devices 20 may include smart phones and smart glasses. The cloud service platform 10 is configured to track specific events of online activity related to playing music. When a user browses a web page on a smart phone and then browses a piece of music, the user plays the music on the smart phone, and the smart phone tracks a specific event related to the playing of the music. At this time, the smart glasses acquire second environment information where the user is located when the music is played. The cloud service platform 10 obtains the specific event and the second environment information, and analyzes the specific event and the second environment information to obtain that the user likes to listen to classical music under the environment condition. When the user searches music next time, a first search result composed of all music is firstly prepared for the user. If the first environmental condition of the user is the same as and/or similar to the environmental condition, providing a second search result composed of classical music for the user, and then providing the first search result and the second search result to the user together.
According to another preferred embodiment, the method may comprise at least one of the following steps:
obtaining facial image information of a user through at least one of a number of mobile computing devices 20 carried and/or worn by the user and uploading the facial image information to a facial recognition system;
the facial recognition system and cloud service platform 10 are configured to: analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of the cloud service platform 10, if data information similar to or identical to the facial image information based on the user is not searched in the cloud database, creating a search window configured for the user and authorizing the search window to enable the user to enter the search window; if data information similar/identical to the facial image information based on the user is searched in the cloud database, authorizing the user so that the user can enter a search window configured in the user;
after a user enters a search window configured on the cloud service platform, the cloud service platform acquires a search request which is input by the user and comprises search parameters corresponding to expected information, and generates a first search result based on the search parameters; while acquiring the search request, the cloud service platform 10 acquires first environment information of the user through at least one of the mobile computing devices 20, and generates a second search result containing a preference that is in accordance with the user in the first environment based on the first environment information and a user profile; the cloud service platform 10 provides the first search result and the second search result to the user together.
According to a preferred embodiment, the user profile may be set as follows: recording the body shape, the four-limb state, the movement speed and the movement acceleration of the user through at least one of a plurality of mobile computing devices 20 carried and/or worn by the user to acquire the offline activity of the user, and analyzing to obtain a related second specific event according to the offline activity; obtaining and recording, by at least one of the number of mobile computing devices 20, third context information in which the user was located at the time of the occurrence of the first particular event, upon the occurrence of at least one second particular event; the cloud service platform 10 obtains the corresponding second specific event and the third environment information corresponding to the second specific event for processing, so as to analyze the preference of the user for the corresponding second specific event under the corresponding third environment information and update the user profile accordingly.
Preferably, the offline activity may include at least one of public transportation, supermarket shopping, outdoor sports, dining, sitting and resting, and walking.
According to a preferred embodiment, the cloud service platform is set as follows: after the cloud service platform 10 generates the first search result and the second search result, acquiring content reactions of the displayed parts of the first search result and the second search result from the user; and dynamically adjusting the display sequence of the undisplayed parts of the subsequently provided first search result and the second search result according to the reaction so as to fit the requirement of the user on the first search result or the second search result.
According to a preferred embodiment, the reaction is identified by the user's action on the displayed portions of the first and second search results in combination with at least one of the following collected information: facial expressions of the user captured by at least one of the number of mobile computing devices 20 through its image capturing element during browsing by the user of the content of the displayed portions of the first and second search results; the reaction is a gesture and a physical action of the user captured by at least one of the number of mobile computing devices 20 through its motion sensor during the user's browsing of the content of the displayed portions of the first and second search results; galvanic skin responses of the user captured by at least one of the number of mobile computing devices 20 through its galvanic skin sensor during browsing of the content of the displayed portions of the first and second search results by the user.
According to a preferred embodiment, the cloud service platform 10 presents a movement track created based on the geographic location information for the user on the GIS map through at least one of the mobile computing devices 20, and labels the corresponding first specific event and/or second specific event and the second environment information and/or the third environment information corresponding to the corresponding first specific event and/or second specific event on the movement track in association, and marks a corresponding preference weight index at the corresponding first specific event and/or second specific event in association, the preference weight index representing a weight of the corresponding specific event to a preference of the analysis user for the corresponding first specific event and/or second specific event under the corresponding environment information, the cloud service platform 10 provides the user with a modification authority of the preference weight index, to enable a user to modify the preference weight index within a predetermined modification range; the cloud service platform 10 is configured to: and providing the modification authority for the user only in a preset time range after the corresponding first specific event and/or second specific event occurs, and canceling the modification authority after the preset time range is exceeded.
According to a preferred embodiment, the number of mobile computing devices 20 may include at least one of a smart watch, a smart bracelet, smart glasses, smart headphones, a smart phone, smart apparel, and smart footwear. For example, the number of mobile computing devices 20 may include smart phones and smart glasses. The cloud service platform 10 is configured to track specific events related to outdoor activities that are offline. When the user browses a fitness video during outdoor sports, the user plays the fitness video on the smart phone, and at the moment, the smart phone tracks a second specific event related to the outdoor sports. At this time, the intelligent glasses acquire the third environment information of the user when the fitness video is played. The cloud service platform 10 obtains the second specific event and the third environment information, and analyzes the second specific event and the third environment information to obtain that the user likes to play the fitness video under the environment condition. And when the user searches videos in outdoor sports next time, first, a first search result composed of all sports videos is prepared for the user. And if the first environmental condition of the user is the same as and/or similar to the environmental condition, providing a second search result consisting of the fitness video for the user, and then providing the first search result and the second search result together to the user.
According to another alternative embodiment, referring to fig. 2, the method may comprise at least one of the following steps:
step S100: tracking, by at least one of the number of mobile computing devices 20 moving with the user, time-related geographic location information of the user during a period of time;
step S200: while tracking the user's geographic location information, synchronously tracking, by at least one of the number of mobile computing devices 20, online activity and/or offline activity of the user and in temporal registration with the geographic location information;
step S300: processing the time-dependent geographic location information and the online activity and/or offline activity to analyze the user's preferences and/or habits for particular events under the respective context information over the time period and to update the user profile accordingly;
step S400: the user enters a search window after being authorized by the face recognition system;
step S500: acquiring a search request which is input by a user and comprises search parameters corresponding to expected information, and generating a first search result based on the search parameters;
step S600: while obtaining a search request input by a user that includes search parameters corresponding to desired information, obtaining current geographic location information of the user through at least one of a number of mobile computing devices 20 carried and/or worn by the user to determine current environmental information, and generating second search results containing particular advertisements associated with the current environmental information and the user's preferences and/or habits based on the current environmental information and the user profile;
step S700: the cloud service platform 10 provides the first search result and the second search result to the user together.
Example 2
The embodiment discloses a search system based on environmental information, which is suitable for executing the steps of the method described by the invention to achieve the expected technical effect. The preferred embodiments of the present invention are described in whole and/or in part in the context of other embodiments, which can supplement the present embodiment, without resulting in conflict or inconsistency.
According to a preferred embodiment, the system may comprise: obtaining facial image information of a user through at least one of a number of mobile computing devices 20 carried and/or worn by the user and uploading the facial image information to a facial recognition system; the facial recognition system and cloud service platform 10 are configured to: analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of the cloud service platform 10, if data information similar to or identical to the facial image information based on the user is not searched in the cloud database, creating a search window configured for the user and authorizing the search window to enable the user to enter the search window; if data information similar/identical to the facial image information based on the user is searched in the cloud database, authorizing the user so that the user can enter a search window configured in the user; after a user enters a search window configured on the cloud service platform, the cloud service platform acquires a search request which is input by the user and comprises search parameters corresponding to expected information, and generates a first search result based on the search parameters; while acquiring the search request, the cloud service platform 10 acquires first environment information of the user through at least one of the mobile computing devices 20, and generates a second search result containing a preference that is in accordance with the user in the first environment based on the first environment information and a user profile; the cloud service platform 10 provides the first search result and the second search result to the user together;
according to a preferred embodiment, the user profile is arranged to: tracking online activity of a user by at least one of a number of mobile computing devices 20 carried and/or worn by the user to obtain a relevant first particular event; at the time of occurrence of at least one first specific event, acquiring and recording, by at least one of the mobile computing devices 20, second environmental information of the user at the time of occurrence of the first specific event; the cloud service platform 10 acquires and processes the corresponding first specific event and the corresponding second environment information to analyze the preference of the user for the corresponding first specific event under the corresponding second environment information and update the user profile accordingly; and/or recording the body shape, the limb state, the movement speed and the movement acceleration of the user through at least one of a plurality of mobile computing devices 20 carried and/or worn by the user to acquire the offline activity of the user, and analyzing according to the offline activity to obtain a related second specific event; obtaining and recording, by at least one of the number of mobile computing devices 20, third context information in which the user was located at the time of the occurrence of the first particular event, upon the occurrence of at least one second particular event; the cloud service platform 10 obtains the corresponding second specific event and the third environment information corresponding to the second specific event for processing, so as to analyze the preference of the user for the corresponding second specific event under the corresponding third environment information and update the user profile accordingly.
It should be noted that the above-mentioned embodiments are exemplary, and that those skilled in the art, having benefit of the present disclosure, may devise various arrangements that are within the scope of the present disclosure and that fall within the scope of the invention. It should be understood by those skilled in the art that the present specification and figures are illustrative only and are not limiting upon the claims. The scope of the invention is defined by the claims and their equivalents.

Claims (10)

1. A method for searching based on environmental information, the method comprising:
obtaining facial image information of a user by at least one of a number of mobile computing devices (20) carried by the user and uploading the facial image information to a facial recognition system;
at least one of the plurality of mobile computing devices (20) is in communication connection with the cloud service platform (10);
the facial recognition system and cloud service platform (10) are configured to:
analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of a cloud service platform (10), if data information similar to or identical to the facial image information of the user is not searched in the cloud database, updating the data information based on the facial image information of the user in the cloud database, setting a search window configured for the user, and authorizing the user to enter the search window; if data information similar to or identical to the facial image information of the user is searched in the cloud database, authorizing the user to enable the user to enter a preset search window configured for the user;
after a user enters the search window configured to the user, the cloud service platform acquires a search request input by the user and based on search parameters, and generates a first search result according to the search parameters;
when the search request of the user is obtained, the cloud service platform (10) obtains first environment information of the user through at least one of the mobile computing devices (20), and generates a second search result which is matched with the preference of the user in the first environment based on the first environment information and a user profile;
the cloud service platform (10) provides the first search result and the second search result to the user together.
2. The method of claim 1, wherein the user profile is set as follows:
tracking and analyzing online activity of a user by at least one of a number of mobile computing devices (20) carried by the user to obtain a relevant first specific event;
at the time of occurrence of at least one first specific event, acquiring and recording second environment information of the user at the time of the occurrence of the first specific event through at least one of the plurality of mobile computing devices (20);
the cloud service platform (10) acquires and processes the corresponding first specific event and the corresponding second environment information to analyze the preference of the user for the corresponding first specific event under the corresponding second environment information, and updates the user configuration file according to the preference.
3. The method of claim 1, wherein the user profile is set as follows:
tracking and analyzing the body shape, the limb state, the limb action, the movement speed, the movement acceleration, the heart rate and/or the blood pressure of the user through at least one of a plurality of mobile computing devices (20) carried by the user to acquire offline activity of the user and obtain a related second specific event according to the offline activity;
obtaining and recording, by at least one of the number of mobile computing devices (20), third context information in which the user was located at the time of the occurrence of the first particular event, upon the occurrence of at least one second particular event;
the cloud service platform (10) acquires the corresponding second specific event and the corresponding third environment information for processing, so as to analyze the preference of the user for the corresponding second specific event under the corresponding third environment information, and update the user configuration file according to the preference.
4. The method of claim 3, wherein the cloud service platform (10) is configured as follows:
after the cloud service platform (10) generates the first search result and the second search result, acquiring content reactions of the displayed parts of the first search result and the second search result of the user;
and dynamically adjusting the display sequence of the undisplayed parts of the subsequently provided first search result and the second search result according to the reaction so as to fit the requirement of the user on the first search result or the second search result.
5. The method of claim 4, wherein the reaction is identified by user action on the displayed portions of the first search result and the second search result in combination with at least one of the following collected information:
is a facial expression of the user captured by at least one of the number of mobile computing devices (20) through its image capturing element during browsing by the user of the content of the displayed portions of the first and second search results;
is a gesture and body motion of the user captured by at least one of the number of mobile computing devices (20) through its motion sensor during the user's browsing of the content of the displayed portions of the first and second search results;
is a galvanic skin response of the user captured by at least one of the number of mobile computing devices (20) through its galvanic skin sensor during the user's browsing of the content of the displayed portions of the first and second search results.
6. The method of one of the claims 2 to 5, wherein the online activity comprises at least one of an email, web content, instant messaging, browsing history, online games and online transactions.
7. The method of any one of claims 3 to 5, wherein the offline activity comprises at least one of public transportation, supermarket shopping, outdoor sports, dining, resting and walking.
8. The method of one of claims 1 to 5, wherein the environmental information comprises at least one of environmental properties, time information, light information, location conditions, humidity information, ambient temperature information, and sound information.
9. The method according to claim 3, characterized in that the cloud service platform (10) presents a movement trajectory created on the basis of the geographic location information for the user on the GIS map through at least one of the several mobile computing devices (20) and labels the respective first and/or second specific event and the second and/or third environment information corresponding to the respective first and/or second specific event in association on the movement trajectory, and marks a corresponding preference weight index in association at the respective first and/or second specific event, the preference weight index representing a weight of the respective specific event to the analysis user's preference for the respective first and/or second specific event under the respective environment information, the cloud service platform (10) provides modification permission of the preference weight index for the user so that the user can modify the preference weight index within a preset modification range; the cloud service platform (10) is arranged to: and providing the modification authority for the user only in a preset time range after the corresponding first specific event and/or second specific event occurs, and canceling the modification authority after the preset time range is exceeded.
10. A search system based on environmental information, characterized by acquiring facial image information of a user through at least one of several mobile computing devices (20) carried and/or worn by the user and uploading the facial image information to a facial recognition system;
the facial recognition system and cloud service platform (10) are configured to:
analyzing and processing the facial image information uploaded by the user, analyzing and comparing the facial image information with data information in a database of a cloud service platform (10), if data information similar to or identical to the facial image information based on the user is not searched in the cloud database, creating a search window configured for the user and authorizing the user to enter the search window; if data information similar/identical to the facial image information based on the user is searched in the cloud database, authorizing the user so that the user can enter a search window configured in the user;
after a user enters a search window configured on the cloud service platform, the cloud service platform acquires a search request which is input by the user and comprises search parameters corresponding to expected information, and generates a first search result based on the search parameters;
while obtaining the search request, the cloud service platform (10) obtains first environment information of the user through at least one of the mobile computing devices (20), and generates a second search result which is in accordance with the preference of the user in the first environment based on the first environment information and a user profile;
the cloud service platform (10) provides the first search result and the second search result to the user together;
the user profile is set to:
tracking online activity of a user by at least one of a number of mobile computing devices (20) carried and/or worn by the user to obtain a relevant first particular event; at the time of occurrence of at least one first specific event, acquiring and recording second environment information of the user at the time of the occurrence of the first specific event through at least one of the plurality of mobile computing devices (20); the cloud service platform (10) acquires and processes the corresponding first specific event and the corresponding second environment information to analyze the preference of the user for the corresponding first specific event under the corresponding second environment information and update the user configuration file;
and/or
Recording the body shape, the four-limb state, the movement speed and the movement acceleration of a user through at least one of a plurality of mobile computing devices (20) carried and/or worn by the user to acquire the offline activity of the user, and analyzing according to the offline activity to obtain a related second specific event; obtaining and recording, by at least one of the number of mobile computing devices (20), third context information in which the user was located at the time of the occurrence of the first particular event, upon the occurrence of at least one second particular event; the cloud service platform (10) acquires the corresponding second specific event and the corresponding third environment information for processing, so as to analyze the preference of the user for the corresponding second specific event under the corresponding third environment information and update the user profile.
CN201810521244.2A 2018-05-25 2018-05-25 Searching method and system based on environmental information Withdrawn CN110598088A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810521244.2A CN110598088A (en) 2018-05-25 2018-05-25 Searching method and system based on environmental information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810521244.2A CN110598088A (en) 2018-05-25 2018-05-25 Searching method and system based on environmental information

Publications (1)

Publication Number Publication Date
CN110598088A true CN110598088A (en) 2019-12-20

Family

ID=68848695

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810521244.2A Withdrawn CN110598088A (en) 2018-05-25 2018-05-25 Searching method and system based on environmental information

Country Status (1)

Country Link
CN (1) CN110598088A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111611204A (en) * 2020-04-30 2020-09-01 中国舰船研究设计中心 Distributed task progress data acquisition and analysis method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101561284A (en) * 2008-04-17 2009-10-21 北京灵图软件技术有限公司 Method, device and system for editing navigation track
CN103778187A (en) * 2013-12-31 2014-05-07 百度(中国)有限公司 Method and device for returning search result in oriented mode
CN104239465A (en) * 2014-09-02 2014-12-24 百度在线网络技术(北京)有限公司 Scene information-based searching method and device
CN105590047A (en) * 2015-12-15 2016-05-18 重庆凯泽科技有限公司 Face identification based login system and login method
US20170155631A1 (en) * 2015-12-01 2017-06-01 Integem, Inc. Methods and systems for personalized, interactive and intelligent searches

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101561284A (en) * 2008-04-17 2009-10-21 北京灵图软件技术有限公司 Method, device and system for editing navigation track
CN103778187A (en) * 2013-12-31 2014-05-07 百度(中国)有限公司 Method and device for returning search result in oriented mode
CN104239465A (en) * 2014-09-02 2014-12-24 百度在线网络技术(北京)有限公司 Scene information-based searching method and device
US20170155631A1 (en) * 2015-12-01 2017-06-01 Integem, Inc. Methods and systems for personalized, interactive and intelligent searches
CN105590047A (en) * 2015-12-15 2016-05-18 重庆凯泽科技有限公司 Face identification based login system and login method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111611204A (en) * 2020-04-30 2020-09-01 中国舰船研究设计中心 Distributed task progress data acquisition and analysis method
CN111611204B (en) * 2020-04-30 2024-03-01 中国舰船研究设计中心 Distributed task progress data acquisition and analysis method

Similar Documents

Publication Publication Date Title
US9558397B2 (en) Method and apparatus for automated analysis and identification of a person in image and video content
US20190220933A1 (en) Presence Granularity with Augmented Reality
JP5866728B2 (en) Knowledge information processing server system with image recognition system
CN110232968A (en) The method and medium of the placement of wearable device and the wearable imaging sensor of correction
US8458177B2 (en) Automated search
CN110084088A (en) For analyzing image and providing the wearable device and method of feedback
CN101853259A (en) Methods and device for adding and processing label with emotional data
US20180316900A1 (en) Continuous Capture with Augmented Reality
US11281733B2 (en) Selective presentation of rich experiences in search
CN108351884A (en) Semantic locations layer for user's correlated activation
CN103620590A (en) Systems and methods for image-to-text and text-to-image association
CN111465949A (en) Information processing apparatus, information processing method, and program
CN108241690A (en) A kind of data processing method and device, a kind of device for data processing
US20140108529A1 (en) Person Filtering in Augmented Reality
CN105159990B (en) A kind of method and apparatus of media data grading control
KR20190031945A (en) Method, system and non-transitory computer-readable recording medium for providing scent recommendation based on sns
CN110598088A (en) Searching method and system based on environmental information
CN110799946A (en) Multi-application user interest memory management
US20140304252A1 (en) Method, apparatus and machine readable media for presenting mobile media information in mobile search system
CN113420209A (en) Recommendation method, device and equipment based on weather search and storage medium
CN110598089A (en) Voice assistant method and system based on environmental information processing
CN110598087A (en) Searching method and system based on environmental information and user preference
JP2019139429A (en) Schedule management program and schedule management system
US11210499B2 (en) Determining a social group to which customers belong from appearance and using artificial intelligence, machine learning, and computer vision, for estimating customer preferences and intent, and for improving customer services
KR20230138813A (en) System and method for providing metaverse fairs based on analysis of buyer's intersests

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20191220