WO2016155284A1 - Information collection method for terminal, and terminal thereof - Google Patents

Information collection method for terminal, and terminal thereof Download PDF

Info

Publication number
WO2016155284A1
WO2016155284A1 PCT/CN2015/092019 CN2015092019W WO2016155284A1 WO 2016155284 A1 WO2016155284 A1 WO 2016155284A1 CN 2015092019 W CN2015092019 W CN 2015092019W WO 2016155284 A1 WO2016155284 A1 WO 2016155284A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
observer
face image
determining
terminal
Prior art date
Application number
PCT/CN2015/092019
Other languages
French (fr)
Chinese (zh)
Inventor
程志超
胡胜刚
Original Assignee
惠州Tcl移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 惠州Tcl移动通信有限公司 filed Critical 惠州Tcl移动通信有限公司
Publication of WO2016155284A1 publication Critical patent/WO2016155284A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/178Human faces, e.g. facial parts, sketches or expressions estimating age from face image; using age information for improving recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition

Definitions

  • the present application relates to the field of communication networks, and in particular, to a method for collecting information of a terminal and a terminal thereof.
  • the application provides a terminal information collection method and a terminal thereof, which can collect attention information in an all-round manner and improve the accuracy of collecting attention information.
  • a technical solution adopted by the present application is: providing an information collecting method of a terminal, the terminal includes a camera for collecting information, and the method includes: the terminal detects and is detected by the camera within a predetermined time. Observer distance; when the distance is less than or equal to a preset threshold, collecting facial image information of the observer; determining the number of facial images and the position of the human eye according to the facial image information; Determining the attention degree information of the observer in combination with the number of the face images when determining the gaze direction of the observer; determining the number of face images corresponding to the face image and the position of the human eye and the The attention degree information corresponding to the number of face images and the position of the human eye is uploaded to the web server to enable the web server to perform statistical analysis.
  • the feature information further includes an age
  • the step of determining the feature information according to the face image information further comprises: determining an age corresponding to the face image according to the face image information
  • the step of determining the attention information of the observer in combination with the number of the face images is specifically: when determining the gaze direction of the observer according to the position of the human eye, combining the The number of face images and the age corresponding to the face image determine the degree of interest information for each age stage in the observer.
  • the attention degree information of each age stage in the observer is determined according to the number of the face images and the age corresponding to the face image.
  • the step is specifically: when determining the gaze direction of the observer according to the position of the human eye, determining a gaze time corresponding to the face image according to the face position, wherein the gaze time is that the observer looks at the gaze The time at which the terminal is located; the degree of attention information of each age stage in the observer is determined in combination with the number of the face images, the age corresponding to the face image, and the gaze time corresponding to the face image.
  • the feature information further includes a gender; the step of determining the number of the face images and the position of the human eye according to the face image information further includes: determining, according to the face image information, the gender corresponding to the face image When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically: determining the observer according to the position of the human eye When the direction is gazing, the attention degree information of the observer is determined in conjunction with the number of the face images and the gender corresponding to the face image.
  • another technical solution adopted by the present application is: providing an information collecting method of a terminal, the terminal includes a camera for collecting information, and the method includes: the terminal detects by a camera within a predetermined time. a distance from the observer; when the distance is less than or equal to a preset threshold, acquiring face image information of the observer; determining feature information according to the face image information, and determining the observation according to the feature information The attention information of the person.
  • the determining the feature information according to the face image information, and determining the attention degree information of the observer according to the feature information includes: determining a number of face images and a human eye position according to the face image information; When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images.
  • the feature information further includes an age
  • the step of determining the feature information according to the face image information further comprises: determining an age corresponding to the face image according to the face image information
  • the step of determining the attention information of the observer in combination with the number of the face images is specifically: when determining the gaze direction of the observer according to the position of the human eye, combining the The number of face images and the age corresponding to the face image determine the degree of interest information for each age stage in the observer.
  • the attention degree information of each age stage in the observer is determined according to the number of the face images and the age corresponding to the face image.
  • the step is specifically: when determining the gaze direction of the observer according to the position of the human eye, determining a gaze time corresponding to the face image according to the face position, wherein the gaze time is that the observer looks at the gaze The time at which the terminal is located; the degree of attention information of each age stage in the observer is determined in combination with the number of the face images, the age corresponding to the face image, and the gaze time corresponding to the face image.
  • the feature information further includes a gender; the step of determining the number of the face images and the position of the human eye according to the face image information further includes: determining, according to the face image information, the gender corresponding to the face image When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically: determining the observer according to the position of the human eye When the direction is gazing, the attention degree information of the observer is determined in conjunction with the number of the face images and the gender corresponding to the face image.
  • the method further includes:
  • an information collecting terminal the terminal includes a camera for collecting information
  • the terminal includes: a distance detecting module, an collecting module, and a statistics module;
  • the distance detecting module is configured to detect a distance from the observer by the camera within a predetermined time;
  • the collecting module is configured to collect the observation when the distance detected by the distance detecting module is less than or equal to a preset threshold
  • the face image information of the person is used to determine the feature information according to the face image information collected by the collection module, and determine the attention degree information of the observer according to the feature information.
  • the statistic module includes a determining unit and a statistic unit, wherein the determining unit is configured to determine a number of face images and a position of a human eye according to the face image information; and the statistic unit is configured to determine, according to a position of a human eye, When the observer's gaze direction is described, the observer's attention information is determined in accordance with the number of the face images.
  • the determining information further includes determining an age corresponding to the face image according to the face image information, and/or determining the person according to the face image information. a gender corresponding to the face image; the statistical unit is specifically configured to determine the observer according to the number of the face images and the age corresponding to the face image when determining the gaze direction of the observer according to the position of the human eye.
  • the terminal further includes a synchronization module, and the synchronization module is configured to upload the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, so that the network server performs statistical analysis.
  • the present application detects the distance from the observer by the camera within a predetermined time, and collects the face image of the observer when the detected distance is less than or equal to the preset threshold.
  • the information determines the feature information according to the face image information, and determines the observer's attention degree information according to the feature information, so that the attention degree information can be collected in all directions, and the accuracy of collecting the attention information is improved.
  • FIG. 1 is a flowchart of an embodiment of an information collection method of a terminal of the present application
  • FIG. 2 is a flowchart of another embodiment of an information collecting method of a terminal of the present application.
  • FIG. 3 is a schematic structural diagram of an embodiment of an information collecting terminal of the present application.
  • FIG. 4 is a schematic structural diagram of another embodiment of an information collecting terminal of the present application.
  • FIG. 1 is a flowchart of an embodiment of an information collection method of a terminal of the present application.
  • the execution body of this embodiment is a terminal, and the terminal includes a camera for collecting information, and the camera is a camera with anti-shake function.
  • the terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat.
  • the terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
  • S101 The terminal detects the distance from the observer through the camera within a predetermined time.
  • the terminal detects the distance from the observer through a camera having a distance detecting function for a predetermined time.
  • the camera may be an infrared detecting camera, but is not limited thereto, and may be other types of cameras having a distance detecting function.
  • the number of cameras can be one or at least two to ensure that the terminal can detect the distance from the observer around the terminal in all directions.
  • the scheduled time can be 1 hour or 2 hours, and can also be set according to time needs.
  • the observer is a crowd that observes the terminal itself near the terminal, or a crowd that observes the carrier of the terminal.
  • the preset threshold corresponding to the distance may be set to 5 meters or 10 meters, but is not limited thereto, and may be set to other values according to actual conditions, and is not limited herein.
  • step S102 is performed.
  • S102 Collect the face image information of the observer when the distance is less than or equal to a preset threshold.
  • the terminal collects the face image information of the observer through the camera.
  • S103 Determine feature information according to the face image information, and determine the attention degree information of the observer according to the feature information.
  • the terminal determines the feature information according to the collected face image information, and determines the observer's attention information according to the feature information.
  • the feature information includes a facial expression, a human eye position, a character gender, a character age, and the like.
  • the degree of interest information includes attention, no attention, age of the observer of interest, sex ratio, time of attention, and the like.
  • the terminal acquires the position of the human eye corresponding to the face image according to the collected face image information, determines the gaze direction of the observer corresponding to the face image according to the position information of the human eye, and determines whether the observer looks at the terminal according to the gaze direction.
  • the carrier of the terminal the gaze direction is the direction when the position of the human eye remains unchanged for a certain duration.
  • the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention;
  • the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
  • the terminal may count the time of attention, the total number of people concerned, the sex ratio among the total number of people concerned, and the age stage according to the feature information of the face image corresponding to the observer. .
  • the user may count the popularity of the host or the host of the terminal according to the attention information for further adjustment or improvement.
  • the terminal detects the distance from the observer through the camera within a predetermined time.
  • the detected distance is less than or equal to the preset threshold
  • the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the attention information of the observer, and can collect the attention information in all directions, and improve the accuracy of collecting the attention information.
  • FIG. 2 is a flowchart of another embodiment of the information collecting method of the present application.
  • the execution body of this embodiment is a terminal, and the terminal includes a camera for collecting information, and the camera is a camera with anti-shake function.
  • the terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat.
  • the terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
  • S201 The terminal detects the distance from the observer through the camera within a predetermined time.
  • the terminal detects the distance from the observer through a camera having a distance detecting function for a predetermined time.
  • the camera may be an infrared detecting camera, but is not limited thereto, and may be other types of cameras having a distance detecting function.
  • the number of cameras can be one or at least two to ensure that the terminal can detect the distance from the observer around the terminal in all directions.
  • the scheduled time can be 1 hour or 2 hours, and can also be set according to time needs.
  • the observer is a crowd that observes the terminal itself near the terminal, or a crowd that observes the carrier of the terminal.
  • the preset threshold corresponding to the distance may be set to 5 meters or 10 meters, but is not limited thereto, and may be set to other values according to actual conditions, and is not limited herein.
  • step S202 is performed.
  • S202 Collect the face image information of the observer when the distance is less than or equal to a preset threshold.
  • the terminal collects the face image information of the observer through the camera.
  • S203 Determine feature information according to the face image information, and determine the attention degree information of the observer according to the feature information.
  • the terminal determines the feature information according to the collected face image information, and determines the observer's attention information according to the feature information.
  • the feature information includes the position of the human eye, age, gender, and the like.
  • the degree of interest information includes attention, no attention, age of the observer of interest, sex ratio, time of attention, and the like.
  • the determining the feature information according to the face image information, and determining the attention degree information of the observer according to the feature information includes: determining a number of face images and a human eye position according to the face image information; When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images.
  • the terminal determines the number of face images and the position of the human eye according to the face image information, and determines the gaze direction of the observer according to the position of the human eye, thereby determining whether the observer looks at the carrier of the terminal or the terminal according to the gaze direction.
  • the gaze direction is the direction when the position of the human eye remains unchanged for a certain duration.
  • the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention.
  • the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
  • the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal, the number of viewers (the total number of people) whose gaze direction is the bearer of the terminal or the terminal is determined in combination with the number of face images.
  • the step of determining the feature information according to the face image information may further include: determining an age corresponding to the face image according to the face image information; and combining the number of the face images when determining the gaze direction of the observer according to the position of the human eye And the age corresponding to the face image determines the degree of interest information of each age stage in the observer.
  • the terminal determines the number of face images according to the face image information and the comprehensive feature database of the human body (where the comprehensive feature database of the human body includes face features, length of the hair and hair style, clothes, style and color of the shoes, etc.)
  • the gaze direction is the direction in which the position of the human eye remains unchanged for a certain duration.
  • the comprehensive feature database of the human body may be pre-stored in the terminal or may be acquired from the network server.
  • the terminal may also determine the age directly based on a related statistical survey report of the correspondence between the face image information, the face feature, and the age.
  • the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention.
  • the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
  • the number of observers (the total number of people) that the gaze direction is the bearer of the terminal or the terminal is determined according to the number of the face images;
  • the number of observers of each age stage in the observer is determined in accordance with the age corresponding to the face image, and the proportion of observers at each age stage is further determined based on the number of observers of each age stage in the observer.
  • the step of determining the degree of interest information of each age stage in the observer in combination with the number of face images and the age corresponding to the face image may be specifically as follows: according to the position of the human eye
  • the gaze time corresponding to the face image is determined according to the face position, wherein the gaze time is the time at which the observer looks at the orientation of the terminal; the number of the face images, the age corresponding to the face image, and the person
  • the gaze time corresponding to the face image determines the degree of attention information of each age stage in the observer.
  • the gaze time corresponding to the face image is determined according to the face position, wherein the gaze time is the time when the observer looks at the orientation of the terminal; Determining the number of observers (total number of people) whose direction of the gaze is the terminal or the host of the terminal according to the number of face images; and determining the observers according to the age corresponding to the face image and the gaze time corresponding to the face image The proportion of observers at the age level and the time of attention at each age stage.
  • the step of determining the feature information according to the face image information may further include: determining a gender corresponding to the face image according to the face image information; and combining the person when determining the gaze direction of the observer according to the position of the human eye The number of face images and the gender corresponding to the face image determine the attention information of the observer.
  • the terminal determines the number of face images, the position of the human eye, and the gender corresponding to the face image according to the face image information, and determines the gaze direction of the observer according to the position of the human eye, thereby determining whether the observer looks at the terminal according to the gaze direction.
  • the carrier of the terminal the terminal determines the number of face images, the position of the human eye, and the gender corresponding to the face image according to the face image information, and determines the gaze direction of the observer according to the position of the human eye, thereby determining whether the observer looks at the terminal according to the gaze direction.
  • the carrier of the terminal the carrier of the terminal.
  • the gaze direction is the direction when the position of the human eye remains unchanged for a certain duration.
  • the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention.
  • the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
  • the number of observers (the total number of people) that the gaze direction is the bearer of the terminal or the terminal is determined according to the number of the face images;
  • the number of observers of different genders in the observer is determined according to the gender corresponding to the face image, and the proportion of observers of different genders is further determined according to the number of observers of different genders.
  • the terminal statistics attention direction is the attention time of the observers of different genders among the observers of the terminal or the bearer of the terminal.
  • the statistical method is similar to the above-mentioned statistics of the observers at different ages. For details, please refer to the related description, which is not described here.
  • S204 Upload the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, so that the network server performs statistical analysis.
  • the terminal After obtaining the attention information of the observer whose gaze direction is the terminal or the bearer of the terminal, the terminal uploads the viewer's face image corresponding to the age, gender, and the like, and the attention degree information corresponding to the observer's age and gender. To the web server, so that the web server can perform statistical analysis according to the attention information collected by the terminal used.
  • the popularity of the terminal or the host of the terminal is counted according to the degree of interest information, thereby providing a reference for further adjustment, improvement, or market launch.
  • the terminal detects the distance from the observer through the camera within a predetermined time.
  • the detected distance is less than or equal to the preset threshold
  • the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the observer's attention information, can collect the attention information in all directions, improve the accuracy of collecting the attention information, and can feedback the attention information to provide a reference for further work in the later stage.
  • FIG. 3 is a schematic structural diagram of an embodiment of an information collecting terminal of the present application.
  • the terminal has an anti-shake camera.
  • the terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat.
  • the terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
  • the modules included in the terminal in this embodiment are used to perform the respective steps in the embodiment corresponding to FIG. 1 .
  • the information collection terminal of this embodiment includes a distance detection module 310, an acquisition module 320, and a statistics module 330.
  • the distance detecting module 310 is configured to detect the distance from the observer by the camera within a predetermined time. For example, the distance detecting module 310 detects the distance from the observer through the camera for a predetermined time. The distance detection module 310 transmits the detected distance to the acquisition module 320.
  • the collecting module 320 is configured to receive the distance detected by the distance detecting module 310. When the detected distance of the detecting module 310 is less than or equal to a preset threshold, the face image information of the observer is collected. For example, the acquisition module 320 receives the distance detected by the distance detection module 310. When the distance detected by the detection module 310 is less than or equal to the preset threshold, the face image information of the observer is collected. The collecting module 320 sends the collected face image information to the statistics module 330.
  • the statistic module 330 is configured to receive the facial image information collected by the collecting module 320, determine the feature information according to the facial image information collected by the collecting module 320, and determine the attention information of the observer according to the feature information.
  • the statistics module 330 receives the face image information collected by the collection module 320, determines the feature information according to the face image information, and determines the observer's attention information according to the feature information.
  • the terminal detects the distance from the observer through the camera within a predetermined time.
  • the detected distance is less than or equal to the preset threshold
  • the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the attention information of the observer, and can collect the attention information in all directions, and improve the accuracy of collecting the attention information.
  • FIG. 4 is a schematic structural diagram of another embodiment of an information collecting terminal of the present application.
  • the terminal has an anti-shake camera.
  • the terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat.
  • the terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
  • the modules included in the terminal in this embodiment are used to respectively perform the steps in the embodiment corresponding to FIG. 2 .
  • the information collection terminal of this embodiment includes a distance detection module 410, an acquisition module 420, a statistics module 430, and a synchronization module 440.
  • the statistic module 430 includes a determining unit 431 and a statistic unit 432.
  • the distance detection module 410 is configured to detect the distance from the observer for a predetermined time by the camera. For example, the distance detecting module 410 detects the distance from the observer for a predetermined time by the camera. The distance detection module 410 transmits the detected distance to the acquisition module 420.
  • the collecting module 420 is configured to receive the distance detected by the distance detecting module 410. When the detected distance of the detecting module 410 is less than or equal to a preset threshold, the face image information of the observer is collected. For example, the acquisition module 420 receives the distance detected by the distance detection module 410. When the distance detected by the detection module 410 is less than or equal to the preset threshold, the face image information of the observer is collected. The collecting module 420 sends the collected face image information to the statistics module 430.
  • the statistics module 430 is configured to receive the facial image information collected by the collecting module 420, determine the feature information according to the facial image information collected by the collecting module 420, and determine the attention information of the observer according to the feature information.
  • the statistics module 430 receives the face image information collected by the collection module 420, determines the feature information according to the face image information, and determines the observer's attention information according to the feature information.
  • the determining unit 431 is configured to determine the number of face images and the position of the human eye according to the face image information collected by the collecting module 420.
  • the counting unit 432 is configured to combine the faces when determining the gaze direction of the observer according to the position of the human eye.
  • the number of images to determine the viewer's attention information For example, the determining unit 431 determines the number of face images and the position of the human eye according to the face image information collected by the collecting module 420.
  • the statistical unit 432 receives the number of face images and the human eye position information transmitted by the determining unit 431, and determines the attention degree information of the observer in combination with the number of face images when determining the gaze direction of the observer according to the position of the human eye.
  • the feature information further includes age and gender.
  • the determining unit 431 is further configured to determine an age corresponding to the face image according to the face image information, and/or determine a gender corresponding to the face image according to the face image information.
  • the statistical unit 432 is specifically configured to determine the attention degree information of each age stage in the observer according to the number of the face images and the age corresponding to the face image when determining the gaze direction of the observer according to the position of the human eye, and/or when according to the person When the eye position determines the gaze direction of the observer, the observer's attention information is determined in conjunction with the number of face images and the gender corresponding to the face image.
  • the feature information determined by the determining unit 431 according to the face image information collected by the collecting module 420 includes age and gender.
  • the determining unit 431 determines the age corresponding to the face image based on the face image information, and/or determines the gender corresponding to the face image based on the face image information.
  • the statistical unit 432 receives the number of face images and the human eye position information transmitted by the determining unit 431, and determines the observer's gaze direction according to the human eye position, and determines the number of the face images and the age corresponding to the face image to determine the observer.
  • the attention degree information of each age stage, and/or when the observer's gaze direction is determined according to the human eye position, the observer's attention degree information is determined in conjunction with the number of face images and the gender corresponding to the face image.
  • the statistical unit 432 transmits the feature information of the face image and the degree of interest information to the synchronization module 440.
  • the synchronization module 440 is configured to receive the feature information and the attention degree information of the face image sent by the statistics unit 432, and upload the feature information corresponding to the face image and the attention degree information corresponding to the feature information to the network server, so that the network server performs statistical analysis. .
  • the synchronization module 440 receives the feature information and the attention degree information of the face image sent by the statistics unit 432, and uploads the feature information corresponding to the face image and the attention degree information corresponding to the feature information to the network server, so that the network server performs statistical analysis. .
  • the terminal detects the distance from the observer through the camera within a predetermined time.
  • the detected distance is less than or equal to the preset threshold
  • the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the observer's attention information, can collect the attention information in all directions, improve the accuracy of collecting the attention information, and can feedback the attention information to provide a reference for further work in the later stage.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An information collection method for a terminal, and a terminal thereof. The method comprises: a terminal detecting a distance from a viewer through a camera within a preset time (S101); acquiring face image information about the viewer when the distance is less than or equal to a preset threshold value (S102); and determining feature information according to the face image information, and determining attention degree information about the viewer according to the feature information (S103). The method can acquire attention degree information omnidirectionally, thereby increasing the accuracy of attention degree information collection.

Description

一种终端的信息采集方法及其终端 Terminal information collecting method and terminal thereof
【技术领域】[Technical Field]
本申请涉及通信网络领域,特别是涉及一种终端的信息采集方法及其终端。The present application relates to the field of communication networks, and in particular, to a method for collecting information of a terminal and a terminal thereof.
【背景技术】 【Background technique】
人们通常通过四处张望或拍摄的方式获取周围人群的关注度信息。然而,当因特殊原因不便四处张望或拍摄时,无法获取到关注度信息。并且,当四处张望或转身时,获取的关注度信息可能会有偏差,不够准确。People usually get attention information of the surrounding people by looking around or shooting. However, when it is inconvenient to look around or shoot for special reasons, the attention information cannot be obtained. Moreover, when looking around or turning around, the attention information obtained may be biased and not accurate enough.
【发明内容】 [Summary of the Invention]
本申请提供一种终端的信息采集方法及其终端,能够全方位采集关注度信息,提高收集关注度信息的准确度。The application provides a terminal information collection method and a terminal thereof, which can collect attention information in an all-round manner and improve the accuracy of collecting attention information.
为解决上述技术问题,本申请采用的一个技术方案是:提供终端的一种信息采集方法,所述终端包括一个用于采集信息的摄像头,所述方法包括:终端通过摄像头在预定时间内探测与观察者的距离;当所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息;根据所述人脸图像信息确定人脸图像的数量和人眼位置;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息;将所述人脸图像对应的人脸图像的数量和人眼位置以及所述人脸图像的数量和人眼位置对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。In order to solve the above technical problem, a technical solution adopted by the present application is: providing an information collecting method of a terminal, the terminal includes a camera for collecting information, and the method includes: the terminal detects and is detected by the camera within a predetermined time. Observer distance; when the distance is less than or equal to a preset threshold, collecting facial image information of the observer; determining the number of facial images and the position of the human eye according to the facial image information; Determining the attention degree information of the observer in combination with the number of the face images when determining the gaze direction of the observer; determining the number of face images corresponding to the face image and the position of the human eye and the The attention degree information corresponding to the number of face images and the position of the human eye is uploaded to the web server to enable the web server to perform statistical analysis.
其中,所述特征信息还包括年龄;根据所述人脸图像信息确定特征信息的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的年龄;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息。Wherein the feature information further includes an age; the step of determining the feature information according to the face image information further comprises: determining an age corresponding to the face image according to the face image information; In the gaze direction of the observer, the step of determining the attention information of the observer in combination with the number of the face images is specifically: when determining the gaze direction of the observer according to the position of the human eye, combining the The number of face images and the age corresponding to the face image determine the degree of interest information for each age stage in the observer.
其中,当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息的步骤具体为:当根据所述人眼位置确定所述观察者的注视方向时,根据所述人脸位置确定所述人脸图像对应的注视时间,其中,所述注视时间为观察者注视所述终端所在方位的时间;结合所述人脸图像的数量、所述人脸图像对应的年龄以及所述人脸图像对应的注视时间,确定所述观察者中各年龄阶段的关注度信息。Wherein, when the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of each age stage in the observer is determined according to the number of the face images and the age corresponding to the face image. The step is specifically: when determining the gaze direction of the observer according to the position of the human eye, determining a gaze time corresponding to the face image according to the face position, wherein the gaze time is that the observer looks at the gaze The time at which the terminal is located; the degree of attention information of each age stage in the observer is determined in combination with the number of the face images, the age corresponding to the face image, and the gaze time corresponding to the face image.
其中,所述特征信息还包括性别;所述根据所述人脸图像信息确定人脸图像的数量和人眼位置的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的性别;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。The feature information further includes a gender; the step of determining the number of the face images and the position of the human eye according to the face image information further includes: determining, according to the face image information, the gender corresponding to the face image When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically: determining the observer according to the position of the human eye When the direction is gazing, the attention degree information of the observer is determined in conjunction with the number of the face images and the gender corresponding to the face image.
为解决上述技术问题,本申请采用的另一个技术方案是:提供终端的一种信息采集方法,所述终端包括一个用于采集信息的摄像头,所述方法包括:终端通过摄像头在预定时间内探测与观察者的距离;当所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息;根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息。In order to solve the above technical problem, another technical solution adopted by the present application is: providing an information collecting method of a terminal, the terminal includes a camera for collecting information, and the method includes: the terminal detects by a camera within a predetermined time. a distance from the observer; when the distance is less than or equal to a preset threshold, acquiring face image information of the observer; determining feature information according to the face image information, and determining the observation according to the feature information The attention information of the person.
其中,根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息的步骤包括:根据所述人脸图像信息确定人脸图像的数量和人眼位置;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息。The determining the feature information according to the face image information, and determining the attention degree information of the observer according to the feature information includes: determining a number of face images and a human eye position according to the face image information; When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images.
其中,所述特征信息还包括年龄;根据所述人脸图像信息确定特征信息的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的年龄;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息。Wherein the feature information further includes an age; the step of determining the feature information according to the face image information further comprises: determining an age corresponding to the face image according to the face image information; In the gaze direction of the observer, the step of determining the attention information of the observer in combination with the number of the face images is specifically: when determining the gaze direction of the observer according to the position of the human eye, combining the The number of face images and the age corresponding to the face image determine the degree of interest information for each age stage in the observer.
其中,当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息的步骤具体为:当根据所述人眼位置确定所述观察者的注视方向时,根据所述人脸位置确定所述人脸图像对应的注视时间,其中,所述注视时间为观察者注视所述终端所在方位的时间;结合所述人脸图像的数量、所述人脸图像对应的年龄以及所述人脸图像对应的注视时间,确定所述观察者中各年龄阶段的关注度信息。Wherein, when the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of each age stage in the observer is determined according to the number of the face images and the age corresponding to the face image. The step is specifically: when determining the gaze direction of the observer according to the position of the human eye, determining a gaze time corresponding to the face image according to the face position, wherein the gaze time is that the observer looks at the gaze The time at which the terminal is located; the degree of attention information of each age stage in the observer is determined in combination with the number of the face images, the age corresponding to the face image, and the gaze time corresponding to the face image.
其中,所述特征信息还包括性别;所述根据所述人脸图像信息确定人脸图像的数量和人眼位置的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的性别;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。The feature information further includes a gender; the step of determining the number of the face images and the position of the human eye according to the face image information further includes: determining, according to the face image information, the gender corresponding to the face image When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically: determining the observer according to the position of the human eye When the direction is gazing, the attention degree information of the observer is determined in conjunction with the number of the face images and the gender corresponding to the face image.
其中,根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息的步骤之后,所述方法还包括:After the step of determining the feature information according to the face image information, and determining the attention degree information of the observer according to the feature information, the method further includes:
将所述人脸图像对应的特征信息以及所述特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。And uploading the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, so that the network server performs statistical analysis.
为解决上述技术问题,本申请采用的再一个技术方案是:提供一种信息采集终端,所述终端包括一个用于采集信息的摄像头,所述终端包括:距离探测模块、采集模块以及统计模块;所述距离探测模块用于通过摄像头在预定时间内探测与观察者的距离;所述采集模块用于当所述距离探测模块探测到的所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息;所述统计模块用于根据所述采集模块采集的所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息。In order to solve the above technical problem, another technical solution adopted by the present application is to provide an information collecting terminal, the terminal includes a camera for collecting information, and the terminal includes: a distance detecting module, an collecting module, and a statistics module; The distance detecting module is configured to detect a distance from the observer by the camera within a predetermined time; the collecting module is configured to collect the observation when the distance detected by the distance detecting module is less than or equal to a preset threshold The face image information of the person is used to determine the feature information according to the face image information collected by the collection module, and determine the attention degree information of the observer according to the feature information.
其中,所述统计模块包括确定单元以及统计单元;所述确定单元用于根据所述人脸图像信息确定人脸图像的数量和人眼位置;所述统计单元用于当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息。The statistic module includes a determining unit and a statistic unit, wherein the determining unit is configured to determine a number of face images and a position of a human eye according to the face image information; and the statistic unit is configured to determine, according to a position of a human eye, When the observer's gaze direction is described, the observer's attention information is determined in accordance with the number of the face images.
其中,所述特征信息还包括年龄、性别;所述确定单元还用于根据所述人脸图像信息确定所述人脸图像对应的年龄,和/或根据所述人脸图像信息确定所述人脸图像对应的性别;所述统计单元具体用于当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息,和/或当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。The determining information further includes determining an age corresponding to the face image according to the face image information, and/or determining the person according to the face image information. a gender corresponding to the face image; the statistical unit is specifically configured to determine the observer according to the number of the face images and the age corresponding to the face image when determining the gaze direction of the observer according to the position of the human eye The attention degree information of each age stage, and/or when determining the gaze direction of the observer according to the position of the human eye, determining the observer's according to the number of the face images and the gender corresponding to the face image Attention information.
其中,所述终端还包括同步模块,所述同步模块用于将所述人脸图像对应的特征信息以及所述特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。The terminal further includes a synchronization module, and the synchronization module is configured to upload the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, so that the network server performs statistical analysis.
本申请的有益效果是:区别于现有技术的情况,本申请通过摄像头在预定时间内探测与观察者的距离,当探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息,能够全方位采集关注度信息,提高收集关注度信息的准确度。The beneficial effects of the present application are: different from the prior art, the present application detects the distance from the observer by the camera within a predetermined time, and collects the face image of the observer when the detected distance is less than or equal to the preset threshold. The information determines the feature information according to the face image information, and determines the observer's attention degree information according to the feature information, so that the attention degree information can be collected in all directions, and the accuracy of collecting the attention information is improved.
【附图说明】 [Description of the Drawings]
图1是本申请终端的信息采集方法一实施例的流程图;1 is a flowchart of an embodiment of an information collection method of a terminal of the present application;
图2是本申请终端的信息采集方法另一实施例的流程图;2 is a flowchart of another embodiment of an information collecting method of a terminal of the present application;
图3是本申请信息采集终端一实施例的结构示意图;3 is a schematic structural diagram of an embodiment of an information collecting terminal of the present application;
图4是本申请信息采集终端另一实施例的结构示意图。4 is a schematic structural diagram of another embodiment of an information collecting terminal of the present application.
【具体实施方式】【detailed description】
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、接口、技术之类的具体细节,以便透彻理解本申请。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施方式中也可以实现本申请。在其它情况中,省略对众所周知的装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。In the following description, for purposes of illustration and description, reference However, it will be apparent to those skilled in the art that the present invention can be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known devices, circuits, and methods are omitted so as not to obscure the description of the application.
参阅图1,图1是本申请终端的信息采集方法一实施例的流程图。本实施例的执行主体为终端,终端包括用于采集信息的摄像头,摄像头为具有防抖动功能的摄像头。终端可以为可穿戴设备、视频采集设备或个人电脑等(但并不限于此),终端还可以内置于饰品、衣服或帽子等,以全方位统计对终端本身,或饰品、衣服或帽子等承载物的关注度。终端可以应用于街区、卖场、展销会等场所。当然,并不限于此,终端还可以应用于其他场所。Referring to FIG. 1, FIG. 1 is a flowchart of an embodiment of an information collection method of a terminal of the present application. The execution body of this embodiment is a terminal, and the terminal includes a camera for collecting information, and the camera is a camera with anti-shake function. The terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat. The attention of the object. The terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
本实施例的信息采集方法包括以下步骤:The information collection method of this embodiment includes the following steps:
S101:终端通过摄像头在预定时间内探测与观察者的距离。S101: The terminal detects the distance from the observer through the camera within a predetermined time.
终端通过具有距离探测功能的摄像头在预定时间内,探测与观察者之间的距离。The terminal detects the distance from the observer through a camera having a distance detecting function for a predetermined time.
其中,摄像头可以为红外探测摄像头,但并不限于此,也可以为其他类型的具有距离探测功能的摄像头。The camera may be an infrared detecting camera, but is not limited thereto, and may be other types of cameras having a distance detecting function.
摄像头的个数可以为一个,也可以为至少两个,以保证终端能够全方位探测与终端四周的观察者的距离。The number of cameras can be one or at least two to ensure that the terminal can detect the distance from the observer around the terminal in all directions.
预定时间可以为1小时或2小时,还可以根据时间需要进行设置。The scheduled time can be 1 hour or 2 hours, and can also be set according to time needs.
观察者为终端附近观察终端本身的人群,或者观察终端的承载物的人群。The observer is a crowd that observes the terminal itself near the terminal, or a crowd that observes the carrier of the terminal.
终端探测到与观察者之间的距离之后,确定探测到的距离是否小于或等于预设阈值。其中,距离对应的预设阈值可以设置为5米或10米,但并不限于此,也可以根据实际设置为其他值,此处不作限制。After the terminal detects the distance from the observer, it is determined whether the detected distance is less than or equal to a preset threshold. The preset threshold corresponding to the distance may be set to 5 meters or 10 meters, but is not limited thereto, and may be set to other values according to actual conditions, and is not limited herein.
当探测到的距离小于或等于预设阈值时,执行步骤S102。When the detected distance is less than or equal to the preset threshold, step S102 is performed.
当探测到的距离大于预设阈值时,则不做任何处理。When the detected distance is greater than the preset threshold, no processing is performed.
S102:当所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息。S102: Collect the face image information of the observer when the distance is less than or equal to a preset threshold.
当探测到的距离小于或等于预设阈值时,终端通过摄像头采集观察者的人脸图像信息。When the detected distance is less than or equal to the preset threshold, the terminal collects the face image information of the observer through the camera.
S103:根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息。S103: Determine feature information according to the face image information, and determine the attention degree information of the observer according to the feature information.
终端根据采集到的人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息。其中,特征信息包括人脸表情、人眼位置、人物性别、人物年龄等。关注度信息包括关注、不关注,关注的观察者的年龄阶段、性别比例、关注时间等。The terminal determines the feature information according to the collected face image information, and determines the observer's attention information according to the feature information. The feature information includes a facial expression, a human eye position, a character gender, a character age, and the like. The degree of interest information includes attention, no attention, age of the observer of interest, sex ratio, time of attention, and the like.
例如,终端根据采集到的人脸图像信息获取人脸图像对应的人眼位置,根据人眼位置信息确定人脸图像对应的观察者的注视方向,并根据注视方向确定该观察者是否注视本终端或本终端的承载物。其中,注视方向为人眼位置在一定持续时间内保持不变时的方向。For example, the terminal acquires the position of the human eye corresponding to the face image according to the collected face image information, determines the gaze direction of the observer corresponding to the face image according to the position information of the human eye, and determines whether the observer looks at the terminal according to the gaze direction. Or the carrier of the terminal. Wherein, the gaze direction is the direction when the position of the human eye remains unchanged for a certain duration.
当终端根据注视方向确定观察者的注视方向为本终端或本终端的承载物时,则确定为关注;When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention;
当终端根据注视方向确定观察者的注视方向为偏离本终端或本终端的承载物时,确定为不关注。When the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
终端在确定关注本终端或本终端的承载物的观察者时,可以根据观察者对应的人脸图像的特征信息统计关注时间、关注的总人数、关注的总人数中的性别比例以及年龄阶段等。When determining the observer who pays attention to the host or the bearer of the terminal, the terminal may count the time of attention, the total number of people concerned, the sex ratio among the total number of people concerned, and the age stage according to the feature information of the face image corresponding to the observer. .
终端在获取到关注度信息之后,用户可根据关注度信息统计对本终端或本终端的承载物的受欢迎程度,以便做进一步调整或改进等。After the terminal obtains the attention information, the user may count the popularity of the host or the host of the terminal according to the attention information for further adjustment or improvement.
上述方案,终端通过摄像头在预定时间内探测与观察者的距离,当探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息,能够全方位采集关注度信息,提高收集关注度信息的准确度。In the above solution, the terminal detects the distance from the observer through the camera within a predetermined time. When the detected distance is less than or equal to the preset threshold, the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the attention information of the observer, and can collect the attention information in all directions, and improve the accuracy of collecting the attention information.
参阅图2,图2是本申请信息采集方法另一实施例的流程图。本实施例的执行主体为终端,终端包括用于采集信息的摄像头,摄像头为具有防抖动功能的摄像头。终端可以为可穿戴设备、视频采集设备或个人电脑等(但并不限于此),终端还可以内置于饰品、衣服或帽子等,以全方位统计对终端本身,或饰品、衣服或帽子等承载物的关注度。终端可以应用于街区、卖场、展销会等场所。当然,并不限于此,终端还可以应用于其他场所。Referring to FIG. 2, FIG. 2 is a flowchart of another embodiment of the information collecting method of the present application. The execution body of this embodiment is a terminal, and the terminal includes a camera for collecting information, and the camera is a camera with anti-shake function. The terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat. The attention of the object. The terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
本实施例的信息采集方法包括以下步骤:The information collection method of this embodiment includes the following steps:
S201:终端通过摄像头在预定时间内探测与观察者的距离。S201: The terminal detects the distance from the observer through the camera within a predetermined time.
终端通过具有距离探测功能的摄像头在预定时间内,探测与观察者之间的距离。The terminal detects the distance from the observer through a camera having a distance detecting function for a predetermined time.
其中,摄像头可以为红外探测摄像头,但并不限于此,也可以为其他类型的具有距离探测功能的摄像头。The camera may be an infrared detecting camera, but is not limited thereto, and may be other types of cameras having a distance detecting function.
摄像头的个数可以为一个,也可以为至少两个,以保证终端能够全方位探测与终端四周的观察者的距离。The number of cameras can be one or at least two to ensure that the terminal can detect the distance from the observer around the terminal in all directions.
预定时间可以为1小时或2小时,还可以根据时间需要进行设置。The scheduled time can be 1 hour or 2 hours, and can also be set according to time needs.
观察者为终端附近观察终端本身的人群,或者观察终端的承载物的人群。The observer is a crowd that observes the terminal itself near the terminal, or a crowd that observes the carrier of the terminal.
终端探测到与观察者之间的距离之后,确定探测到的距离是否小于或等于预设阈值。其中,距离对应的预设阈值可以设置为5米或10米,但并不限于此,也可以根据实际设置为其他值,此处不作限制。After the terminal detects the distance from the observer, it is determined whether the detected distance is less than or equal to a preset threshold. The preset threshold corresponding to the distance may be set to 5 meters or 10 meters, but is not limited thereto, and may be set to other values according to actual conditions, and is not limited herein.
当探测到的距离小于或等于预设阈值时,执行步骤S202。When the detected distance is less than or equal to the preset threshold, step S202 is performed.
当探测到的距离大于预设阈值时,则不做任何处理。When the detected distance is greater than the preset threshold, no processing is performed.
S202:当所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息。S202: Collect the face image information of the observer when the distance is less than or equal to a preset threshold.
当探测到的距离小于或等于预设阈值时,终端通过摄像头采集观察者的人脸图像信息。When the detected distance is less than or equal to the preset threshold, the terminal collects the face image information of the observer through the camera.
S203:根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息。S203: Determine feature information according to the face image information, and determine the attention degree information of the observer according to the feature information.
终端根据采集到的人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息。The terminal determines the feature information according to the collected face image information, and determines the observer's attention information according to the feature information.
特征信息包括人眼位置、年龄、性别等。关注度信息包括关注、不关注,关注的观察者的年龄阶段、性别比例、关注时间等。The feature information includes the position of the human eye, age, gender, and the like. The degree of interest information includes attention, no attention, age of the observer of interest, sex ratio, time of attention, and the like.
其中,根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息的步骤包括:根据所述人脸图像信息确定人脸图像的数量和人眼位置;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息。The determining the feature information according to the face image information, and determining the attention degree information of the observer according to the feature information includes: determining a number of face images and a human eye position according to the face image information; When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images.
例如,终端根据人脸图像信息确定人脸图像的数量和人眼位置,并根据人眼位置确定观察者的注视方向,从而根据注视方向确定该观察者是否注视本终端或本终端的承载物。其中,注视方向为人眼位置在一定持续时间内保持不变时的方向。For example, the terminal determines the number of face images and the position of the human eye according to the face image information, and determines the gaze direction of the observer according to the position of the human eye, thereby determining whether the observer looks at the carrier of the terminal or the terminal according to the gaze direction. Wherein, the gaze direction is the direction when the position of the human eye remains unchanged for a certain duration.
当终端根据注视方向确定观察者的注视方向为本终端或本终端的承载物时,则确定为关注。当终端根据注视方向确定观察者的注视方向为偏离本终端或本终端的承载物时,确定为不关注。When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention. When the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
当终端确定观察者的的注视方向为本终端或本终端的承载物时,结合人脸图像的数量,确定注视方向为本终端或本终端的承载物的观察者的数量(总人数)。When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal, the number of viewers (the total number of people) whose gaze direction is the bearer of the terminal or the terminal is determined in combination with the number of face images.
或者,根据所述人脸图像信息确定特征信息的步骤还可以包括:根据人脸图像信息确定人脸图像对应的年龄;当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量以及人脸图像对应的年龄确定观察者中各年龄阶段的关注度信息。Alternatively, the step of determining the feature information according to the face image information may further include: determining an age corresponding to the face image according to the face image information; and combining the number of the face images when determining the gaze direction of the observer according to the position of the human eye And the age corresponding to the face image determines the degree of interest information of each age stage in the observer.
例如,终端根据人脸图像信息以及人体的综合特征数据库(其中,人体的综合特征数据库包括人脸特征、头发的长度和发型、衣服、鞋子的样式和颜色等信息)确定人脸图像的数量、人眼位置以及人脸图像对应的年龄,并根据人眼位置确定观察者的注视方向,从而根据注视方向确定该观察者是否注视本终端或本终端的承载物。注视方向为人眼位置在一定持续时间内保持不变时的方向。其中,人体的综合特征数据库中包含的人脸特征与年龄的对应关系。人体的综合特征数据库可以是预先存储在终端内的,也可以是从网络服务器中获取的。在其他实施例中,终端还可以直接根据人脸图像信息、人脸特征与年龄的对应关系的相关统计调查报告来确定年龄。For example, the terminal determines the number of face images according to the face image information and the comprehensive feature database of the human body (where the comprehensive feature database of the human body includes face features, length of the hair and hair style, clothes, style and color of the shoes, etc.) The position of the human eye and the age corresponding to the face image, and determining the gaze direction of the observer according to the position of the human eye, thereby determining whether the observer looks at the carrier of the terminal or the terminal according to the gaze direction. The gaze direction is the direction in which the position of the human eye remains unchanged for a certain duration. Among them, the correspondence between the facial features and the age included in the comprehensive feature database of the human body. The comprehensive feature database of the human body may be pre-stored in the terminal or may be acquired from the network server. In other embodiments, the terminal may also determine the age directly based on a related statistical survey report of the correspondence between the face image information, the face feature, and the age.
当终端根据注视方向确定观察者的注视方向为本终端或本终端的承载物时,则确定为关注。当终端根据注视方向确定观察者的注视方向为偏离本终端或本终端的承载物时,确定为不关注。When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention. When the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
当终端确定观察者的的注视方向为本终端或本终端的承载物时,结合人脸图像的数量,确定注视方向为本终端或本终端的承载物的观察者的数量(总人数);以及结合人脸图像对应的年龄确定观察者中各年龄阶段的观察者的数量,并进一步根据观察者中各年龄阶段的观察者的数量确定各年龄阶段的观察者的比例。When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal, the number of observers (the total number of people) that the gaze direction is the bearer of the terminal or the terminal is determined according to the number of the face images; The number of observers of each age stage in the observer is determined in accordance with the age corresponding to the face image, and the proportion of observers at each age stage is further determined based on the number of observers of each age stage in the observer.
其中,当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量以及人脸图像对应的年龄确定观察者中各年龄阶段的关注度信息的步骤可以具体为:当根据人眼位置确定观察者的注视方向时,根据人脸位置确定人脸图像对应的注视时间,其中,注视时间为观察者注视终端所在方位的时间;结合人脸图像的数量、人脸图像对应的年龄以及人脸图像对应的注视时间,确定观察者中各年龄阶段的关注度信息。Wherein, when determining the gaze direction of the observer according to the position of the human eye, the step of determining the degree of interest information of each age stage in the observer in combination with the number of face images and the age corresponding to the face image may be specifically as follows: according to the position of the human eye When determining the gaze direction of the observer, the gaze time corresponding to the face image is determined according to the face position, wherein the gaze time is the time at which the observer looks at the orientation of the terminal; the number of the face images, the age corresponding to the face image, and the person The gaze time corresponding to the face image determines the degree of attention information of each age stage in the observer.
例如,当终端确定观察者的的注视方向为本终端或本终端的承载物时,根据人脸位置确定人脸图像对应的注视时间,其中,注视时间为观察者注视终端所在方位的时间;并根据人脸图像的数量确定注视方向为本终端或本终端的承载物的观察者的数量(总人数);以及根据人脸图像对应的年龄以及人脸图像对应的注视时间,确定观察者中各年龄阶段的观察者的比例以及各年龄阶段的关注时间。For example, when the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal, the gaze time corresponding to the face image is determined according to the face position, wherein the gaze time is the time when the observer looks at the orientation of the terminal; Determining the number of observers (total number of people) whose direction of the gaze is the terminal or the host of the terminal according to the number of face images; and determining the observers according to the age corresponding to the face image and the gaze time corresponding to the face image The proportion of observers at the age level and the time of attention at each age stage.
或者,根据所述人脸图像信息确定特征信息的步骤还可以包括:据人脸图像信息确定人脸图像对应的性别;当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。Alternatively, the step of determining the feature information according to the face image information may further include: determining a gender corresponding to the face image according to the face image information; and combining the person when determining the gaze direction of the observer according to the position of the human eye The number of face images and the gender corresponding to the face image determine the attention information of the observer.
例如,终端根据人脸图像信息确定人脸图像的数量、人眼位置以及人脸图像对应的性别,并根据人眼位置确定观察者的注视方向,从而根据注视方向确定该观察者是否注视本终端或本终端的承载物。For example, the terminal determines the number of face images, the position of the human eye, and the gender corresponding to the face image according to the face image information, and determines the gaze direction of the observer according to the position of the human eye, thereby determining whether the observer looks at the terminal according to the gaze direction. Or the carrier of the terminal.
其中,注视方向为人眼位置在一定持续时间内保持不变时的方向。当终端根据注视方向确定观察者的注视方向为本终端或本终端的承载物时,则确定为关注。当终端根据注视方向确定观察者的注视方向为偏离本终端或本终端的承载物时,确定为不关注。Wherein, the gaze direction is the direction when the position of the human eye remains unchanged for a certain duration. When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal according to the gaze direction, it is determined to be the attention. When the terminal determines that the observer's gaze direction is a deviation from the terminal or the terminal of the terminal according to the gaze direction, it is determined that the terminal does not pay attention.
当终端确定观察者的的注视方向为本终端或本终端的承载物时,结合人脸图像的数量,确定注视方向为本终端或本终端的承载物的观察者的数量(总人数);以及结合人脸图像对应的性别确定观察者中不同性别的观察者的数量,并进一步根据不同性别的观察者的数量确定不同性别的观察者的比例。When the terminal determines that the gaze direction of the observer is the bearer of the terminal or the terminal, the number of observers (the total number of people) that the gaze direction is the bearer of the terminal or the terminal is determined according to the number of the face images; The number of observers of different genders in the observer is determined according to the gender corresponding to the face image, and the proportion of observers of different genders is further determined according to the number of observers of different genders.
可以理解的是,终端统计注视方向为本终端或本终端的承载物的观察者中,不同性别的观察者的关注时间。统计方法与上述统计各年龄阶段的观察者的关注时间类似,具体请参阅相关描述,此处不赘述。It can be understood that the terminal statistics attention direction is the attention time of the observers of different genders among the observers of the terminal or the bearer of the terminal. The statistical method is similar to the above-mentioned statistics of the observers at different ages. For details, please refer to the related description, which is not described here.
S204:将所述人脸图像对应的特征信息以及所述特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。S204: Upload the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, so that the network server performs statistical analysis.
终端在获得注视方向为本终端或本终端的承载物的观察者的关注度信息之后,将观察者的人脸图像对应年龄、性别等信息以及观察者的年龄、性别各自对应的关注度信息上传至网络服务器,以使网络服务器能够根据所使用终端收集的关注度信息进行统计分析。After obtaining the attention information of the observer whose gaze direction is the terminal or the bearer of the terminal, the terminal uploads the viewer's face image corresponding to the age, gender, and the like, and the attention degree information corresponding to the observer's age and gender. To the web server, so that the web server can perform statistical analysis according to the attention information collected by the terminal used.
例如,根据关注度信息统计对本终端或本终端的承载物的受欢迎程度,从而为做进一步调整、改进或市场投放等提供参考依据。For example, the popularity of the terminal or the host of the terminal is counted according to the degree of interest information, thereby providing a reference for further adjustment, improvement, or market launch.
上述方案,终端通过摄像头在预定时间内探测与观察者的距离,当探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息,能够全方位采集关注度信息,提高收集关注度信息的准确度,并能够将关注度信息进行反馈,以对后期进一步作业提供参考依据。In the above solution, the terminal detects the distance from the observer through the camera within a predetermined time. When the detected distance is less than or equal to the preset threshold, the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the observer's attention information, can collect the attention information in all directions, improve the accuracy of collecting the attention information, and can feedback the attention information to provide a reference for further work in the later stage.
参阅图3,图3是本申请信息采集终端一实施例的结构示意图。终端具有防抖动的摄像头。终端可以为可穿戴设备、视频采集设备或个人电脑等(但并不限于此),终端还可以内置于饰品、衣服或帽子等,以全方位统计对终端本身,或饰品、衣服或帽子等承载物的关注度。终端可以应用于街区、卖场、展销会等场所。当然,并不限于此,终端还可以应用于其他场所。Referring to FIG. 3, FIG. 3 is a schematic structural diagram of an embodiment of an information collecting terminal of the present application. The terminal has an anti-shake camera. The terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat. The attention of the object. The terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
本实施例中终端包含的各模块用于分别执行图1对应的实施例中的各步骤,具体请参阅图1对应的实施例中各步骤的相关描述,此处不赘述。本实施例的信息采集终端包括距离探测模块310、采集模块320以及统计模块330。The modules included in the terminal in this embodiment are used to perform the respective steps in the embodiment corresponding to FIG. 1 . For details, refer to the related descriptions of the steps in the embodiment corresponding to FIG. 1 , and details are not described herein. The information collection terminal of this embodiment includes a distance detection module 310, an acquisition module 320, and a statistics module 330.
距离探测模块310用于通过摄像头在预定时间内探测与观察者的距离。比如,距离探测模块310通过摄像头在预定时间内探测与观察者的距离。距离探测模块310将探测到的距离发送给采集模块320。The distance detecting module 310 is configured to detect the distance from the observer by the camera within a predetermined time. For example, the distance detecting module 310 detects the distance from the observer through the camera for a predetermined time. The distance detection module 310 transmits the detected distance to the acquisition module 320.
采集模块320用于接收距离探测模块310探测到的距离,当探测模块310探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息。比如,采集模块320接收距离探测模块310探测到的距离,当探测模块310探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息。采集模块320将采集到的人脸图像信息发送给统计模块330。The collecting module 320 is configured to receive the distance detected by the distance detecting module 310. When the detected distance of the detecting module 310 is less than or equal to a preset threshold, the face image information of the observer is collected. For example, the acquisition module 320 receives the distance detected by the distance detection module 310. When the distance detected by the detection module 310 is less than or equal to the preset threshold, the face image information of the observer is collected. The collecting module 320 sends the collected face image information to the statistics module 330.
统计模块330用于接收采集模块320采集到的人脸图像信息,根据采集模块320采集的人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息。The statistic module 330 is configured to receive the facial image information collected by the collecting module 320, determine the feature information according to the facial image information collected by the collecting module 320, and determine the attention information of the observer according to the feature information.
比如,统计模块330接收采集模块320采集到的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息。For example, the statistics module 330 receives the face image information collected by the collection module 320, determines the feature information according to the face image information, and determines the observer's attention information according to the feature information.
上述方案,终端通过摄像头在预定时间内探测与观察者的距离,当探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息,能够全方位采集关注度信息,提高收集关注度信息的准确度。In the above solution, the terminal detects the distance from the observer through the camera within a predetermined time. When the detected distance is less than or equal to the preset threshold, the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the attention information of the observer, and can collect the attention information in all directions, and improve the accuracy of collecting the attention information.
参阅图4,图4是本申请信息采集终端另一实施例的结构示意图。终端具有防抖动的摄像头。终端可以为可穿戴设备、视频采集设备或个人电脑等(但并不限于此),终端还可以内置于饰品、衣服或帽子等,以全方位统计对终端本身,或饰品、衣服或帽子等承载物的关注度。终端可以应用于街区、卖场、展销会等场所。当然,并不限于此,终端还可以应用于其他场所。Referring to FIG. 4, FIG. 4 is a schematic structural diagram of another embodiment of an information collecting terminal of the present application. The terminal has an anti-shake camera. The terminal can be a wearable device, a video capture device, or a personal computer (but not limited to this), and the terminal can also be built in jewelry, clothes, or a hat, etc., to comprehensively count the terminal itself, or the jewelry, clothes, or hat. The attention of the object. The terminal can be applied to places such as blocks, stores, trade fairs and the like. Of course, it is not limited to this, and the terminal can also be applied to other places.
本实施例中终端包含的各模块用于分别执行图2对应的实施例中的各步骤,具体请参阅图2对应的实施例中各步骤的相关描述,此处不赘述。本实施例的信息采集终端包括距离探测模块410、采集模块420、统计模块430以及同步模块440。其中,统计模块430包括确定单元431以及统计单元432。The modules included in the terminal in this embodiment are used to respectively perform the steps in the embodiment corresponding to FIG. 2 . For details, refer to the related descriptions of the steps in the embodiment corresponding to FIG. 2 , and details are not described herein. The information collection terminal of this embodiment includes a distance detection module 410, an acquisition module 420, a statistics module 430, and a synchronization module 440. The statistic module 430 includes a determining unit 431 and a statistic unit 432.
距离探测模块410用于通过摄像头在预定时间内探测与观察者的距离。比如,距离探测模块410通过摄像头在预定时间内探测与观察者的距离。距离探测模块410将探测到的距离发送给采集模块420。The distance detection module 410 is configured to detect the distance from the observer for a predetermined time by the camera. For example, the distance detecting module 410 detects the distance from the observer for a predetermined time by the camera. The distance detection module 410 transmits the detected distance to the acquisition module 420.
采集模块420用于接收距离探测模块410探测到的距离,当探测模块410探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息。比如,采集模块420接收距离探测模块410探测到的距离,当探测模块410探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息。采集模块420将采集到的人脸图像信息发送给统计模块430。The collecting module 420 is configured to receive the distance detected by the distance detecting module 410. When the detected distance of the detecting module 410 is less than or equal to a preset threshold, the face image information of the observer is collected. For example, the acquisition module 420 receives the distance detected by the distance detection module 410. When the distance detected by the detection module 410 is less than or equal to the preset threshold, the face image information of the observer is collected. The collecting module 420 sends the collected face image information to the statistics module 430.
统计模块430用于接收采集模块420采集到的人脸图像信息,根据采集模块420采集的人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息。比如,统计模块430接收采集模块420采集到的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息。The statistics module 430 is configured to receive the facial image information collected by the collecting module 420, determine the feature information according to the facial image information collected by the collecting module 420, and determine the attention information of the observer according to the feature information. For example, the statistics module 430 receives the face image information collected by the collection module 420, determines the feature information according to the face image information, and determines the observer's attention information according to the feature information.
其中,确定单元431用于根据采集模块420采集到的人脸图像信息确定人脸图像的数量和人眼位置;统计单元432用于当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量,确定观察者的关注度信息。比如,确定单元431根据采集模块420采集到的人脸图像信息确定人脸图像的数量和人眼位置。统计单元432接收确定单元431发送的人脸图像的数量和人眼位置信息,当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量,确定观察者的关注度信息。The determining unit 431 is configured to determine the number of face images and the position of the human eye according to the face image information collected by the collecting module 420. The counting unit 432 is configured to combine the faces when determining the gaze direction of the observer according to the position of the human eye. The number of images to determine the viewer's attention information. For example, the determining unit 431 determines the number of face images and the position of the human eye according to the face image information collected by the collecting module 420. The statistical unit 432 receives the number of face images and the human eye position information transmitted by the determining unit 431, and determines the attention degree information of the observer in combination with the number of face images when determining the gaze direction of the observer according to the position of the human eye.
其中,特征信息还包括年龄、性别;确定单元431还用于根据人脸图像信息确定人脸图像对应的年龄,和/或根据人脸图像信息确定人脸图像对应的性别。统计单元432具体用于当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量以及人脸图像对应的年龄确定观察者中各年龄阶段的关注度信息,和/或当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量以及人脸图像对应的性别确定观察者的关注度信息。The feature information further includes age and gender. The determining unit 431 is further configured to determine an age corresponding to the face image according to the face image information, and/or determine a gender corresponding to the face image according to the face image information. The statistical unit 432 is specifically configured to determine the attention degree information of each age stage in the observer according to the number of the face images and the age corresponding to the face image when determining the gaze direction of the observer according to the position of the human eye, and/or when according to the person When the eye position determines the gaze direction of the observer, the observer's attention information is determined in conjunction with the number of face images and the gender corresponding to the face image.
比如,确定单元431根据采集模块420采集的人脸图像信息确定的特征信息包括年龄、性别。确定单元431根据人脸图像信息确定人脸图像对应的年龄,和/或根据人脸图像信息确定人脸图像对应的性别。For example, the feature information determined by the determining unit 431 according to the face image information collected by the collecting module 420 includes age and gender. The determining unit 431 determines the age corresponding to the face image based on the face image information, and/or determines the gender corresponding to the face image based on the face image information.
统计单元432接收确定单元431发送的人脸图像的数量和人眼位置信息,当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量以及人脸图像对应的年龄确定观察者中各年龄阶段的关注度信息,和/或当根据人眼位置确定观察者的注视方向时,结合人脸图像的数量以及人脸图像对应的性别确定观察者的关注度信息。The statistical unit 432 receives the number of face images and the human eye position information transmitted by the determining unit 431, and determines the observer's gaze direction according to the human eye position, and determines the number of the face images and the age corresponding to the face image to determine the observer. The attention degree information of each age stage, and/or when the observer's gaze direction is determined according to the human eye position, the observer's attention degree information is determined in conjunction with the number of face images and the gender corresponding to the face image.
统计单元432将人脸图像的特征信息,关注度信息发送给同步模块440。The statistical unit 432 transmits the feature information of the face image and the degree of interest information to the synchronization module 440.
同步模块440用于接收统计单元432发送的人脸图像的特征信息、关注度信息,将人脸图像对应的特征信息以及特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。The synchronization module 440 is configured to receive the feature information and the attention degree information of the face image sent by the statistics unit 432, and upload the feature information corresponding to the face image and the attention degree information corresponding to the feature information to the network server, so that the network server performs statistical analysis. .
比如,同步模块440接收统计单元432发送的人脸图像的特征信息、关注度信息,将人脸图像对应的特征信息以及特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。For example, the synchronization module 440 receives the feature information and the attention degree information of the face image sent by the statistics unit 432, and uploads the feature information corresponding to the face image and the attention degree information corresponding to the feature information to the network server, so that the network server performs statistical analysis. .
上述方案,终端通过摄像头在预定时间内探测与观察者的距离,当探测到的距离小于或等于预设阈值时,采集观察者的人脸图像信息,根据人脸图像信息确定特征信息,并根据特征信息确定观察者的关注度信息,能够全方位采集关注度信息,提高收集关注度信息的准确度,并能够将关注度信息进行反馈,以对后期进一步作业提供参考依据。In the above solution, the terminal detects the distance from the observer through the camera within a predetermined time. When the detected distance is less than or equal to the preset threshold, the face image information of the observer is collected, and the feature information is determined according to the face image information, and according to the The feature information determines the observer's attention information, can collect the attention information in all directions, improve the accuracy of collecting the attention information, and can feedback the attention information to provide a reference for further work in the later stage.
以上描述中,为了说明而不是为了限定,提出了诸如特定系统结构、接口、技术之类的具体细节,以便透彻理解本申请。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施方式中也可以实现本申请。在其它情况中,省略对众所周知的装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。In the above description, specific details such as specific system structures, interfaces, techniques, and the like have been presented for the purpose of illustration and description. However, it will be apparent to those skilled in the art that the present invention can be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known devices, circuits, and methods are omitted so as not to obscure the description of the application.

Claims (14)

  1. 一种终端的信息采集方法,所述终端包括一个用于采集信息的摄像头,其中,所述方法包括:A method for collecting information of a terminal, the terminal includes a camera for collecting information, wherein the method includes:
    终端通过摄像头在预定时间内探测与观察者的距离;The terminal detects the distance from the observer through the camera within a predetermined time;
    当所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息;Collecting face image information of the observer when the distance is less than or equal to a preset threshold;
    根据所述人脸图像信息确定人脸图像的数量和人眼位置;Determining the number of face images and the position of the human eye according to the face image information;
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息;Determining the attention information of the observer in combination with the number of the face images when determining the gaze direction of the observer according to the position of the human eye;
    将所述人脸图像对应的人脸图像的数量和人眼位置以及所述人脸图像的数量和人眼位置特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。And uploading the attention degree information corresponding to the number of the face images corresponding to the face image and the position of the human eye and the number of the face images and the position information of the human eye to the network server, so that the network server performs statistical analysis.
  2. 根据权利要求1所述的方法,其中,所述特征信息还包括年龄;根据所述人脸图像信息确定特征信息的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的年龄;The method according to claim 1, wherein the feature information further includes an age; the step of determining the feature information according to the face image information further comprises: determining an age corresponding to the face image based on the face image information ;
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically:
    当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息。When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of each age stage in the observer is determined in conjunction with the number of the face images and the age corresponding to the face image.
  3. 根据权利要求2所述的方法,其中,当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息的步骤具体为:The method according to claim 2, wherein when the gaze direction of the observer is determined according to the position of the human eye, the observer is determined in accordance with the number of the face images and the age corresponding to the face image The steps of the attention information of each age stage are as follows:
    当根据所述人眼位置确定所述观察者的注视方向时,根据所述人脸位置确定所述人脸图像对应的注视时间,其中,所述注视时间为观察者注视所述终端所在方位的时间;When the gaze direction of the observer is determined according to the position of the human eye, the gaze time corresponding to the face image is determined according to the face position, wherein the gaze time is an observer's gaze at the orientation of the terminal time;
    结合所述人脸图像的数量、所述人脸图像对应的年龄以及所述人脸图像对应的注视时间,确定所述观察者中各年龄阶段的关注度信息。The degree of interest information of each age stage in the observer is determined in combination with the number of the face images, the age corresponding to the face image, and the gaze time corresponding to the face image.
  4. 根据权利要求1所述的方法,其中,所述特征信息还包括性别;所述根据所述人脸图像信息确定人脸图像的数量和人眼位置的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的性别;The method according to claim 1, wherein said feature information further comprises a gender; said step of determining a number of face images and a position of a human eye based on said face image information further comprising: based on said face image information Determining a gender corresponding to the face image;
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically:
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images and the gender corresponding to the face image.
  5. 一种终端的信息采集方法,所述终端包括一个用于采集信息的摄像头,其中,所述方法包括:A method for collecting information of a terminal, the terminal includes a camera for collecting information, wherein the method includes:
    终端通过摄像头在预定时间内探测与观察者的距离;The terminal detects the distance from the observer through the camera within a predetermined time;
    当所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息;Collecting face image information of the observer when the distance is less than or equal to a preset threshold;
    根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息。Determining the feature information according to the face image information, and determining the attention degree information of the observer according to the feature information.
  6. 根据权利要求5所述的方法,其中,根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息的步骤包括:The method according to claim 5, wherein the determining the feature information based on the face image information and determining the attention degree information of the observer based on the feature information comprises:
    根据所述人脸图像信息确定人脸图像的数量和人眼位置;Determining the number of face images and the position of the human eye according to the face image information;
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息。When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images.
  7. 根据权利要求6所述的方法,其中,所述特征信息还包括年龄;根据所述人脸图像信息确定特征信息的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的年龄;The method according to claim 6, wherein the feature information further includes an age; the step of determining the feature information according to the face image information further comprises: determining an age corresponding to the face image based on the face image information ;
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically:
    当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息。When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of each age stage in the observer is determined in conjunction with the number of the face images and the age corresponding to the face image.
  8. 根据权利要求7所述的方法,其中,当根据所述人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息的步骤具体为:The method according to claim 7, wherein when the gaze direction of the observer is determined according to the position of the human eye, the observer is determined in accordance with the number of the face images and the age corresponding to the face image The steps of the attention information of each age stage are as follows:
    当根据所述人眼位置确定所述观察者的注视方向时,根据所述人脸位置确定所述人脸图像对应的注视时间,其中,所述注视时间为观察者注视所述终端所在方位的时间;When the gaze direction of the observer is determined according to the position of the human eye, the gaze time corresponding to the face image is determined according to the face position, wherein the gaze time is an observer's gaze at the orientation of the terminal time;
    结合所述人脸图像的数量、所述人脸图像对应的年龄以及所述人脸图像对应的注视时间,确定所述观察者中各年龄阶段的关注度信息。The degree of interest information of each age stage in the observer is determined in combination with the number of the face images, the age corresponding to the face image, and the gaze time corresponding to the face image.
  9. 根据权利要求6所述的方法,其中,所述特征信息还包括性别;所述根据所述人脸图像信息确定人脸图像的数量和人眼位置的步骤还包括:根据所述人脸图像信息确定所述人脸图像对应的性别;The method according to claim 6, wherein said feature information further comprises a gender; said step of determining a number of face images and a position of a human eye based on said face image information further comprising: based on said face image information Determining a gender corresponding to the face image;
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息的步骤具体为:When determining the gaze direction of the observer according to the position of the human eye, the step of determining the attention information of the observer in combination with the number of the face images is specifically:
    当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。When the gaze direction of the observer is determined according to the position of the human eye, the attention degree information of the observer is determined in conjunction with the number of the face images and the gender corresponding to the face image.
  10. 根据权利要求5所述的方法,其中,根据所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息的步骤之后,所述方法还包括:The method according to claim 5, wherein after the step of determining the feature information according to the face image information and determining the attention degree information of the observer according to the feature information, the method further comprises:
    将所述人脸图像对应的特征信息以及所述特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。And uploading the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, so that the network server performs statistical analysis.
  11. 一种信息采集终端,所述终端包括一个用于采集信息的摄像头,其中,所述终端包括:距离探测模块、采集模块以及统计模块;An information collecting terminal, the terminal includes a camera for collecting information, wherein the terminal includes: a distance detecting module, an collecting module, and a statistics module;
    所述距离探测模块用于通过摄像头在预定时间内探测与观察者的距离;The distance detecting module is configured to detect a distance from an observer by a camera within a predetermined time;
    所述采集模块用于当所述距离探测模块探测到的所述距离小于或等于预设阈值时,采集所述观察者的人脸图像信息;The collecting module is configured to collect face image information of the observer when the distance detected by the distance detecting module is less than or equal to a preset threshold;
    所述统计模块用于根据所述采集模块采集的所述人脸图像信息确定特征信息,并根据所述特征信息确定所述观察者的关注度信息。The statistic module is configured to determine feature information according to the face image information collected by the collection module, and determine the attention degree information of the observer according to the feature information.
  12. 根据权利要求11所述的终端,其中,所述统计模块包括确定单元以及统计单元;The terminal according to claim 11, wherein the statistical module comprises a determining unit and a statistical unit;
    所述确定单元用于根据所述人脸图像信息确定人脸图像的数量和人眼位置;The determining unit is configured to determine the number of face images and the position of the human eye according to the face image information;
    所述统计单元用于当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量,确定所述观察者的关注度信息。The statistical unit is configured to determine the attention degree information of the observer in combination with the number of the face images when determining the gaze direction of the observer according to the position of the human eye.
  13. 根据权利要求11所述的终端,其中,所述特征信息还包括年龄、性别;The terminal according to claim 11, wherein the feature information further includes age and gender;
    所述确定单元还用于根据所述人脸图像信息确定所述人脸图像对应的年龄,和/或根据所述人脸图像信息确定所述人脸图像对应的性别;The determining unit is further configured to determine an age corresponding to the face image according to the face image information, and/or determine a gender corresponding to the face image according to the face image information;
    所述统计单元具体用于当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的年龄确定所述观察者中各年龄阶段的关注度信息,和/或当根据人眼位置确定所述观察者的注视方向时,结合所述人脸图像的数量以及所述人脸图像对应的性别确定所述观察者的关注度信息。The statistic unit is specifically configured to determine the attention of each age of the observer in combination with the number of the face images and the age corresponding to the face image when determining the gaze direction of the observer according to the position of the human eye. Degree information, and/or when the observer's gaze direction is determined according to the human eye position, the observer's attention information is determined in conjunction with the number of the face images and the gender corresponding to the face image.
  14. 根据权利要求11所述的终端,其中,所述终端还包括同步模块,所述同步模块用于将所述人脸图像对应的特征信息以及所述特征信息对应的关注度信息上传至网络服务器,以使网络服务器进行统计分析。The terminal according to claim 11, wherein the terminal further includes a synchronization module, and the synchronization module is configured to upload the feature information corresponding to the face image and the degree of interest information corresponding to the feature information to a network server, In order to enable the network server to perform statistical analysis.
PCT/CN2015/092019 2015-04-03 2015-10-15 Information collection method for terminal, and terminal thereof WO2016155284A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510159206.3A CN104834896A (en) 2015-04-03 2015-04-03 Method and terminal for information acquisition
CN2015101592063 2015-04-03

Publications (1)

Publication Number Publication Date
WO2016155284A1 true WO2016155284A1 (en) 2016-10-06

Family

ID=53812774

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/092019 WO2016155284A1 (en) 2015-04-03 2015-10-15 Information collection method for terminal, and terminal thereof

Country Status (2)

Country Link
CN (1) CN104834896A (en)
WO (1) WO2016155284A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104834896A (en) * 2015-04-03 2015-08-12 惠州Tcl移动通信有限公司 Method and terminal for information acquisition
CN105243084A (en) * 2015-09-07 2016-01-13 广东欧珀移动通信有限公司 Photographed image file storage method and system and photographed image file search method and system
CN105868782A (en) * 2016-03-30 2016-08-17 苏州大学 Attention rate statistical system, information delivery device, and electronic advertisement display screen
CN107995987A (en) * 2017-03-21 2018-05-04 深圳市欸阿技术有限公司 Advertisement show window and its display methods
CN107545702A (en) * 2017-08-28 2018-01-05 北京工业大学 The security system and implementation method of the too high attention rate of intelligent early-warning crowd
CN110135222A (en) * 2018-02-08 2019-08-16 上海荟宸信息科技有限公司 A method of realizing the transmission of wisdom commercial circle face characteristic information acquisition terminal data
CN108848366B (en) * 2018-07-05 2020-12-18 盎锐(上海)信息科技有限公司 Information acquisition device and method based on 3D camera
CN109961048A (en) * 2019-03-26 2019-07-02 北京儒博科技有限公司 Human-computer interaction learning process middle school student recall method, apparatus, robot and medium
CN113139411A (en) * 2020-01-20 2021-07-20 北京芯海视界三维科技有限公司 Method, device and product for realizing information statistics

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102934458A (en) * 2011-02-04 2013-02-13 松下电器产业株式会社 Interest estimation device and interest estimation method
CN102982753A (en) * 2011-08-30 2013-03-20 通用电气公司 Person tracking and interactive advertising
CN104143079A (en) * 2013-05-10 2014-11-12 腾讯科技(深圳)有限公司 Method and system for face attribute recognition
CN104834896A (en) * 2015-04-03 2015-08-12 惠州Tcl移动通信有限公司 Method and terminal for information acquisition

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509070A (en) * 2011-10-12 2012-06-20 西安理工大学 Video-based human face area tracking method for counting people paying close attention to advertisement
CN104112209A (en) * 2013-04-16 2014-10-22 苏州和积信息科技有限公司 Audience statistical method of display terminal, and audience statistical system of display terminal
CN103440038B (en) * 2013-08-28 2016-06-15 中国人民大学 A kind of information acquisition system based on eye recognition and application thereof
CN103886317B (en) * 2014-03-28 2017-01-11 合肥工业大学 Local feature characterization method based on face expression image
CN104462530A (en) * 2014-12-23 2015-03-25 小米科技有限责任公司 Method and device for analyzing user preferences and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102934458A (en) * 2011-02-04 2013-02-13 松下电器产业株式会社 Interest estimation device and interest estimation method
CN102982753A (en) * 2011-08-30 2013-03-20 通用电气公司 Person tracking and interactive advertising
CN104143079A (en) * 2013-05-10 2014-11-12 腾讯科技(深圳)有限公司 Method and system for face attribute recognition
CN104834896A (en) * 2015-04-03 2015-08-12 惠州Tcl移动通信有限公司 Method and terminal for information acquisition

Also Published As

Publication number Publication date
CN104834896A (en) 2015-08-12

Similar Documents

Publication Publication Date Title
WO2016155284A1 (en) Information collection method for terminal, and terminal thereof
WO2018018771A1 (en) Dual camera-based photography method and system
WO2017204596A1 (en) Facial contour correcting method and device
WO2015012441A1 (en) Digital device and control method thereof
WO2017014415A1 (en) Image capturing apparatus and method of operating the same
WO2018053906A1 (en) Dual camera-based shooting method and device, and mobile terminal
WO2014094437A1 (en) Security monitoring system and corresponding alarm triggering method
WO2016107230A1 (en) System and method for reproducing objects in 3d scene
WO2012118274A1 (en) Method for measuring actual size of object using camera included in portable terminal
WO2018076744A1 (en) Wear status detection method and detection apparatus for smart wearable device
WO2018090740A1 (en) Method and apparatus for implementing company based on mixed reality technology
WO2011071277A2 (en) System and method for synchronizing video and sensor signals
WO2017175929A1 (en) Advertisement display system using smart film screen
WO2016095094A1 (en) Image processing system, remote control shooting module, and exposal information prompting method
WO2011035560A1 (en) Device and method for synchronization of stereoscopic digital imaging
WO2015105234A1 (en) Head mounted display and method for controlling the same
WO2015126060A1 (en) Electronic device and method for processing image
WO2014193065A1 (en) Video search apparatus and method
WO2017181686A1 (en) Automatic image angle correction method and system for use in video communication of mobile terminal
WO2013100239A1 (en) Method for processing images in a stereo vision system and apparatus for same
WO2018040269A1 (en) Image processing method and terminal
WO2016018067A1 (en) Method and device for mapping sensor location and event operation using monitoring device
WO2018097384A1 (en) Crowdedness notification apparatus and method
WO2015196878A1 (en) Television virtual touch control method and system
WO2022050668A1 (en) Method for detecting hand motion of wearable augmented reality device by using depth image, and wearable augmented reality device capable of detecting hand motion by using depth image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15887238

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15887238

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 15887238

Country of ref document: EP

Kind code of ref document: A1