CN109062403B - PDA equipment - Google Patents

PDA equipment Download PDF

Info

Publication number
CN109062403B
CN109062403B CN201810790621.2A CN201810790621A CN109062403B CN 109062403 B CN109062403 B CN 109062403B CN 201810790621 A CN201810790621 A CN 201810790621A CN 109062403 B CN109062403 B CN 109062403B
Authority
CN
China
Prior art keywords
user
pupil
equipment
receiving
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810790621.2A
Other languages
Chinese (zh)
Other versions
CN109062403A (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Putian Lianzheng Information Technology Co.,Ltd.
Original Assignee
Putian Hongming Trading Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Putian Hongming Trading Co ltd filed Critical Putian Hongming Trading Co ltd
Priority to CN201810790621.2A priority Critical patent/CN109062403B/en
Publication of CN109062403A publication Critical patent/CN109062403A/en
Application granted granted Critical
Publication of CN109062403B publication Critical patent/CN109062403B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks

Abstract

The invention relates to a PDA device, which belongs to the field of intelligent analysis, and comprises a detection starting device, a detection judging device and a control device, wherein the detection starting device is used for sending a starting detection signal when receiving a starting signal of the PDA device and sending a closing detection signal when receiving a closing signal of the PDA device; the method comprises the steps that an ultra-clear camera device is used, is arranged in a front frame of the PDA device and is used for carrying out ultra-clear data real-time acquisition on the front of a user of the PDA device so as to obtain and output a front image of the user; the pupil identification equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the ultra-clear camera equipment, and is used for receiving the front image of the user and extracting a pupil subimage of the user from the front image of the user based on a preset reference pupil pattern; and the using data analysis equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the pupil identification equipment, and is used for receiving the user pupil subimage and determining and outputting the real-time resolution of the user pupil subimage.

Description

PDA equipment
The application is a divisional application of a patent with the application number of 2017111912546 and the application date of 2017, 11 and 24, and the invention creates a name of a real-time user watching content analysis method.
Technical Field
The invention relates to the field of intelligent analysis, in particular to a real-time analysis method for user watching content. Background art pda (personal digital assistant), also known as palm top computer, can help us to work, study, entertain, etc. while on the move. Classified by use, into industrial-grade PDAs and consumer-product PDAs. The industrial-grade PDA is mainly applied to the industrial field, and a common bar code scanner, an RFID reader-writer, a POS machine and the like can be called as the PDA; consumer PDAs include many smart phones, tablet computers, handheld game consoles, and the like.
Pda (personal digital assistant) means a personal digital assistant. The name is a digital tool for assisting the personal work, and mainly provides the functions of keeping a record of events, an address book, business card exchange, scheduling and the like.
Currently, due to the diversity and richness of functions of the PDA device, a user often uses the PDA device for a long time without knowing himself, and in the prior art, the detection of the user's fatigue degree is roughly calculated based on time, and it is not considered that the cumulative effects of different display contents on the user's fatigue degree are different, so that the judgment of the user's fatigue degree is not accurate.
Disclosure of Invention
In order to solve the above problems, the present invention provides a real-time analysis method for user viewing content, which is capable of starting an ultra-clear image capture device when receiving a start detection signal, and receiving a content type in a display interface of a PDA device of a pupil response output from a correlation recognition device or a non-correlation recognition device, wherein the ultra-clear image capture device captures a plurality of front images of a user based on a time sequence, and receives the content type based on the time sequence using a user status analysis device, and the user status analysis device determines a user fatigue degree based on respective durations of various received content types between a current time and a time when the start detection signal is received.
The present invention has at least the following important points:
(1) establishing an image identification equipment selection mechanism based on image resolution numerical values, so that images with various resolutions can be correspondingly and efficiently identified;
(2) the image after the identification processing is subjected to morphological processing based on controllable strength of object complexity in the image, so that the quality of the image for subsequent processing is improved;
(3) and a detection mechanism for determining the fatigue degree of the user based on the respective duration of various content types received from the current moment to the moment of receiving the start detection signal is established, so that the detection precision of the fatigue degree of the user is improved.
According to an aspect of the present invention, there is provided a method for analyzing user viewing content in real time, the method including:
the PDA equipment comprises a use detection starting device, a starting detection device and a shutdown detection device, wherein the use detection starting device is arranged on an integrated circuit board of the PDA equipment and used for sending a starting detection signal when receiving a starting signal of the PDA equipment and sending a shutdown detection signal when receiving a shutdown signal of the PDA equipment;
the method comprises the steps that an ultra-clear camera device is used, is arranged in a front frame of the PDA device and is used for carrying out ultra-clear data real-time acquisition on the front of a user of the PDA device so as to obtain and output a front image of the user;
the pupil identification equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the ultra-clear camera equipment, and is used for receiving the front image of the user and extracting a pupil subimage of the user from the front image of the user based on a preset reference pupil pattern;
and the using data analysis equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the pupil identification equipment, and is used for receiving the user pupil subimage and determining and outputting the real-time resolution of the user pupil subimage.
Preferably, the method further comprises the following steps:
the method comprises the steps that corrosion expansion processing equipment is used, arranged on an integrated circuit board of PDA equipment, connected with the data analysis equipment and used for receiving the user pupil subimages, determining the strength of performing corrosion processing and expansion processing on the user pupil subimages on the basis of the object complexity in the user pupil subimages, and performing corrosion processing and expansion processing on the user pupil subimages to output a morphological image, wherein the higher the object complexity in the user pupil subimages is, the higher the strength of performing corrosion processing and expansion processing is;
using a correlation identification device, arranged on an integrated circuit board of the PDA device, connected with the corrosion expansion processing device, and used for receiving the morphological image, and starting correlation identification processing on the morphological image when the real-time resolution exceeds the limit, wherein the specific correlation identification processing is as follows: determining the number of hidden layers of a deep neural network for executing target recognition based on the real-time resolution, wherein the higher the real-time resolution is, the more the number of determined hidden layers is;
the deep neural network comprises an input layer, hidden layers and an output layer, wherein the input layer inputs morphological images, the hidden layers are one or more and are used for carrying out feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of the feature abstraction of the last hidden layer;
using a non-correlation identification device, arranged on an integrated circuit board of the PDA device, connected with the corrosion expansion processing device, and used for receiving the morphological image, and starting the non-correlation identification processing of the morphological image when the real-time resolution is not over limit, wherein the non-specific correlation identification processing is as follows: the number of hidden layers of a deep neural network for executing target recognition is fixed, wherein the deep neural network consists of an input layer, hidden layers and an output layer, the input layer inputs morphological images, the number of the hidden layers is fixed, the hidden layers are used for performing feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of performing feature abstraction on the last hidden layer;
the output layer of the deep neural network of the correlation identification device and the non-correlation identification device outputs the content type in the display interface of the PDA device which is pupil response;
the user state analysis device is arranged on an integrated circuit board of the PDA device, is respectively connected with the detection starting device, the correlation identification device and the non-correlation identification device, and is used for starting the ultra-clear camera device when receiving the starting detection signal and receiving content types in a display interface of the PDA device of pupil response output by the correlation identification device or the non-correlation identification device, wherein the ultra-clear camera device shoots a plurality of front images of the user on the basis of a time sequence, the user state analysis device receives the content types on the basis of the time sequence, and the user state analysis device determines the fatigue degree of the user on the basis of the respective continuous time of various received content types between the current time and the time of receiving the starting detection signal.
Preferably, when receiving the closing detection signal, the user state analysis device closes the super-definition imaging device, and performs a zero clearing operation on the user fatigue degree.
Preferably, the erosion expansion processing device comprises an image receiving unit, an object analysis unit, an erosion processing unit and an expansion processing unit.
Preferably, in the erosion expansion processing device, the image receiving unit is connected to the data analysis device and configured to receive the user pupil sub-image, the object analysis unit is connected to the image receiving unit and the erosion processing unit respectively and configured to determine the object complexity in the user pupil sub-image, the erosion processing unit is further connected to the expansion processing unit, and the erosion processing unit and the expansion processing unit are configured to perform erosion processing before expansion processing on the user pupil sub-image.
Drawings
Embodiments of the invention will now be described with reference to the accompanying drawings, in which:
fig. 1 is a schematic interface diagram of a user status analysis device of a user-viewed content real-time analysis system according to an embodiment of the present invention.
Fig. 2 is a block diagram illustrating a structure of a user-viewed content real-time analysis system according to an embodiment of the present invention.
Fig. 3 is a flowchart illustrating steps of a method for analyzing content viewed by a user in real time according to an embodiment of the present invention.
Detailed Description
An embodiment of a user viewing content real-time analysis method of the present invention will be described in detail below with reference to the accompanying drawings.
The prior art PDA user eye fatigue determination lacks a viewing content based recognition mechanism. In order to overcome the defects, the invention builds a system and a method for analyzing the content watched by the user in real time, and the specific implementation scheme is as follows.
Fig. 1 is a schematic interface diagram of a user status analysis device of a user-viewed content real-time analysis system according to an embodiment of the present invention. The user state analysis device is implemented by using a control chip as shown in fig. 1.
Fig. 2 is a block diagram showing a structure of a user-viewed content real-time analysis system according to an embodiment of the present invention, the system including:
the PDA device comprises a detection starting device, a detection starting device and a control device, wherein the detection starting device is arranged on an integrated circuit board of the PDA device and used for sending a starting detection signal when receiving a starting signal of the PDA device and sending a closing detection signal when receiving a closing signal of the PDA device;
the super-definition camera equipment is arranged in the front frame of the PDA equipment and is used for carrying out real-time super-definition data acquisition on the front of a user of the PDA equipment so as to obtain and output a front image of the user;
the pupil identification device is arranged on an integrated circuit board of the PDA device, is connected with the ultra-clear camera device, and is used for receiving the front image of the user and extracting pupil subimages of the user from the front image of the user based on a preset reference pupil pattern;
and the data analysis equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the pupil identification equipment, and is used for receiving the user pupil subimage and determining and outputting the real-time resolution of the user pupil subimage.
Next, the detailed structure of the user-viewed content real-time analysis system of the present invention will be further described.
The real-time analysis system for the user-viewed content may further include:
the erosion expansion processing device is connected with the data analysis device and used for receiving the user pupil subimage, determining the strength of erosion processing and expansion processing on the user pupil subimage based on the object complexity in the user pupil subimage, and performing erosion processing and expansion processing on the user pupil subimage to output a morphological image, wherein the higher the object complexity in the user pupil subimage is, the higher the strength of erosion processing and expansion processing is;
and the correlation identification device is connected with the erosion and expansion processing device and used for receiving the morphological image, and when the real-time resolution exceeds the limit, the correlation identification processing of the morphological image is started, wherein the specific correlation identification processing is as follows: determining the number of hidden layers of a deep neural network for executing target recognition based on the real-time resolution, wherein the higher the real-time resolution is, the more the number of the determined hidden layers is, the deep neural network consists of an input layer, hidden layers and an output layer, the input layer inputs morphological images, the hidden layers are one or more, the hidden layers are used for performing feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of performing feature abstraction on the last hidden layer;
and the non-correlation identification device is connected with the erosion and expansion processing device and used for receiving the morphological image, and starting the non-correlation identification processing of the morphological image when the real-time resolution is not over the limit, wherein the non-specific correlation identification processing comprises the following steps: the number of hidden layers of a deep neural network for executing target recognition is fixed, wherein the deep neural network consists of an input layer, hidden layers and an output layer, the input layer inputs morphological images, the number of the hidden layers is fixed, the hidden layers are used for performing feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of performing feature abstraction on the last hidden layer;
the output layer of the deep neural network of the correlation identification device and the non-correlation identification device outputs the content type in the display interface of the PDA device which is pupil response;
and the user state analysis device is respectively connected with the detection starting device, the correlation identification device and the non-correlation identification device, and is used for starting the ultra-clear camera device when receiving the starting detection signal and receiving the content type in the display interface of the PDA device of the pupil response output by the correlation identification device or the non-correlation identification device, wherein the ultra-clear camera device shoots a plurality of front images of the user on the basis of a time sequence, the user state analysis device receives the content type on the basis of the time sequence, and the user state analysis device determines the fatigue degree of the user on the basis of the time for which the various content types received between the current moment and the moment of receiving the starting detection signal respectively last.
In the user viewing content real-time analysis system:
and when the user state analysis equipment receives the closing detection signal, closing the super-clear camera equipment and carrying out zero clearing operation on the fatigue degree of the user.
In the user viewing content real-time analysis system:
the corrosion expansion processing equipment comprises an image receiving unit, an object analysis unit, a corrosion processing unit and an expansion processing unit.
And in the user viewing content real-time analysis system:
in the erosion expansion processing device, the image receiving unit is connected to the data analysis device and configured to receive the user pupil sub-image, the object analysis unit is respectively connected to the image receiving unit and the erosion processing unit and configured to determine object complexity in the user pupil sub-image, the erosion processing unit is further connected to the expansion processing unit, and the erosion processing unit and the expansion processing unit are configured to perform erosion processing before expansion processing on the user pupil sub-image.
Fig. 3 is a flowchart illustrating steps of a method for analyzing content viewed by a user in real time according to an embodiment of the present invention, the method including:
the PDA equipment comprises a use detection starting device, a starting detection device and a shutdown detection device, wherein the use detection starting device is arranged on an integrated circuit board of the PDA equipment and used for sending a starting detection signal when receiving a starting signal of the PDA equipment and sending a shutdown detection signal when receiving a shutdown signal of the PDA equipment;
the method comprises the steps that an ultra-clear camera device is used, is arranged in a front frame of the PDA device and is used for carrying out ultra-clear data real-time acquisition on the front of a user of the PDA device so as to obtain and output a front image of the user;
the pupil identification equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the ultra-clear camera equipment, and is used for receiving the front image of the user and extracting a pupil subimage of the user from the front image of the user based on a preset reference pupil pattern;
and the using data analysis equipment is arranged on an integrated circuit board of the PDA equipment, is connected with the pupil identification equipment, and is used for receiving the user pupil subimage and determining and outputting the real-time resolution of the user pupil subimage.
Next, the specific steps of the user viewing content real-time analysis method of the present invention will be further described.
The real-time user viewing content analysis method may further include:
the method comprises the steps that corrosion expansion processing equipment is used, arranged on an integrated circuit board of PDA equipment, connected with the data analysis equipment and used for receiving the user pupil subimages, determining the strength of performing corrosion processing and expansion processing on the user pupil subimages on the basis of the object complexity in the user pupil subimages, and performing corrosion processing and expansion processing on the user pupil subimages to output a morphological image, wherein the higher the object complexity in the user pupil subimages is, the higher the strength of performing corrosion processing and expansion processing is;
using a correlation identification device, arranged on an integrated circuit board of the PDA device, connected with the corrosion expansion processing device, and used for receiving the morphological image, and starting correlation identification processing on the morphological image when the real-time resolution exceeds the limit, wherein the specific correlation identification processing is as follows: determining the number of hidden layers of a deep neural network for executing target recognition based on the real-time resolution, wherein the higher the real-time resolution is, the more the number of the determined hidden layers is, the deep neural network consists of an input layer, hidden layers and an output layer, the input layer inputs morphological images, the hidden layers are one or more, the hidden layers are used for performing feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of performing feature abstraction on the last hidden layer;
using a non-correlation identification device, arranged on an integrated circuit board of the PDA device, connected with the corrosion expansion processing device, and used for receiving the morphological image, and starting the non-correlation identification processing of the morphological image when the real-time resolution is not over limit, wherein the non-specific correlation identification processing is as follows: the number of hidden layers of a deep neural network for executing target recognition is fixed, wherein the deep neural network consists of an input layer, hidden layers and an output layer, the input layer inputs morphological images, the number of the hidden layers is fixed, the hidden layers are used for performing feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of performing feature abstraction on the last hidden layer;
the output layer of the deep neural network of the correlation identification device and the non-correlation identification device outputs the content type in the display interface of the PDA device which is pupil response;
the user state analysis device is arranged on an integrated circuit board of the PDA device, is respectively connected with the detection starting device, the correlation identification device and the non-correlation identification device, and is used for starting the ultra-clear camera device when receiving the starting detection signal and receiving content types in a display interface of the PDA device of pupil response output by the correlation identification device or the non-correlation identification device, wherein the ultra-clear camera device shoots a plurality of front images of the user on the basis of a time sequence, the user state analysis device receives the content types on the basis of the time sequence, and the user state analysis device determines the fatigue degree of the user on the basis of the respective continuous time of various received content types between the current time and the time of receiving the starting detection signal.
The user watching content real-time analysis method comprises the following steps:
and when the user state analysis equipment receives the closing detection signal, closing the super-clear camera equipment and carrying out zero clearing operation on the fatigue degree of the user.
The user watching content real-time analysis method comprises the following steps:
the corrosion expansion processing equipment comprises an image receiving unit, an object analysis unit, a corrosion processing unit and an expansion processing unit.
The user watching content real-time analysis method comprises the following steps:
in the erosion expansion processing device, the image receiving unit is connected to the data analysis device and configured to receive the user pupil sub-image, the object analysis unit is respectively connected to the image receiving unit and the erosion processing unit and configured to determine object complexity in the user pupil sub-image, the erosion processing unit is further connected to the expansion processing unit, and the erosion processing unit and the expansion processing unit are configured to perform erosion processing before expansion processing on the user pupil sub-image.
In addition, the PDA, i.e., the palm computer, is most characterized by having an open operating system, supporting software and hardware upgrade, integrating information input, storage, management and transmission, and having powerful functions such as common office, entertainment, mobile communication, etc. Thus, the PDA can be referred to as a mobile office at all. Of course, not all of the above functions are available to any PDA; if available, it may not be possible to do so due to lack of corresponding service. However, it is anticipated that the trend and trend of PDA development is the convergence of computing, communication, networking, storage, entertainment, e-commerce, and other functionalities.
There is no definite definition for the palm computer, and someone also refers to the notebook as a palm computer, generally, the palm computer is a palm os, windows ce or other open operating systems, has network functions, and can freely upgrade software and hardware by users. That is, the user can add software besides expanding hardware, and even can develop a program by himself to run on the software.
In the use, he is more simple than desktop computer easy operation, remove convenient, and the function is practical, has eliminated desktop computer's five big restrictions, promptly: mobility restrictions, complexity of use, difficulty of mobile networking, high price, idleness of use.
By adopting the real-time analysis system and method for the user watching content, aiming at the technical problem that a fatigue degree judgment mechanism based on the watching content is lacked in the prior art, the front side of the user of the PDA device is subjected to super-clear data real-time acquisition to obtain and output a front side image of the user, the content type in the display interface of the PDA device watched by the user is identified based on a deep neural network, and the fatigue degree of the user is judged by combining the watching time, so that the technical problem is solved.
It is to be understood that while the present invention has been described in conjunction with the preferred embodiments thereof, it is not intended to limit the invention to those embodiments. It will be apparent to those skilled in the art from this disclosure that many changes and modifications can be made, or equivalents modified, in the embodiments of the invention without departing from the scope of the invention. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention are still within the scope of the protection of the technical solution of the present invention, unless the contents of the technical solution of the present invention are departed.

Claims (3)

1. A PDA device, comprising: integrated circuit board, front frame, display interface and user watch content real-time analysis system, wherein, user watches content real-time analysis system and includes:
the ultra-clear camera equipment is arranged in the front frame and used for outputting a front image of a user;
the pupil identification device is arranged on the integrated circuit board, is connected with the ultra-clear camera device, and is used for receiving the front image of the user and extracting a pupil subimage of the user from the front image of the user based on a preset reference pupil pattern;
the data analysis equipment is arranged on the integrated circuit board, is connected with the pupil identification equipment, and is used for receiving the user pupil subimage and determining and outputting the real-time resolution of the user pupil subimage;
the corrosion expansion processing equipment is arranged on the integrated circuit board, is connected with the data analysis equipment, and is used for receiving the user pupil subimage, determining the strength of performing corrosion processing and expansion processing on the user pupil subimage on the basis of the object complexity in the user pupil subimage, and performing corrosion processing and expansion processing on the user pupil subimage to output a morphological image;
the correlation identification equipment is arranged on the integrated circuit board, is connected with the corrosion expansion processing equipment and is used for receiving the morphological image and starting correlation identification processing on the morphological image when the real-time resolution exceeds the limit; the non-correlation identification equipment is arranged on the integrated circuit board, is connected with the corrosion expansion processing equipment and is used for receiving the morphological image and starting the non-correlation identification processing of the morphological image when the real-time resolution is not over the limit;
the PDA device power-on detection device comprises an integrated circuit board, a detection starting device and a detection signal receiving device, wherein the detection starting device is arranged on the integrated circuit board and used for sending the starting detection signal when receiving a power-on signal of the PDA device and sending the closing detection signal when receiving a power-off signal of the PDA device; and
the user state analysis equipment is arranged on the integrated circuit board, is respectively connected with the detection starting equipment, the correlation identification equipment and the non-correlation identification equipment, and is used for starting the ultra-clear camera equipment when receiving a starting detection signal, receiving the content type reflected in the display interface by the pupil output by the correlation identification equipment or the non-correlation identification equipment, and determining the fatigue degree of a user based on the time that various content types received between the current moment and the moment when the starting detection signal is received respectively last;
the correlation identification process is specifically as follows: determining the number of hidden layers of a deep neural network for executing target recognition based on the real-time resolution, wherein the higher the real-time resolution is, the more the number of determined hidden layers is; the deep neural network comprises an input layer, hidden layers and an output layer, wherein the input layer inputs morphological images, the hidden layers are one or more and are used for carrying out feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of the feature abstraction of the last hidden layer;
the non-correlation identification processing is specifically as follows: the number of hidden layers of a deep neural network for executing target recognition is fixed, wherein the deep neural network consists of an input layer, hidden layers and an output layer, the input layer inputs morphological images, the number of the hidden layers is fixed, the hidden layers are used for performing feature abstraction on the morphological images input by the input layer by layer, and the output layer is connected with the last hidden layer and is used for outputting the result of performing feature abstraction on the last hidden layer;
the erosion and expansion processing device comprises an image receiving unit, an object analysis unit, an erosion processing unit and an expansion processing unit, wherein in the erosion and expansion processing device, the image receiving unit is connected with the data analysis device and used for receiving the user pupil sub-image, the object analysis unit is respectively connected with the image receiving unit and the erosion processing unit and used for determining the object complexity in the user pupil sub-image, the erosion processing unit is also connected with the expansion processing unit, and the erosion processing unit and the expansion processing unit are used for performing erosion processing and expansion processing on the user pupil sub-image.
2. The PDA device of claim 1, wherein: the output layer of the deep neural network of the correlation identification device and the non-correlation identification device outputs the content type reflected by the pupil in the display interface of the PDA device.
3. The PDA device of claim 1, wherein: and when the user state analysis equipment receives a closing detection signal, closing the super-clear camera equipment and carrying out zero clearing operation on the fatigue degree of the user.
CN201810790621.2A 2017-11-24 2017-11-24 PDA equipment Active CN109062403B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810790621.2A CN109062403B (en) 2017-11-24 2017-11-24 PDA equipment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810790621.2A CN109062403B (en) 2017-11-24 2017-11-24 PDA equipment
CN201711191254.6A CN107817899B (en) 2017-11-24 2017-11-24 A kind of user watches content real-time analysis method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201711191254.6A Division CN107817899B (en) 2017-11-24 2017-11-24 A kind of user watches content real-time analysis method

Publications (2)

Publication Number Publication Date
CN109062403A CN109062403A (en) 2018-12-21
CN109062403B true CN109062403B (en) 2021-12-14

Family

ID=61609947

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201711191254.6A Active CN107817899B (en) 2017-11-24 2017-11-24 A kind of user watches content real-time analysis method
CN201810790621.2A Active CN109062403B (en) 2017-11-24 2017-11-24 PDA equipment

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201711191254.6A Active CN107817899B (en) 2017-11-24 2017-11-24 A kind of user watches content real-time analysis method

Country Status (1)

Country Link
CN (2) CN107817899B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108073896B (en) * 2017-11-24 2018-11-16 仲恺农业工程学院 User watches content real-time analyzer

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1680779A (en) * 2005-02-04 2005-10-12 江苏大学 Fatigue monitoring method and device for driver
CN101615252A (en) * 2008-06-25 2009-12-30 中国科学院自动化研究所 A kind of method for extracting text information from adaptive images
US8000941B2 (en) * 2007-12-30 2011-08-16 St. Jude Medical, Atrial Fibrillation Division, Inc. System and method for surface reconstruction from an unstructured point set
CN104133548A (en) * 2013-05-03 2014-11-05 中国移动通信集团公司 Method and device for determining viewpoint area and controlling screen luminance
CN104159098A (en) * 2014-08-29 2014-11-19 杭州道玄影视科技有限公司 Time-domain consistent semi-transparent edge extraction method for video
CN106963385A (en) * 2017-03-21 2017-07-21 苏州合欣美电子科技有限公司 A kind of eye fatigue based reminding method and system for the person that sees TV
CN107194893A (en) * 2017-05-22 2017-09-22 西安电子科技大学 Depth image ultra-resolution method based on convolutional neural networks

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101620359A (en) * 2008-07-04 2010-01-06 华晶科技股份有限公司 Judging method of eye sight line
CN101964111B (en) * 2010-09-27 2011-11-30 山东大学 Method for improving sight tracking accuracy based on super-resolution
CN102833410B (en) * 2012-08-23 2015-07-15 惠州Tcl移动通信有限公司 Method for controlling usage time of mobile phone
US9596508B2 (en) * 2013-03-15 2017-03-14 Sony Corporation Device for acquisition of viewer interest when viewing content
TW201624400A (en) * 2014-11-10 2016-07-01 鴻海精密工業股份有限公司 System, method and electronic device for monitoring state of eyes
US20160231812A1 (en) * 2015-02-06 2016-08-11 The Eye Tribe Aps Mobile gaze input system for pervasive interaction
CN104850228B (en) * 2015-05-14 2018-07-17 上海交通大学 The method of the watching area of locking eyeball based on mobile terminal
CN205563453U (en) * 2015-12-16 2016-09-07 中国科学院西安光学精密机械研究所 Sight is tracked and people's eye zone location system interested
CN105843376A (en) * 2016-03-07 2016-08-10 乐视移动智能信息技术(北京)有限公司 Operation method of mobile terminal application, and mobile terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1680779A (en) * 2005-02-04 2005-10-12 江苏大学 Fatigue monitoring method and device for driver
US8000941B2 (en) * 2007-12-30 2011-08-16 St. Jude Medical, Atrial Fibrillation Division, Inc. System and method for surface reconstruction from an unstructured point set
CN101615252A (en) * 2008-06-25 2009-12-30 中国科学院自动化研究所 A kind of method for extracting text information from adaptive images
CN104133548A (en) * 2013-05-03 2014-11-05 中国移动通信集团公司 Method and device for determining viewpoint area and controlling screen luminance
CN104159098A (en) * 2014-08-29 2014-11-19 杭州道玄影视科技有限公司 Time-domain consistent semi-transparent edge extraction method for video
CN106963385A (en) * 2017-03-21 2017-07-21 苏州合欣美电子科技有限公司 A kind of eye fatigue based reminding method and system for the person that sees TV
CN107194893A (en) * 2017-05-22 2017-09-22 西安电子科技大学 Depth image ultra-resolution method based on convolutional neural networks

Also Published As

Publication number Publication date
CN107817899A (en) 2018-03-20
CN109062403A (en) 2018-12-21
CN107817899B (en) 2018-06-26

Similar Documents

Publication Publication Date Title
WO2014022809A1 (en) Automated scanning
CN111901896A (en) Information sharing method, information sharing device, electronic equipment and storage medium
CN111464716A (en) Certificate scanning method, device, equipment and storage medium
CN111339842A (en) Video jamming identification method and device and terminal equipment
CN112099704A (en) Information display method and device, electronic equipment and readable storage medium
KR100648161B1 (en) System and Method For Collaborative Handwriting Input
US8620027B2 (en) Augmented reality-based file transfer method and file transfer system thereof
CN102034081A (en) Calculator device using image as data source
CN112532885A (en) Anti-shake method and device and electronic equipment
CN112532884B (en) Identification method and device and electronic equipment
CN109062403B (en) PDA equipment
CN113486738A (en) Fingerprint identification method and device, electronic equipment and readable storage medium
CN113128244A (en) Scanning method and device and electronic equipment
CN112734661A (en) Image processing method and device
EP3461138B1 (en) Processing method and terminal
CN112486387A (en) Application program control method and device
US10095714B2 (en) Mobile device capable of offline and online synchronous image identifying, an image identifying system, and a storage medium for the same
CN114466140B (en) Image shooting method and device
CN113794831B (en) Video shooting method, device, electronic equipment and medium
CN112383708B (en) Shooting method and device, electronic equipment and readable storage medium
CN111859356B (en) Application program login method and device
CN114125226A (en) Image shooting method and device, electronic equipment and readable storage medium
CN113778311A (en) Operation method and device and electronic equipment
CN111859322A (en) Identity verification method and device and electronic equipment
CN108073896B (en) User watches content real-time analyzer

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20211125

Address after: 351100 two, Ping Ning Road, Lantau Peak street, Chengxiang District, Putian, Fujian, two

Applicant after: PUTIAN HONGMING TRADING CO.,LTD.

Address before: Room 602, building 10, Nanchang garden, Longwen District, Zhangzhou City, Fujian Province

Applicant before: ZHANGZHOU LONGWEN DISTRICT LIANSHENGHE INFORMATION TECHNOLOGY CO.,LTD.

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220315

Address after: 351100 802, No. 16, Dongzhen East Road, Gongchen street, Licheng District, Putian City, Fujian Province

Patentee after: Putian Lianzheng Information Technology Co.,Ltd.

Address before: 351100 two, Ping Ning Road, Lantau Peak street, Chengxiang District, Putian, Fujian, two

Patentee before: PUTIAN HONGMING TRADING CO.,LTD.