WO2021138964A1 - Read/write distance identification method based on smart watch - Google Patents

Read/write distance identification method based on smart watch Download PDF

Info

Publication number
WO2021138964A1
WO2021138964A1 PCT/CN2020/075568 CN2020075568W WO2021138964A1 WO 2021138964 A1 WO2021138964 A1 WO 2021138964A1 CN 2020075568 W CN2020075568 W CN 2020075568W WO 2021138964 A1 WO2021138964 A1 WO 2021138964A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart watch
target
distance
sitting posture
current
Prior art date
Application number
PCT/CN2020/075568
Other languages
French (fr)
Chinese (zh)
Inventor
鄢家厚
Original Assignee
鄢家厚
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 鄢家厚 filed Critical 鄢家厚
Publication of WO2021138964A1 publication Critical patent/WO2021138964A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Definitions

  • the present invention relates to the technical field of mobile sensing, and in particular to a method for recognizing a reading and writing distance based on a smart watch.
  • the present invention provides a read-write distance recognition method based on a smart watch, which is used to determine the user's read-write distance by acquiring first target data and second target data, thereby facilitating the determination of the user's current sitting posture.
  • the embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch, which includes:
  • the first target data is detected according to the acceleration sensor and the gyroscope sensor in the smart watch, and based on the first target data, the current reading and writing status of the target user wearing the smart watch is determined;
  • control the distance sensing group in the smart watch to detect the second target data, and judge the current reading and writing distance of the target user corresponding to the current reading and writing state through the second target data;
  • the first target data and the second target data are recognized, and the current sitting posture of the target user is determined and recorded.
  • the current sitting posture includes: a sitting type, a head-down reading and writing type, and a hand-supporting cheek writing type;
  • the step of recognizing the first target data and the second target data based on the constructed sitting posture recognition model, and determining the current sitting posture of the target user includes:
  • the current sitting posture of the target user is an upright sitting type
  • the current sitting posture of the target user is a head-down reading and writing type
  • the current sitting posture of the target user is hand-supported cheek writing type .
  • the step of judging the current reading and writing distance of the target user corresponding to the current reading and writing state based on the judgment result and through the second target data includes:
  • the second target data is the current reading and writing distance calculated from the laser emission-reflection time difference.
  • the process of judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch further includes acquiring the smart watch and the target head.
  • the steps of the optimal distance of the target head of the target user include:
  • an optimal distance is selected from the first distance and the second distance as the head distance between the smart watch and the target head.
  • the vibration sensor inside the smart watch generates a vibration to indicate the current sitting posture error, and at the same time the display on the smart watch displays a prompt display;
  • the smart watch further detects the current sitting posture of the target user a preset number of times at a preset time interval. If the preset number of detection results are all the current sitting posture errors, the smart watch The alarm in the system emits the first alarm sound.
  • the smart watch is also used to record the detected first target data, second target data, and the current sitting posture of the target user, and transmit the recording results to the parent terminal for display ;
  • the parent terminal when the user of the parent terminal is viewing the displayed recording result in real time, the parent terminal also receives a correction instruction input by the user of the parent terminal.
  • timing statistics are performed on the current sitting posture of the target user
  • the timing statistics results are output to the parent terminal for display.
  • the method further includes: performing correction processing on the sitting posture recognition model, and performing correction processing on the posture after correction processing.
  • the steps include:
  • the camera and CCD module set on the smart watch Based on the camera and CCD module set on the smart watch, acquire scene images of preset read-write scenes where a number of historical users are located, and transmit the scene images to the server, the scene images including: the historical users Image information of the sitting posture, object image information of the target object;
  • the offset distance between the calibration coordinates and the corresponding scene feature points is determined based on the offset database in the server, and the calibration coordinates and the corresponding scene feature points are determined based on the preset offset correction algorithm. Perform correction processing until the calibration coordinates after correction processing are consistent with the corresponding scene feature points;
  • the accuracy is higher than the preset value, it is determined that the verification is successful, and the successfully verified sitting posture recognition model is transmitted to the smart watch to realize the recognition of the current sitting posture.
  • the method further includes:
  • an infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
  • the smart watch is provided with a processor for judging the current user based on the infrared image when it is determined based on the gyro sensor in the smart watch that the target hand of the target user is horizontally placed on the target object
  • the facial swing feature of the user and the corresponding prompt is issued according to the facial swing feature; wherein the judging the current user's facial swing feature based on the infrared image and the current reading and writing distance includes:
  • N 1, 2, 3,,, N;
  • w n(12) is the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images; and the X n1 (i,j) is the nth group of infrared images.
  • ⁇ n is the weight coefficient corresponding to w n(12) , and the value range is (0,1);
  • the processor controls the speaker on the smart watch to emit sound prompts.
  • FIG. 1 is a flowchart of a method for recognizing read-write distance based on a smart watch in an embodiment of the present invention
  • Figure 2 is a schematic diagram of a distance sensing group in an embodiment of the present invention.
  • Figure 3 is a top view of a smart watch in an embodiment of the invention.
  • Fig. 4 is a schematic diagram of a reading and writing gesture in an embodiment of the present invention.
  • the embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch, as shown in FIG. 1, including:
  • Step 1 Build a sitting position recognition model
  • Step 2 According to the acceleration sensor and the gyroscope sensor in the smart watch, the first target data is detected, and based on the first target data, the current reading and writing status of the target user wearing the smart watch is determined;
  • Step 3 According to the judgment result, control the distance sensing group in the smart watch to detect the second target data, and judge the current reading and writing of the target user corresponding to the current reading and writing state through the second target data distance;
  • Step 4 At the same time, based on the constructed sitting posture recognition model, the first target data and the second target data are recognized, and the current sitting posture of the target user is determined and recorded.
  • the smart watch in the embodiment of the present invention is an existing conventional smart watch, which has all the functions of the existing conventional smart watch, such as GPS positioning, one-key alarm, Make phone calls, heart rate and blood pressure statistics, step counting, etc.
  • the above-mentioned construction of the sitting posture recognition model is to facilitate the subsequent determination of the user’s current sitting posture
  • the above-mentioned target users can be students, etc.;
  • the above-mentioned first target data is acceleration data and gyroscope data to determine the current reading and writing status of the target user wearing the smart watch. For example, it can be based on the gyroscope sensor in the smart watch to determine whether the target hand of the target user is placed horizontally on the target.
  • Related data on the object such as: horizontal placement, not horizontal placement, etc.; the corresponding judgment result is that when the smart watch is placed horizontally and there is only a slight displacement within a certain period of time, it is judged that the target user has entered the reading and writing state; otherwise, the target is judged The user has not entered the read-write state.
  • the current read-write distance determined above is determined after the user is determined to be in the read-write state, which can effectively save the power consumption of the smart watch;
  • the above-mentioned sitting posture recognition model based on the construction of the first target data and the second target data is recognized, the current sitting posture of the target user is determined, and recorded, in order to determine whether the corresponding sitting posture matches when the user is in the reading and writing state. Regulations, and continue to record them, in order to facilitate parents to supervise them and improve the enthusiasm of target users.
  • the above technical solution has the beneficial effect that it is used to determine the user's reading and writing distance by acquiring the first target data and the second target data, thereby facilitating the determination of the user's current sitting posture.
  • the embodiment of the present invention provides a reading and writing distance recognition method based on a smart watch, and the current sitting posture includes: a sitting type, a head-down reading and writing type, and a hand-supported cheek writing type;
  • the step of recognizing the first target data and the second target data based on the constructed sitting posture recognition model, and determining the current sitting posture of the target user includes:
  • the current sitting posture of the target user is an upright sitting type
  • the current sitting posture of the target user is a head-down reading and writing type
  • the current sitting posture of the target user is hand-supported cheek writing type .
  • the target object mentioned above can be a desk
  • the above-mentioned preset distance is generally 30cm, and the preset distance can be effectively adjusted according to the age and height of the target user;
  • the aforementioned preset angle range is generally between [70°, 90°], and the aforementioned first angle is measured by a gyroscope sensor.
  • the beneficial effect of the above technical solution is that it can be effectively judged from the horizontal placement and the head distance to effectively determine whether it is a sitting type or a countersunk reading and writing type, and it can be effectively judged from both the horizontal placement and the first angle. It is a hand-supported cheek writing type, and its judgment method is simple, which improves the efficiency and efficiency of determining the current sitting posture.
  • the embodiment of the present invention provides a method for identifying a reading and writing distance based on a smart watch.
  • the step of judging the current reading and writing distance of the target user corresponding to the current reading and writing state based on the judgment result and using the second target data includes:
  • the second target data is the current reading and writing distance calculated from the laser emission-reflection time difference.
  • the aforementioned distance sensor group may be a laser sensor or an infrared sensor, and the distance sensor group includes at least one sensor, generally two.
  • the beneficial effect of the above technical solution is that by controlling the distance sensing group to emit laser light, it provides convenience for obtaining the current reading and writing distance.
  • the embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch.
  • the process of judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch further includes
  • the steps of obtaining the optimal distance between the smart watch and the target head of the target user include:
  • an optimal distance is selected from the first distance and the second distance as the head distance between the smart watch and the target head.
  • the first sensor 01 and the second sensor 02 respectively include: a transmitting and receiving window, a receiving and sending window angle, and the receiving and sending window angle of the first sensor is 25°, and the receiving and sending window angle of the second sensor is 35°. °;
  • the above measurement angle is calculated based on the gyroscope sensor
  • the above smart watch has two built-in distance sensors, and the two sensor angles are different, because each student's height is different, but there is a range of height.
  • the smart watch will calculate the distance sensor according to the student's height segment when determining the position of the distance sensor installed on the watch. An appropriate angle and position ensure that students within this height range can accurately measure the distance.
  • the beneficial effect of the above technical solution is that by obtaining the optimal distance, it is convenient to effectively determine a more accurate distance sensor as an instrument for reading and writing distance measurement, and to ensure the accuracy of the reading and writing distance.
  • the embodiment of the present invention provides a method for recognizing the reading and writing distance based on a smart watch.
  • it is detected whether the current sitting posture of the target user is correct. If so, the smart watch does not execute anything. operating;
  • the vibration sensor inside the smart watch generates a vibration to indicate the current sitting posture error, and at the same time the display on the smart watch displays a prompt display;
  • the smart watch further detects the current sitting posture of the target user a preset number of times at a preset time interval. If the preset number of detection results are all the current sitting posture errors, the smart watch The alarm in the system emits the first alarm sound.
  • the above alarm can be implemented as a buzzer, horn, etc.
  • FIG. 3 it is a top view of the display screen and the distance sensing group
  • 01 represents sensor A, which is the first sensor
  • 02 represents sensor B, which is the second sensor
  • 10 represents the display screen
  • a represents the correct reading and writing posture
  • b represents the wrong reading and writing posture
  • 03 represents the incident laser
  • 04 represents the reflected laser
  • 05 represents the target user.
  • the above-mentioned preset times are generally 3 times, and the above-mentioned display is based on a display screen, for example, a text prompt;
  • the aforementioned preset time interval is, for example, 1 minute.
  • the above-mentioned current sitting posture error of the target user is generally caused by the target user being too close to the desk.
  • the beneficial effect of the above technical solution is: through the combination of multiple reminding means such as display screen reminder, vibration reminder, alarm reminder, etc., it is convenient for the target user to correct the current sitting posture in time.
  • the embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch.
  • the smart watch is also used to record the detected first target data, second target data, and the current sitting posture of the target user, and record the result Transmit to the parent terminal for display;
  • the parent terminal when the user of the parent terminal is viewing the displayed recording result in real time, the parent terminal also receives a correction instruction input by the user of the parent terminal.
  • the smart watch is actually the watch side of the mobile phone. When entering the smart watch, it will synchronize the data in the smart phone. These data include time, address book, weather, call history, text messages, etc.
  • the synchronization of these data is through Bluetooth, wifi , 2G/3G/4G/5G and other communication modules for communication transmission, using a smart watch to make a call is also in the synchronization process, when the watch is connected to the mobile phone, the watch end is through Bluetooth or wifi or 2G/3G/4G/5G network Operate the mobile phone, and because the existing smart watch has a distance limitation, the communication connection with the parent terminal is generally realized through Bluetooth or wifi signal;
  • parents can use the 2G/3G/4G/5G network to realize the smart phone to control the smart watch vibration, text message display, buzzer, call reminder, etc.;
  • the parents can use video signals to watch the child's reading and writing status live, and can issue instructions to correct them.
  • the smart watch can effectively count the child's daily reading and writing time, and after the reading and writing scene of the day is over, based on the time axis, it will generate a log of the reading and writing time for each period to send
  • parents can judge their children's reading and writing intensity or the intensity of reading and writing learning pressure.
  • the advantage is that it is convenient for parents to use the data to reasonably arrange their children's stress relief, exercise and outdoor activities.
  • Bluetooth and wifi communication modules can be used for communication.
  • the above correction instruction is, for example, the current sitting posture correction instruction, and the corresponding correction instruction result is: smart watch vibration, short message display, buzzer, call prompt, etc.
  • the above recorded result can be the user's reading and writing time and the sitting posture during the reading and writing process.
  • the sitting posture includes, for example, the normal sitting posture in the first time period, the reading and writing distance is too close in the second time period, and the third time
  • the side-slung sitting posture is used in the segment, which has the advantage of making it easier for parents to understand more clearly.
  • the beneficial effect of the above technical solution is that by transmitting the recorded data to the parent terminal for display, it is convenient for the parent to know the sitting posture of the target user in time.
  • the embodiment of the present invention provides a method for recognizing a reading and writing distance based on a smart watch. When it is judged that the target user is in a reading and writing state, timing statistics are performed on the current sitting posture of the target user;
  • the timing statistics results are output to the parent terminal for display.
  • the above-mentioned setting of the preset time axis is to clearly express the timing statistics, so that the parental user can understand it thoroughly.
  • the above-mentioned parent terminal may be a smart phone, a notebook, etc., and the user of the parent terminal can view the timing statistics results on the WeChat applet or related APP.
  • the beneficial effect of the above technical solution is that by counting the current sitting posture, it is convenient to record the sitting posture of the target user in different time periods in time, and it is convenient for parents to carry out effective supervision.
  • the embodiment of the present invention provides a read-write distance recognition method based on a smart watch. After the sitting posture recognition model is constructed, in order to improve the accuracy of the sitting posture recognition model, the method further includes: correcting the sitting posture recognition model and correcting The processed posture recognition model is verified, and the steps include:
  • the camera and CCD module set on the smart watch Based on the camera and CCD module set on the smart watch, acquire scene images of preset read-write scenes where a number of historical users are located, and transmit the scene images to the server, the scene images including: the historical users Image information of the sitting posture, object image information of the target object;
  • the offset distance between the calibration coordinates and the corresponding scene feature points is determined based on the offset database in the server, and the calibration coordinates and the corresponding scene feature points are determined based on the preset offset correction algorithm. Perform correction processing until the calibration coordinates after correction processing are consistent with the corresponding scene feature points;
  • the accuracy is higher than the preset value, it is determined that the verification is successful, and the successfully verified sitting posture recognition model is transmitted to the smart watch to realize the recognition of the current sitting posture.
  • the authenticity prediction of each calibration coordinate is to determine the uniqueness of the calibration coordinates.
  • the position information corresponding to the coordinate c1 includes the coordinates of the coordinates c2 and c3. Position information, at this time, the coordinate c1 is uniquely irreplaceable, and keeping the uniquely irreplaceable calibration coordinates can reduce the workload of calculating each coordinate and improve efficiency.
  • the above-mentioned reconstruction of the calibration image based on all the retained calibration coordinates, and the in-depth learning training of the sitting posture recognition model based on the calibration image is to improve the recognition accuracy of the sitting posture recognition model;
  • the preset value 90% or more.
  • This embodiment is based on the scene image acquired by the smart watch, which is trained and recognized by the server, and is pre-loaded and transmitted to the smart watch, which can effectively reduce the transmission delay of data. At the same time, it is based on the trained sitting posture recognition model and the smart watch hardware itself. Recognizing the current posture can effectively reduce the occupation of multiple network resources and improve efficiency.
  • the above-mentioned image algorithm detection is performed on the scene image to obtain the scene calibration point, and based on the standard three-dimensional space, the calibration coordinates of the scene calibration point are obtained, in order to continue the splitting of the positioning point of the scene image, so as to facilitate the correction of each point Processing to improve its accuracy,
  • the scene image is, for example, an image including the target user and desk;
  • the scene calibration point is to determine and label the positioning point of the scene image;
  • the offset distance between the calibration coordinates and the corresponding scene feature points is determined, and the calibration coordinates and the corresponding scene feature points are corrected based on a preset offset correction algorithm, Until the calibration coordinates after the correction process are consistent with the corresponding scene feature points;
  • the above-mentioned correction processing of the calibration coordinates and the corresponding scene feature points is to ensure that the calibration coordinates are consistent with the corresponding scene feature points and ensure their unity.
  • the beneficial effect of the above technical solution is that by correcting the sitting posture recognition model and verifying the posture recognition model after the correction processing, in order to improve the accuracy of the sitting posture recognition model, the first target data and the The accuracy of the identification of the second target data.
  • the embodiment of the present invention provides a read-write distance recognition method based on a smart watch, which recognizes the first target data and the second target data, determines the current sitting posture of the target user, and records it, and further includes:
  • the above-mentioned second alarm information is different from the above-mentioned first alarm information.
  • the alarm durations of the two are different.
  • the first alarm information has an alarm duration of 3S
  • the second alarm information has a duration of 10S.
  • the interval is longer, which facilitates effective distinction and correspondence.
  • Alarm information is generated.
  • the beneficial effect of the above technical solution is that it is convenient to give effective reminders to the target user, and avoids the use of the eye time process, which may cause the possibility of vision loss.
  • the embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch, where an infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
  • the smart watch is provided with a processor for judging the current user based on the infrared image when it is determined based on the gyro sensor in the smart watch that the target hand of the target user is horizontally placed on the target object
  • the facial swing feature of the user and the corresponding prompt is issued according to the facial swing feature; wherein the judging the current user's facial swing feature based on the infrared image and the current reading and writing distance includes:
  • N 1, 2, 3,,, N;
  • w n(12) is the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images; and the X n1 (i,j) is the nth group of infrared images.
  • ⁇ n is the weight coefficient corresponding to w n(12) , and the value range is (0,1);
  • the processor controls the speaker on the smart watch to emit sound prompts.
  • Frequent face swing refers to the high frequency of the current user's head swinging left and right.
  • the user's wrist wearing a smart watch does not swing frequently, and The current user’s face is frequently swinging to the left and right, and he does not read carefully; when it is determined that the current user’s face is swinging frequently, the smart watch can be used to give a reminder to remind the current user to read and write at ease.
  • an infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
  • the smart watch is provided with a processor for judging the current face orientation of the current user according to the infrared image and the current reading and writing distance, and issuing corresponding prompts according to the current face orientation; wherein, The judging the current face orientation of the current user according to the infrared image and the current reading and writing distance includes:
  • the various face orientations include face forward, face deflection and face backward;
  • the sending out corresponding prompts according to the current face orientation includes:
  • the speaker on the smart watch is controlled to emit a sound prompt.
  • the beneficial effects of this embodiment are: according to the above method, it can be judged whether the current user has a face deflection or face is facing backward, and when the current user's face is deflected or face is facing backward, it means that the current user is not studying carefully; A reminder is issued through the smart watch to remind the current user to read and write at ease.

Abstract

A read/write distance identification method based on a smart watch. The method comprises: step 1: constructing a sitting posture identification model; step 2: according to an acceleration sensor and a gyroscope sensor in a smart watch, performing detection to obtain first target data, and determining, on the basis of the first target data, the current read/write state of a target user (05) wearing the smart watch; step 3: according to a determination result, controlling a distance sensor group (01, 02) in the smart watch to perform detection to obtain second target data, and by means of the second target data, determining the current read/write distance, corresponding to the current read/write state, of the target user (05); and step 4: furthermore, on the basis of the constructed sitting posture identification model, identifying the first target data and the second target data, and determining and recording the current sitting posture of the target user (05). First target data and second target data are acquired to determine the read/write distance of the target user (05), thereby facilitating the determination of the current sitting posture of the target user (05).

Description

基于智能手表的读写距离识别方法Read-write distance recognition method based on smart watch 技术领域Technical field
本发明涉及移动感知技术领域,特别涉及基于智能手表的读写距离识别方法。The present invention relates to the technical field of mobile sensing, and in particular to a method for recognizing a reading and writing distance based on a smart watch.
背景技术Background technique
随着信息爆炸的时代的到来,无论是学生还是成人,每天都需要进行大量的伏案工作、学习。但是在工作和学习过程中,错误的坐姿会导致疲劳,带来视力的下降,特别是学生群体,虽然,一般老师会对学生的坐姿进行矫正,但是仅仅是限于老师在教室的情况,而且,还存在学生下意识的出现坐姿不正确的情况,且学生可能不会去在意这些事情的发生,但是却严重影响了学生的正确坐姿,因此,在确定学生坐姿的基础上,对学生的读写距离进行检测就显得尤为重要。With the advent of the information explosion era, both students and adults need to do a lot of desk work and study every day. However, in the process of work and study, the wrong sitting posture can cause fatigue and reduce vision, especially for students. Although teachers generally correct the sitting posture of students, it is only limited to the situation of the teacher in the classroom, and, There are also situations where students subconsciously appear incorrect sitting postures, and students may not care about these things, but they seriously affect the correct sitting posture of students. Therefore, on the basis of determining the sitting posture of students, the reading and writing distance of students It is particularly important to carry out the test.
发明内容Summary of the invention
本发明提供基于智能手表的读写距离识别方法,用以通过获取第一目标数据和第二目标数据,确定用户的读写距离,进而方便确定用户的当前坐姿。The present invention provides a read-write distance recognition method based on a smart watch, which is used to determine the user's read-write distance by acquiring first target data and second target data, thereby facilitating the determination of the user's current sitting posture.
本发明实施例提供基于智能手表的读写距离识别方法,包括:The embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch, which includes:
构建坐姿识别模型;Build a seated recognition model;
根据所述智能手表中的加速度传感器和陀螺仪传感器,检测得到第一目标数据,并基于所述第一目标数据,判断佩戴有智能手表的目标用户的当前读写状态;The first target data is detected according to the acceleration sensor and the gyroscope sensor in the smart watch, and based on the first target data, the current reading and writing status of the target user wearing the smart watch is determined;
根据判断结果,控制所述智能手表中的距离传感组检测得到第二目标数据,通过所述第二目标数据判断与所述当前读写状态对应的所述目标用户的当 前读写距离;According to the judgment result, control the distance sensing group in the smart watch to detect the second target data, and judge the current reading and writing distance of the target user corresponding to the current reading and writing state through the second target data;
同时,基于构建的所述坐姿识别模型,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录。At the same time, based on the constructed sitting posture recognition model, the first target data and the second target data are recognized, and the current sitting posture of the target user is determined and recorded.
在一种可能实现的方式中,所述当前坐姿包括:正坐型、埋头读写型和手撑脸颊书写型;In a possible implementation manner, the current sitting posture includes: a sitting type, a head-down reading and writing type, and a hand-supporting cheek writing type;
其中,基于构建的所述坐姿识别模型,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿的步骤包括:Wherein, the step of recognizing the first target data and the second target data based on the constructed sitting posture recognition model, and determining the current sitting posture of the target user includes:
基于所述智能手表中的陀螺仪传感器判断所述目标用户的目标手部是否水平放置在目标物体上;Judging whether the target hand of the target user is placed horizontally on the target object based on the gyroscope sensor in the smart watch;
基于所述智能手表中的距离传感组判断所述智能手表与所述目标用户的目标头部的头部距离;Judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch;
基于所述坐姿识别模型,如果判断出所述目标用户的目标手部水平放置在目标物体上,且所述头部距离大于预设距离,则所述目标用户的当前坐姿为正坐型;Based on the sitting posture recognition model, if it is determined that the target hand of the target user is placed horizontally on the target object, and the head distance is greater than a preset distance, then the current sitting posture of the target user is an upright sitting type;
如果判断出所述目标用户的目标手部水平放置在目标物体上,且所述头部距离不大于预设距离,则所述目标用户的当前坐姿为埋头读写型;If it is determined that the target hand of the target user is horizontally placed on the target object, and the head distance is not greater than a preset distance, then the current sitting posture of the target user is a head-down reading and writing type;
如果判断出所述目标用户的目标手部未水平放置在目标物体上,且与所述目标物体的第一角度在预设角度范围内,则所述目标用户的当前坐姿为手撑脸颊书写型。If it is determined that the target hand of the target user is not placed horizontally on the target object, and the first angle with the target object is within the preset angle range, then the current sitting posture of the target user is hand-supported cheek writing type .
在一种可能实现的方式中,基于判断结果,并通过所述第二目标数据判断与所述当前读写状态对应的所述目标用户的当前读写距离的步骤包括:In a possible implementation manner, the step of judging the current reading and writing distance of the target user corresponding to the current reading and writing state based on the judgment result and through the second target data includes:
当所述判断结果为所述目标用户当前处于读写状态时,控制所述距离传感组发射激光,并根据激光发射-反射时间差计算所述目标用户的当前读写距离;When the judgment result is that the target user is currently in a reading and writing state, controlling the distance sensing group to emit laser light, and calculating the current reading and writing distance of the target user according to the laser emission-reflection time difference;
当所述判断结果为所述目标用户当前未处于读写状态时,控制所述智能手表不执行任何操作;When the judgment result is that the target user is not currently in a read-write state, control the smart watch not to perform any operation;
其中,所述第二目标数据为所述激光发射-反射时间差计算得到的当前读 写距离。Wherein, the second target data is the current reading and writing distance calculated from the laser emission-reflection time difference.
在一种可能实现的方式中,基于所述智能手表中的距离传感组判断所述智能手表与所述目标用户的目标头部的头部距离的过程中,还包括获取所述智能手表与所述目标用户的目标头部的最优距离,其步骤包括:In a possible implementation manner, the process of judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch further includes acquiring the smart watch and the target head. The steps of the optimal distance of the target head of the target user include:
确定所述智能手表中的距离传感组中的第一传感器获取的第一距离和第二传感器获取的第二距离;Determining the first distance obtained by the first sensor and the second distance obtained by the second sensor in the distance sensing group in the smart watch;
确定所述智能手表中的陀螺仪传感器计算得出的所述智能手表与所述目标物体基于水平面的测量角度;Determining the horizontal measurement angle between the smart watch and the target object calculated by the gyroscope sensor in the smart watch;
根据所述测量角度,从所述第一距离和第二距离中选择最优距离,作为所述智能手表与所述目标头部的头部距离。According to the measurement angle, an optimal distance is selected from the first distance and the second distance as the head distance between the smart watch and the target head.
在一种可能实现的方式中,当判断佩戴有智能手表的目标用户处于读写状态时,检测所述目标用户的当前坐姿是否正确,若是,所述智能手表不执行任何操作;In a possible implementation manner, when it is determined that the target user wearing the smart watch is in a reading and writing state, it is detected whether the current sitting posture of the target user is correct, and if so, the smart watch does not perform any operation;
否则,所述智能手表内部的振动传感器产生震动提示当前坐姿错误,同时所述智能手表上的显示屏进行提示显示;Otherwise, the vibration sensor inside the smart watch generates a vibration to indicate the current sitting posture error, and at the same time the display on the smart watch displays a prompt display;
且,所述智能手表还按照预设时间间隔对所述目标用户的当前坐姿进行预设次数的检测,如果,所述预设次数的检测结果都为所述当前坐姿错误,则所述智能手表中的报警器发出第一报警声音。Moreover, the smart watch further detects the current sitting posture of the target user a preset number of times at a preset time interval. If the preset number of detection results are all the current sitting posture errors, the smart watch The alarm in the system emits the first alarm sound.
在一种可能实现的方式中,所述智能手表还用于对检测到的第一目标数据、第二目标数据和所述目标用户的当前坐姿进行记录,并将记录结果传输到家长端进行显示;In a possible implementation manner, the smart watch is also used to record the detected first target data, second target data, and the current sitting posture of the target user, and transmit the recording results to the parent terminal for display ;
且所述家长端的用户在对显示的记录结果进行实时查看的过程中,所述家长端还接收家长端的用户输入的纠正指令。In addition, when the user of the parent terminal is viewing the displayed recording result in real time, the parent terminal also receives a correction instruction input by the user of the parent terminal.
在一种可能实现的方式中,当判断所述目标用户处于读写状态时,对所述目标用户的当前坐姿进行计时统计;In a possible implementation manner, when it is judged that the target user is in a reading and writing state, timing statistics are performed on the current sitting posture of the target user;
当所述目标用户的当前坐姿发生变化时,重新对所述发生变化的当前坐姿 进行计时统计,当所述目标用户的当前坐姿未发生变化时,对所述当前坐姿继续进行计时统计;When the current sitting posture of the target user changes, re-calculate the timing statistics of the changed current sitting posture, and when the current sitting posture of the target user does not change, continue timing statistics on the current sitting posture;
基于预设时间轴,将计时统计结果进行输出到家长端进行显示。Based on the preset time axis, the timing statistics results are output to the parent terminal for display.
在一种可能实现的方式中,所述构建坐姿识别模型之后,为了提高所述坐姿识别模型的精准性,还包括:对所述坐姿识别模型进行修正处理,并对修正处理后的所述姿势识别模型进行验证,其步骤包括:In a possible implementation manner, after constructing the sitting posture recognition model, in order to improve the accuracy of the sitting posture recognition model, the method further includes: performing correction processing on the sitting posture recognition model, and performing correction processing on the posture after correction processing. To verify the recognition model, the steps include:
基于所述智能手表上设置的摄像头和CCD模组,获取若干个历史用户所处预设读写场景的场景图像,并将所述场景图像传输到服务器,所述场景图像包括:所述历史用户的坐姿图像信息、所述目标物体的物体图像信息;Based on the camera and CCD module set on the smart watch, acquire scene images of preset read-write scenes where a number of historical users are located, and transmit the scene images to the server, the scene images including: the historical users Image information of the sitting posture, object image information of the target object;
基于所述服务器,对所述场景图像进行图像算法检测,获得场景标定点,并基于标准三维空间,获取所述场景标定点的标定坐标;Based on the server, perform image algorithm detection on the scene image to obtain scene calibration points, and obtain calibration coordinates of the scene calibration points based on a standard three-dimensional space;
基于服务器中的图像特征数据库,获取所述场景图像的场景特征点,判断所述标定坐标与对应的场景特征点是否相一致,若是,保留对应的场景标定点;Based on the image feature database in the server, obtain the scene feature points of the scene image, determine whether the calibration coordinates are consistent with the corresponding scene feature points, and if so, retain the corresponding scene calibration points;
否则,基于服务器中的偏移数据库,确定所述标定坐标与对应的场景特征点之间的偏移距离,并基于预先设定的偏移修正算法,对所述标定坐标与对应的场景特征点进行修正处理,直到修正处理后的所述标定坐标与对应的场景特征点相一致;Otherwise, the offset distance between the calibration coordinates and the corresponding scene feature points is determined based on the offset database in the server, and the calibration coordinates and the corresponding scene feature points are determined based on the preset offset correction algorithm. Perform correction processing until the calibration coordinates after correction processing are consistent with the corresponding scene feature points;
当所有所述标定坐标与对应的场景特征点相一致后,对每个所述标定坐标进行真伪预测,并根据真伪预测结果,判断所述标定坐标是否需要删除;When all the calibration coordinates are consistent with the corresponding scene feature points, predict the authenticity of each calibration coordinate, and determine whether the calibration coordinates need to be deleted according to the result of the authenticity prediction;
若是,将所述标定坐标删除,否则,将所述标定坐标进行保留;If yes, delete the calibration coordinates, otherwise, keep the calibration coordinates;
同时,根据保留的所有标定坐标,重构标定图像,并基于所述标定图像对所述坐姿识别模型进行深度学习训练;At the same time, reconstruct the calibration image according to all the retained calibration coordinates, and perform deep learning training on the sitting posture recognition model based on the calibration image;
获取若干张目标用户所处预设读写场景的场景图像,并基于所述深度学习训练后的坐姿识别模型进行识别验证,根据识别验证结果,确定深度学习训练后的坐姿识别模型识别的准确性;Acquire several scene images of the preset reading and writing scenes where the target user is located, and perform recognition verification based on the sitting posture recognition model after the deep learning training, and determine the recognition accuracy of the sitting posture recognition model after the deep learning training according to the recognition and verification results ;
当准确性高于预设值时,判定验证成功,并将验证成功的坐姿识别模型传 输到所述智能手表实现对当前坐姿的识别。When the accuracy is higher than the preset value, it is determined that the verification is successful, and the successfully verified sitting posture recognition model is transmitted to the smart watch to realize the recognition of the current sitting posture.
在一种可能实现的方式中,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录之后,还包括:In a possible implementation manner, after recognizing the first target data and the second target data, determining the current sitting posture of the target user, and recording it, the method further includes:
对所记录的所述目标用户当前坐姿的保持时间进行计时,当计时时间大于预设时间时,控制所述智能手表的显示屏显示用眼过长提醒信息,或者控制所述智能手表的报警器发出第二报警信息。Time the recorded retention time of the current sitting position of the target user, and when the time is greater than a preset time, control the smart watch’s display screen to display a reminder of too long eyes, or control the smart watch’s alarm Issue the second alarm message.
在一种可能实现的方式中,所述智能手表上设置有红外摄像头,所述红外摄像头用于拍摄所述目标用户的红外图像;In a possible implementation manner, an infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
所述智能手表上设置有处理器,用于在基于所述智能手表中的陀螺仪传感器判定所述目标用户的目标手部水平放置在目标物体上时,根据所述红外图像判断所述当前用户的脸部摆动特征,并根据所述脸部摆动特征来发出相应提示;其中,所述根据所述红外图像和所述当前读写距离判断所述当前用户的脸部摆动特征,包括:The smart watch is provided with a processor for judging the current user based on the infrared image when it is determined based on the gyro sensor in the smart watch that the target hand of the target user is horizontally placed on the target object The facial swing feature of the user and the corresponding prompt is issued according to the facial swing feature; wherein the judging the current user's facial swing feature based on the infrared image and the current reading and writing distance includes:
获取共N组红外图像,其中,第n组红外图像中包括第一红外图像和第二红外图像,所述第一红外图像和第二红外图像之间的拍摄时间间隔小于或等于预设时间间隔;n=1,2,3、、、N;Acquire a total of N groups of infrared images, where the nth group of infrared images includes a first infrared image and a second infrared image, and the shooting time interval between the first infrared image and the second infrared image is less than or equal to the preset time interval ; N = 1, 2, 3,,, N;
按照下述公式(1)计算所述当前用户在第n组红外图像所对应的所述拍摄时间间隔内的脸部摆动系数:Calculate the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images according to the following formula (1):
Figure PCTCN2020075568-appb-000001
Figure PCTCN2020075568-appb-000001
其中,w n(12)为所述当前用户在第n组红外图像所对应的所述拍摄时间间隔内的脸部摆动系数;所述X n1(i,j)为第n组红外图像中第一红外图像在第i 行第j列的像素点的像素值;所述X n2(i,j)为第n组红外图像中第二红外图像在第i行第j列的像素点的像素值;所述I为所述红外摄像头所拍摄的红外图像的像素总行数;所述J为所述红外摄像头所拍摄的红外图像的像素总列数; Wherein, w n(12) is the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images; and the X n1 (i,j) is the nth group of infrared images. The pixel value of a pixel in the i-th row and j-th column of an infrared image; said X n2 (i,j) is the pixel value of the pixel in the i-th row and j-th column of the second infrared image in the n-th group of infrared images The I is the total number of rows of pixels in the infrared image captured by the infrared camera; the J is the total number of columns of pixels in the infrared image captured by the infrared camera;
按照如下公式(2)计算所述当前用户在所述N组红外图像中的脸部摆动系数W:Calculate the face swing coefficient W of the current user in the N groups of infrared images according to the following formula (2):
Figure PCTCN2020075568-appb-000002
Figure PCTCN2020075568-appb-000002
其中,δ n为所述w n(12)对应的权重系数,取值范围为(0,1); Where δ n is the weight coefficient corresponding to w n(12) , and the value range is (0,1);
当所述W等于或大于预设行动系数阈值时,确定所述当前用户的脸部摆动特征为脸部摆动频繁,所述处理器控制所述智能手表上的扬声器发出声音提示。When the W is equal to or greater than the preset action coefficient threshold, it is determined that the current user's facial wobbling feature is frequent facial wobbling, and the processor controls the speaker on the smart watch to emit sound prompts.
本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优点可通过在所写的说明书、权利要求书、以及附图中所特别指出的结构来实现和获得。Other features and advantages of the present invention will be described in the following description, and partly become obvious from the description, or understood by implementing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings.
下面通过附图和实施例,对本发明的技术方案做进一步的详细描述。The technical solutions of the present invention will be further described in detail below through the accompanying drawings and embodiments.
附图说明Description of the drawings
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明的实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention, and do not constitute a limitation to the present invention. In the attached picture:
图1为本发明实施例中基于智能手表的读写距离识别方法的流程图;FIG. 1 is a flowchart of a method for recognizing read-write distance based on a smart watch in an embodiment of the present invention;
图2为本发明实施例中距离传感组的示意图;Figure 2 is a schematic diagram of a distance sensing group in an embodiment of the present invention;
图3为本发明实施例中智能手表的俯视图;Figure 3 is a top view of a smart watch in an embodiment of the invention;
图4为本发明实施例中读写姿势的示意图。Fig. 4 is a schematic diagram of a reading and writing gesture in an embodiment of the present invention.
具体实施方式Detailed ways
以下结合附图对本发明的优选实施例进行说明,应当理解,此处所描述的优选实施例仅用于说明和解释本发明,并不用于限定本发明。The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not used to limit the present invention.
本发明实施例提供基于智能手表的读写距离识别方法,如图1所示,包括:The embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch, as shown in FIG. 1, including:
步骤1:构建坐姿识别模型;Step 1: Build a sitting position recognition model;
步骤2:根据所述智能手表中的加速度传感器和陀螺仪传感器,检测得到第一目标数据,并基于所述第一目标数据,判断佩戴有智能手表的目标用户的当前读写状态;Step 2: According to the acceleration sensor and the gyroscope sensor in the smart watch, the first target data is detected, and based on the first target data, the current reading and writing status of the target user wearing the smart watch is determined;
步骤3:根据判断结果,控制所述智能手表中的距离传感组检测得到第二目标数据,通过所述第二目标数据判断与所述当前读写状态对应的所述目标用户的当前读写距离;Step 3: According to the judgment result, control the distance sensing group in the smart watch to detect the second target data, and judge the current reading and writing of the target user corresponding to the current reading and writing state through the second target data distance;
步骤4:同时,基于构建的所述坐姿识别模型,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录。Step 4: At the same time, based on the constructed sitting posture recognition model, the first target data and the second target data are recognized, and the current sitting posture of the target user is determined and recorded.
在具体的实施过程中,需要说明的是,本发明实施例中的智能手表为现有的常规智能手表,其具备现有的常规智能手表所具备的所有功能,比如GPS定位,一键报警、拨打电话、心率血压统计、计步等等。In the specific implementation process, it should be noted that the smart watch in the embodiment of the present invention is an existing conventional smart watch, which has all the functions of the existing conventional smart watch, such as GPS positioning, one-key alarm, Make phone calls, heart rate and blood pressure statistics, step counting, etc.
上述构建坐姿识别模型,是为了后续便于确定用户的当前坐姿;The above-mentioned construction of the sitting posture recognition model is to facilitate the subsequent determination of the user’s current sitting posture;
上述目标用户可以为,学生等;The above-mentioned target users can be students, etc.;
上述第一目标数据为加速度数据和陀螺仪数据,判断佩戴有智能手表的目标用户的当前读写状态,例如可以是基于智能手表中的陀螺仪传感器判断目标用户的目标手部是否水平放置在目标物体上的相关数据,如:是水平放置、不是水平放置等;对应的判断结果为,当智能手表处于水平放置,且一定时间内只有轻微位移则判定目标用户进入读写状态;否则,判定目标用户未进入读写状态。The above-mentioned first target data is acceleration data and gyroscope data to determine the current reading and writing status of the target user wearing the smart watch. For example, it can be based on the gyroscope sensor in the smart watch to determine whether the target hand of the target user is placed horizontally on the target. Related data on the object, such as: horizontal placement, not horizontal placement, etc.; the corresponding judgment result is that when the smart watch is placed horizontally and there is only a slight displacement within a certain period of time, it is judged that the target user has entered the reading and writing state; otherwise, the target is judged The user has not entered the read-write state.
上述判定的当前读写距离,是在确定用户处于读写状态之后,才进行判断的,可有效的节省智能手表的使用电能;The current read-write distance determined above is determined after the user is determined to be in the read-write state, which can effectively save the power consumption of the smart watch;
上述基于构建的所述坐姿识别模型,对第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录,是为了确定用户在读写状态时,对应的坐姿是否合规,并对其继续记录,是为了方便家长对其进行监督,提高目标用户的积极性。The above-mentioned sitting posture recognition model based on the construction of the first target data and the second target data is recognized, the current sitting posture of the target user is determined, and recorded, in order to determine whether the corresponding sitting posture matches when the user is in the reading and writing state. Regulations, and continue to record them, in order to facilitate parents to supervise them and improve the enthusiasm of target users.
上述技术方案的有益效果是:用以通过获取第一目标数据和第二目标数据,确定用户的读写距离,进而方便确定用户的当前坐姿。The above technical solution has the beneficial effect that it is used to determine the user's reading and writing distance by acquiring the first target data and the second target data, thereby facilitating the determination of the user's current sitting posture.
本发明实施例提供基于智能手表的读写距离识别方法,所述当前坐姿包括:正坐型、埋头读写型和手撑脸颊书写型;The embodiment of the present invention provides a reading and writing distance recognition method based on a smart watch, and the current sitting posture includes: a sitting type, a head-down reading and writing type, and a hand-supported cheek writing type;
其中,基于构建的所述坐姿识别模型,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿的步骤包括:Wherein, the step of recognizing the first target data and the second target data based on the constructed sitting posture recognition model, and determining the current sitting posture of the target user includes:
基于所述智能手表中的陀螺仪传感器判断所述目标用户的目标手部是否水平放置在目标物体上;Judging whether the target hand of the target user is placed horizontally on the target object based on the gyroscope sensor in the smart watch;
基于所述智能手表中的距离传感组判断所述智能手表与所述目标用户的目标头部的头部距离;Judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch;
基于所述坐姿识别模型,如果判断出所述目标用户的目标手部水平放置在目标物体上,且所述头部距离大于预设距离,则所述目标用户的当前坐姿为正坐型;Based on the sitting posture recognition model, if it is determined that the target hand of the target user is placed horizontally on the target object, and the head distance is greater than a preset distance, then the current sitting posture of the target user is an upright sitting type;
如果判断出所述目标用户的目标手部水平放置在目标物体上,且所述头部距离不大于预设距离,则所述目标用户的当前坐姿为埋头读写型;If it is determined that the target hand of the target user is horizontally placed on the target object, and the head distance is not greater than a preset distance, then the current sitting posture of the target user is a head-down reading and writing type;
如果判断出所述目标用户的目标手部未水平放置在目标物体上,且与所述目标物体的第一角度在预设角度范围内,则所述目标用户的当前坐姿为手撑脸颊书写型。If it is determined that the target hand of the target user is not placed horizontally on the target object, and the first angle with the target object is within the preset angle range, then the current sitting posture of the target user is hand-supported cheek writing type .
上述目标物体,可以为书桌;The target object mentioned above can be a desk;
上述预设距离一般取值为30cm,且预设距离可以随着目标用户的年龄和身高进行有效调节;The above-mentioned preset distance is generally 30cm, and the preset distance can be effectively adjusted according to the age and height of the target user;
上述预设角度范围一般为[70°,90°]之间,上述第一角度是根据陀螺仪传感器测量出来的。The aforementioned preset angle range is generally between [70°, 90°], and the aforementioned first angle is measured by a gyroscope sensor.
上述技术方案的有益效果是:通过从水平放置和头部距离两方面,来有效的判断其是正坐型、埋头读写型,通过对从水平放置和第一角度两方面,来有效的判断其是手撑脸颊书写型,其判断方式简单,提高其确定当前坐姿的效率和高效性。The beneficial effect of the above technical solution is that it can be effectively judged from the horizontal placement and the head distance to effectively determine whether it is a sitting type or a countersunk reading and writing type, and it can be effectively judged from both the horizontal placement and the first angle. It is a hand-supported cheek writing type, and its judgment method is simple, which improves the efficiency and efficiency of determining the current sitting posture.
本发明实施例提供基于智能手表的读写距离识别方法,基于判断结果,并通过所述第二目标数据判断与所述当前读写状态对应的所述目标用户的当前读写距离的步骤包括,The embodiment of the present invention provides a method for identifying a reading and writing distance based on a smart watch. The step of judging the current reading and writing distance of the target user corresponding to the current reading and writing state based on the judgment result and using the second target data includes:
当所述判断结果为所述目标用户当前处于读写状态时,控制所述距离传感组发射激光,并根据激光发射-反射时间差计算所述目标用户的当前读写距离;When the judgment result is that the target user is currently in a reading and writing state, controlling the distance sensing group to emit laser light, and calculating the current reading and writing distance of the target user according to the laser emission-reflection time difference;
当所述判断结果为所述目标用户当前未处于读写状态时,控制所述智能手表不执行任何操作;When the judgment result is that the target user is not currently in a read-write state, control the smart watch not to perform any operation;
其中,所述第二目标数据为所述激光发射-反射时间差计算得到的当前读写距离。Wherein, the second target data is the current reading and writing distance calculated from the laser emission-reflection time difference.
上述距离传感器组,可以是激光传感器或者红外传感器,且距离传感器组包括至少一个传感器在内,一般是两个。The aforementioned distance sensor group may be a laser sensor or an infrared sensor, and the distance sensor group includes at least one sensor, generally two.
上述技术方案的有益效果是:通过控制距离传感组发射激光,为获取当前读写距离提供了便利。The beneficial effect of the above technical solution is that by controlling the distance sensing group to emit laser light, it provides convenience for obtaining the current reading and writing distance.
本发明实施例提供基于智能手表的读写距离识别方法,基于所述智能手表中的距离传感组判断所述智能手表与所述目标用户的目标头部的头部距离的过程中,还包括获取所述智能手表与所述目标用户的目标头部的最优距离,其 步骤包括,The embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch. The process of judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch further includes The steps of obtaining the optimal distance between the smart watch and the target head of the target user include:
确定所述智能手表中的距离传感组中的第一传感器获取的第一距离和第二传感器获取的第二距离;Determining the first distance obtained by the first sensor and the second distance obtained by the second sensor in the distance sensing group in the smart watch;
确定所述智能手表中的陀螺仪传感器计算得出的所述智能手表与所述目标物体基于水平面的测量角度;Determining the horizontal measurement angle between the smart watch and the target object calculated by the gyroscope sensor in the smart watch;
根据所述测量角度,从所述第一距离和第二距离中选择最优距离,作为所述智能手表与所述目标头部的头部距离。According to the measurement angle, an optimal distance is selected from the first distance and the second distance as the head distance between the smart watch and the target head.
如图2所示,为第一传感器01和第二传感器02,且分别包括:发射接收窗、收发窗口角度,且第一传感器的收发窗口角度为25°,第二传感器的收发窗口角度为35°;As shown in Figure 2, the first sensor 01 and the second sensor 02 respectively include: a transmitting and receiving window, a receiving and sending window angle, and the receiving and sending window angle of the first sensor is 25°, and the receiving and sending window angle of the second sensor is 35°. °;
上述测量角度是根据陀螺仪传感器计算得到的;The above measurement angle is calculated based on the gyroscope sensor;
上述智能手表内置两个距离传感器,且两个传感器角度分别不同,是因为每个学生身高不一样,但是身高有一个范围,智能手表在确定距离传感器安装在手表的位置时会根据学生身高段算出一个合适的角度和位置,保证在这个身高段内的学生都能准确测出距离。The above smart watch has two built-in distance sensors, and the two sensor angles are different, because each student's height is different, but there is a range of height. The smart watch will calculate the distance sensor according to the student's height segment when determining the position of the distance sensor installed on the watch. An appropriate angle and position ensure that students within this height range can accurately measure the distance.
上述技术方案的有益效果是:通过获取最优距离,便于有效的确定更具有准确定的距离传感器作为读写距离测量的仪器,保证其读写距离的精准性。The beneficial effect of the above technical solution is that by obtaining the optimal distance, it is convenient to effectively determine a more accurate distance sensor as an instrument for reading and writing distance measurement, and to ensure the accuracy of the reading and writing distance.
本发明实施例提供基于智能手表的读写距离识别方法,当判断佩戴有智能手表的目标用户处于读写状态时,检测所述目标用户的当前坐姿是否正确,若是,所述智能手表不执行任何操作;The embodiment of the present invention provides a method for recognizing the reading and writing distance based on a smart watch. When it is determined that the target user wearing the smart watch is in the reading and writing state, it is detected whether the current sitting posture of the target user is correct. If so, the smart watch does not execute anything. operating;
否则,所述智能手表内部的振动传感器产生震动提示当前坐姿错误,同时所述智能手表上的显示屏进行提示显示;Otherwise, the vibration sensor inside the smart watch generates a vibration to indicate the current sitting posture error, and at the same time the display on the smart watch displays a prompt display;
且,所述智能手表还按照预设时间间隔对所述目标用户的当前坐姿进行预设次数的检测,如果,所述预设次数的检测结果都为所述当前坐姿错误,则所述智能手表中的报警器发出第一报警声音。Moreover, the smart watch further detects the current sitting posture of the target user a preset number of times at a preset time interval. If the preset number of detection results are all the current sitting posture errors, the smart watch The alarm in the system emits the first alarm sound.
上述报警器可实施为,蜂鸣器、喇叭等;The above alarm can be implemented as a buzzer, horn, etc.;
如图3所示,为显示屏、距离传感组的俯视图;As shown in Figure 3, it is a top view of the display screen and the distance sensing group;
其中,01表示传感器A,即为第一传感器,02表示传感器B,即为第二传感器,10表示显示屏;Among them, 01 represents sensor A, which is the first sensor, 02 represents sensor B, which is the second sensor, and 10 represents the display screen;
如图4所示,a表示正确的读写姿势,b表示错误的读写姿势;As shown in Figure 4, a represents the correct reading and writing posture, and b represents the wrong reading and writing posture;
其中,03表示入射激光,04表示反射激光,05表示目标用户。Among them, 03 represents the incident laser, 04 represents the reflected laser, and 05 represents the target user.
上述预设次数,一般为3次,上述基于显示屏进行显示,例如是文本提示;The above-mentioned preset times are generally 3 times, and the above-mentioned display is based on a display screen, for example, a text prompt;
上述预设时间间隔,例如为:1分钟。The aforementioned preset time interval is, for example, 1 minute.
上述目标用户的当前坐姿错误,一般是因为目标用户距离书桌的距离过近引起的。The above-mentioned current sitting posture error of the target user is generally caused by the target user being too close to the desk.
上述技术方案的有益效果是:通过显示屏提醒、震动提醒、报警器提醒等多种提醒手段的结合,便于目标用户可以及时更正当前坐姿。The beneficial effect of the above technical solution is: through the combination of multiple reminding means such as display screen reminder, vibration reminder, alarm reminder, etc., it is convenient for the target user to correct the current sitting posture in time.
本发明实施例提供基于智能手表的读写距离识别方法,所述智能手表还用于对检测到的第一目标数据、第二目标数据和所述目标用户的当前坐姿进行记录,并将记录结果传输到家长端进行显示;The embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch. The smart watch is also used to record the detected first target data, second target data, and the current sitting posture of the target user, and record the result Transmit to the parent terminal for display;
且所述家长端的用户在对显示的记录结果进行实时查看的过程中,所述家长端还接收家长端的用户输入的纠正指令。In addition, when the user of the parent terminal is viewing the displayed recording result in real time, the parent terminal also receives a correction instruction input by the user of the parent terminal.
智能手表实际上就是手机的手表端,在进入智能手表时,会同步智能手机中的数据,这些数据包括时间,通讯录,天气,通话记录,短信等等,这些数据的同步就是通过蓝牙、wifi、2G/3G/4G/5G等通讯模块进行通讯传输的,用智能手表打电话也就是在同步的过程中,手表与手机互联时,手表端通过蓝牙或者wifi或者2G/3G/4G/5G网络操作手机,且由于现有的智能手表是存在距离限制的,一般是通过蓝牙或者wifi信号实现与家长端的通讯连接;The smart watch is actually the watch side of the mobile phone. When entering the smart watch, it will synchronize the data in the smart phone. These data include time, address book, weather, call history, text messages, etc. The synchronization of these data is through Bluetooth, wifi , 2G/3G/4G/5G and other communication modules for communication transmission, using a smart watch to make a call is also in the synchronization process, when the watch is connected to the mobile phone, the watch end is through Bluetooth or wifi or 2G/3G/4G/5G network Operate the mobile phone, and because the existing smart watch has a distance limitation, the communication connection with the parent terminal is generally realized through Bluetooth or wifi signal;
同时,当智能手表上安装有SIM卡时,家长可基于2G/3G/4G/5G网络,实现智能手机控制智能手表震动、短信显示、蜂鸣、通话提示等;At the same time, when a SIM card is installed on the smart watch, parents can use the 2G/3G/4G/5G network to realize the smart phone to control the smart watch vibration, text message display, buzzer, call reminder, etc.;
并且,当家长使用4G/5G网络与智能手表连接时,家长可通过视频讯号实施直播收看孩子读写状态,并可发出指令予以纠正。In addition, when parents use the 4G/5G network to connect to the smart watch, the parents can use video signals to watch the child's reading and writing status live, and can issue instructions to correct them.
在2G/3G/4G/5G通讯模式下连接智能手表,其智能手表可有效的统计孩子每日读写时长,并在当日读写场景结束后,基于时间轴,生成各时段读写时长日志发送到家长端,以供家长判断孩子读写强度或者读写学习压力强度,其好处是,方便家长以此数据来合理安排孩子缓解压力、运动及户外活动时间。Connect the smart watch in the 2G/3G/4G/5G communication mode. The smart watch can effectively count the child's daily reading and writing time, and after the reading and writing scene of the day is over, based on the time axis, it will generate a log of the reading and writing time for each period to send To parents, parents can judge their children's reading and writing intensity or the intensity of reading and writing learning pressure. The advantage is that it is convenient for parents to use the data to reasonably arrange their children's stress relief, exercise and outdoor activities.
当智能手表上未安装有SIM卡时,可使用蓝牙、wifi通讯模块进行通讯传输。When there is no SIM card installed on the smart watch, Bluetooth and wifi communication modules can be used for communication.
上述纠正指令,例如是:当前坐姿纠正指令,对应的纠正指令结果为:智能手表震动、短信显示、蜂鸣、通话提示等。The above correction instruction is, for example, the current sitting posture correction instruction, and the corresponding correction instruction result is: smart watch vibration, short message display, buzzer, call prompt, etc.
上述记录结果,可以是用户的读写时长以及读写过程中的坐姿情况,其中,坐姿情况包括,例如第一时间段内为正常坐姿,第二时间段内读写距离过近,第三时间段内为侧偏坐姿,其好处是,便于家长端了解的更加清晰。The above recorded result can be the user's reading and writing time and the sitting posture during the reading and writing process. The sitting posture includes, for example, the normal sitting posture in the first time period, the reading and writing distance is too close in the second time period, and the third time The side-slung sitting posture is used in the segment, which has the advantage of making it easier for parents to understand more clearly.
上述技术方案的有益效果是:通过将记录的数据传输到家长端进行显示,便于家长及时了解目标用户的坐姿情况。The beneficial effect of the above technical solution is that by transmitting the recorded data to the parent terminal for display, it is convenient for the parent to know the sitting posture of the target user in time.
本发明实施例提供基于智能手表的读写距离识别方法,当判断所述目标用户处于读写状态时,对所述目标用户的当前坐姿进行计时统计;The embodiment of the present invention provides a method for recognizing a reading and writing distance based on a smart watch. When it is judged that the target user is in a reading and writing state, timing statistics are performed on the current sitting posture of the target user;
当所述目标用户的当前坐姿发生变化时,重新对所述发生变化的当前坐姿进行计时统计,当所述目标用户的当前坐姿未发生变化时,对所述当前坐姿继续进行计时统计;When the current sitting posture of the target user changes, re-calculate the timing statistics of the changed current sitting posture, and when the current sitting posture of the target user does not change, continue timing statistics on the current sitting posture;
基于预设时间轴,将计时统计结果进行输出到家长端进行显示。Based on the preset time axis, the timing statistics results are output to the parent terminal for display.
上述设置预设时间轴,是为了对计时统计结果进行清晰的表达,便于家长端的用户了解透彻。The above-mentioned setting of the preset time axis is to clearly express the timing statistics, so that the parental user can understand it thoroughly.
上述家长端,可以为,智能手机、笔记本等,且家长端的用户可以在微信小程序,相关APP上,对其计时统计结果进行查看。The above-mentioned parent terminal may be a smart phone, a notebook, etc., and the user of the parent terminal can view the timing statistics results on the WeChat applet or related APP.
上述技术方案的有益效果是:通过对当前坐姿进行计时统计,便于对该目标用户在不同时间段内的坐姿情况进行及时记录,方便家长进行有效的监督。The beneficial effect of the above technical solution is that by counting the current sitting posture, it is convenient to record the sitting posture of the target user in different time periods in time, and it is convenient for parents to carry out effective supervision.
本发明实施例提供基于智能手表的读写距离识别方法,所述构建坐姿识别模型之后,为了提高所述坐姿识别模型的精准性,还包括:对所述坐姿识别模型进行修正处理,并对修正处理后的所述姿势识别模型进行验证,其步骤包括:The embodiment of the present invention provides a read-write distance recognition method based on a smart watch. After the sitting posture recognition model is constructed, in order to improve the accuracy of the sitting posture recognition model, the method further includes: correcting the sitting posture recognition model and correcting The processed posture recognition model is verified, and the steps include:
基于所述智能手表上设置的摄像头和CCD模组,获取若干个历史用户所处预设读写场景的场景图像,并将所述场景图像传输到服务器,所述场景图像包括:所述历史用户的坐姿图像信息、所述目标物体的物体图像信息;Based on the camera and CCD module set on the smart watch, acquire scene images of preset read-write scenes where a number of historical users are located, and transmit the scene images to the server, the scene images including: the historical users Image information of the sitting posture, object image information of the target object;
基于所述服务器,对所述场景图像进行图像算法检测,获得场景标定点,并基于标准三维空间,获取所述场景标定点的标定坐标;Based on the server, perform image algorithm detection on the scene image to obtain scene calibration points, and obtain calibration coordinates of the scene calibration points based on a standard three-dimensional space;
基于服务器中的图像特征数据库,获取所述场景图像的场景特征点,判断所述标定坐标与对应的场景特征点是否相一致,若是,保留对应的场景标定点;Based on the image feature database in the server, obtain the scene feature points of the scene image, determine whether the calibration coordinates are consistent with the corresponding scene feature points, and if so, retain the corresponding scene calibration points;
否则,基于服务器中的偏移数据库,确定所述标定坐标与对应的场景特征点之间的偏移距离,并基于预先设定的偏移修正算法,对所述标定坐标与对应的场景特征点进行修正处理,直到修正处理后的所述标定坐标与对应的场景特征点相一致;Otherwise, the offset distance between the calibration coordinates and the corresponding scene feature points is determined based on the offset database in the server, and the calibration coordinates and the corresponding scene feature points are determined based on the preset offset correction algorithm. Perform correction processing until the calibration coordinates after correction processing are consistent with the corresponding scene feature points;
当所有所述标定坐标与对应的场景特征点相一致后,对每个所述标定坐标进行真伪预测,并根据真伪预测结果,判断所述标定坐标是否需要删除;When all the calibration coordinates are consistent with the corresponding scene feature points, predict the authenticity of each calibration coordinate, and determine whether the calibration coordinates need to be deleted according to the result of the authenticity prediction;
若是,将所述标定坐标删除,否则,将所述标定坐标进行保留;If yes, delete the calibration coordinates, otherwise, keep the calibration coordinates;
同时,根据保留的所有标定坐标,重构标定图像,并基于所述标定图像对所述坐姿识别模型进行深度学习训练;At the same time, reconstruct the calibration image according to all the retained calibration coordinates, and perform deep learning training on the sitting posture recognition model based on the calibration image;
获取若干张目标用户所处预设读写场景的场景图像,并基于所述深度学习训练后的坐姿识别模型进行识别验证,根据识别验证结果,确定深度学习训练后的坐姿识别模型识别的准确性;Acquire several scene images of the preset reading and writing scenes where the target user is located, and perform recognition verification based on the sitting posture recognition model after the deep learning training, and determine the recognition accuracy of the sitting posture recognition model after the deep learning training according to the recognition and verification results ;
当准确性高于预设值时,判定验证成功,并将验证成功的坐姿识别模型传 输到所述智能手表实现对当前坐姿的识别。When the accuracy is higher than the preset value, it is determined that the verification is successful, and the successfully verified sitting posture recognition model is transmitted to the smart watch to realize the recognition of the current sitting posture.
上述当所有标定坐标与对应的场景特征点相一致后,对每个标定坐标进行真伪预测,是为了确定标定坐标的唯一不可替代性,例如:坐标c1对应的位置信息包括坐标c2、c3的位置信息,此时,坐标c1就具备唯一不可替代性,将具有唯一不可替代性的标定坐标进行保留,可以降低对每个坐标都计算的工作量,提高效率。When all the calibration coordinates mentioned above are consistent with the corresponding scene feature points, the authenticity prediction of each calibration coordinate is to determine the uniqueness of the calibration coordinates. For example, the position information corresponding to the coordinate c1 includes the coordinates of the coordinates c2 and c3. Position information, at this time, the coordinate c1 is uniquely irreplaceable, and keeping the uniquely irreplaceable calibration coordinates can reduce the workload of calculating each coordinate and improve efficiency.
上述根据保留的所有标定坐标,重构标定图像,并基于标定图像对坐姿识别模型进行深度学习训练是为了提高坐姿识别模型的识别精度;The above-mentioned reconstruction of the calibration image based on all the retained calibration coordinates, and the in-depth learning training of the sitting posture recognition model based on the calibration image is to improve the recognition accuracy of the sitting posture recognition model;
当准确性高于预设值时,判定验证成功,其中预设值,为90%及其以上。When the accuracy is higher than the preset value, it is determined that the verification is successful, where the preset value is 90% or more.
本实施例是基于智能手表获取场景图像,由服务器进行训练识别,预加载传输到智能手表的,其可有效的减少数据的传输延迟,同时,通过基于训练好的坐姿识别模型和智能手表硬件本身进行当前姿势的识别,可有效的降低多网络资源的占用,提高效率。This embodiment is based on the scene image acquired by the smart watch, which is trained and recognized by the server, and is pre-loaded and transmitted to the smart watch, which can effectively reduce the transmission delay of data. At the same time, it is based on the trained sitting posture recognition model and the smart watch hardware itself. Recognizing the current posture can effectively reduce the occupation of multiple network resources and improve efficiency.
上述对场景图像进行图像算法检测,获得场景标定点,并基于标准三维空间,获取所述场景标定点的标定坐标,是为了将场景图像继续进行定位点的拆分,便于对每个点进行修正处理,提高其的准确性,其中,场景图像,例如是包括目标用户、课桌在内的图像;场景标定点,是对场景图像进行定位点的确定和标注;The above-mentioned image algorithm detection is performed on the scene image to obtain the scene calibration point, and based on the standard three-dimensional space, the calibration coordinates of the scene calibration point are obtained, in order to continue the splitting of the positioning point of the scene image, so as to facilitate the correction of each point Processing to improve its accuracy, where the scene image is, for example, an image including the target user and desk; the scene calibration point is to determine and label the positioning point of the scene image;
上述基于偏移数据库,确定所述标定坐标与对应的场景特征点之间的偏移距离,并基于预先设定的偏移修正算法,对所述标定坐标与对应的场景特征点进行修正处理,直到修正处理后的所述标定坐标与对应的场景特征点相一致;In the above, based on the offset database, the offset distance between the calibration coordinates and the corresponding scene feature points is determined, and the calibration coordinates and the corresponding scene feature points are corrected based on a preset offset correction algorithm, Until the calibration coordinates after the correction process are consistent with the corresponding scene feature points;
上述对标定坐标与对应的场景特征点进行修正处理,是为了标定坐标与对应的场景特征点相一致,保证其的统一性。The above-mentioned correction processing of the calibration coordinates and the corresponding scene feature points is to ensure that the calibration coordinates are consistent with the corresponding scene feature points and ensure their unity.
上述技术方案的有益效果是:通过对所述坐姿识别模型进行修正处理,并对修正处理后的所述姿势识别模型进行验证,为了提高坐姿识别模型的精准性,可以提高对第一目标数据和第二目标数据进行识别的准确性。The beneficial effect of the above technical solution is that by correcting the sitting posture recognition model and verifying the posture recognition model after the correction processing, in order to improve the accuracy of the sitting posture recognition model, the first target data and the The accuracy of the identification of the second target data.
本发明实施例提供基于智能手表的读写距离识别方法,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录之后,还包括:The embodiment of the present invention provides a read-write distance recognition method based on a smart watch, which recognizes the first target data and the second target data, determines the current sitting posture of the target user, and records it, and further includes:
对所记录的所述目标用户当前坐姿的保持时间进行计时,当计时时间大于预设时间时,控制所述智能手表的显示屏显示用眼过长提醒信息,或者控制所述智能手表的报警器发出第二报警信息。Time the recorded retention time of the current sitting position of the target user, and when the time is greater than a preset time, control the smart watch’s display screen to display a reminder of too long eyes, or control the smart watch’s alarm Issue the second alarm message.
上述第二报警信息区别于上述第一报警信息,例如:两者的报警时长不一样,第一报警信息报警时长为3S,第二报警时长为10S,间隔时间较长,可便于有效的区分对应的报警信息。The above-mentioned second alarm information is different from the above-mentioned first alarm information. For example, the alarm durations of the two are different. The first alarm information has an alarm duration of 3S, and the second alarm information has a duration of 10S. The interval is longer, which facilitates effective distinction and correspondence. Alarm information.
上述技术方案的有益效果是:便于对目标用户进行有效的提醒,避免用眼时间过程,造成视力下降的可能性。The beneficial effect of the above technical solution is that it is convenient to give effective reminders to the target user, and avoids the use of the eye time process, which may cause the possibility of vision loss.
本发明实施例提供基于智能手表的读写距离识别方法,所述智能手表上设置有红外摄像头,所述红外摄像头用于拍摄所述目标用户的红外图像;The embodiment of the present invention provides a method for recognizing a read-write distance based on a smart watch, where an infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
所述智能手表上设置有处理器,用于在基于所述智能手表中的陀螺仪传感器判定所述目标用户的目标手部水平放置在目标物体上时,根据所述红外图像判断所述当前用户的脸部摆动特征,并根据所述脸部摆动特征来发出相应提示;其中,所述根据所述红外图像和所述当前读写距离判断所述当前用户的脸部摆动特征,包括:The smart watch is provided with a processor for judging the current user based on the infrared image when it is determined based on the gyro sensor in the smart watch that the target hand of the target user is horizontally placed on the target object The facial swing feature of the user and the corresponding prompt is issued according to the facial swing feature; wherein the judging the current user's facial swing feature based on the infrared image and the current reading and writing distance includes:
获取共N组红外图像,其中,第n组红外图像中包括第一红外图像和第二红外图像,所述第一红外图像和第二红外图像之间的拍摄时间间隔小于或等于预设时间间隔;n=1,2,3、、、N;Acquire a total of N groups of infrared images, where the nth group of infrared images includes a first infrared image and a second infrared image, and the shooting time interval between the first infrared image and the second infrared image is less than or equal to the preset time interval ; N = 1, 2, 3,,, N;
按照下述公式(1)计算所述当前用户在第n组红外图像所对应的所述拍摄时间间隔内的脸部摆动系数:Calculate the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images according to the following formula (1):
Figure PCTCN2020075568-appb-000003
Figure PCTCN2020075568-appb-000003
其中,w n(12)为所述当前用户在第n组红外图像所对应的所述拍摄时间间隔内的脸部摆动系数;所述X n1(i,j)为第n组红外图像中第一红外图像在第i行第j列的像素点的像素值;所述X n2(i,j)为第n组红外图像中第二红外图像在第i行第j列的像素点的像素值;所述I为所述红外摄像头所拍摄的红外图像的像素总行数;所述J为所述红外摄像头所拍摄的红外图像的像素总列数; Wherein, w n(12) is the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images; and the X n1 (i,j) is the nth group of infrared images. The pixel value of a pixel in the i-th row and j-th column of an infrared image; said X n2 (i,j) is the pixel value of the pixel in the i-th row and j-th column of the second infrared image in the n-th group of infrared images The I is the total number of rows of pixels in the infrared image captured by the infrared camera; the J is the total number of columns of pixels in the infrared image captured by the infrared camera;
按照如下公式(2)计算所述当前用户在所述N组红外图像中的脸部摆动系数W:Calculate the face swing coefficient W of the current user in the N groups of infrared images according to the following formula (2):
Figure PCTCN2020075568-appb-000004
Figure PCTCN2020075568-appb-000004
其中,δ n为所述w n(12)对应的权重系数,取值范围为(0,1); Where δ n is the weight coefficient corresponding to w n(12) , and the value range is (0,1);
当所述W等于或大于预设行动系数阈值时,确定所述当前用户的脸部摆动特征为脸部摆动频繁,所述处理器控制所述智能手表上的扬声器发出声音提示。When the W is equal to or greater than the preset action coefficient threshold, it is determined that the current user's facial wobbling feature is frequent facial wobbling, and the processor controls the speaker on the smart watch to emit sound prompts.
上述技术方案的有益效果是:根据上述算法可以判断出当前用户是否脸部摆动频繁,脸部摆动频繁是指当前用户头部左右摆动频率较高,例如用户佩戴智能手表的手腕没有频繁摆动,而当前用户脸部在频繁的向左右两侧摆动,没有用心读书;当判定出当前用户脸部摆动频繁时,可以通过智能手表发出提示,以提醒当前用户要安心读书写字。The beneficial effect of the above technical solution is that according to the above algorithm, it can be judged whether the current user's face swings frequently. Frequent face swing refers to the high frequency of the current user's head swinging left and right. For example, the user's wrist wearing a smart watch does not swing frequently, and The current user’s face is frequently swinging to the left and right, and he does not read carefully; when it is determined that the current user’s face is swinging frequently, the smart watch can be used to give a reminder to remind the current user to read and write at ease.
且针对上述基于公式(1)和(2)的具体实施例还提出,所述智能手表上设置有红外摄像头,所述红外摄像头用于拍摄所述目标用户的红外图像;Furthermore, for the above specific embodiments based on formulas (1) and (2), it is also proposed that an infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
所述智能手表上设置有处理器,用于根据所述红外图像和所述当前读写距离判断所述当前用户的当前脸部朝向,并根据所述当前脸部朝向来发出相应提示;其中,所述根据所述红外图像和所述当前读写距离判断所述当前用户的当前脸部朝向,包括:The smart watch is provided with a processor for judging the current face orientation of the current user according to the infrared image and the current reading and writing distance, and issuing corresponding prompts according to the current face orientation; wherein, The judging the current face orientation of the current user according to the infrared image and the current reading and writing distance includes:
对所述红外图像进行红外区域的提取,获得红外区域;Extracting the infrared region from the infrared image to obtain the infrared region;
根据所述红外区域的轮廓特征,确定出所述红外区域中的当前用户头部所对应的当前头部红外区域;Determine the current head infrared area corresponding to the current user's head in the infrared area according to the contour feature of the infrared area;
根据预先存储的所述当前读写距离所对应的各种脸部朝向、及每种脸部朝向所对应的红外区域特征图,确定所述当前头部红外区域所对应的当前脸部朝向;所述各种脸部朝向中包括脸部朝前、脸部偏转和脸部朝后;Determine the current face orientation corresponding to the current head infrared region according to the pre-stored various facial orientations corresponding to the current read-write distance and the infrared region feature maps corresponding to each facial orientation; The various face orientations include face forward, face deflection and face backward;
所述根据所述当前脸部朝向来发出相应提示,包括:The sending out corresponding prompts according to the current face orientation includes:
当所述当前脸部朝向为脸部偏转或者脸部朝后时,控制所述智能手表上的扬声器发出声音提示。When the current face orientation is the face deflection or the face is facing backward, the speaker on the smart watch is controlled to emit a sound prompt.
其该实施例的有益效果为:根据上述方法可以判断出当前用户是否脸部偏转或者脸部朝后,当当前用户脸部脸部偏转或者脸部朝后时,说明当前用户没有用心读书;可以通过智能手表发出提示,以提醒当前用户要安心读书写字。The beneficial effects of this embodiment are: according to the above method, it can be judged whether the current user has a face deflection or face is facing backward, and when the current user's face is deflected or face is facing backward, it means that the current user is not studying carefully; A reminder is issued through the smart watch to remind the current user to read and write at ease.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. In this way, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims (10)

  1. 基于智能手表的读写距离识别方法,其特征在于,包括:The read-write distance recognition method based on smart watches is characterized in that it includes:
    构建坐姿识别模型;Build a seated recognition model;
    根据所述智能手表中的加速度传感器和陀螺仪传感器,检测得到第一目标数据,并基于所述第一目标数据,判断佩戴有智能手表的目标用户的当前读写状态;The first target data is detected according to the acceleration sensor and the gyroscope sensor in the smart watch, and based on the first target data, the current reading and writing status of the target user wearing the smart watch is determined;
    根据判断结果,控制所述智能手表中的距离传感组检测得到第二目标数据,通过所述第二目标数据判断与所述当前读写状态对应的所述目标用户的当前读写距离;According to the judgment result, controlling the distance sensing group in the smart watch to detect the second target data, and judging the current reading and writing distance of the target user corresponding to the current reading and writing state through the second target data;
    同时,基于构建的所述坐姿识别模型,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录。At the same time, based on the constructed sitting posture recognition model, the first target data and the second target data are recognized, and the current sitting posture of the target user is determined and recorded.
  2. 如权利要求1所述的读写距离识别方法,其特征在于,所述当前坐姿包括:正坐型、埋头读写型和手撑脸颊书写型;The method for recognizing the reading and writing distance of claim 1, wherein the current sitting posture includes: sitting type, head-down reading and writing type, and hand-supported cheek writing type;
    其中,基于构建的所述坐姿识别模型,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿的步骤包括:Wherein, the step of recognizing the first target data and the second target data based on the constructed sitting posture recognition model, and determining the current sitting posture of the target user includes:
    基于所述智能手表中的陀螺仪传感器判断所述目标用户的目标手部是否水平放置在目标物体上;Judging whether the target hand of the target user is placed horizontally on the target object based on the gyroscope sensor in the smart watch;
    基于所述智能手表中的距离传感组判断所述智能手表与所述目标用户的目标头部的头部距离;Judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch;
    基于所述坐姿识别模型,如果判断出所述目标用户的目标手部水平放置在目标物体上,且所述头部距离大于预设距离,则所述目标用户的当前坐姿为正坐型;Based on the sitting posture recognition model, if it is determined that the target hand of the target user is placed horizontally on the target object, and the head distance is greater than a preset distance, then the current sitting posture of the target user is an upright sitting type;
    如果判断出所述目标用户的目标手部水平放置在目标物体上,且所述头部距离不大于预设距离,则所述目标用户的当前坐姿为埋头读写型;If it is determined that the target hand of the target user is horizontally placed on the target object, and the head distance is not greater than a preset distance, then the current sitting posture of the target user is a head-down reading and writing type;
    如果判断出所述目标用户的目标手部未水平放置在目标物体上,且与所述 目标物体的第一角度在预设角度范围内,则所述目标用户的当前坐姿为手撑脸颊书写型。If it is determined that the target hand of the target user is not placed horizontally on the target object, and the first angle with the target object is within the preset angle range, then the current sitting posture of the target user is hand-supported cheek writing type .
  3. 如权利要求1所述的读写距离识别方法,其特征在于,基于判断结果,并通过所述第二目标数据判断与所述当前读写状态对应的所述目标用户的当前读写距离的步骤包括:The method for identifying the reading and writing distance according to claim 1, wherein the step of judging the current reading and writing distance of the target user corresponding to the current reading and writing state through the second target data based on the judgment result include:
    当所述判断结果为所述目标用户当前处于读写状态时,控制所述距离传感组发射激光,并根据激光发射-反射时间差计算所述目标用户的当前读写距离;When the judgment result is that the target user is currently in a reading and writing state, controlling the distance sensing group to emit laser light, and calculating the current reading and writing distance of the target user according to the laser emission-reflection time difference;
    当所述判断结果为所述目标用户当前未处于读写状态时,控制所述智能手表不执行任何操作;When the judgment result is that the target user is not currently in a read-write state, control the smart watch not to perform any operation;
    其中,所述第二目标数据为所述激光发射-反射时间差计算得到的当前读写距离。Wherein, the second target data is the current reading and writing distance calculated from the laser emission-reflection time difference.
  4. 如权利要求2所述的读写距离识别方法,其特征在于,基于所述智能手表中的距离传感组判断所述智能手表与所述目标用户的目标头部的头部距离的过程中,还包括获取所述智能手表与所述目标用户的目标头部的最优距离,其步骤包括:3. The method for recognizing a reading and writing distance according to claim 2, wherein in the process of judging the head distance between the smart watch and the target head of the target user based on the distance sensing group in the smart watch, It also includes obtaining the optimal distance between the smart watch and the target head of the target user, and the steps include:
    确定所述智能手表中的距离传感组中的第一传感器获取的第一距离和第二传感器获取的第二距离;Determining the first distance obtained by the first sensor and the second distance obtained by the second sensor in the distance sensing group in the smart watch;
    确定所述智能手表中的陀螺仪传感器计算得出的所述智能手表与所述目标物体基于水平面的测量角度;Determining the horizontal measurement angle between the smart watch and the target object calculated by the gyroscope sensor in the smart watch;
    根据所述测量角度,从所述第一距离和第二距离中选择最优距离,作为所述智能手表与所述目标头部的头部距离。According to the measurement angle, an optimal distance is selected from the first distance and the second distance as the head distance between the smart watch and the target head.
  5. 如权利要求1所述的读写距离识别方法,其特征在于,当判断佩戴有智能手表的目标用户处于读写状态时,检测所述目标用户的当前坐姿是否正确,若是,所述智能手表不执行任何操作;The method for recognizing the reading and writing distance of claim 1, wherein when it is determined that the target user wearing the smart watch is in a reading and writing state, it is detected whether the current sitting posture of the target user is correct, and if so, the smart watch is not Perform any operation;
    否则,所述智能手表内部的振动传感器产生震动提示当前坐姿错误,同时所述智能手表上的显示屏进行提示显示;Otherwise, the vibration sensor inside the smart watch generates a vibration to indicate the current sitting posture error, and at the same time the display on the smart watch displays a prompt display;
    且,所述智能手表还按照预设时间间隔对所述目标用户的当前坐姿进行预设次数的检测,如果,所述预设次数的检测结果都为所述当前坐姿错误,则所述智能手表中的报警器发出第一报警声音。Moreover, the smart watch further detects the current sitting posture of the target user a preset number of times at a preset time interval. If the preset number of detection results are all the current sitting posture errors, the smart watch The alarm in the system emits the first alarm sound.
  6. 如权利要求1所述的读写距离识别方法,其特征在于,The method for recognizing a read-write distance according to claim 1, wherein:
    所述智能手表还用于对检测到的第一目标数据、第二目标数据和所述目标用户的当前坐姿进行记录,并将记录结果传输到家长端进行显示;The smart watch is also used to record the detected first target data, second target data, and the current sitting posture of the target user, and transmit the recording result to the parent terminal for display;
    且所述家长端的用户在对显示的记录结果进行实时查看的过程中,所述家长端还接收家长端的用户输入的纠正指令。In addition, when the user of the parent terminal is viewing the displayed recording result in real time, the parent terminal also receives a correction instruction input by the user of the parent terminal.
  7. 如权利要求1所述的读写距离识别方法,其特征在于,当判断所述目标用户处于读写状态时,对所述目标用户的当前坐姿进行计时统计;4. The method for recognizing a reading and writing distance according to claim 1, wherein when it is determined that the target user is in a reading and writing state, timing statistics are performed on the current sitting posture of the target user;
    当所述目标用户的当前坐姿发生变化时,重新对所述发生变化的当前坐姿进行计时统计,当所述目标用户的当前坐姿未发生变化时,对所述当前坐姿继续进行计时统计;When the current sitting posture of the target user changes, re-calculate the timing statistics of the changed current sitting posture, and when the current sitting posture of the target user does not change, continue timing statistics on the current sitting posture;
    基于预设时间轴,将计时统计结果进行输出到家长端进行显示。Based on the preset time axis, the timing statistics results are output to the parent terminal for display.
  8. 如权利要求1所述的读写距离识别方法,其特征在于,所述构建坐姿识别模型之后,为了提高所述坐姿识别模型的精准性,还包括:对所述坐姿识别模型进行修正处理,并对修正处理后的所述姿势识别模型进行验证,其步骤包括:The method for reading and writing distance recognition according to claim 1, wherein after the construction of the sitting posture recognition model, in order to improve the accuracy of the sitting posture recognition model, the method further comprises: correcting the sitting posture recognition model, and The steps of verifying the posture recognition model after correction processing include:
    基于所述智能手表上设置的摄像头和CCD模组,获取若干个历史用户所处预设读写场景的场景图像,并将所述场景图像传输到服务器,所述场景图像包括:所述历史用户的坐姿图像信息、所述目标物体的物体图像信息;Based on the camera and CCD module set on the smart watch, acquire scene images of preset read-write scenes where a number of historical users are located, and transmit the scene images to the server, the scene images including: the historical users Image information of the sitting posture, object image information of the target object;
    基于所述服务器,对所述场景图像进行图像算法检测,获得场景标定点,并基于标准三维空间,获取所述场景标定点的标定坐标;Based on the server, perform image algorithm detection on the scene image to obtain scene calibration points, and obtain calibration coordinates of the scene calibration points based on a standard three-dimensional space;
    基于服务器中的图像特征数据库,获取所述场景图像的场景特征点,判断所述标定坐标与对应的场景特征点是否相一致,若是,保留对应的场景标定点;Based on the image feature database in the server, obtain the scene feature points of the scene image, determine whether the calibration coordinates are consistent with the corresponding scene feature points, and if so, retain the corresponding scene calibration points;
    否则,基于服务器中的偏移数据库,确定所述标定坐标与对应的场景特征 点之间的偏移距离,并基于预先设定的偏移修正算法,对所述标定坐标与对应的场景特征点进行修正处理,直到修正处理后的所述标定坐标与对应的场景特征点相一致;Otherwise, the offset distance between the calibration coordinates and the corresponding scene feature points is determined based on the offset database in the server, and the calibration coordinates and the corresponding scene feature points are determined based on the preset offset correction algorithm. Perform correction processing until the calibration coordinates after correction processing are consistent with the corresponding scene feature points;
    当所有所述标定坐标与对应的场景特征点相一致后,对每个所述标定坐标进行真伪预测,并根据真伪预测结果,判断所述标定坐标是否需要删除;When all the calibration coordinates are consistent with the corresponding scene feature points, predict the authenticity of each calibration coordinate, and determine whether the calibration coordinates need to be deleted according to the result of the authenticity prediction;
    若是,将所述标定坐标删除,否则,将所述标定坐标进行保留;If yes, delete the calibration coordinates, otherwise, keep the calibration coordinates;
    同时,根据保留的所有标定坐标,重构标定图像,并基于所述标定图像对所述坐姿识别模型进行深度学习训练;At the same time, reconstruct the calibration image according to all the retained calibration coordinates, and perform deep learning training on the sitting posture recognition model based on the calibration image;
    获取若干张目标用户所处预设读写场景的场景图像,并基于所述深度学习训练后的坐姿识别模型进行识别验证,根据识别验证结果,确定深度学习训练后的坐姿识别模型识别的准确性;Acquire several scene images of the preset reading and writing scenes where the target user is located, and perform recognition verification based on the sitting posture recognition model after the deep learning training, and determine the recognition accuracy of the sitting posture recognition model after the deep learning training according to the recognition and verification results ;
    当准确性高于预设值时,判定验证成功,并将验证成功的坐姿识别模型传输到所述智能手表实现对当前坐姿的识别。When the accuracy is higher than the preset value, it is determined that the verification is successful, and the successfully verified sitting posture recognition model is transmitted to the smart watch to recognize the current sitting posture.
  9. 如权利要求1所述的读写距离识别方法,其特征在于,对所述第一目标数据和第二目标数据进行识别,确定所述目标用户的当前坐姿,并记录之后,还包括:5. The method for recognizing a reading and writing distance according to claim 1, wherein after recognizing the first target data and the second target data, determining the current sitting posture of the target user, and recording it, the method further comprises:
    对所记录的所述目标用户当前坐姿的保持时间进行计时,当计时时间大于预设时间时,控制所述智能手表的显示屏显示用眼过长提醒信息,或者控制所述智能手表的报警器发出第二报警信息。Time the recorded retention time of the current sitting position of the target user, and when the time is greater than a preset time, control the smart watch’s display screen to display a reminder of too long eyes, or control the smart watch’s alarm Issue the second alarm message.
  10. 如权利要求1所述的读写距离识别方法,其特征在于,The method for recognizing a read-write distance according to claim 1, wherein:
    所述智能手表上设置有红外摄像头,所述红外摄像头用于拍摄所述目标用户的红外图像;An infrared camera is provided on the smart watch, and the infrared camera is used to capture an infrared image of the target user;
    所述智能手表上设置有处理器,用于在基于所述智能手表中的陀螺仪传感器判定所述目标用户的目标手部水平放置在目标物体上时,根据所述红外图像判断所述当前用户的脸部摆动特征,并根据所述脸部摆动特征来发出相应提示;其中,所述根据所述红外图像和所述当前读写距离判断所述当前用户的脸 部摆动特征,包括:The smart watch is provided with a processor for judging the current user based on the infrared image when it is determined based on the gyro sensor in the smart watch that the target hand of the target user is horizontally placed on the target object The facial swing feature of the user and the corresponding prompt is issued according to the facial swing feature; wherein the judging the current user's facial swing feature based on the infrared image and the current reading and writing distance includes:
    获取共N组红外图像,其中,第n组红外图像中包括第一红外图像和第二红外图像,所述第一红外图像和第二红外图像之间的拍摄时间间隔小于或等于预设时间间隔;n=1,2,3、、、N;Acquire a total of N groups of infrared images, where the nth group of infrared images includes a first infrared image and a second infrared image, and the shooting time interval between the first infrared image and the second infrared image is less than or equal to the preset time interval ; N = 1, 2, 3,,, N;
    按照下述公式(1)计算所述当前用户在第n组红外图像所对应的所述拍摄时间间隔内的脸部摆动系数:Calculate the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images according to the following formula (1):
    Figure PCTCN2020075568-appb-100001
    Figure PCTCN2020075568-appb-100001
    其中,w n(12)为所述当前用户在第n组红外图像所对应的所述拍摄时间间隔内的脸部摆动系数;所述X n1(i,j)为第n组红外图像中第一红外图像在第i行第j列的像素点的像素值;所述X n2(i,j)为第n组红外图像中第二红外图像在第i行第j列的像素点的像素值;所述I为所述红外摄像头所拍摄的红外图像的像素总行数;所述J为所述红外摄像头所拍摄的红外图像的像素总列数; Wherein, w n(12) is the face swing coefficient of the current user in the shooting time interval corresponding to the nth group of infrared images; and the X n1 (i,j) is the nth group of infrared images. The pixel value of a pixel in the i-th row and j-th column of an infrared image; said X n2 (i,j) is the pixel value of the pixel in the i-th row and j-th column of the second infrared image in the n-th group of infrared images The I is the total number of rows of pixels in the infrared image captured by the infrared camera; the J is the total number of columns of pixels in the infrared image captured by the infrared camera;
    按照如下公式(2)计算所述当前用户在所述N组红外图像中的脸部摆动系数W:Calculate the face swing coefficient W of the current user in the N groups of infrared images according to the following formula (2):
    Figure PCTCN2020075568-appb-100002
    Figure PCTCN2020075568-appb-100002
    其中,δ n为所述w n(12)对应的权重系数,取值范围为(0,1); Where δ n is the weight coefficient corresponding to w n(12) , and the value range is (0,1);
    当所述W等于或大于预设行动系数阈值时,确定所述当前用户的脸部摆动特征为脸部摆动频繁,所述处理器控制所述智能手表上的扬声器发出声音提 示。When the W is equal to or greater than the preset action coefficient threshold, it is determined that the current user's facial wobbling feature is frequent facial wobbling, and the processor controls the speaker on the smart watch to emit a sound prompt.
PCT/CN2020/075568 2020-01-10 2020-02-17 Read/write distance identification method based on smart watch WO2021138964A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010026595.3A CN111240481B (en) 2020-01-10 2020-01-10 Read-write distance identification method based on smart watch
CN202010026595.3 2020-01-10

Publications (1)

Publication Number Publication Date
WO2021138964A1 true WO2021138964A1 (en) 2021-07-15

Family

ID=70880472

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/075568 WO2021138964A1 (en) 2020-01-10 2020-02-17 Read/write distance identification method based on smart watch

Country Status (2)

Country Link
CN (1) CN111240481B (en)
WO (1) WO2021138964A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023119305A1 (en) * 2021-12-22 2023-06-29 Ahmed Syed Irfan Posture tracking
CN116740811A (en) * 2023-06-15 2023-09-12 东芯泰合(深圳)科技有限公司 Gait recognition method, medium and device of intelligent watch

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111964674B (en) * 2020-10-23 2021-01-15 四川写正智能科技有限公司 Method for judging read-write state by combining acceleration sensor and mobile terminal
CN112015242B (en) * 2020-10-29 2021-02-02 四川写正智能科技有限公司 Intelligent reward method and system with active triggering
CN111998829B (en) * 2020-10-30 2021-01-29 四川写正智能科技有限公司 Method for judging read-write posture based on sensor
CN112414307B (en) * 2020-10-30 2022-04-15 四川写正智能科技有限公司 Method and system for judging read-write state based on gyroscope sensor and mobile device
CN111999999B (en) * 2020-10-30 2021-02-02 四川写正智能科技有限公司 Child intelligent watch capable of correcting sitting posture and correcting method
CN112733626B (en) * 2020-12-28 2023-02-28 歌尔科技有限公司 Sitting posture reminding method based on bracelet, bracelet and computer readable storage medium
CN112698730B (en) * 2021-01-20 2022-09-06 四川写正智能科技有限公司 Intelligent watch reading and writing posture recognition method
CN112925190B (en) * 2021-01-25 2022-02-01 四川写正智能科技有限公司 Intelligent watch with infrared sensors arranged at multiple angles for distance measurement
CN113052735B (en) * 2021-04-15 2023-06-20 四川写正智能科技有限公司 Method for correcting sitting postures of students by one key
CN113129374B (en) * 2021-04-20 2023-06-23 四川写正智能科技有限公司 Method and device for assisting in judging read-write gesture by using laser point cloud face recognition
CN113792664B (en) * 2021-09-16 2023-06-23 四川写正智能科技有限公司 Method and system for calibrating correct read-write coordinate index
CN114639157B (en) * 2022-05-18 2022-11-22 合肥的卢深视科技有限公司 Bad learning behavior detection method, system, electronic device and storage medium
CN117237923B (en) * 2023-11-10 2024-01-09 深圳市金大智能创新科技有限公司 Automatic identification system for virtual character intelligent equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103745577A (en) * 2014-01-16 2014-04-23 中国工程物理研究院电子工程研究所 Sedentary reminding and sitting posture detection device based on smart mobile device
CN104239860A (en) * 2014-09-10 2014-12-24 广东小天才科技有限公司 Detecting and reminding method and device for sitting posture in using process of intelligent terminal
CN106773626A (en) * 2016-11-29 2017-05-31 夏若凡 A kind of watch and sitting-posture correction device and method
US9855005B2 (en) * 2015-04-22 2018-01-02 Samsung Electronics Co., Ltd. Wearable posture advisory system
CN109002803A (en) * 2018-07-24 2018-12-14 武汉大学 A kind of pen holding posture detection and Chinese characters' order of strokes recognition method based on smartwatch
CN109584521A (en) * 2018-10-15 2019-04-05 西安理工大学 A kind of incorrect sitting-pose monitoring method based on Notch sensor
CN109948435A (en) * 2019-01-31 2019-06-28 深圳奥比中光科技有限公司 Sitting posture prompting method and device
CN110211345A (en) * 2019-05-27 2019-09-06 歌尔科技有限公司 Sitting posture reminding method, system and smartwatch
CN110493471A (en) * 2019-08-28 2019-11-22 重庆医药高等专科学校 One kind is corrected sitting posture pre- myopia prevention system and method based on intelligent mobile terminal

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063998B (en) * 2014-07-09 2017-03-22 广东小天才科技有限公司 Device for assisting user in writing and sitting posture warning method
US20160349956A1 (en) * 2015-05-28 2016-12-01 Fih (Hong Kong) Limited Electronic device and method for controlling display interface
US20170199578A1 (en) * 2016-01-08 2017-07-13 16Lab Inc. Gesture control method for interacting with a mobile or wearable device
CN105787478B (en) * 2016-04-14 2019-09-20 中南大学 Recognition methods is turned to based on the face of neural network and sensitivity parameter
CN108665687B (en) * 2017-03-28 2020-07-24 上海市眼病防治中心 Sitting posture monitoring method and device
CN108021902A (en) * 2017-12-19 2018-05-11 珠海瞳印科技有限公司 Head pose recognition methods, head pose identification device and storage medium
CN109491520B (en) * 2018-11-19 2022-03-01 广东小天才科技有限公司 Sedentary reminding method based on wrist type wearable equipment and wrist type wearable equipment
CN110077414B (en) * 2019-04-04 2020-12-01 合肥思艾汽车科技有限公司 Vehicle driving safety guarantee method and system based on driver state monitoring

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103745577A (en) * 2014-01-16 2014-04-23 中国工程物理研究院电子工程研究所 Sedentary reminding and sitting posture detection device based on smart mobile device
CN104239860A (en) * 2014-09-10 2014-12-24 广东小天才科技有限公司 Detecting and reminding method and device for sitting posture in using process of intelligent terminal
US9855005B2 (en) * 2015-04-22 2018-01-02 Samsung Electronics Co., Ltd. Wearable posture advisory system
CN106773626A (en) * 2016-11-29 2017-05-31 夏若凡 A kind of watch and sitting-posture correction device and method
CN109002803A (en) * 2018-07-24 2018-12-14 武汉大学 A kind of pen holding posture detection and Chinese characters' order of strokes recognition method based on smartwatch
CN109584521A (en) * 2018-10-15 2019-04-05 西安理工大学 A kind of incorrect sitting-pose monitoring method based on Notch sensor
CN109948435A (en) * 2019-01-31 2019-06-28 深圳奥比中光科技有限公司 Sitting posture prompting method and device
CN110211345A (en) * 2019-05-27 2019-09-06 歌尔科技有限公司 Sitting posture reminding method, system and smartwatch
CN110493471A (en) * 2019-08-28 2019-11-22 重庆医药高等专科学校 One kind is corrected sitting posture pre- myopia prevention system and method based on intelligent mobile terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023119305A1 (en) * 2021-12-22 2023-06-29 Ahmed Syed Irfan Posture tracking
CN116740811A (en) * 2023-06-15 2023-09-12 东芯泰合(深圳)科技有限公司 Gait recognition method, medium and device of intelligent watch

Also Published As

Publication number Publication date
CN111240481A (en) 2020-06-05
CN111240481B (en) 2021-02-09

Similar Documents

Publication Publication Date Title
WO2021138964A1 (en) Read/write distance identification method based on smart watch
CN108968907B (en) The bearing calibration of eye movement data and device
WO2021093896A1 (en) Reading/writing distance recognition method based on smart watch
CN105788185A (en) Method and device for monitoring sitting posture
CN112270815B (en) Read-write gesture recognition method and system based on smart watch
US20170156589A1 (en) Method of identification based on smart glasses
CN103400476A (en) Sitting posture reminding method and device
WO2020118669A1 (en) Student concentration detection method, computer storage medium, and computer device
CN112014850B (en) Method for judging read-write state based on laser ranging sensor and mobile device
CN107103309A (en) A kind of sitting posture of student detection and correcting system based on image recognition
CN108577852B (en) Cervical vertebra activity prompting method and cervical vertebra activity detection system
CN104116491A (en) Vision detection device and method
CN111999999B (en) Child intelligent watch capable of correcting sitting posture and correcting method
WO2020020022A1 (en) Method for visual recognition and system thereof
WO2021147394A1 (en) Method for determining read-write state on the basis of sensor
CN112101124A (en) Sitting posture detection method and device
CN105787237A (en) Read-write posture monitoring method and device
CN111444789B (en) Myopia prevention method and system based on video induction technology
KR20200000680U (en) The Device for improving the study concentration
CN111134693B (en) Virtual reality technology-based autism child auxiliary detection method, system and terminal
KR20190143742A (en) The Device for improving the study concentration
CN204133428U (en) Full-automatic vision detects instrument for training
WO2019071806A1 (en) Method and system for guiding posture of user using electronic product
CN113197542A (en) Online self-service vision detection system, mobile terminal and storage medium
CN211293955U (en) Teenager eyesight guard system based on video deep learning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20912821

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20912821

Country of ref document: EP

Kind code of ref document: A1