CN115998592A

CN115998592A - Data processing method and system for assisting blind person based on intelligent watch

Info

Publication number: CN115998592A
Application number: CN202310327115.0A
Authority: CN
Inventors: 陈泽鹏; 綦吉
Original assignee: Shenzhen Wake Up Technology Co ltd
Current assignee: Shenzhen Weike Technology Co ltd
Priority date: 2023-03-30
Filing date: 2023-03-30
Publication date: 2023-04-25
Anticipated expiration: 2043-03-30
Also published as: CN115998592B

Abstract

The invention provides a data processing method and a system for assisting blind people based on an intelligent watch, which are applied to the field of data generation and processing; according to the invention, when the blind person unintentionally leaves the field of vision of family friends, the intelligent watch can be used for recording and presetting contents to help the blind person smoothly return to a safe place to gather with the family friends, so that the probability of irreversible accidents is reduced without assistance of other people and guide dogs or under the condition of unfamiliar road traffic, and meanwhile, the corresponding auxiliary instruction function is provided for the blind person by detecting finger conversion data of the blind person, and the self-help efficiency of the blind person is improved.

Description

Data processing method and system for assisting blind person based on intelligent watch

Technical Field

The invention relates to the field of data generation and processing, in particular to a data processing method and system for assisting a blind person based on an intelligent watch.

Background

Along with the development and technological progress of society, innovations lead the social trend, and more intelligent products are of course generated. In recent years, the attention of the society to special people is increasingly improved, and the corresponding design is pulled up like the spring bamboo shoots after rain. The development of the intelligent watch industry is also more in compliance with the market environment, and an intelligent operating system is designed for special groups such as visually impaired people or blind people so as to help the special groups to more conveniently perform daily life.

At present, the blind person is required to walk with the aid of a crutch, and the general crutch only has a crutch rod and a handrail, so that the blind person can be simply assisted to search whether the front part has an obstacle or not, even if the life walking of the blind person is still very inconvenient, once the blind person leaves the field of view of families, no assistance of other people or a guide dog is caused, and the blind person is extremely easy to generate irreversible accidents under the condition of unfamiliar with road traffic.

Disclosure of Invention

The invention aims to solve the problem that the blind is extremely easy to generate accidents under the condition of unfamiliar road traffic without the help of other people or blind dogs when the blind leaves the view range of families, and provides a data processing method and a data processing system for assisting the blind based on an intelligent watch.

The invention adopts the following technical means for solving the technical problems:

the invention provides a data processing method for assisting blind people based on an intelligent watch, which comprises the following steps:

based on a GPS positioning device preset by the intelligent watch, transmitting GPS positioning data to a north bucket system, receiving a wireless signal returned by the Beidou system, acquiring the current geographic position of a user through matching the wireless signal with a preset electronic compass, and judging whether the geographic position is in preset positioning;

If not, monitoring finger transformation data of the user by using preset sensing equipment, inputting the finger transformation data into a preset neural network distributor for action recognition, collecting finger movement postures of the user, reading a preset instruction corresponding to the finger movement postures, and executing auxiliary content corresponding to the instruction, wherein the sensing equipment comprises an accelerometer and an acceleration sensor;

providing an optimal route which goes to a destination and can finally reach the preset position for the user according to the destination content set by the user, acquiring at least one environmental information data set in a conical range in the optimal route by using a preset scanner, and judging whether the environmental information data set is updated in a preset time period;

if not, judging that the user stops moving, reading corresponding contents in the environment information data set, carrying out iterative updating on the optimal route according to the corresponding contents, and generating and broadcasting corrected corresponding voice contents, wherein the corresponding contents specifically comprise the relative distance between the user and each obstacle.

Further, the step of applying a preset sensing device to monitor finger transformation data of the user, inputting the finger transformation data into a preset neural network distributor for motion recognition, and collecting the finger movement gesture of the user includes:

Acquiring fluctuation data corresponding to each finger of the user through the sensing equipment, inputting the fluctuation data into a preset prediction model, and reading the finger action of the user, wherein the fluctuation data specifically comprises the fitting distance between the finger and the palm;

and generating presentation probability of the finger action through the prediction model, providing corresponding instruction selection for the user based on priority distribution of the presentation probability, respectively generating execution content corresponding to the instruction selection into a preset tactile braille keyboard, and reading instructions selected by the user based on the touch.

Further, the step of providing the user with an optimal route to a destination and eventually to reach the preset location according to the destination content set by the user includes:

acquiring a destination keyword input by a user through a touch braille keyboard, identifying a destination corresponding to the destination keyword in a preset range according to the current coordinate positioning of the user, acquiring the shortest distance between the current coordinate positioning of the user and the preset positioning based on the preset positioning as a base point coordinate, and defining and selecting available vehicles in the shortest distance, wherein the preset range is specifically identified in a fixed distance from the current coordinate positioning of the user to the periphery;

Generating at least one route and an optimal route for the user as a function of the destination, the shortest distance and the available vehicles, wherein the at least one route and the optimal route are ordered, in particular with a safety factor as a priority.

Further, the step of determining that the user stops moving and reading the corresponding content in the environmental information dataset further includes:

transmitting an electromagnetic wave signal by using a preset radar, receiving a radar echo of the electromagnetic wave signal within a preset distance of a user, acquiring echo time length of at least one object according to a scattering direction of the radar echo, and generating surface layer data corresponding to the object;

judging whether the surface layer data accords with pre-recorded information or not;

if so, generating object data corresponding to the surface layer data according to the pre-recorded information, listing the corresponding object as a trusted object according to the object data, generating the object data in a touch braille keyboard based on the current coordinate positioning of the user, and generating a safety coefficient corresponding to the object data, wherein the object data comprises the distance between the object and the user, the relative direction of the object based on the user and the general name of the object.

Further, the step of acquiring the current geographic position of the user by matching the wireless signal with the preset electronic compass further comprises the steps of:

acquiring movement data in a preset period of a user, generating a movement path of the user in a preset virtual region chart according to the movement data, and acquiring a measurement interval value of the electronic compass according to the movement data, wherein the movement data comprises movement duration of the user and movement rate of the user, and the measurement interval value is specifically earth magnetic field direction change information and intensity change information measured by the electronic compass when the user moves from a previous preset period to a current period;

and generating coordinate transformation information of the user in the virtual region chart based on the moving path and the measurement interval value, feeding back the coordinate transformation information to a touch braille keyboard, inputting the coordinate transformation information into a preset prediction model to obtain a required time length for the user to move from the current geographic position to the preset position, wherein the coordinate transformation information comprises a moving distance between the last preset moment and the current moment and a distance difference between the current geographic position and the preset position of the user.

Further, after the step of reading the instruction corresponding to the preset gesture of the finger movement and executing the auxiliary content corresponding to the instruction, the method further includes:

based on the instruction use times of the user, ordering corresponding instructions of the finger movement gestures by taking the instruction use times as priorities to obtain frequently used instructions, setting the frequently used instructions into a preset shortcut bar, and setting a wake-up mode corresponding to a touch braille keyboard for the frequently used instructions;

based on the short-term use instruction of the user, carrying out secondary sequencing on the short-term use instruction serving as a priority for the corresponding instruction of the finger movement gesture, obtaining a most recently used instruction by the secondary sequencing, inputting the most recently used instruction into a preset shortcut bar, and setting a wake-up mode corresponding to a touch braille keyboard for the most recently used instruction.

Further, the step of iteratively updating the optimal route according to the corresponding content to generate and broadcast the corrected voice content includes:

acquiring auxiliary route information of the user, wherein the auxiliary route information is specifically mobile route information from the user needing assistance to the end of assistance, and the auxiliary route information comprises total mobile duration and total mobile distance;

Judging whether the auxiliary route information contains movement data of the vehicles or not;

if so, removing the movement path corresponding to the movement data of the vehicle based on the total path of the auxiliary route information, acquiring the residual movement path of the user, and generating the movement information of the user according to the residual movement path, wherein the movement information comprises the average movement rate of the user and the speed change trend of the user.

The invention also provides a data processing system for assisting the blind person based on the intelligent watch, which comprises the following steps:

the judging module is used for transmitting GPS positioning data to the north bucket system based on a GPS positioning device preset by the intelligent watch, receiving a wireless signal returned by the Beidou system, acquiring the current geographic position of a user through matching the wireless signal with a preset electronic compass, and judging whether the geographic position is in preset positioning;

the execution module is used for monitoring finger transformation data of the user by using preset sensing equipment if not, inputting the finger transformation data into a preset neural network distributor for action recognition, collecting finger movement postures of the user, reading preset instructions corresponding to the finger movement postures, and executing auxiliary content corresponding to the instructions, wherein the sensing equipment comprises an accelerometer and an acceleration sensor;

The second judging module is used for providing an optimal route which goes to a destination and can finally reach the preset position for the user according to the destination content set by the user, collecting at least one environment information data set in a conical range in the optimal route by using a preset scanner, and judging whether the environment information data set is updated in a preset time period or not;

and the second execution module is used for judging that the user stops moving if the user does not update, reading the corresponding content in the environment information data set, carrying out iterative updating on the optimal route according to the corresponding content, and generating and broadcasting corrected corresponding voice content, wherein the corresponding content specifically comprises the relative distance between the user and each obstacle.

Further, the execution module further includes:

the reading unit is used for acquiring fluctuation data corresponding to each finger of the user through the sensing equipment, inputting the fluctuation data into a preset prediction model and reading the finger action of the user, wherein the fluctuation data specifically comprises the fitting distance between the finger and the palm;

and the second reading unit is used for generating the presentation probability of the finger action through the prediction model, providing corresponding instruction selection for the user based on the priority distribution of the presentation probability, respectively generating execution contents corresponding to the instruction selection into a preset tactile braille keyboard, and reading the instruction selected by the user based on the touch.

Further, the second judging module further includes:

the acquisition unit is used for acquiring destination keywords input by a user through a touch braille keyboard, identifying destinations corresponding to the destination keywords in a preset range according to the current coordinate positioning of the user, acquiring the shortest distance between the current coordinate positioning of the user and the preset positioning based on the preset positioning as a base point coordinate, and demarcating and selecting available vehicles in the shortest distance, wherein the preset range is specifically identified in a peripheral fixed distance based on the current coordinate positioning of the user;

and the generation unit is used for generating at least one route and an optimal route for the user according to the destination, the shortest distance and the available vehicles, wherein the at least one route and the optimal route are specifically ordered by taking a safety coefficient as a priority.

The invention provides a data processing method and system for assisting blind people based on an intelligent watch, which have the following beneficial effects:

according to the invention, when the blind person unintentionally leaves the field of vision of family friends, the intelligent watch can be used for recording and presetting contents to help the blind person smoothly return to a safe place to gather with the family friends, so that the probability of irreversible accidents is reduced without assistance of other people and guide dogs or under the condition of unfamiliar road traffic, and meanwhile, the corresponding auxiliary instruction function is provided for the blind person by detecting finger conversion data of the blind person, and the self-help efficiency of the blind person is improved.

Drawings

FIG. 1 is a schematic flow chart of one embodiment of a data processing method for assisting a blind person based on a smart watch according to the present invention;

fig. 2 is a block diagram illustrating an embodiment of a data processing system for assisting a blind person based on a smart watch according to the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present invention, as the achievement, functional features, and advantages of the present invention are further described with reference to the embodiments, with reference to the accompanying drawings.

The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Referring to fig. 1, in an embodiment of the present invention, a data processing method for assisting a blind person based on a smart watch includes:

s1: based on a GPS positioning device preset by the intelligent watch, transmitting GPS positioning data to a north bucket system, receiving a wireless signal returned by the Beidou system, acquiring the current geographic position of a user through matching the wireless signal with a preset electronic compass, and judging whether the geographic position is in preset positioning;

S2: if not, monitoring finger transformation data of the user by using preset sensing equipment, inputting the finger transformation data into a preset neural network distributor for action recognition, collecting finger movement postures of the user, reading a preset instruction corresponding to the finger movement postures, and executing auxiliary content corresponding to the instruction, wherein the sensing equipment comprises an accelerometer and an acceleration sensor;

s3: providing an optimal route which goes to a destination and can finally reach the preset position for the user according to the destination content set by the user, acquiring at least one environmental information data set in a conical range in the optimal route by using a preset scanner, and judging whether the environmental information data set is updated in a preset time period;

s4: if not, judging that the user stops moving, reading corresponding contents in the environment information data set, carrying out iterative updating on the optimal route according to the corresponding contents, and generating and broadcasting corrected corresponding voice contents, wherein the corresponding contents specifically comprise the relative distance between the user and each obstacle.

It should be noted that, the application scenario of the present invention specifically includes: when the blind is playing with family friends, the blind is not lost or the blind cannot contact with other people in time, the auxiliary blind function of the intelligent watch can provide an auxiliary instruction function for the blind user, an optimal route for the blind user to return to a safe place is formulated in time, corresponding auxiliary instruction function is provided for the blind by detecting finger conversion data of the blind, and self-service efficiency of the blind is improved.

In this embodiment, the system transmits GPS positioning data in the current smart watch to the north-bucket system based on the GPS positioning data recorded in advance, and can learn the current location and orientation of the user by receiving the wireless signal data returned by the beidou system, and the pre-arranged electronic compass positioning module cooperates with the wireless signal data returned by the beidou system to clearly acquire the current geographical position information of the user, and meanwhile, judge whether the geographical position information is in the preset safe positioning or not so as to execute the corresponding steps; for example, when the system determines that the current geographic location information of the user is in the preset safe location, the system does not provide an auxiliary function for the user at this time, because the user is already in the preset safe location (such as the home of the user, the home of the user friend, etc.), even if the blind user leaves the line of sight of the relatives and friends, irreversible traffic accidents are not easy to occur at this time, because the blind user can set the safe location at the place, at least the environment around the safe location is not strange; for example, when the system determines that the current geographic position information of the user is not in the preset safe positioning, the system defaults to enable an auxiliary function for the user, firstly, the finger transformation data of the user is monitored by applying a preset sensing device, the sensing device comprises a triaxial accelerometer and the real-time finger transformation data of the user is input into a preset neural network distributor for finger action recognition, the finger movement gesture of the user is recognized by collecting the finger transformation data, the auxiliary instruction corresponding to the preset auxiliary instruction is read, and the corresponding auxiliary content of the auxiliary instruction is executed, so that the instruction content for assisting the blind user is quickly executed; according to the current set destination content of the blind user, the system provides the blind user with an optimal route which can pass through the destination and can reach preset safe positioning, and in the process that the blind user moves in the optimal route, a scanner preset by the intelligent watch is applied to scan environment information data sets in the front road condition conical range of the blind user, and meanwhile, whether the environment information data sets are continuously updated in preset time length is judged so as to execute corresponding different steps; for example, when the system determines that the environmental information data sets can be continuously updated within a preset time period, that is, the user is still in a moving state, the intelligent watch continuously collects the environmental information data sets of the road section ahead, and therefore the environmental information data sets are continuously updated; for example, when the system determines that the environmental information data sets cannot be continuously updated within a preset duration, that is, the environmental information data sets of the front road section, which indicate that the user is in a stop moving state, are all the same picture, the system reads corresponding contents in the environmental information data sets, the corresponding contents include relative distances between the blind user and each obstacle in the current environment, iterative updating is performed on the optimal route of the current blind user according to the corresponding contents, after the iteratively updated contents are converted into corresponding voice contents, the corresponding voice contents are broadcasted in the current environment through a preset voice generating device, and if the corresponding contents are: scanning the traffic light column within one hundred meters in front of the traffic light column, and taking notice of detour; if the corresponding content is that the movable vehicle is found by scanning in the left front two hundred meters, please pay attention to avoidance.

In this embodiment, the step S2 of monitoring the finger transformation data of the user by using a preset sensing device, inputting the finger transformation data into a preset neural network distributor for performing action recognition, and collecting the finger movement gesture of the user includes:

s21: acquiring fluctuation data corresponding to each finger of the user through the sensing equipment, inputting the fluctuation data into a preset prediction model, and reading the finger action of the user, wherein the fluctuation data specifically comprises the fitting distance between the finger and the palm;

s22: and generating presentation probability of the finger action through the prediction model, providing corresponding instruction selection for the user based on priority distribution of the presentation probability, respectively generating execution content corresponding to the instruction selection into a preset tactile braille keyboard, and reading instructions selected by the user based on the touch.

In this embodiment, the system acquires, through the sensing device, fluctuation data generated correspondingly when five fingers of the user interact, inputs the fluctuation data into a preset prediction model, generates at least one finger action when the five fingers of the blind user interact through the prediction model, distributes the presentation probability as a priority to the user according to the presentation probability of the finger actions provided by the prediction model, provides instruction selection with highest presentation probability, and generates execution content corresponding to the instruction selection into the tactile braille keyboard for the user to select and confirm a corresponding instruction; for example, the sensing device monitors that the thumb and the index finger of the blind user have fluctuation data, and other fingers have no fluctuation data, at this time, the predicted finger actions of the prediction model only show related finger actions of the thumb and the index finger, such as "OK", i.e. the thumb and the index finger form a circle, and the other three fingers are straightened, such as "five fingers are gathered", i.e. the thumb and the index finger are gathered, and the other three fingers are straightened, i.e. the prediction model generates the two finger actions for the user to select, and the priority determining process of the two finger actions is as follows: collecting the joint distances between the thumb and the index finger of the blind person and the palm to be 56% and 94%, and simultaneously obtaining the joint distances between the thumb and the index finger and the palm in the two finger actions, wherein the joint distances between the thumb and the index finger and the palm are 50% and 90% corresponding to OK, and the joint distances between the thumb and the index finger and the palm are 5% and 5% corresponding to five-finger convergence, so that the priority of the two finger actions is judged to be OK as the preference, and the five-finger convergence is selected as the secondary choice; after the system defines the priority finger actions, defining the preferred finger actions at the first position of the touch braille keyboard, defining the next finger actions at the second position of the touch braille keyboard, and sequentially sequencing for the blind users to select and execute corresponding auxiliary contents; for example, the instruction corresponding to ok is a help call, when the blind user swings out the finger action of ok, the intelligent watch can broadcast help seeking information to the environment through the voice generating device so as to request help to surrounding passers-by; for example, the instruction corresponding to the five-finger closing is stop, when the blind user swings out the finger action of the five-finger closing, the intelligent watch stops all the current auxiliary functions at the moment, and the system is reset to allow the blind user to give the auxiliary instruction again.

In this embodiment, according to the destination content set by the user, the step S3 of providing the user with an optimal route to the destination and eventually able to reach the preset location includes:

s31: acquiring a destination keyword input by a user through a touch braille keyboard, identifying a destination corresponding to the destination keyword in a preset range according to the current coordinate positioning of the user, acquiring the shortest distance between the current coordinate positioning of the user and the preset positioning based on the preset positioning as a base point coordinate, and defining and selecting available vehicles in the shortest distance, wherein the preset range is specifically identified in a fixed distance from the current coordinate positioning of the user to the periphery;

s32: generating at least one route and an optimal route for the user as a function of the destination, the shortest distance and the available vehicles, wherein the at least one route and the optimal route are ordered, in particular with a safety factor as a priority.

In this embodiment, the system identifies a destination corresponding to a destination keyword in a preset range according to a coordinate location where a blind user is currently located by acquiring the destination keyword input by the blind user in a tactile braille keyboard, the preset range is specifically a range threshold value in which the current coordinate location of the blind user is diffused to a fixed distance from the periphery, the shortest distance between the current coordinate location of the blind user and the preset safety location is acquired based on the preset safety location as a base point coordinate, the shortest distance is defined and available vehicles which can be applied by the blind user are selected, and then the system generates at least one route and an optimal route among the routes according to the identified destination, the identified shortest distance and the available vehicles of the blind user, wherein the generated routes are arranged by taking the safety coefficient of the blind user as a priority, and the optimal route is the safest route relative to the blind user; for example, a conventional route requires a blind user to turn to take a bus with two or three different routes to achieve a destination and a preset safe positioning, the commuting time is relatively short, but it is inconvenient for the blind user to take a plurality of different vehicles, and an optimal route recommends the blind user to take a single bus to achieve the destination or a place close to the destination, and then recommends the blind user to complete a subsequent commuting route in a walking manner, so that the blind user is prevented from taking a plurality of different vehicles, and the safety and convenience of the blind user in the commuting process are improved by the optimal route.

In this embodiment, the step S4 of determining that the user stops moving and reading the corresponding content in the environmental information dataset further includes:

s41: transmitting an electromagnetic wave signal by using a preset radar, receiving a radar echo of the electromagnetic wave signal within a preset distance of a user, acquiring echo time length of at least one object according to a scattering direction of the radar echo, and generating surface layer data corresponding to the object;

s42: judging whether the surface layer data accords with pre-recorded information or not;

s43: if so, generating object data corresponding to the surface layer data according to the pre-recorded information, listing the corresponding object as a trusted object according to the object data, generating the object data in a touch braille keyboard based on the current coordinate positioning of the user, and generating a safety coefficient corresponding to the object data, wherein the object data comprises the distance between the object and the user, the relative direction of the object based on the user and the general name of the object.

In this embodiment, the system controls a radar preset in the smart watch, applies the radar to emit electromagnetic wave signals to the periphery, receives radar echoes returned by the electromagnetic wave signals within a preset distance, obtains echo time length of at least one object within the preset distance according to scattering directions of the radar echoes, generates surface layer data of corresponding objects according to the echo time length of different objects, and simultaneously judges whether the surface layer data are consistent with pre-recorded information so as to execute corresponding steps; for example, when the system determines that the surface layer data of a certain object does not accord with the pre-recorded information, the system determines the object as an unknown object, generates the orientation of the unknown object in a braille mode in a touch braille keyboard, and informs that the unknown object is in the orientation of a blind user so as to prompt the blind user to bypass; for example, when the system determines that the surface data of an object can be matched with the pre-recorded information, the system determines the object as a known object, generates corresponding object data of the known object according to the pre-recorded information, generates a relative distance value which needs to be reserved for the known object in a touch braille keyboard of a blind user, and prevents the blind user from carelessly colliding with the known object by informing the blind user through braille and generating a corresponding safety coefficient of the known object, wherein the safety coefficient is determined by the surface data of the known object, the safety coefficient of the corresponding known object correspondingly decreases when the length and the height of the surface data of the known object are larger, and reaches the lowest value when the known object is at the same height as the blind user.

In this embodiment, based on a GPS positioning device preset by the smart watch, the north-bucket system transmits GPS positioning data, receives a wireless signal returned by the beidou system, and cooperates with the wireless signal through a preset electronic compass, so as to obtain a current geographic position of a user, and in step S1, the method further includes:

s11: acquiring movement data in a preset period of a user, generating a movement path of the user in a preset virtual region chart according to the movement data, and acquiring a measurement interval value of the electronic compass according to the movement data, wherein the movement data comprises movement duration of the user and movement rate of the user, and the measurement interval value is specifically earth magnetic field direction change information and intensity change information measured by the electronic compass when the user moves from a previous preset period to a current period;

s12: and generating coordinate transformation information of the user in the virtual region chart based on the moving path and the measurement interval value, feeding back the coordinate transformation information to a touch braille keyboard, inputting the coordinate transformation information into a preset prediction model to obtain a required time length for the user to move from the current geographic position to the preset position, wherein the coordinate transformation information comprises a moving distance between the last preset moment and the current moment and a distance difference between the current geographic position and the preset position of the user.

In this embodiment, the system obtains movement data of the blind user in a preset time period, the movement data includes movement time length of the blind user and movement speed of the blind user, generates a movement path of the blind user in a preset virtual region chart of the smart watch according to the movement data, collects measurement interval values of electronic version in the smart watch according to the movement data of the blind user, the measurement interval values include earth magnetic field direction change information and strength change information measured by the electronic compass when the blind user moves from a certain coordinate to another coordinate, the system generates coordinate transformation information of the blind user in the virtual region chart based on the movement paths and the measurement interval values of the electronic compass, the coordinate transformation information includes a difference between a movement distance of the blind user from a last preset time and a current geographic position of the blind user and a preset positioning distance, and the prediction model generates a time length required by the blind user to move from the current geographic position to the preset safe positioning if the blind user keeps walking to the preset safe position, so that the blind user can provide a reference time length for the blind user.

In this embodiment, after step S4 of reading a preset instruction corresponding to the finger movement gesture and executing auxiliary content corresponding to the instruction, the method further includes:

s201: based on the instruction use times of the user, ordering corresponding instructions of the finger movement gestures by taking the instruction use times as priorities to obtain frequently used instructions, setting the frequently used instructions into a preset shortcut bar, and setting a wake-up mode corresponding to a touch braille keyboard for the frequently used instructions;

s202: based on the short-term use instruction of the user, carrying out secondary sequencing on the short-term use instruction serving as a priority for the corresponding instruction of the finger movement gesture, obtaining a most recently used instruction by the secondary sequencing, inputting the most recently used instruction into a preset shortcut bar, and setting a wake-up mode corresponding to a touch braille keyboard for the most recently used instruction.

In this embodiment, the system orders the corresponding instructions of the finger movement gestures based on the number of instruction uses that the blind user has applied, using the number of instruction uses as a priority, ordering to obtain the finger instructions that the blind user uses most frequently to occasionally use, setting the corresponding instructions of the finger movement gestures in the shortcut bar of the smart watch, and setting corresponding wake-up modes for the corresponding instructions of the finger movement gestures; based on finger instructions recently used by a blind user, the system sorts corresponding instructions of finger movement gestures by taking the most recently used finger instructions as priorities, sorts the finger instructions used by the blind user in the most recent time period until an auxiliary function is started, sets the corresponding instructions of the finger movement gestures in a shortcut bar of the intelligent watch, and sets a corresponding awakening mode for the corresponding instructions of the finger movement gestures, wherein the shortcut bar comprises: the left side column key and the right side column key of the intelligent watch; the awakening mode comprises the following steps: waking up according to the crown for a long time; the main table disc slides rightwards, and clicks on the icon to wake up; after voice awakening is started, the wrist is lifted, and the screen is lightened for voice awakening.

In this embodiment, after step S4 of iteratively updating the optimal route according to the corresponding content to generate and broadcast the corrected voice content, the method includes:

s401: acquiring auxiliary route information of the user, wherein the auxiliary route information is specifically mobile route information from the user needing assistance to the end of assistance, and the auxiliary route information comprises total mobile duration and total mobile distance;

s402: judging whether the auxiliary route information contains movement data of the vehicles or not;

s403: if so, removing the movement path corresponding to the movement data of the vehicle based on the total path of the auxiliary route information, acquiring the residual movement path of the user, and generating the movement information of the user according to the residual movement path, wherein the movement information comprises the average movement rate of the user and the speed change trend of the user.

In this embodiment, the system determines whether the auxiliary route information further includes movement data for applying the traffic tool to commute by acquiring movement route information of the blind user from the time when the auxiliary function is required to be completed to the end of the auxiliary, including total movement duration of the blind user and total distance of the auxiliary route, so as to execute corresponding steps; for example, when the system determines that the auxiliary route information does not include movement data of traffic means commute, the system obtains an average movement rate of the blind user according to the total distance of the auxiliary route, generates a rate change trend of the blind user according to the movement rate recorded when the auxiliary function is started, and can learn the physical change condition of the blind user according to the rate change trend, so as to provide a first health value which can be referred to for the blind user; for example, when the system determines that the auxiliary route information includes movement data of the traffic tool commute, the system removes a movement path corresponding to the movement data of the traffic tool according to a total distance of the auxiliary route, obtains a remaining movement path of the blind user, generates movement information of the blind user according to the remaining movement path, wherein the movement information includes an average movement rate of the user and a change trend of the speed of the user, and the movement information can also provide a referent second health value for the blind user, but the second health value is not higher than a reference value of a first health value of the non-traffic tool commute, and compared with the first health value, the physical quality of the blind user can be displayed.

Referring to fig. 2, a data processing system for assisting a blind person based on a smart watch according to an embodiment of the present invention includes:

the judging module 10 is configured to transmit GPS positioning data to a north-bucket system based on a GPS positioning device preset by the smart watch, receive a wireless signal returned by the Beidou system, obtain a current geographic position of a user by matching the wireless signal with a preset electronic compass, and judge whether the geographic position is in preset positioning;

the execution module 20 is configured to, if not, monitor finger transformation data of the user using a preset sensing device, input the finger transformation data into a preset neural network distributor for performing action recognition, collect a finger movement gesture of the user, read a preset instruction corresponding to the finger movement gesture, and execute auxiliary content corresponding to the instruction, where the sensing device includes an accelerometer and an acceleration sensor;

a second judging module 30, configured to provide, to the user, an optimal route that goes to a destination and can finally reach the preset location according to the destination content set by the user, collect, by using a preset scanner, at least one environmental information dataset within a cone range in the optimal route, and judge whether the environmental information dataset is updated within a preset duration;

And the second execution module 40 is configured to determine that the user stops moving if the user does not update, read the corresponding content in the environmental information data set, iteratively update the optimal route according to the corresponding content, and generate and broadcast a corrected corresponding voice content, where the corresponding content specifically includes a relative distance between the user and each obstacle.

In this embodiment, the determining module 10 transmits GPS positioning data in the current smart watch to the north-bucket system based on the GPS positioning data recorded in advance, and can learn the current location and orientation of the user by receiving the wireless signal data returned by the beidou system, and the pre-arranged electronic compass positioning module cooperates with the wireless signal data returned by the beidou system to clearly acquire the current geographical position information of the user, and determine whether the geographical position information is in the preset safe positioning or not, so as to execute the corresponding steps; for example, when the system determines that the current geographic location information of the user is in the preset safe location, the system does not provide an auxiliary function for the user at this time, because the user is already in the preset safe location (such as the home of the user, the home of the user friend, etc.), even if the blind user leaves the line of sight of the relatives and friends, irreversible traffic accidents are not easy to occur at this time, because the blind user can set the safe location at the place, at least the environment around the safe location is not strange; for example, when the system determines that the current geographic position information of the user is not in the preset safe positioning, the system defaults to enable an auxiliary function for the user, the execution module 20 firstly monitors finger transformation data of the user by applying a preset sensing device, the sensing device comprises a triaxial accelerometer and inputs the finger transformation data of the user in real time into a preset neural network distributor for finger action recognition, the finger movement gesture of the user is recognized by collecting the finger transformation data, the auxiliary instruction corresponding to the preset auxiliary instruction is read, and the corresponding auxiliary content of the auxiliary instruction is executed, so that the instruction content for assisting the blind user is quickly executed; the second judging module 30 provides the blind user with an optimal route which can pass through the destination and can reach preset safe positioning according to the current set destination content of the blind user, scans the environmental information data sets in the road condition conical range in front of the blind user by applying a scanner preset by the intelligent watch in the process that the blind user moves in the optimal route, and judges whether the environmental information data sets are continuously updated in preset time periods or not so as to execute corresponding different steps; for example, when the system determines that the environmental information data sets can be continuously updated within a preset time period, that is, the user is still in a moving state, the intelligent watch continuously collects the environmental information data sets of the road section ahead, and therefore the environmental information data sets are continuously updated; for example, when the system determines that the environmental information data sets cannot be continuously updated within a preset duration, that is, the environmental information data sets of the front road section, which indicate that the user is in a stop moving state, are all the same picture, the second execution module 40 reads the corresponding content in the environmental information data sets, where the corresponding content includes the relative distance between the blind user and each obstacle in the current environment, and iteratively updates the optimal route of the current blind user according to the corresponding content, and after the iteratively updated content is converted into the corresponding voice content, the voice content is broadcasted in the current environment through a preset voice generating device, where the corresponding content is: scanning the traffic light column within one hundred meters in front of the traffic light column, and taking notice of detour; if the corresponding content is that the movable vehicle is found by scanning in the left front two hundred meters, please pay attention to avoidance.

In this embodiment, the execution module further includes:

In this embodiment, the second judging module further includes:

In this embodiment, the second execution module further includes:

the receiving unit is used for transmitting electromagnetic wave signals by using a preset radar, receiving radar echoes of the electromagnetic wave signals within a preset distance of a user, acquiring echo time length of at least one object according to the scattering direction of the radar echoes, and generating surface layer data corresponding to the object;

the judging unit is used for judging whether the surface layer data are consistent with pre-recorded information or not;

and the execution unit is used for generating object data corresponding to the surface layer data according to the pre-recorded information if the object data is positive, listing the corresponding object as a trusted object according to the object data, generating the object data in a touch braille keyboard based on the current coordinate positioning of the user, and generating a safety coefficient corresponding to the object data, wherein the object data comprises the distance between the object and the user, the relative direction of the object based on the user and the general name of the object.

In this embodiment, the judging module further includes:

the acquisition unit is used for acquiring movement data in a preset period of the user, generating a movement path of the user in a preset virtual region chart according to the movement data, and acquiring a measurement interval value of the electronic compass according to the movement data, wherein the movement data comprises movement duration of the user and movement rate of the user, and the measurement interval value is specifically earth magnetic field direction change information and intensity change information measured by the electronic compass when the user moves from a previous preset period to a current period;

the prediction unit is used for generating coordinate transformation information of the user in the virtual region chart based on the moving path and the measurement interval value, feeding the coordinate transformation information back to a touch braille keyboard, inputting the coordinate transformation information into a preset prediction model, and obtaining a required time length for the user to move from the current geographic position to the preset position, wherein the coordinate transformation information comprises a moving distance between the last preset time and the current time and a distance difference between the current geographic position of the user and the preset position.

In this embodiment, further comprising:

the ordering module is used for ordering the corresponding instructions of the finger movement gestures by taking the instruction use times as priorities based on the instruction use times of the user, ordering the instructions to obtain frequently used instructions, setting the frequently used instructions into a preset shortcut bar, and setting a wake-up mode corresponding to a touch braille keyboard for the frequently used instructions;

and the second sorting module is used for carrying out secondary sorting on the corresponding instruction of the finger movement gesture by taking the short-term use instruction as a priority based on the short-term use instruction of the user, obtaining a most recently used instruction by the secondary sorting, inputting the most recently used instruction into a preset shortcut bar, and setting a wake-up mode corresponding to the tactile braille keyboard for the most recently used instruction.

In this embodiment, further comprising:

the system comprises an acquisition module, a storage module and a control module, wherein the acquisition module is used for acquiring auxiliary route information of the user, the auxiliary route information is specifically mobile route information which is needed to be assisted to the end of assistance by the user, and the auxiliary route information comprises total mobile duration and total mobile distance;

a third judging module, configured to judge whether the auxiliary route information includes movement data of a vehicle;

and the third execution module is used for removing the movement path corresponding to the movement data of the vehicle based on the total path of the auxiliary path information if yes, acquiring the residual movement path of the user, and generating the movement information of the user according to the residual movement path, wherein the movement information comprises the average movement rate of the user and the speed change trend of the user.

Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims

1. The data processing method for assisting the blind based on the intelligent watch is characterized by comprising the following steps of:

2. The method for processing data based on the intelligent watch for assisting the blind person according to claim 1, wherein the step of applying a preset sensing device to monitor finger transformation data of the user, inputting the finger transformation data into a preset neural network distributor for motion recognition and collecting finger motion gestures of the user comprises the following steps:

3. A data processing method for assisting a blind person based on a smart watch according to claim 1, wherein the step of providing the user with an optimal route to a destination and finally to the preset location according to the destination content set by the user comprises:

4. The method for assisting a blind person in data processing based on a smart watch according to claim 1, wherein the step of determining that the user stops moving and reading the corresponding content in the environmental information dataset further comprises:

5. The method for assisting the blind person in data processing based on the intelligent watch according to claim 1, wherein the step of acquiring the current geographic position of the user by matching the wireless signal with the preset electronic compass by transmitting GPS positioning data to the north bucket system and receiving the wireless signal returned by the Beidou system through the GPS positioning device preset on the intelligent watch further comprises:

6. The method for processing data based on the intelligent watch for assisting the blind according to claim 1, wherein the step of reading the instruction corresponding to the finger movement gesture and executing the assisting content corresponding to the instruction further comprises:

7. The data processing method for assisting the blind person based on the smart watch according to claim 1, wherein after the step of iteratively updating the optimal route according to the corresponding content to generate and broadcast the corrected voice content, the method comprises the steps of:

8. Data processing system based on supplementary blind person of intelligent wrist-watch, characterized by, include:

9. The data processing system for assisting a blind person based on a smart watch according to claim 8, wherein the execution module further comprises:

10. The data processing system for assisting a blind person based on a smart watch according to claim 8, wherein the second judging module further comprises: