CN113507564A - Blind person camera identification auxiliary system - Google Patents
Blind person camera identification auxiliary system Download PDFInfo
- Publication number
- CN113507564A CN113507564A CN202110781187.3A CN202110781187A CN113507564A CN 113507564 A CN113507564 A CN 113507564A CN 202110781187 A CN202110781187 A CN 202110781187A CN 113507564 A CN113507564 A CN 113507564A
- Authority
- CN
- China
- Prior art keywords
- user
- electronic equipment
- identification
- recovery
- limiting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a blind camera identification auxiliary system, which comprises an identification device, a voice prompt device for reminding based on the identification device, a feedback device, a collection device, a calibration device and a processor, wherein the feedback device is used for acquiring a blind image; the recognition device recognizes the object by the face orientation direction of the user; the voice prompt device carries out voice recognition on the user based on the recognition device; the feedback device is used for identifying the data of the electronic equipment and feeding back the layout of the electronic equipment; the acquisition device is used for acquiring the control operation of a user; the calibration device is used for calibrating or adjusting the posture of a user. After the offset of the electronic equipment is determined, when the distances between the electronic screen and the face of the user in all directions are within the set threshold distance or threshold angle, the electronic screen is set to be the optimal shooting angle, and at the moment, the optimal shooting angle can be obtained, and the user triggers the shooting control signal to take a picture.
Description
Technical Field
The invention relates to the technical field of mobile terminals, in particular to a blind person camera identification auxiliary system.
Background
The traditional blind auxiliary tool such as a blind walking stick needs to be moved repeatedly by the blind to know the situation in front of the face, and is time-consuming and labor-consuming. Meanwhile, the electronic equipment and the like cannot be assisted, and great trouble is caused to the blind.
The prior art of CN106203390B discloses an intelligent blind-person assisting system, which is based on the laser radar technology, and has the advantages of high assisting cost, low sampling rate, sensitivity to dust, haze and rainwater, and incapability of acquiring color and texture information. The auxiliary resolution based on the millimeter wave radar is low, and the signal processing process is difficult. The thermal imaging technology-based auxiliary resolution is low, the calibration process is complex, and only human, animal and other heating objects can be detected. The GPS has low assist accuracy, causes signal loss, cannot be used indoors, and cannot acquire local dynamic obstacle information. Meanwhile, the assistance based on the laser speckle coding technique fails outdoors because the actively projected structured light is submerged by sunlight, and thus the coded speckles cannot be identified. Due to the power limitation, the laser speckle coding technology has the farthest distance, and an object beyond the farthest distance cannot measure the distance. After a lot of searches, the existing prior art such as KR101148664B1, EP2414336B1 and US08743816B1 is found, and the traditional interaction method for assisting the blind mainly comprises voice prompt and tactile vibration. Voice prompts generally broadcast the distance and direction of obstacles, require a certain time to play, cause delay and accident risks, and have small transmittable information amount. The touch vibration is realized by taking a vibration waistband or a vibration vest as hardware and promoting the direction of an obstacle through vibration, and the vibration device can solve the problem of delay, but brings burden to the blind, and the wearing feeling of different people is different.
The invention aims to solve the problems that electronic equipment cannot be used, the intelligence degree is low, the posture cannot be adjusted, an interaction device is lack, the electronic equipment is extremely easy to be influenced by an external environment, the recognition precision is low and the like in the field.
Disclosure of Invention
The invention aims to provide a blind person camera identification auxiliary system aiming at the defects of the current blind person camera identification.
In order to overcome the defects of the prior art, the invention adopts the following technical scheme:
a blind camera identification auxiliary system comprises an identification device and a voice prompt device for reminding based on the identification device, and comprises a feedback device and a voice prompt device for prompting based on the identification deviceThe device comprises a collection device, a calibration device and a processor, wherein the identification device identifies the face orientation direction of a user to perform object identification; the voice prompt device carries out voice recognition on the user based on the recognition device; the feedback device is used for identifying the data of the electronic equipment and feeding back the layout of the electronic equipment; the acquisition device is used for acquiring the control operation of the user; the calibration device is used for calibrating or adjusting the posture of the user; the feedback device comprises a feedback mechanism, a storage mechanism, an adjusting mechanism and a data storage module, wherein the feedback mechanism is used for feeding back an input instruction of the acquisition device and triggering the electronic equipment to execute corresponding actions; the storage mechanism is used for placing the electronic equipment; the adjusting mechanism adjusts the storage capacity of the storage mechanism based on the size of the electronic equipment; the data storage module is used for identifying the electronic equipment and acquiring the layout of the electronic equipment; the adjusting mechanism comprises a group of recovery components, clamping components, a storage cavity, a supporting plate, a clamping plate and limiting plates, wherein the clamping plate and the limiting plates are respectively and symmetrically arranged on the left side, the right side, the upper side and the lower side of the supporting plate and surround to form the storage cavity for storing the recovery components and the limiting components, and the group of recovery components are used for adjusting the clamping plates on the left side and the right side of the supporting plate; the limiting component adjusts limiting components on the upper side and the lower side; the identification device detects that the distance between the user and the electronic equipment is DabAccording to the bias value function l (x), there are:
L(x)＝Dab sin Δα
wherein, DeltaαIs a value of the deviation angle, the value being in accordance withα＝αap-αam，αap＝αAPP+β，αamIs a reference position value; alpha is alphaAPPThe current deviation angle value of the electronic equipment is obtained; beta is a correction parameter and has a value range of [25 degrees, 90 degrees ]]。
Optionally, the collecting device includes a collecting mechanism and a response mechanism, and the collecting mechanism is configured to collect the input instruction of the user; the response mechanism is activated based on a layout of the data storage module; the acquisition mechanism comprises a contact plate, a connection module and a control module, wherein the contact plate is arranged on the outer wall of the clamping piece, and the contact plate inputs a control signal through a contact instruction of the hand of the user; the connection module is used for establishing and controlling a link for the control signal; and the control module controls the corresponding program based on the control input response of the connection module.
Optionally, the calibration device includes a calibration mechanism, an alignment mechanism and a fixing mechanism, the fixing mechanism is used for supporting the calibration mechanism and the calibration mechanism, and the calibration mechanism is used for calibrating the posture of the user; the alignment mechanism is used for aligning and indicating the objects in the identification range; the calibration mechanism comprises a plurality of calibration sensors, a motion detection component and a rotation indication module, each calibration sensor is used for detecting the direction of the head of the user, and the motion detection component is used for detecting the adjustment amplitude of the body of the user; the rotation indicating module is used for broadcasting the posture adjusting direction and the adjusting amount to the user.
Optionally, the recovery member includes a recovery rod, a recovery driving mechanism, a recovery detecting element and a supporting seat, and the supporting seat is disposed at an end of the recovery rod and supports the recovery rod; the recovery driving mechanism is arranged at the end part of the recovery rod and is in driving connection with the recovery rod; the recovery detection is further used for detecting the rotation angle of the recovery rod.
Optionally, the limiting member comprises a limiting rod, an extension spring and a movable cavity, one end of the limiting rod is connected with the limiting plate, and the other end of the limiting rod extends out towards one side far away from the limiting plate; one end of the extension spring is connected with the limiting plate, and the other end of the extension spring is connected with the bottom of the movable cavity; the movable cavity and the storage cavity are separated by a partition plate to form two independent cavities.
Optionally, the alignment mechanism includes an alignment member and a rotating member, and the rotating member adjusts a position of the alignment member; the alignment piece is used for limiting the calibration range; the rotating component comprises a poking seat, a limiting rod and a clamping seat, one end of the limiting rod is connected with the rotating seat, the other end of the limiting rod extends out towards one side of the rotating seat and is hinged with the fixing mechanism, and the clamping seat is used for limiting the position of the rotating seat.
Optionally, the identification device includes an identification mechanism, and the identification mechanism is configured to identify the control input of the acquisition device and the output of the control signal; the identification mechanism comprises an identification probe and a memory, and the identification probe is used for guiding the direction of the article or the control signal; the memory is used for storing the identification data of the identification probe.
Optionally, the voice prompt device includes a voice mechanism, and the voice mechanism broadcasts based on the identification data of the identification mechanism; the voice mechanism comprises a group of earplugs, a transmission line and a sensing piece, two ends of the transmission line are respectively connected with the earplugs and the identification mechanism, and the sensing piece is arranged on the earplugs and used for identifying the wearing state of a user.
The beneficial effects obtained by the invention are as follows:
1. the action of the user is detected by adopting the calibration device, and the posture between the electronic equipment and the user is adjusted, so that the accurate control of the electronic equipment is effectively improved;
2. the voice lifting device is matched with the recognition device, the calibration device and the acquisition device, so that the posture of a user can be adjusted, and the posture of the user can be adjusted adaptively;
3. the recovery component and the clamping component are matched with each other, so that the electronic equipment can be clamped, and the stability of the electronic equipment is improved;
4. the control input of a user is collected, the control of the electronic equipment is responded, and the walking convenience of the blind is improved;
5. the response mechanism is adopted to transmit signals collected on the contact plate and data are transmitted through the data transmission module, the calibration device or the recognition device receives the data, the posture is adjusted or the response output of control input is carried out based on the received data signals, and the control operation is input into the electronic equipment, so that the accurate transmission of the data is realized;
6. the angle between the electronic equipment and the face of a user is detected by adopting the matching between the calibration mechanism and the alignment mechanism which are arranged on the wearing glasses; adjusting based on the acquired data to obtain the optimal shooting angle;
7. after the offset of the electronic equipment is determined, the distance between the electronic screen and the face of the user in each direction is within the set threshold distance or threshold angle, and the electronic screen is set to be the optimal shooting angle.
Drawings
The invention will be further understood from the following description in conjunction with the accompanying drawings. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the embodiments. Like reference numerals designate corresponding parts throughout the different views.
FIG. 1 is a schematic control flow diagram of the present invention.
Fig. 2 is a schematic structural diagram of the whole feedback device.
Fig. 3 is a schematic structural view of the recovery member.
Fig. 4 is an enlarged schematic view of a portion a of fig. 3.
Fig. 5 is a schematic structural view of the snap member.
Fig. 6 is a schematic partial cross-sectional view of the feedback device and an electronic device.
Fig. 7 is a schematic structural view of the wearable glasses.
Fig. 8 is a detailed view at B in fig. 7.
Fig. 9 is a schematic cross-sectional view of the alignment mechanism.
Fig. 10 is a schematic view of an application scenario of the present invention.
Fig. 11 is a schematic diagram of an overall functional module.
Fig. 12 is a schematic diagram of an intelligent photographing process.
Fig. 13 is a flow chart illustrating an emergency alert function.
The reference numbers illustrate: 1-a clamping and connecting plate; 2-a limiting plate; 3-a restraining projection; 4-a movable groove; 5-extension spring; 6-a restraining bar; 7-a movable cavity; 8-a separation plate; 9-a limiting groove; 10-rib plate; 11-a deformation strip; 12-a recovery drive mechanism; 13-a support base; 14-a recovery rod; 15-an electronic device; 16-a contact plate; 17-a feedback device; 18-an alignment mechanism; 19-wearing glasses; 20-an earplug; 21-a sensing member; 22-the user; 23-a fixed cavity; 24-rotating rods; 25-a support table; 26-a restraining bar; 27-a return spring; 28-a card seat; 29-a transmission line; 30-an electronic device; 31-dial seat.
Detailed Description
In order to make the objects and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the following embodiments; it should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. Other systems, methods, and/or features of the present embodiments will become apparent to one with skill in the art upon examination of the following detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the accompanying claims. Additional features of the disclosed embodiments are described in, and will be apparent from, the detailed description that follows.
The same or similar reference numerals in the drawings of the embodiments of the present invention correspond to the same or similar components; in the description of the present invention, it should be understood that if there is an orientation or positional relationship indicated by the terms "upper" and "lower" and "left" and "right" etc., it is only for convenience of description and simplification of the description, but not to indicate or imply that the device or component referred to must have a specific orientation.
The first embodiment is as follows: with reference to fig. 1-13, a blind person camera recognition auxiliary system is provided, which comprises a recognition device and a voice prompt device for reminding based on the recognition device, and further comprises a feedback device, a collection device, a calibration device and a processor, wherein the recognition device recognizes an object in the face orientation direction of a user; the voice prompt device carries out voice recognition on the user based on the recognition device; the feedback device is used for identifying the data of the electronic equipment and feeding back the layout of the electronic equipment; the acquisition device is used for acquiring the control operation of the user; the calibration device is used for calibrating or adjusting the posture of the user; the processor is respectively in control connection with the recognition device, the voice prompt device, the feedback device, the acquisition device and the calibration device, and can efficiently work on each device under the centralized control operation based on the processor and perform auxiliary operation on a user; the recognition device and the voice prompt device are matched with each other, so that the operation of a user can be recognized and broadcasted; in the present embodiment, the user includes a blind person or a visually impaired person or the like; the feedback device is matched with the acquisition device, so that the control operation of the user can be acquired, and the acquired control operation is used for controlling the electronic equipment; the calibration device is matched with the feedback device to adjust the posture of the user, so that the user can accurately control the posture in the using process; in addition, the calibration device also detects the action of the user, adjusts the posture between the electronic equipment and the user, and effectively improves the accurate control on the electronic equipment; the voice lifting device is matched with the recognition device, the calibration device and the acquisition device, so that the posture of the user can be adjusted adaptively while the posture of the user is adjusted.
The feedback device comprises a feedback mechanism, a storage mechanism, an adjusting mechanism and a data storage module, wherein the feedback mechanism is used for feeding back an input instruction of the acquisition device and triggering the electronic equipment to execute corresponding actions; the storage mechanism is used for placing the electronic equipment; the adjusting mechanism adjusts the storage capacity of the storage mechanism based on the size of the electronic device; the data storage module is used for identifying the electronic equipment and acquiring the layout of the electronic equipment; the adjusting mechanism comprises a group of recovery components, clamping components, a storage cavity, a supporting plate, a clamping plate and limiting plates, wherein the clamping plate and the limiting plates are respectively symmetrically arranged on the left side, the right side, the upper side and the lower side of the supporting plate and surround to form the storage cavity for storing the recovery components and the limiting components, and the group of recovery components are used for adjusting the clamping plates on the left side and the right side of the supporting plate; the limiting member adjusts the limiting members on the upper side and the lower side.
The storage mechanism comprises an equipment cavity and a clamping cavity, and the adjusting mechanism is arranged in the equipment cavity and is specifically arranged on one side of the supporting plate. The clamping cavity is used for storing the electronic equipment, the electronic equipment is placed in the clamping cavity, and the electronic equipment in the clamping range is clamped through the adjusting mechanism; the electronic equipment is placed in the clamping cavity, and various electronic equipment is sensed through the identification operation of the data storage module; retrieve the component with the joint component is mutually supported, carries out the centre gripping to electronic equipment's week side, realizes that electronic equipment can be by stable centre gripping, promotes electronic equipment's stability. In addition, the data storage module comprises an induction board and a database, wherein the induction board is used for inducing a clamping signal of the electronic equipment, so that the feedback mechanism can perform induction operation based on the signal of the induction board; the induction board is also connected with the database and used for carrying out induction identification on the electronic equipment, so that the feedback mechanism can identify the position of a key of the electronic equipment based on the model of the electronic equipment, and the identification effect on the electronic equipment is further improved; the induction plate is arranged on one side, facing the electronic equipment, of the limiting plate and the clamping plate and induces the electronic equipment in the detection process.
Optionally, the recovery member includes a recovery rod, a recovery driving mechanism, a recovery detecting element and a supporting seat, and the supporting seat is disposed at an end of the recovery rod and supports the recovery rod; the recovery driving mechanism is arranged at the end part of the recovery rod and is in driving connection with the recovery rod; the recovery detection piece is used for detecting the rotation angle of the recovery rod; in addition, the supporting seat supports the recovery rod, and the recovery rod rotates along the axis of the recovery rod under the limiting support of the supporting seat in the driving direction of the recovery driving mechanism; in addition, a flexible deformation strip is arranged on one side, close to the recovery rod, of the clamping plate, one end of the deformation strip is connected with the rod body of the recovery rod, and the other end of the deformation strip is connected with the clamping plate; the recovery rod winds the deformation strip around the rod body of the recovery rod under the driving operation of the recovery driving mechanism to realize the clamping of the electronic equipment; in addition, during the winding process of the deformation strip, a travel switch is arranged on a moving path and is used for detecting the maximum limit and the minimum limit of the movement of the deformation strip.
The adjusting mechanism further comprises a partition plate, and the partition plate is used for dividing the limiting member and the recovery member, so that two areas are formed in the clamping cavity, and the limiting member and the recovery member can not affect each other; the partition plate is disposed in the storage chamber and partitions the holding chamber to form two independent cavities capable of accommodating the recovery member and the restriction member, respectively.
The clamping plate is provided with a group of rib plates, one side of the isolation plate is provided with a limiting groove for limiting the group of rib plates, and the rib plates are matched with the limiting groove; meanwhile, the clamping plate can move along a set direction in the moving process through the matching of the rib plate and the deformation strip, and the clamping plate is prevented from shifting or shifting in the moving process.
The clamping plate with the limiting plate is kept away from one side of the recovery component with the clamping component sets up a clamping circular arc, the clamping circular arc faces towards the clamping plate or one side of the limiting plate protrudes to form an equipment cavity, and the equipment cavity is used for clamping the electronic equipment, so that the electronic equipment can be fixed in the equipment cavity.
Optionally, the limiting member comprises a limiting rod, an extension spring and a movable cavity, one end of the limiting rod is connected with the limiting plate, and the other end of the limiting rod extends out towards one side far away from the limiting plate; one end of the extension spring is connected with the limiting plate, and the other end of the extension spring is connected with the bottom of the movable cavity; the movable cavity and the storage cavity are separated by a partition plate to form two independent cavities; the storage cavity is divided into two cavities by the partition plate, and the cavity for storing the limiting component and allowing the limiting rod and the extension spring to move is set as a movable cavity which can ensure that the limiting rod and the extension spring can not be influenced by a recovery component in the action process; the limiting rod faces to a direction perpendicular to a moving path of the deformation strip, so that the clamping plate and the limiting plate can clamp the electronic device; a limiting groove for limiting the limiting rod is formed in the body of one side, facing the movable cavity, of the isolation plate, the limiting groove is used for limiting the limiting rod, a sliding wheel is arranged at the end part, connected with the limiting groove in a limiting and clamping mode, of one end of the limiting rod, the other end of the limiting rod is connected with the plate body of the limiting plate, the sliding wheel slides along the direction of the limiting groove under the action of the extension spring, and the limiting rod is prevented from not deviating in the moving process; the limiting plates are respectively connected with a group of limiting rods, are symmetrically distributed, and are used for clamping the upper side and the lower side of the electronic equipment, so that the clamping stability of the electronic equipment is effectively improved.
The clamping and connecting plate is provided with a group of limiting bulges, the other side of the isolation plate is provided with a movable groove for limiting the group of limiting bulges, and the limiting bulges are matched with the movable groove; meanwhile, the limiting plate can move along a set direction in the moving process through the matching of the limiting protrusion and the limiting rod, and the clamping plate is prevented from shifting or displacing in the moving process; one end of the limiting bulge is connected with the clamping plate, and the other end of the limiting bulge extends out towards the other side of the clamping plate and is in limiting clamping connection with the movable groove.
An upright rod is arranged on one side of the isolation plate, the upright rod is constructed to be in limiting clamping connection with one end of the extension spring, and the other end of the extension spring is in limiting clamping connection with a plate body of the limiting plate, so that the limiting plate can be used for stably clamping the electronic equipment under the action of the extension spring; the restricting groove is parallel to the direction of the movable groove and perpendicular to the recovery direction of the deformed strip of the recovery member.
The limiting plate is flush with the clamping plate, and the positions of the recovery component and the clamping component are adjusted;
optionally, the identification device includes an identification mechanism, and the identification mechanism is configured to identify the control signal input and the control signal output of the acquisition device; the identification mechanism comprises an identification probe and a memory, and the identification probe is used for guiding the direction of the article or the control signal; the memory is used for storing the identification data of the identification probe; the identification device detects that the distance between the user and the electronic equipment is DabAccording to the deflection value function l (x), there are:
L(x)＝Dab sin Δα
wherein, DeltaαIs a value of the deviation angle, the value being in accordance withα＝αap-αam，αap＝αAPP+β，αamIs a reference position value; alpha is alphaAPPThe current deviation angle value of the electronic equipment is obtained; beta is a correction parameter and has a value range of [25 degrees, 90 degrees ]]；
The recognition probe detects the posture of the electronic equipment, so that the angle between the user and the electronic equipment can be in the optimal shooting angle; the identification device is matched with the calibration device, so that the distance between the electronic equipment and the face of the user can be detected; in addition, the distance detection of the electronic equipment and the calibration device is carried out through a distance sensor arranged on the clamping plate or the limiting plate and the calibration device; when the identification device and the calibration device are used in a matched manner, the calibration device needs to be respectively paired with the feedback device and the identification device to establish an output link, so that the distance value between the electronic equipment and the user can be detected.
Optionally, the collecting device includes a collecting mechanism and a response mechanism, and the collecting mechanism is configured to collect the input instruction of the user; the response mechanism is activated based on a layout of the data storage module; the acquisition mechanism comprises a contact plate, a connection module and a control module, wherein the contact plate is arranged on the outer wall of the clamping piece, and the contact plate inputs a control signal through a contact instruction of the hand of the user; the connection module is used for establishing and controlling a link for the control signal; the control module controls the corresponding program based on the control input response of the connection module; the acquisition mechanism is arranged on the outer wall of the clamping arc and can be in a touch control type; by collecting the control input of the user, the control of the electronic equipment is responded, and the use convenience of the blind is improved; meanwhile, each control input of the acquisition device can be acquired by the voice prompt device and is reported to the user for use; the contact plate is arranged on the outer wall of the clamping arc and is used for collecting signals of the contact plate through the connection module; the connecting module comprises an activating piece and position marking pieces, each position marking piece marks each position area of the contact plate on each clamping arc, each activating piece is connected with each position marking piece, and when the user activates the contact plate at a specific position according to the requirement of the user; the other positions are set to be in an inactivated state, and the input of the control signal of the user can be input through the activated contact plate; the control module responds to the input of the user based on the state of the control input of the connection module, so that the control operation of the user can start or control the camera function of the electronic equipment; the response mechanism is used for responding to the user and a photographing trigger key of the electronic equipment; the response mechanism comprises a microcontroller and a data transmission module, wherein the microcontroller is used for transmitting signals acquired on the contact plate and transmitting data through the data transmission module, so that the calibration device, the recognition device or the calibration device can receive the data, adjust the posture or output the response of control input based on the received data signals, and input the control operation into the electronic equipment.
Optionally, the calibration device includes a calibration mechanism, an alignment mechanism and a fixing mechanism, the fixing mechanism is used for supporting the calibration mechanism and the calibration mechanism, and the calibration mechanism is used for calibrating the posture of the user; the alignment mechanism is used for aligning and indicating the objects in the identification range; the calibration mechanism comprises a plurality of calibration sensors, a motion detection component and a rotation indication module, each calibration sensor is used for detecting the direction of the head of the user, and the motion detection component is used for detecting the adjustment amplitude of the body of the user; the rotation indicating module is used for broadcasting the posture adjusting direction and the adjusting amount to the user; the calibration device collects the posture of the user, and meanwhile, the electronic equipment is subjected to adaptive adjustment based on the posture of the user to obtain the optimal photographing angle; in addition, the calibration mechanism and the alignment mechanism are both arranged on the fixing mechanism, and the angle between the electronic equipment and the user can be in the optimal position by collecting the head of the user; the fixing mechanism comprises wearable glasses, and the calibrating mechanism and the aligning mechanism are arranged on the wearable glasses.
When the wearable glasses are used, the angle between the electronic equipment and the face of the user is detected through the cooperation between the calibration mechanism and the alignment mechanism; and adjusting based on the acquired data to obtain the optimal shooting angle.
The calibration mechanism further comprises a fixed cavity, and the fixed cavity is used for storing the calibration sensor, the action detection component and the rotation indication module and detecting the rotation angle or the offset of the user; the fixed seats are arranged on two glasses legs of the wearable glasses and are symmetrically arranged on two sides of the glasses; the calibration sensor detects the direction of the head deviation, detects the movement amplitude of the head of the user by the motion detection means, and forms a movement difference by comparing the movement amplitude with an optimum posture or angle, thereby correcting the user's deviation.
Optionally, the alignment mechanism includes an alignment member and a rotating member, and the rotating member adjusts a position of the alignment member; the alignment piece is used for limiting the calibration range; the rotating component comprises a poking seat, a limiting rod and a clamping seat, one end of the limiting rod is connected with the rotating seat, the other end of the limiting rod extends out towards one side of the rotating seat and is hinged with the fixing mechanism, and the clamping seat is used for limiting the position of the rotating seat; the aligning piece enables the rotating piece to perform aligning operation in a set range under the rotation of the rotating component, and meanwhile, the electronic equipment in a visual range is automatically identified by the user or the whole system; the electronic equipment matched with the feedback device can be identified, so that the electronic equipment can be effectively and accurately controlled; the rotating component also comprises a return spring, and the return spring and the limiting rod are mutually nested to form a movable part; a plurality of movable parts are arranged in the toggle seat and limit the position of the rotating component; the inner wall of the clamping seat is provided with a limiting ring, the upper top of the limiting ring is provided with a limiting hole, and the upper top of the limiting ring is provided with a clamping groove for limiting each movable part; each clamping groove is matched with one end part of each movable part, so that each movable part inside can be switched among the clamping grooves in the process that the user dials the dial seat; the toggle seat is internally and correspondingly provided with a supporting platform, and the supporting platform is used for supporting each movable part so as to enable the movable parts to be always in a vertical state; the support table is provided with a through hole for nesting the limiting rod, and the through hole is matched with the circumference of the limiting rod; the rod body of the limiting rod and the clamping bulge are in a cross shape, the reset spring is nested with the limiting rod, one end of the reset spring is clamped with the clamping bulge, and the other end of the reset spring abuts against the supporting table; one end of the movable part is limited with the clamping seat, so that the movable part can limit the position of the alignment member in the rotating process; the rotating component also comprises a rotating rod, one end of the rotating rod is connected with the poking seat, the other end of the rotating rod is in limit clamping connection with the limiting hole of the clamping seat, and each movable seat arranged in the movable seat is supported; in addition, the dwang with stir the coaxial setting of seat.
Optionally, the voice prompt device includes a voice mechanism, and the voice mechanism broadcasts based on the identification data of the identification mechanism; the voice mechanism comprises a group of earplugs, a transmission line and an induction piece, two ends of the transmission line are respectively connected with the earplugs and the identification mechanism, and the induction piece is arranged on the earplugs and used for identifying the wearing state of a user; the voice prompt device respectively receives the data of the recognition device, the feedback device and the calibration device, so that each control input or deflection action of a user can be transmitted through the voice mechanism; the voice mechanism further comprises a communication component, the communication component is used for transmitting the data of the identification device, the feedback device, the calibration device and the processor, and meanwhile, the communication component is used for communicating in a wireless or wired transmission mode to ensure that voice prompts of a group of the earplugs can be received by the user; the user is in the process of wearing the earplug, the data of the user are sensed through the sensing wire, meanwhile, the using state of the user is obtained based on the sensing wire, and if the using of the user is not detected, the user is prompted or displayed in other modes.
Example two: with reference to fig. 1-13, the identification device further includes a calibrator disposed on the wearable glasses or the alignment mechanism for detecting a distance to the electronic device; the calibrators arranged on the wearable glasses are symmetrically arranged on two sides of the glasses, so that the distance to the electronic equipment can be accurately detected, the deviation of the upper frame and the lower frame of the electronic equipment is detected, the posture of the electronic equipment is obtained, and the optimal photographing posture is obtained by adjusting the posture of the electronic equipment or the posture of the face of the user; in addition, distance sensors for position detection of the calibrator are arranged on the frames of the clamping plate and the limiting plate of the feedback device, and when the posture of the electronic equipment needs to be detected, the difference value of the distance between the left frame and the right frame or the difference value of the distance between the upper frame and the lower frame exists for detection, so that the calibrator is effectively ensured to obtain the posture of the electronic equipment;
and establishing virtual moving direction coordinates on the electronic equipment, wherein the moving direction comprises X-Y-Z three dimensions for shifting.
Detecting the coordinate value x of the central position of the electronic equipment by the two paths of identification probes in the process of detecting the electronic equipment1、x2And x 'after migration'1、x'2Of the electronic deviceThe amount of offset is changed to Deltax1＝x'1- x1；Δx2＝x'2-x2Then the average value of the moving distance in the X direction can be
Ideally, the offset amount of the electronic device in the X direction is equal to the product of the offset variation of the electronic device and the lateral width h of the electronic device, that is:
similarly, the principle of the translation of the electronic device along the Y direction is the same as that of the translation along the X direction, and if the electronic device performs the translation along the Y direction, the translation amount along the Y direction can be obtained by the following formula:
wherein v is a longitudinal width of the electronic device; Δ y1And Δ y2The variation of the electronic equipment in the Y direction during the translation motion along the Y direction;
for the confirmation of the offset in the Z direction, if the offset amount of the two symmetrical aligners from the Z direction is θ and the lateral width of the electronic device is h, the translation amount of the electronic device can be obtained according to the following formula:
wherein, l ═ htan θ; for the determination of theta, forming a matrix according to the coordinate combination of detection points arranged on the frame of the electronic equipment, and solving a normal vector according to the matrix, namely determining theta; suppose there is a*＝ (a1，a2，a3，…，aj),j∈k，ajA matrix formed for the coordinates of the individual detection points, so that there are:
θ＝tan-1w*
wherein, w*Is a*And confirming the normal vector corresponding to the plane determined by the matrix and the current detection direction to obtain an offset angle value.
After the offset of the electronic equipment is determined, when the distances between the electronic screen and the face of the user in all directions are within the set threshold distance or threshold angle, the electronic screen is set to be the optimal shooting angle, at the moment, the optimal shooting angle can be obtained, the user triggers a shooting control signal to shoot, and the camera identification auxiliary operation can be completed.
Example three: with reference to fig. 1-13, the device further comprises a voice prompt device, a radio frequency communication module, a central processor, front and rear cameras, and a storage module; the voice prompt device comprises a microphone, a loudspeaker and an emergency alarm; the radio frequency communication module comprises an audio receiver, an audio filter and a signal transmitter; the central processor comprises an instruction receiving module, an audio encoder and an instruction sending module; the front camera and the rear camera comprise camera bodies, main body capturers, ambient light sensors and distance sensors; the output end of the voice prompt device is electrically connected with the input end of the radio frequency communication module; the output end of the radio frequency communication module is electrically connected with the input end of the central processor. The output end of the central processor is electrically connected with the input ends of the front and rear cameras, the output end of the central processor is also electrically connected with the storage module, the output end of the microphone voice acquisition port is electrically connected with the input end of the audio receiver, the output end of the audio receiver is electrically connected with the input end of the audio filter, the output end of the audio filter is electrically connected with the input end of the signal transmitter, the output end of the signal transmitter is electrically connected with the input end of the instruction receiving module, the output end of the instruction receiving module is electrically connected with the input end of the audio encoder, the output end of the audio encoder is electrically connected with the input end of the instruction sending module, the instruction sending module is respectively electrically connected with the input ends of the camera body, the main body catcher, the ambient light sensor and the distance sensor, the front and rear cameras are provided with the ambient light sensor and the distance sensor, after the front camera and the rear camera are started, the ambient light sensor automatically acquires ambient light sources and adjusts the ambient light sources in a self-adaptive mode according to the ambient light sources, and the distance sensor adjusts the focus in a self-adjusting mode according to the size of the main body and the size of the screen and adjusts the focus to the most appropriate focus.
In this embodiment, the specific implementation process of the technical scheme is as follows: firstly, a microphone of electronic equipment is instructed by a common language, a microphone voice acquisition end transmits acquired audio signals to an audio receiver, then a received signal is screened by an audio filter to remove noise, then a signal transmitter transmits the audio signals to a central processor, then an audio encoder decodes and restores encoded multi-channel audio information of the acquired instruction information, then an instruction sending module issues the instruction and starts a camera, the front camera or the rear camera can be selected to be started by voice when the camera is started, an ambient light sensor and a distance sensor are started while the camera is started, the ambient light sensor automatically acquires ambient light sources and adaptively adjusts according to the ambient light sources, and the distance sensor self-adjusts focusing according to the size of a main body and a screen, adjusting to the most suitable focus, then capturing the position of the main body and judging whether the main body is in the best position for shooting the photo frame, if so, sending a shooting instruction through a loudspeaker, if not, sending a voice prompt through the loudspeaker to present the position of the main body and prompt the adjustment, for example, "the main body is positioned on the left side of a screen and can be slightly adjusted to the right", shooting after the adjustment is finished, and then automatically storing the shot photo in a storage module, namely finishing the whole shooting process; such electronic devices include, but are not limited to, the following listed ones: a mobile phone, a smart phone, a tablet or a computer capable of talking, etc.
The audio filter is used for improving the voice definition and increasing S/N, and is formed by combining a high-energy filter capable of filtering frequencies below 300HZ and a low-pass filter capable of filtering frequencies above 3KHZ, the audio filter has a bandwidth of 300 HZ-3 KHZ, in addition, a sound synthesis output signal contains a plurality of higher harmonics, and the higher harmonics can be filtered by combining the high-energy filter and the low-pass filter; this is a well-known technique in the art and is not described in detail;
in this embodiment, the filter performs noise removal by a filtering effect, where the filtering effect means that there are a weak signal and a strong signal at the same time, the frequencies of the two signals are close, the strong signal will raise the hearing threshold of the weak signal, and when the hearing threshold of the weak signal is raised to a certain extent, the weak signal can not be heard by human ears, if A, B two sounds occur at the same time, if the hearing threshold of the a sound is 50dB, the threshold of the a sound is raised to 64 to 68dB, for example, 68dB, because there is another B sound with a different frequency, the value (68 to 50) dB is 18dB, which is called a masking amount, the strong B is declared as a masking sound, and the weak a is declared as a masked sound, and the above-mentioned masking phenomenon indicates that, if there is only the a sound with a sound pressure level of 50dB or more can be transmitted, and the sound below 50dB can not be heard, if there is the B sound at the same time, the B sound has a simultaneous masking effect, so that the sound with the sound pressure level below 68dB cannot be heard, namely the human ears of the A sound between 50dB and 68dB cannot be heard, the sounds are not required to be transmitted, the sounds with the sound pressure level above 68dB cannot be transmitted even if the sounds are transmitted, the noise is removed, and the sound quality effect is improved.
The output end of the emergency alarm is electrically connected with the input end of the central processor, the instruction sending module in the central processor is also electrically connected with the address book storage module, the address book storage module defaults the emergency alarm function as authorization, and the address book in the electronic equipment can be directly called and searched and judged according to voice.
In this embodiment, for example, in case of an emergency, if there is no other person at the user's side who may be very dangerous at the user's side, the user may send an emergency alarm or an emergency contact instruction to the electronic device, the instruction is transmitted to the central processing unit through conversion and decoding, then the central processing unit may directly call the content in the address book and search for the contact person mentioned in the instruction, and after searching for the contact person, the user directly dials the number, if the contact person does not exist, the user may prompt that the contact person does not exist through the speaker, and if the sent instruction is an alarm, the user may directly dial the emergency alarm phone, thereby avoiding an accident caused by the help of no person at the user's side in case of an emergency.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to related descriptions of other embodiments for parts that are not described or recorded in a certain embodiment.
Although the invention has been described above with reference to various embodiments, it should be understood that many changes and modifications may be made without departing from the scope of the invention. That is, the methods, systems, and devices discussed above are examples. Various configurations may omit, substitute, or add various procedures or components as appropriate. For example, in alternative configurations, the methods may be performed in an order different than that described, and/or various components may be added, omitted, and/or combined. Moreover, features described with respect to certain configurations may be combined in various other configurations, as different aspects and elements of the configurations may be combined in a similar manner. Further, elements therein may be updated as technology evolves, i.e., many elements are examples and do not limit the scope of the disclosure or claims.
Specific details are given in the description to provide a thorough understanding of the exemplary configurations including implementations. However, configurations may be practiced without these specific details, for example, well-known circuits, processes, algorithms, structures, and techniques have been shown without unnecessary detail in order to avoid obscuring the configurations. This description provides example configurations only, and does not limit the scope, applicability, or configuration of the claims. Rather, the foregoing description of the configuration will provide those skilled in the art with an enabling description for implementing the described techniques. Various changes may be made in the function and arrangement of elements without departing from the spirit or scope of the disclosure.
In conclusion, it is intended that the foregoing detailed description be regarded as illustrative rather than limiting, and that it be understood that it is illustrative only and that it is not intended to limit the scope of the invention. After reading the description of the invention, the skilled person can make various changes or modifications to the invention, and these equivalent changes and modifications also fall into the scope of the invention defined by the claims.
Claims (8)
1. A blind camera identification auxiliary system comprises an identification device and a voice prompt device for reminding based on the identification device, and is characterized by further comprising a feedback device, a collecting device, a calibrating device and a processor; the recognition device recognizes an object in the direction in which the face of the user faces; the voice prompt device carries out voice recognition on the user based on the recognition device; the feedback device is used for identifying the data of the electronic equipment and feeding back the layout of the electronic equipment; the acquisition device is used for acquiring the control operation of the user; the calibration device is used for calibrating or adjusting the posture of the user; the feedback device comprises a feedback mechanism, a storage mechanism, an adjusting mechanism and a data storage module, wherein the feedback mechanism is used for feeding back an input instruction of the acquisition device and triggering the electronic equipment to execute corresponding actions; the storage mechanism is used for placing the electronic equipment; the adjusting mechanism adjusts the storage capacity of the storage mechanism based on the size of the electronic device; the data storage module is used for identifying the electronic equipment and acquiring the layout of the electronic equipment; the adjusting mechanism comprises a group of recovery components, clamping components, a storage cavity, a supporting plate, a clamping plate and limiting plates, wherein the clamping plate and the limiting plates are respectively symmetrically arranged on the left side, the right side, the upper side and the lower side of the supporting plate and surround to form the storage cavity for storing the recovery components and the limiting components, and the group of recovery components are used for adjusting the clamping plates on the left side and the right side of the supporting plate; the limiting component adjusts limiting components on the upper side and the lower side; the identification device detects that the distance between the user and the electronic equipment is DabAccording to the bias value function l (x), there are:
L(x)＝DabsinΔα
wherein，ΔαIs a value of the deviation angle, the value being in accordance withα＝αap-αam，αap＝αAPP+β，αamIs a reference position value; alpha is alphaAPPThe current deviation angle value of the electronic equipment is obtained; beta is a correction parameter and has a value range of [25 degrees, 90 degrees ]]。
2. The blind person camera identification aid system according to claim 1 wherein the acquisition means comprises an acquisition mechanism for acquiring the input instruction of the user and a response mechanism; the response mechanism is activated based on a layout of the data storage module; the acquisition mechanism comprises a contact plate, a connection module and a control module, wherein the contact plate is arranged on the outer wall of the clamping piece, and the contact plate inputs a control signal through a contact instruction of the hand of the user; the connection module is used for establishing and controlling a link for the control signal; and the control module controls the corresponding program based on the control input response of the connection module.
3. The blind person camera recognition assistance system of claim 2 wherein the calibration means comprises a calibration mechanism, an alignment mechanism and a fixing mechanism, the fixing mechanism supporting the calibration mechanism and the alignment mechanism, the calibration mechanism calibrating the posture of the user; the alignment mechanism is used for aligning and indicating the objects in the identification range; the calibration mechanism comprises a plurality of calibration sensors, a motion detection component and a rotation indication module, wherein each calibration sensor is used for detecting the direction of the head of the user, and the motion detection component is used for detecting the adjustment amplitude of the body of the user; the rotation indicating module is used for broadcasting the posture adjusting direction and the adjusting amount to the user.
4. The blind camera recognition assistance system as claimed in claim 3, wherein one set of the recovery members includes a recovery lever, a recovery driving mechanism, a recovery detecting member, and a support base provided at an end of the recovery lever and supporting the recovery lever; the recovery driving mechanism is arranged at the end part of the recovery rod and is in driving connection with the recovery rod; the recovery detection piece is used for detecting the rotation angle of the recovery rod.
5. The blind camera recognition assistance system as claimed in claim 4, wherein the restricting member includes a restricting lever, an extension spring, and a movable chamber, one end of the restricting lever being connected to a restricting plate, the other end of the restricting lever projecting toward a side away from the restricting plate; one end of the extension spring is connected with the limiting plate, and the other end of the extension spring is connected with the bottom of the movable cavity; the movable cavity and the storage cavity are separated by a partition plate to form two independent cavities.
6. A blind camera recognition assistance system as claimed in claim 5 wherein the alignment mechanism includes an alignment member and a rotating member, the rotating member adjusting the position of the alignment member; the alignment piece is used for limiting the calibration range; the rotating component comprises a poking seat, a limiting rod and a clamping seat, one end of the limiting rod is connected with the rotating seat, the other end of the limiting rod extends out towards one side of the rotating seat and is hinged with the fixing mechanism, and the clamping seat is used for limiting the position of the rotating seat.
7. A blind person camera identification aid system as claimed in claim 6 wherein the identification means includes identification means for identifying the input of the acquisition means and the output of the control signal; the identification mechanism comprises an identification probe and a memory, and the identification probe is used for guiding the direction of the article or the control signal; the memory is used for storing the identification data of the identification probe.
8. The blind person camera recognition assistance system of claim 7 wherein the voice prompting device comprises a voice mechanism that broadcasts based on recognition data of the recognition mechanism; the voice mechanism comprises a group of earplugs, a transmission line and a sensing piece, two ends of the transmission line are respectively connected with the earplugs and the identification mechanism, and the sensing piece is arranged on the earplugs and used for identifying the wearing state of a user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110781187.3A CN113507564B (en) | 2021-07-10 | 2021-07-10 | Blind person's camera discernment auxiliary system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110781187.3A CN113507564B (en) | 2021-07-10 | 2021-07-10 | Blind person's camera discernment auxiliary system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113507564A true CN113507564A (en) | 2021-10-15 |
| CN113507564B CN113507564B (en) | 2022-07-08 |
Family
ID=78012574
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110781187.3A Active CN113507564B (en) | 2021-07-10 | 2021-07-10 | Blind person's camera discernment auxiliary system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113507564B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104737090A (en) * | 2012-06-14 | 2015-06-24 | Zonev有限公司 | Mobile computing device for blind or low-vision users |
| CN104883486A (en) * | 2015-05-28 | 2015-09-02 | 上海应用技术学院 | Blind person camera system |
| CN106845454A (en) * | 2017-02-24 | 2017-06-13 | 张家口浩扬科技有限公司 | The method and its device of a kind of image output feedback |
| CA2937650A1 (en) * | 2016-08-01 | 2018-02-01 | Arash Ak Koozehkananitorbati | A cibleball game device |
| CN112422829A (en) * | 2020-11-19 | 2021-02-26 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for assisting in shooting image |
-
2021
- 2021-07-10 CN CN202110781187.3A patent/CN113507564B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104737090A (en) * | 2012-06-14 | 2015-06-24 | Zonev有限公司 | Mobile computing device for blind or low-vision users |
| CN104883486A (en) * | 2015-05-28 | 2015-09-02 | 上海应用技术学院 | Blind person camera system |
| CA2937650A1 (en) * | 2016-08-01 | 2018-02-01 | Arash Ak Koozehkananitorbati | A cibleball game device |
| CN106845454A (en) * | 2017-02-24 | 2017-06-13 | 张家口浩扬科技有限公司 | The method and its device of a kind of image output feedback |
| CN112422829A (en) * | 2020-11-19 | 2021-02-26 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for assisting in shooting image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113507564B (en) | 2022-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101834674B1 (en) | Method and device for image photographing | |
| WO2021037129A1 (en) | Sound collection method and apparatus | |
| JP6357884B2 (en) | POSITIONING DEVICE AND AUDIO DEVICE | |
| JP2011223549A (en) | Sound output device | |
| CN103970500A (en) | Method and device for displaying picture | |
| JP2006270274A (en) | Object recognition apparatus and method | |
| US20200322540A1 (en) | Image capturing apparatus, control method, and recording medium | |
| CN111970625A (en) | Recording method and device, terminal and storage medium | |
| EP1257146B1 (en) | Method and system of sound processing | |
| US11950087B2 (en) | Audio signal processing method, electronic apparatus, and storage medium | |
| JP2019159193A (en) | Behavior support device for visually impaired person | |
| CN113507564B (en) | Blind person's camera discernment auxiliary system | |
| JPH08221081A (en) | Sound transmission device | |
| US20180176450A1 (en) | Image processing device | |
| US10225670B2 (en) | Method for operating a hearing system as well as a hearing system | |
| US11902754B2 (en) | Audio processing method, apparatus, electronic device and storage medium | |
| CN114390426A (en) | Volume calibration method and device | |
| CN104811619B (en) | Image-forming correction method and device, electronic equipment | |
| US20200412927A1 (en) | Miniature camera device for stabilized video | |
| US20190327555A1 (en) | Audio pickup and play circuit and system, and method for switching audio pickup and play | |
| EP4132014A1 (en) | Audio signal processing method, electronic apparatus, and storage medium | |
| JP2011114720A (en) | Intercom system with external abnormality detection function | |
| JP2023514462A (en) | Hearing aid system that can be integrated into the spectacle frame | |
| CN115015838B (en) | Positioning method and sound source positioning system | |
| EP4297398A1 (en) | Video recording method and electronic devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |