CN113596303B - Visual auxiliary device and method - Google Patents

Visual auxiliary device and method Download PDF

Info

Publication number
CN113596303B
CN113596303B CN202110846765.7A CN202110846765A CN113596303B CN 113596303 B CN113596303 B CN 113596303B CN 202110846765 A CN202110846765 A CN 202110846765A CN 113596303 B CN113596303 B CN 113596303B
Authority
CN
China
Prior art keywords
equipment
ball type
rolling ball
shooting
type camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110846765.7A
Other languages
Chinese (zh)
Other versions
CN113596303A (en
Inventor
杨涛
田娜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Normal University
Original Assignee
Jiangxi Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Normal University filed Critical Jiangxi Normal University
Priority to CN202110846765.7A priority Critical patent/CN113596303B/en
Publication of CN113596303A publication Critical patent/CN113596303A/en
Application granted granted Critical
Publication of CN113596303B publication Critical patent/CN113596303B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/51Housings
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/56Accessories
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes

Abstract

The invention relates to the technical field of visual assistance, and discloses a visual assistance device and a visual assistance method, wherein the visual assistance device comprises the following steps: ball formula collection equipment, image processing equipment and display device of making a video recording, wherein, ball formula collection equipment of making a video recording includes: the invention provides a visual auxiliary device, which mainly comprises a shell, a camera and an adjusting mechanism, wherein the shell is made of transparent materials, the appearance is spherical, the camera is arranged in the shell, the adjusting mechanism is connected onto the camera, image processing equipment comprises a first processing module, the first processing module is used for receiving image information transmitted by the camera and processing the image information and then sending the image information to display equipment, the display equipment comprises a wearing piece and a second processing module, and a key for setting a camera shooting angle and a shooting area is arranged on the wearing piece.

Description

Vision auxiliary device and method
Technical Field
The invention relates to the technical field of vision assistance, in particular to a vision assistance device and a vision assistance method.
Background
Vision is an important way for human perception and understanding of the world, however, due to the limitations of the human physiological system and nervous system, even people with excellent health status cannot achieve the required visual information acquisition in many delicate fields, which requires certain equipment or technical assistance. Visual aids are not exactly equivalent to "artificial vision", which refers to the simulation and implementation of human visual system functions by wearable or implantable visual electronic devices and systems, whereas the former is the enhancement and enhancement of visual observation systems by technical means and "artificial vision" is actually a visual aid.
At present, the vision assistance technology is a system implanted in a human body, and also has non-implanted high-tech assistance devices, i.e., "eyes in the eyes" and "touch helmet", and other technical products, often adopt a traditional complementary metal oxide semiconductor or charge coupled device image sensor, so as to be connected with a digital system executing a machine vision algorithm, thereby realizing an artificial vision function. With the application of the latest small chip technology, optical technology, photoelectric conversion material array technology, transparent brain shell technology and other technologies, the vision assistance technology has great development potential in the fields of medical treatment, emergency rescue, military, scientific research, entertainment and the like.
For observation of a non-direct-view field, visual auxiliary equipment is often required to form acquisition of continuous images of the required field, such as multi-mirror refraction, camera monitoring acquisition and the like, and generally, light and image projection or image acquisition equipment is set in advance in a preset field or special equipment is required to adjust in real time. However, for a particularly urgent scene or a complex and variable scene, the traditional method is difficult to meet the actual requirements.
Disclosure of Invention
The invention provides a visual auxiliary device and a method, and mainly provides the visual auxiliary device which can be used for observation of a 'desired field of view' in a space where a main body is inconvenient to observe, and can freely and conveniently realize the acquisition of a visual image of the 'desired field of view'.
The present invention provides a visual aid device comprising:
ball formula collection equipment, image processing equipment and display device of making a video recording, wherein, ball formula collection equipment of making a video recording includes:
the shell is made of transparent materials and is spherical;
the camera is arranged in the shell;
the adjusting mechanism is connected to the camera and used for adjusting the angles of the camera in the vertical direction and the horizontal direction;
the image processing equipment comprises a first processing module, a second processing module and a display device, wherein the first processing module is used for receiving the image information transmitted by the camera, processing the image information and then sending the processed image information to the display device;
the imaging equipment comprises a wearing piece and a second processing module, wherein a key used for setting a camera shooting angle and a shooting area is arranged on the wearing piece, the second processing module is used for transmitting the shooting angle and the shooting area information to the adjusting mechanism, receiving the image information processed by the first processing module in real time, and imaging the processed image information through the wearing piece.
Optionally, the housing further comprises:
the device comprises two support rings, a driving piece and a plurality of distance measuring sensors, wherein the two support rings are detachably fixed in a cross shape in a shell, the distance measuring sensors are uniformly distributed on the support rings and used for detecting the distance from each distance measuring sensor to an obstacle, batteries are fixed at the cross parts of the support rings, the bottom of the support ring below the batteries is connected with a plurality of rolling wheels through the driving piece, and the lower ends of the rolling wheels extend out of the shell so as to enable the rolling wheels to rotate;
the angular velocity sensor is fixed on the battery and used for detecting the angular velocity of the rotation of the shell;
and the communication module is arranged on the battery and used for transmitting the data detected by the distance measuring sensor and the angular velocity sensor to the second processing module and transmitting the image information shot by the camera to the first processing module.
Optionally, the adjusting mechanism includes:
the lower end of the steady shooting device is connected with a first rotating mechanism, the first rotating mechanism is fixed on the battery, the upper end of the steady shooting device is fixed with a second rotating mechanism, and the camera is connected with the rotating end of the second rotating mechanism so as to adjust the angle of the camera in the vertical direction and the horizontal direction.
Optionally, the number of the rolling ball type camera shooting acquisition devices is not less than two, the image processing device further comprises an eye bin, a plurality of clamping positions are arranged on the eye bin, the rolling ball type camera shooting acquisition devices are detachably connected to the clamping positions, and buttons are arranged on the eye bin, wherein one of the rolling ball type camera shooting acquisition devices is set as a main acquisition device, and the rest of the rolling ball type camera shooting acquisition devices are set as auxiliary acquisition devices.
Optionally, the eye chamber is further provided with an indicator light group for displaying the state of the rolling ball type camera shooting acquisition equipment.
Optionally, the wearing piece is further provided with a key for manually adjusting the auxiliary acquisition device to automatically cooperate with the field of view.
Optionally, the angular velocity sensor is an electronic gyroscope.
Optionally, a wireless charging module is further arranged in the housing.
Optionally, the image data can be shared in real time with other display devices of the same type or with a licensed dedicated APP account.
The invention also provides a visual auxiliary method, which comprises the following steps:
the method comprises the following steps: device start-up and self-test
The user respectively starts the image processing equipment and the developing equipment, and the device automatically completes the relevant self-checking operation.
Step two: turn on image acquisition
The user wears the display equipment, selects a rolling ball type camera shooting and collecting equipment as a main collecting equipment in the eye bin, presets a shooting angle and a shooting area on the display equipment, throws out the rolling ball type camera shooting and collecting equipment, the user can adjust the shooting angle and the shooting area of a camera in the rolling ball type camera shooting and collecting equipment to start real-time image collection, a steady camera in the rolling ball type camera shooting and collecting equipment as the main collecting equipment keeps buffering in the shooting process, a distance measuring sensor in the rolling ball type camera shooting and collecting equipment measures the nearest distance of the rolling ball type camera shooting and collecting equipment towards the ground, the information is used for finely adjusting the camera through combining an angular velocity sensor, so that the camera always keeps the lens in the preset visual angle orientation after the camera is in motion and stops, the camera automatically focuses according to a visual field, and the image obtained by the rolling ball type camera shooting and collecting equipment is sent to an image processing equipment in a wireless transmission mode, after image processing, the image is transmitted to the display device, and the user adjusts the expected view field by adjusting the keys on the display device.
Step three: continuous use visual aid
The user can select remaining ball formula collection equipment that makes a video recording as supplementary collection equipment in the eye storehouse according to the demand to continue throwing out suitable position, the visual field of supplementary collection equipment cooperates with main collection equipment's setting, and when the picture of gathering has coincidence with the relevant parameter of main collection equipment collection, the image data of supplementary collection equipment splices, augments and fuses main collection equipment data in image processing equipment.
Compared with the prior art, the invention has the beneficial effects that: the rolling ball type camera shooting and collecting device is thrown to a position needing to be observed, image information shot by the camera is processed by the first processing module and then fed back to the phenomenon device in time for a user to check, during use, the user can set a shooting angle of the camera through a key on the wearing piece and transmit the information to the adjusting mechanism through the second processing module, the adjusting mechanism drives the camera to adjust the angle, and the user adjusts the angle of the camera at any time to obtain the field image information to be obtained.
Drawings
Fig. 1 is a schematic structural diagram of a rolling ball type camera shooting and collecting device provided in an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an eye chamber according to an embodiment of the present invention;
fig. 3 is a flowchart of a visual assistance method according to an embodiment of the present invention.
Detailed Description
An embodiment of the present invention will be described in detail below with reference to the accompanying drawings, but it should be understood that the scope of the present invention is not limited to the embodiment.
In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "axial", "radial", "circumferential", etc. indicate orientations or positional relationships based on those shown in the drawings, merely for convenience of description and simplification of the technical solution of the present invention, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention.
However, even people in excellent health status cannot complete the required visual information acquisition in many delicate fields, which requires certain equipment or technical assistance. Visual aids are not exactly equivalent to "artificial vision", which refers to the simulation and implementation of human visual system functions by wearable or implantable visual electronic devices and systems, whereas the former is the enhancement and enhancement of visual observation systems by technical means and "artificial vision" is actually a visual aid.
At present, the vision assistance technology is a system implanted in a human body, and also has non-implanted high-tech assistance devices, i.e., "eyes in the eyes" and "touch helmet", and other technical products, often adopt a traditional complementary metal oxide semiconductor or charge coupled device image sensor, so as to be connected with a digital system executing a machine vision algorithm, thereby realizing an artificial vision function. With the application of the latest small chip technology, optical technology, photoelectric conversion material array technology, transparent brain shell technology and other technologies, the vision auxiliary technology has great development potential in the fields of medical treatment, emergency rescue, military, scientific research, entertainment and the like.
For observation of a non-direct-view field, visual auxiliary equipment is often required to form acquisition of continuous images of the required field, such as multi-mirror refraction, camera monitoring acquisition and the like, and generally, light and image projection or image acquisition equipment is set in advance in a preset field or special equipment is required to adjust in real time. However, for a particularly urgent scene or a complex and variable scene, the traditional method is difficult to meet the actual requirement.
In view of the above problem, as shown in fig. 1, an embodiment of the present invention provides a visual aid, including: the rolling ball type camera shooting and collecting device 24, the image processing device and the developing device, wherein the rolling ball type camera shooting and collecting device 24 comprises: shell 1, camera 10 and guiding mechanism, shell 1 is transparent material, the appearance is the ball form, camera 10 sets up in shell 1, guiding mechanism connects on camera 10, be used for adjusting camera 10 at the angle of vertical direction and horizontal direction, image processing equipment includes first processing module, first processing module is used for receiving the image information of camera 10 transmission and handles the back with image information and send to the display equipment, the display equipment is including wearing piece and second processing module, it is used for setting up camera 10 and shoots the angle and shoot regional button to wear to be equipped with on the piece, second processing module is used for will shooting the angle and shoots regional information transmission and gives guiding mechanism, and receive the image information after first processing module handles in real time, image information after will handling is through wearing the piece and is shown the picture.
The rolling ball type camera shooting and collecting device is thrown to a position needing to be observed, image information shot by the camera is processed by the first processing module and then fed back to the phenomenon device in time for a user to check, during the use period, the user can set the shooting angle of the camera through the keys on the wearing piece and transmit the information to the adjusting mechanism through the second processing module, the adjusting mechanism drives the camera to adjust the angle, and the user adjusts the angle of the camera at any time to obtain the view field image information which the user wants to obtain.
Referring to fig. 1, the housing 1 is further provided with: two support rings 2, an angular velocity sensor 8 and a communication module 7, wherein the two support rings 2 are detachably fixed in a criss-cross manner in a housing 1, a plurality of distance measuring sensors 3 are uniformly distributed on the support rings 2 and used for detecting the distance between each distance measuring sensor 3 and an obstacle, a battery 6 is fixed at the cross portion of the support rings 2, the bottom of the support ring 2 below the battery 6 is connected with a plurality of rolling wheels 4 through a driving part, the lower ends of the rolling wheels 4 extend out of the housing 1 to enable the rolling wheels 4 to rotate, the angular velocity sensor 8 is fixed on the battery 6 and used for detecting the angular velocity of the housing 1, the communication module 7 is arranged on the battery 6 and used for transmitting the data detected by the distance measuring sensors 3 and the angular velocity sensor 8 to a second processing module and also used for transmitting the image information shot by a camera 10 to a first processing module, the distance measuring sensor 3 is an ultrasonic distance measuring sensor, and the angular velocity sensor 8 is an electronic gyroscope.
The support ring 2 is arranged to connect the outer replaceable shell 1 and the internal equipment thereof, and carry distance measuring sensors 3 uniformly distributed in the support ring 2 and a small amount of rolling wheels 4 for finely adjusting the space position of the rolling ball type camera shooting acquisition equipment 24, when the support ring 2 blocks in a preset sight line direction, the rolling wheels 4 are finely adjusted to enable the whole rolling ball type camera shooting acquisition equipment 24 to rotate and avoid sight line blocking, each distance measuring sensor 3 uniformly distributed on the support ring 2 automatically measures the distance towards the nearest barrier, the sensor which normally obtains the shortest distance is the sensor closest to the ground (or a bearing surface) due to gravity stress, and the space motion state information of the rolling ball type camera shooting acquisition equipment 24 per se is judged by combining the electronic gyroscope 8 (the sensor with gradually reduced distance measurement is the approximate direction of motion). The measurement data of the distance measuring sensor 3 and the electronic gyroscope 8 are transmitted back to a first processing module (data analysis module) in the image processing device through the communication module 7, the information is used for judging whether the orientation of the camera 10 of the rolling ball type camera shooting and collecting device 24 still keeps the direction of an expected field of view, if the orientation of the camera 10 of the rolling ball type camera shooting and collecting device is inconsistent, parameters required to be adjusted are analyzed, a signal is sent to the rolling ball type camera shooting and collecting device 24, the camera 10 is finely adjusted through an adjusting mechanism, the camera 10 keeps the preset visual angle orientation (the direction is basically consistent, but the rotation visual angle of the expected field of view is possible) after the camera 10 moves and stops, the camera 10 automatically focuses according to the field of view, the space motion state of the camera shooting device is judged through ultrasonic ranging and the gyroscope, and stable collection of images at a specific visual angle is adjusted through the action of a stable shooting device.
Optionally, the adjusting mechanism includes: the lower end of the steady shooting device 9 is connected with a first rotating mechanism, the first rotating mechanism is fixed on the battery 6, the upper end of the steady shooting device 9 is fixed with a second rotating mechanism, and the camera 10 is connected with the rotating end of the second rotating mechanism so that the camera 10 can be adjusted in the vertical direction and the horizontal direction.
In this embodiment, the first rotating mechanism and the second rotating mechanism are both micro-motors.
Optionally, the number of the rolling ball type camera shooting acquisition devices 24 is not less than two, the image processing device further comprises an eye bin, a plurality of clamping positions 23 are arranged on the eye bin, the rolling ball type camera shooting acquisition devices 24 are detachably connected to the clamping positions 23, and buttons are arranged on the eye bin, wherein one of the rolling ball type camera shooting acquisition devices 24 is set as a main acquisition device, and the rest of the rolling ball type camera shooting acquisition devices 24 are set as auxiliary acquisition devices.
According to the needs, one rolling ball type camera shooting acquisition device 24 can be set as a main acquisition device and one or more rolling ball type camera shooting acquisition devices 24 can be used as auxiliary acquisition devices in an auxiliary mode, so that images acquired by the rolling ball type camera shooting acquisition devices 24 can be spliced, fused and the like to generate a user's expected view field', and the user is assisted in obtaining a visual enhancement effect.
Specifically, as shown in fig. 2, the eye chamber further has an indicator light group 26 (for respectively displaying communication, working state, and communication state), a blocking-position eye-rolling electric quantity indicator light 28, and an eye chamber state display screen 25, which are used for displaying the state of the rolling ball type camera shooting collecting device 24, in this embodiment, the eye chamber is a device for storing, supplying electric energy, communicating data, and processing images of the rolling ball type camera shooting collecting device 24. The upper portion of the cabin body is a transparent openable cover body 21, a plurality of rolling ball type camera shooting collection devices 24 can be placed in different clamping positions 23 on the lower cabin body 22, a working state indicator lamp 26 used for displaying the rolling ball type camera shooting collection devices 24 on the corresponding clamping positions 23 and a clamping rolling eye electric quantity indicator lamp 28 used for displaying the residual electric quantity of the rolling ball type camera shooting collection devices 24 are arranged on the surface of the lower cabin body 22, a first processing module is arranged in the lower cabin body 22, the rolling ball type camera shooting collection devices 24 can be automatically and wirelessly charged in the clamping positions 23, and a clamping power key 27 used for setting one of the rolling ball type camera shooting collection devices 24 as a main collection device and the residual rolling ball type camera shooting collection devices 24 as auxiliary collection devices is arranged on each clamping position 23.
Optionally, the wearing piece is further provided with a key for manually adjusting the auxiliary acquisition device to automatically cooperate with the field of view.
Optionally, a wireless charging module 5 is further disposed in the housing 1.
Optionally, the image data can be shared in real time with other display devices of the same type or with a licensed dedicated APP account.
The invention also provides a visual auxiliary method, which comprises the following steps:
the method comprises the following steps: device start-up and self-test
The user respectively starts the image processing equipment and the developing equipment, and the device automatically completes the relevant self-checking operation.
Step two: turn on image acquisition
The user wears the display device, selects a rolling ball type camera shooting and collecting device 24 as a main collecting device in an eye chamber, presets a shooting angle and a shooting area on the display device, throws out the rolling ball type camera shooting and collecting device 24, the user can adjust the shooting angle and the shooting area of a camera 10 in the rolling ball type camera shooting and collecting device 24 to start real-time image collection, in the shooting process, a steady camera 9 in the rolling ball type camera shooting and collecting device 24 as the main collecting device keeps buffering, a distance measuring sensor 3 in the rolling ball type camera shooting and collecting device 24 measures the nearest distance of the rolling ball type camera shooting and collecting device towards the ground, the information is combined with an angular velocity sensor 8 to judge the self space motion state information, the information is used for finely adjusting the camera 10, so that the camera 10 always keeps the lens in the preset visual angle orientation after the camera is in motion and stops, the camera 10 automatically focuses according to the field of view, the image obtained by the rolling ball type camera shooting and collecting device 24 is sent to an image processing device in a wireless transmission mode, after image processing, the image is transmitted to the display device, and the user adjusts the expected view field by adjusting the keys on the display device.
Step three: continuous use visual aid
The user can select remaining ball formula collection equipment 24 as supplementary collection equipment in the eye storehouse according to the demand to continue throwing out suitable position, supplementary collection equipment's visual field and main collection equipment's setting are in coordination, and when the picture of gathering has coincidence with the relevant parameter of main collection equipment collection, supplementary collection equipment's image data splices, augments and fuses main collection equipment data in image processing equipment.
The use method and the working principle are as follows:
the working flow of the invention is shown in figure 3
The method comprises the following steps: device start-up and self-test
The user wears the display equipment, and the image processing equipment and the display equipment are started in sequence, so that the device automatically completes self-checking operations such as electric quantity detection, hardware detection, connectivity monitoring and the like. Clicking a power key 29 of the eye bin, displaying the current electric quantity of the eye bin, the signal communication state of the eye bin and the display equipment, the information of the connected main rolling ball type camera shooting acquisition equipment 24 and the secondary rolling ball type camera shooting acquisition equipment 24 in a state display screen, pressing the power key 29 of the eye bin for three seconds within 3 seconds after clicking, starting the image processing equipment, and starting the display equipment to press the power key of the equipment, wherein the steps are the same.
Step two: starting image acquisition
A main rolling ball type camera shooting acquisition device 24 is selected as a main acquisition device in the eye cabin, and in the starting state of the eye cabin, a clamping power key 27 on a clamping position of the rolling ball type camera shooting acquisition device 24 is clicked, so that the electric quantity of the current clamping rolling ball type camera shooting acquisition device 24, the signal connection state of the rolling ball type camera shooting acquisition device 24 and the eye cabin and the working state (whether the rolling ball type camera shooting acquisition device 24 works normally) can be displayed. Double-click eye bin power key 29, eye bin power key 29 lights up and flashes, long-press of blocking power key 27 of rolling ball type camera shooting collecting device 24 corresponding to blocking position 23 can set up a main rolling ball type camera shooting collecting device 24 (if the existing main rolling ball type camera shooting collecting device 24 is communicated and works normally, the operation will be readjusted to be the main rolling ball type camera shooting collecting device 24, the original main rolling ball type camera shooting collecting device 24 is automatically adjusted to be the sub rolling ball type camera shooting collecting device 24).
Adjusting the preset visual angle of the visualization device (this step can also be adjusted after the rolling ball type camera shooting device 24 is thrown out), and throwing out the rolling ball type camera shooting device 24. The user can adjust the angle of the field of view and the region of interest (zoom in/zoom out) to start the real-time image acquisition.
In the process, the steady camera 9 in the rolling ball type camera shooting and collecting device 24 keeps a certain degree of buffering, the ultrasonic ranging sensor 3 in the rolling ball type camera shooting and collecting device 24 measures the nearest distance of the orientation of the rolling ball type camera shooting and collecting device, and the electronic gyroscope 8 is combined to judge the self space motion state information (in general, the minimum ultrasonic ranging direction in the gravity direction is the ground), the information is used for the rolling ball type camera shooting and collecting device 24 to finely adjust the camera 10, so that the camera 10 keeps the orientation (the direction is basically consistent, but the rotation angle of the 'expected field of view') of the lens at the preset angle of view all the time during the motion and after the stop, and the camera 10 automatically focuses according to the field of view. The images obtained by the rolling ball type camera shooting and collecting device 24 are transmitted to the image processing device in a wireless transmission mode, and are transmitted to the display device after image processing (the images of the single rolling ball type camera shooting and collecting device 24 mainly comprise video rotation, picture optimization and the like). The user completes the adjustment of the 'expected view field' by adjusting the knob and the key of the display device.
Step three: continuous use visual aid
The user can select the sub-rolling ball type camera shooting and collecting equipment 24 in the eye bin according to the requirement and continuously throw the camera shooting and collecting equipment to a proper position. In the eye cabin starting state, double-click the eye cabin power key 29, the eye cabin power key 29 lights up and flashes, double-click the blocking power key 27 of the blocking position of the rolling ball type camera shooting acquisition equipment 24 can set one rolling ball type camera shooting acquisition equipment 24 (if the rolling ball type camera shooting acquisition equipment 24 which is normally communicated does not exist at present, the eye cabin state display screen 25 reminds error reporting).
The view field of the sub-rolling-ball type camera acquisition device 24 is cooperated with the setting of the main rolling-ball type camera acquisition device 24, when the acquired picture is consistent with the main rolling-ball type camera acquisition device 24 to a certain extent (relevant parameters are adjustable), the image data of the sub-rolling-ball type camera acquisition device 24 is spliced, amplified, fused and the like (under certain conditions, high-grade display of three-dimensional pictures and the like can also be realized) on the data of the main rolling-ball type camera acquisition device 24 in the image processing device. After the sub-rolling ball type camera shooting and collecting device 24 is thrown, the visual angle of the camera 10 is automatically adjusted to be a preset visual angle, and a user can also adjust the visual angle of the sub-rolling ball type camera shooting and collecting device 24 through an App. The image acquired by the secondary rolling ball type camera shooting acquisition equipment 24 is compared with the image acquired by the main rolling ball type camera shooting acquisition equipment 24, the image overlapping rate exceeds a certain rate (adjustable, 60 percent of initial setting), and image splicing can be carried out; if the field difference is too large, a part of images of the secondary rolling ball type camera shooting and collecting equipment 24 can be intercepted to amplify the images of the main rolling ball type camera shooting and collecting equipment 24; the common view field is more, but when the visual angle has larger difference, the image of the secondary rolling ball type camera shooting and collecting device 24 can be fused with the image of the main rolling ball type camera shooting and collecting device 24, and the stereoscopic display effect is realized.
The user can repeatedly operate, adds a plurality of times rolling ball formula collection equipment 24 of making a video recording, realizes richer visual information acquisition.
Too low ball formula of electric quantity collection equipment 24 of making a video recording can pass through image processing equipment, display device picture, or its special APP reminds the user to handle (when a plurality of ball formula collection equipment 24 of making a video recording carry out same vision acquisition task, also can set up automatic change, and sub-ball formula collection equipment 24 of making a video recording is changeable to main ball formula collection equipment 24 promptly). The user of the low-power shutdown rolling ball type camera shooting acquisition equipment 24 can recover the rolling ball type camera shooting acquisition equipment 24 storage position (clamping position) of the image processing equipment, the clamping position 23 is provided with wireless charging equipment, and the electric quantity of the rolling ball type camera shooting acquisition equipment 24 is automatically supplemented.
The user can share the special APP account for other same-style development equipment or permission in real time through the setting of the development equipment, so that a plurality of people can share the view field to jointly complete certain work.
Step four: end of use
The rolling ball type camera shooting acquisition equipment 24 is collected and placed at the eye bin clamping position 23, and under the condition that the power key of the eye bin is not clicked and lightened, the power key is pressed for 10 seconds, so that the closing of the image processing equipment is completed (all rolling ball type camera shooting acquisition equipment in the clamping position are synchronously closed, the clamping power key can be lightened at the rolling hole in the clamping position of the eye bin, and the rolling ball type camera shooting acquisition equipment is independently closed). The same operation completes the shutdown of the developing device.
The above disclosure is only for a few specific embodiments of the present invention, however, the present invention is not limited to the above embodiments, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present invention.

Claims (8)

1. A visual aid, comprising: the system comprises a rolling ball type camera shooting and collecting device (24), an image processing device and a developing device, wherein the rolling ball type camera shooting and collecting device (24) comprises:
the shell (1) is made of transparent materials and is spherical;
a camera (10) disposed within the housing (1);
the adjusting mechanism is connected to the camera (10) and is used for adjusting the angles of the camera (10) in the vertical direction and the horizontal direction;
the image processing equipment comprises a first processing module, and the first processing module is used for receiving the image information transmitted by the camera (10), processing the image information and then sending the processed image information to the developing equipment;
the imaging equipment comprises a wearing piece and a second processing module, wherein a key used for setting the shooting angle of the camera (10) is arranged on the wearing piece, the second processing module is used for transmitting the shooting angle information to the adjusting mechanism, receiving the image information processed by the first processing module in real time and imaging the processed image information through the wearing piece;
the housing (1) is further provided with: the device comprises two support rings (2) which are detachably fixed in the shell (1) in a crisscross shape, wherein a plurality of distance measuring sensors (3) are uniformly distributed on the support rings (2) and used for detecting the distance between each distance measuring sensor (3) and an obstacle, a battery (6) is fixed on the crossed part of each support ring (2), the bottom of each support ring (2) below the battery (6) is connected with a plurality of rolling wheels (4) through a driving piece, and the lower ends of the rolling wheels (4) extend out of the shell (1) so as to enable the rolling wheels (4) to rotate;
the angular velocity sensor (8) is fixed on the battery (6) and used for detecting the rotational angular velocity of the shell (1), and the angular velocity sensor (8) is an electronic gyroscope;
a communication module (7) arranged on the battery (6) and used for transmitting the data detected by the distance measuring sensor (3) and the angular velocity sensor (8) to the second processing module and transmitting the image information shot by the camera (10) to the first processing module, the measured data of the distance measuring sensor (3) and the electronic gyroscope are transmitted back to the first processing module in the image processing equipment through the communication module (7) and when the image is collected, presetting a shooting angle and a shooting area on a display device, then throwing out a rolling ball type camera shooting and collecting device (24), wherein the sensor which obtains the shortest distance is closest to the ground due to the gravity stress, therefore, the measurement data of the distance measuring sensor (3) and the electronic gyroscope can be used for judging whether the orientation of the camera (10) of the rolling ball type camera shooting and collecting device (24) still maintains the expected view field direction.
2. A visual aid according to claim 1 wherein said adjustment mechanism comprises:
steadily clap ware (9), the lower extreme of steadily clapping ware (9) is connected with first slewing mechanism, first slewing mechanism is fixed in on battery (6), the upper end of steadily clapping ware (9) is fixed with second slewing mechanism, camera (10) with second slewing mechanism's rotation end is connected, so that camera (10) carry out angle adjustment in vertical direction and horizontal direction.
3. The visual assistance device according to claim 1, wherein the number of the rolling ball type camera shooting devices (24) is not less than two, the image processing device further comprises an eye chamber, the eye chamber is provided with a plurality of clamping positions (23), the rolling ball type camera shooting devices (24) are detachably connected to the clamping positions (23), and buttons for setting one of the rolling ball type camera shooting devices (24) as a main shooting device and the rest of the rolling ball type camera shooting devices (24) as auxiliary shooting devices are arranged on the eye chamber.
4. A visual aid according to claim 3 wherein the eye chamber further has a set of indicator lights (26) thereon to indicate the status of the pan camera capture device (24).
5. A visual aid as claimed in claim 3 wherein said wearing means is further provided with a button for manual adjustment of said auxiliary acquisition device's automatic coordinated field of view.
6. Visual aid according to claim 1, characterised in that a wireless charging module (5) is also provided in the housing (1).
7. The visual aid of claim 1, wherein the image data can be shared in real time with other like-equipped presentation devices or licensed dedicated APP accounts.
8. A visual aid method, comprising the steps of:
the method comprises the following steps: device start-up and self-test
The user respectively starts the image processing equipment and the developing equipment, and the device automatically completes the relevant self-checking operation;
step two: starting image acquisition
The user wears the display equipment, selects a rolling ball type camera shooting and collecting equipment (24) as main collecting equipment in an eye bin, presets a shooting angle and a shooting area on the display equipment, throws out the rolling ball type camera shooting and collecting equipment (24), the user can adjust the shooting angle and the shooting area of a camera (10) in the rolling ball type camera shooting and collecting equipment (24) to start real-time image collection, in the shooting process, a stable shooting device (9) in the rolling ball type camera shooting and collecting equipment (24) as the main collecting equipment keeps buffering, a distance measuring sensor (3) in the rolling ball type camera shooting and collecting equipment (24) measures the nearest distance of the rolling ball type camera shooting and collecting equipment towards the ground, and judges the self space motion state information by combining an angular velocity sensor (8), the information is used for finely adjusting the camera (10) to enable the camera (10) to keep the orientation of a lens at a preset visual angle all the time in motion and after the camera stops, the camera (10) automatically focuses according to a view field, images obtained by the rolling ball type camera shooting and collecting device (24) are sent to the image processing device in a wireless transmission mode and are transmitted to the display device after image processing, and a user finishes the adjustment of the expected view field by adjusting keys on the display device;
step three: continuous use visual aid
The user can select the residual rolling ball type camera shooting acquisition equipment (24) as auxiliary acquisition equipment in the eye bin according to the requirement, and continuously throws out the auxiliary acquisition equipment to a proper position, the view field of the auxiliary acquisition equipment is cooperated with the setting of the main acquisition equipment, and when the acquired picture is coincident with the related parameters acquired by the main acquisition equipment, the image data of the auxiliary acquisition equipment is spliced, amplified and fused with the data of the main acquisition equipment in the image processing equipment.
CN202110846765.7A 2021-07-26 2021-07-26 Visual auxiliary device and method Active CN113596303B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110846765.7A CN113596303B (en) 2021-07-26 2021-07-26 Visual auxiliary device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110846765.7A CN113596303B (en) 2021-07-26 2021-07-26 Visual auxiliary device and method

Publications (2)

Publication Number Publication Date
CN113596303A CN113596303A (en) 2021-11-02
CN113596303B true CN113596303B (en) 2022-09-02

Family

ID=78250180

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110846765.7A Active CN113596303B (en) 2021-07-26 2021-07-26 Visual auxiliary device and method

Country Status (1)

Country Link
CN (1) CN113596303B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116006860B (en) * 2023-03-24 2023-05-16 程宝数字科技(北京)有限公司 Photogrammetry device and application method thereof

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357442A (en) * 2015-11-27 2016-02-24 小米科技有限责任公司 Shooting angle adjustment method and device for camera

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101146231A (en) * 2007-07-03 2008-03-19 浙江大学 Method for generating panoramic video according to multi-visual angle video stream
CN105187777B (en) * 2015-08-05 2018-10-19 广州杰赛科技股份有限公司 A kind of detecting ball and its camera recovery method, detecting system
CN105500331B (en) * 2015-12-31 2023-09-22 上海灿星文化传媒股份有限公司 Multipurpose intelligent camera robot
CN213069469U (en) * 2020-10-15 2021-04-27 成都易瞳科技有限公司 Spherical omnidirectional mobile robot based on panoramic VR shooting

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357442A (en) * 2015-11-27 2016-02-24 小米科技有限责任公司 Shooting angle adjustment method and device for camera

Also Published As

Publication number Publication date
CN113596303A (en) 2021-11-02

Similar Documents

Publication Publication Date Title
CN106233328B (en) Apparatus and method for improving, enhancing or augmenting vision
CN105917639B (en) Location tags camera focusing system
CN104253935B (en) Camera device
CN103827735B (en) For measuring the method for the form geometric parameter of the individuality of wearing spectacles
CN107411701A (en) Measure it is oculomotor can head-wearing device
CN106419867A (en) Wearable electronic instrument, human health monitoring system comprising same and human health monitoring method
CN107005653A (en) Virtual focusing feeds back
CN113596303B (en) Visual auxiliary device and method
WO2011024134A1 (en) Wearable systems for audio, visual and gaze monitoring
US9225895B2 (en) Automatic focusing method and apparatus for same
JP2013219541A (en) Photographing system and photographing method
WO2013162471A2 (en) Portable optics adapter to digital camera for fundus imaging
CN110215186A (en) One kind being automatically aligned to positioning fundus camera and its working method
CN101881665B (en) Scouting device for criminal investigation or night search and rescue
CN206294286U (en) A kind of remote dummy reality realizes system
CN106650201A (en) Mobile diagnosis and treatment system
CN104757933A (en) Handheld type fundus camera
CN207220273U (en) Visualize sea police's patrol helmet
CN105615826A (en) Head mountable device for measuring eye movement having visible projection means
CN204945491U (en) Wear-type holographic intelligent glasses
WO2003074982A1 (en) Infrared camera with slave monitor
CN105068248A (en) Head-mounted holographic intelligent glasses
CN109445267A (en) Intelligent watch
CN206301082U (en) A kind of AR intelligent glasses of convenient use
CN206178826U (en) Movable type system of diagnosing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant