CN112578904A - Man-machine interaction testing device for mobile terminal - Google Patents
Man-machine interaction testing device for mobile terminal Download PDFInfo
- Publication number
- CN112578904A CN112578904A CN202011282174.3A CN202011282174A CN112578904A CN 112578904 A CN112578904 A CN 112578904A CN 202011282174 A CN202011282174 A CN 202011282174A CN 112578904 A CN112578904 A CN 112578904A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- sub
- eye
- clamping
- supporting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention discloses a human-computer interaction testing device for a mobile terminal, which comprises an eye movement tracking sub-device, a mobile terminal sub-device, a video acquisition sub-device and a supporting seat, wherein the eye movement tracking sub-device comprises an eye movement tracking supporting frame device and eye movement equipment, and the eye movement tracking supporting frame device is used for supporting the eye movement equipment and is fixed at one end of the supporting seat; the mobile terminal sub-device comprises a mobile terminal support frame device, is used for supporting the mobile terminal and is fixed at the other end of the support seat; the video acquisition sub-device is detachably connected with the mobile terminal through an interface and is used for acquiring a screen picture of the mobile terminal and uploading the screen picture when the video acquisition sub-device is connected with the mobile terminal; the eye movement tracking sub-device is used for collecting a convergence point of the eye vision on the mobile terminal, tracking the position and the retention time of the convergence point on the screen of the mobile terminal, and uploading eye vision track data. According to the method and the device, the mobile screen picture is derived, the mobile screen picture is overlapped with the motion trail of the eye vision point, and the human-computer interaction test is accurately realized.
Description
Technical Field
The invention relates to the technical field of human-computer interaction testing, in particular to a human-computer interaction testing device for a mobile terminal.
Background
The human-computer interface is the most direct interaction layer between software and a user, the first impression of the user on the software is determined by the quality of the interface, good interface design is more and more emphasized by system analysis and designers, but how to test the human-computer interface and give objective and fair evaluation does not have a unified standard.
At present, for the test of man-machine interaction, a camera is adopted to shoot a screen picture, the focus of eyes is detected at the same time, the shot picture and an eye movement track are projected, and the moving track of the eyesight on the screen picture is tracked, so that the test of man-machine interaction is realized.
Meanwhile, because the position of the eye tracker is fixed, the eyes of a person can change along with the height and the movement of the head of the person, so that the definition of eye track information acquired by the eye tracker can be influenced, the eye track information is further influenced, and the test precision is reduced.
Therefore, it is an urgent problem to design a testing apparatus capable of improving testing accuracy.
Disclosure of Invention
The invention aims to provide a human-computer interaction testing device for a mobile terminal, which is characterized in that tracking of an eye vision point on a screen picture of the mobile terminal is realized by setting an eye tracker and adjusting the distance between the eye tracker and the mobile terminal and eyes, so that a motion track of the eye vision point is obtained, the motion tracks of the mobile screen picture and the eye vision point on the mobile screen picture are superposed and combined by deriving the mobile screen picture, quantitative research in a human-computer interaction process of a user and the mobile terminal is obtained, and an interaction design effect is analyzed and evaluated.
The above object of the present invention is achieved by the following technical solutions:
a human-computer interaction testing device for a mobile terminal comprises an eye movement tracking sub-device, a mobile terminal sub-device, a video acquisition sub-device and a supporting seat, wherein the eye movement tracking sub-device comprises an eye movement tracking support frame device and eye movement equipment, the eye movement tracking support frame device is used for supporting the eye movement equipment and is fixed at one end of the supporting seat; the mobile terminal sub-device comprises a mobile terminal support frame device, is used for supporting the mobile terminal and is fixed at the other end of the support seat; the video acquisition sub-device is detachably connected with the mobile terminal through an interface and is used for acquiring a screen picture of the mobile terminal and uploading the screen picture when the video acquisition sub-device is connected with the mobile terminal; the eye movement tracking sub-device is used for collecting a convergent point of the eye vision on the mobile terminal, tracking the position and the retention time of the convergent point on a screen of the mobile terminal, and uploading eye vision track data; the supporting seat adopts an adjustable length structure and is used for adjusting the relative positions of the eye movement tracking sub-device and the mobile terminal sub-device.
The invention is further configured to: the mobile terminal sub-device comprises a first support, wherein the first support is used for placing and fixing the mobile terminal, the first support is fixedly arranged at one end of the supporting seat, and a first limiting gear is arranged and used for limiting the position of the mobile terminal on the first support.
The invention is further configured to: the eye movement tracking sub-device comprises a second bracket which is fixedly arranged at the other end of the supporting seat; the second support is provided with a second limiting stop and a magnetic attraction piece, the magnetic attraction piece is used for attracting the eye movement tracking system module, and the second limiting stop is used for limiting the position of the eye movement tracking system module on the second support.
The invention is further configured to: the video acquisition sub-device comprises a video interface converter and a video converter, wherein one end of the video interface converter is connected with the mobile terminal, the other end of the video interface converter is connected with a first interface of the video converter, a second interface of the video converter is connected with an upper computer, and the video converter is used for converting a real-time screen picture of the mobile terminal and transmitting a conversion result to the upper computer.
The invention is further configured to: the supporting seat comprises a first supporting frame and a second supporting frame, the first end of the first supporting frame is connected with the mobile terminal device, the second end of the first supporting frame is movably and fixedly connected with the first end of the second supporting frame, the second end of the second supporting frame is connected with the eye movement tracking sub-device, and the first supporting frame moves along the second supporting frame and is used for adjusting the relative position of the mobile terminal device and the eye movement tracking sub-device.
The invention is further configured to: the supporting seat is hinged to the clamping frame, and the clamping device is used for fixing the supporting seat to the using platform.
The invention is further configured to: the clamping device comprises an upper clamping rod, a lower clamping rod, a clamping connecting rod and a clamping device, the clamping connecting rod is hinged to a clamping base, the clamping connecting rod is fixedly connected with the upper clamping rod and the lower clamping rod, the clamping connecting rod is located at the same end of the upper clamping rod and the lower clamping rod, the clamping device is rotatably and fixedly connected with the lower clamping rod, the upper clamping rod is used for contacting with the upper surface of a using plane, the lower clamping rod is used for contacting with the lower surface of the using plane, and the clamping device is used for clamping the human-computer interaction testing device on the using platform or loosening the using platform.
The invention is further configured to: the arm supporting sub-device is adjustably and fixedly connected with the holding device and is used for supporting the arm.
The invention is further configured to: the arm supporting sub-device comprises an arm supporting frame, an arm supporting fixing platform, a left arm supporting plate and a right arm supporting plate, wherein the arm supporting fixing platform is fixedly connected with the left arm supporting plate and the right arm supporting plate at the same time, and the left arm supporting plate and the right arm supporting plate are respectively positioned on two sides of the mobile terminal sub-device; the arm supporting and fixing platform is fixedly connected with the arm supporting frame in an adjustable mode, and the arm supporting frame is fixedly connected with an upper holding rod of the holding device.
The invention is further configured to: the mobile terminal sub-device and the clamping device are positioned on the same side of the supporting seat, and the eye movement tracking sub-device is positioned on the other side of the supporting seat opposite to the mobile terminal sub-device.
The invention is further configured to: the eye tracking system is characterized by further comprising an electric adjusting sub-device, driving motors are respectively arranged on the eye tracking sub-device and the mobile terminal sub-device, the electric adjusting sub-device adjusts the eye tracking system according to the position information of the eye tracking system, the mobile terminal is adjusted according to the position information of the mobile terminal, and automatic adjustment of the position of the eye tracking system and the position of the mobile terminal is achieved.
The invention is further configured to: the electric adjusting sub-device also comprises an arm supporting motor driving device which is connected with the arm supporting frame and used for adjusting the height and the angle of the arm supporting frame.
Compared with the prior art, the beneficial technical effects of this application do:
1. the distance between the eye tracker bracket and the mobile terminal and the eyes are adjusted through the adjustable support frame between the eye tracker bracket and the mobile terminal, so that the comfort of the eyes and the accuracy of the test are guaranteed during the test;
2. furthermore, the video acquisition sub-device is adopted to acquire the screen picture of the mobile terminal, so that the definition of the screen picture is increased, and a high-quality picture is provided for accurate analysis;
3. furthermore, the motor is arranged at each adjusting point, so that the position of each part can be automatically adjusted, and the use comfort level is improved;
4. furthermore, the high-quality picture and the detection result of the eye tracker are combined and analyzed, and the analysis accuracy is improved.
Drawings
FIG. 1 is a schematic side view of a test apparatus according to an embodiment of the present application;
FIG. 2 is a schematic view of the angle 1 of the test apparatus according to an embodiment of the present application;
FIG. 3 is a partial schematic view of the angle 2 of the test apparatus according to an embodiment of the present application;
FIG. 4 is a partial schematic view of the angle 3 of the test apparatus according to an embodiment of the present application;
FIG. 5 is a schematic top view of a test apparatus according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a video acquisition sub-apparatus according to an embodiment of the present application;
FIG. 7 is a control flow diagram of an embodiment of the present application.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings.
Detailed description of the preferred embodiment
The human-computer interaction testing device for the mobile terminal comprises a mobile terminal sub-device 1, a supporting seat 2, an eye movement tracking sub-device 3, a clamping device and an arm supporting sub-device, wherein the mobile terminal sub-device is shown in figures 1 and 2; the arm supporting sub-device comprises a supporting plate 4 and an arm supporting frame 5; the clamping device comprises a clamping device 6 and a clamping frame 7.
The mobile terminal support device 1 is fixed at one end of the support base 2, the eye-tracking sub-device 3 is fixed at the other end of the support base 2, and the eye-tracking sub-device 3 and the mobile terminal sub-device 1 are respectively arranged at two sides of the support base 2 and fixedly connected with the support base 2.
The eye movement tracking sub-device 3 is used for collecting convergence points of eye vision on the mobile terminal, and the mobile terminal sub-device 1 is used for supporting the mobile terminal.
Specifically, the mobile terminal device 1 is disposed at the top end of the supporting seat 2, and has a first included angle with the supporting seat 2, and the angle of the first included angle is between 0 and 180 degrees.
The eye tracking sub-device 3 is disposed at the bottom end of the support base 2 and located at two opposite sides of the support base 2. A second included angle is formed between the eye tracking sub-device 3 and the supporting base 2, and the angle of the second included angle is between 0 and 180 degrees.
The clamping frame 7 is hinged with the supporting base 2 and is positioned on the same side of the supporting base 2 as the mobile terminal device 1.
The mobile terminal sub-device 1 and the clamping device are positioned on the same side of the supporting seat 2, and the eye tracking sub-device 3 is positioned on the other side of the supporting seat 2 and is arranged on two sides of the supporting seat 2 opposite to the mobile terminal sub-device 1.
The arm support frame 5 is fixedly arranged on the clamping frame 7, and a third included angle is formed between the arm support frame and the clamping frame 7, and the angle of the third included angle is 0-180 degrees.
Backup pad 4 and the adjustable fixed connection of arm support frame 5 have the fourth contained angle between backup pad 4 and the support frame, and the angle of fourth contained angle is between 0 to 180 degrees.
As shown in fig. 3, with reference to fig. 1 and 2, the mobile terminal device includes a first bracket 12, in this embodiment, the first bracket 12 is a flat structure and has a square shape, one side of the first bracket 12 is fixedly connected to the supporting base 2, and an included angle between a plane of the first bracket 12 and a plane of the supporting base 2 is 60-120 degrees.
A first limiting stop 11 is arranged at the fixing position of the first support 12 and the support base 2, and the first limiting stop 11 protrudes from the upper surface of the first support 12 and is used for limiting the position of the mobile terminal. In this embodiment, the first position-limiting stopper 11 includes two same protrusions disposed on the same side of the first bracket 12, and a surface of the first position-limiting stopper 11 facing away from the first bracket 12 and a surface of a side of the supporting bracket 21 are in the same plane.
The support seat 2 comprises a first support frame 21 and a second support frame 22, the first support frame 21 is a first square frame structure and comprises 4 frames, wherein the frames 211 and 212 are two opposite frames; the second supporting frame 22 is a second square frame structure with an opening, the opening of the second square frame structure has no frame, the front view of the second square frame is "U" shaped, and includes three frames, wherein the frames 221 and 222 are two opposite frames. The surface of each frame facing the inside of the box is an inner side surface, and the surface of each frame facing away from the inside of the box is an outer side surface.
The first support frame 21 is sleeved with the second support frame 22 from the opening of the second support frame 22, and the first frame 211 of the first support frame 21 is clamped with the first frame 221 of the second support frame 22 and can move along the frame 221; the second frame 212 of the first support frame 21 is clamped with the second frame 222 of the second support frame 22 and can move along the frame 222; when the frame 211 moves along the frame 221, the frame 212 also moves along the frame 222, so as to realize the movement of the first support frame 21 along the second support frame 22, thereby changing the length of the support base 2, and realizing the change of the relative position of the mobile terminal sub-device and the eye-tracking sub-device. The first position-limiting stop 11 is disposed on a third frame of the first support 21, and the third frame is located at a first end of the frame 211 and a first end of the frame 212. Opposite to the third border of the first stent 21, is a fourth border of the first stent 21.
At the second end position that is close to frame 211, the fixed locating bolt 213 that is provided with is located the lateral surface of frame 211, is close to the fourth frame of first support 21, is provided with rectangular form positioning hole 223 on the frame 221, is provided with a plurality of spacing draw-in grooves along positioning hole 223 long border, and positioning bolt 213 passes positioning hole 223 and fixes on the lateral surface of frame 211.
In this embodiment, the positioning bolt is a bolt.
The outer side surface of the frame 221 is further fixedly provided with a butting block 224, which is located at the hinged position with the clamping frame 7 and used for limiting the clamping frame 7. The abutting block 224 and the positioning bolt 213 are located on the same side of the frame 221, and the abutting block 224 and the positioning bolt 213 are located approximately in the middle of the frame 221 in view of stability.
Accordingly, bezel 212 is identical in structure to bezel 211, and bezel 222 is identical in structure to bezel 221.
The eye tracking sub-device 3 is arranged at one end of the side frames 221, 222 away from the first support 21, the eye tracking sub-device 3 comprises a third support 31 which is rotatably and fixedly connected with the second support 22, the third support 31 is also of a square frame structure and comprises four side frames, wherein the side frames 314, 315 are two opposite side frames; the bezel 311 is away from the second bracket 22; at one end of the rims 314, 315 near the rim 311, an eye tracker frame 32 is provided for placing an eye tracker that can be used to track the convergence point of the eye vision.
One end of the frame 314 close to the frame 311 is provided with a first groove, a first through hole is arranged on the groove frame edge of the first groove, the drawable bottom plate 313 penetrates through the first through hole, and a stop edge is arranged on the outer side of the drawable bottom plate 313 and used for limiting the bottom plate 313.
Similarly, one end of the frame 315 close to the frame 311 is provided with a second groove, a second through hole is provided on the bezel edge of the second groove, the drawable bottom plate 312 passes through the second through hole, and a stop edge is provided on the outer side of the drawable bottom plate 312 for limiting the bottom plate 312.
The first groove, the second groove and the frame 311 form the eye tracker frame 32, the drawable bottom plates 312 and 313 are located at the bottom of the eye tracker frame 32, and the size of the eye tracker frame 32 is determined by the drawing positions of the drawable bottom plates 312 and 313.
The magnetic attraction piece is fixedly arranged in the eye tracker frame 32 and is used for attracting the eye tracker.
As shown in fig. 4, in conjunction with fig. 1 and 2, the clamping device includes a clamping fixture 6 and a clamping frame 7.
The clamping frame 7 comprises a clamping connecting rod 71, a first upper clamping rod 73 and a first lower clamping rod 72, the clamping connecting rod 71 is fixedly connected to the same ends of the first upper clamping rod 73 and the first lower clamping rod 72, the clamping connecting rod 71, the first upper clamping rod 73 and the first lower clamping rod 72 are of an integral structure, the first upper clamping rod 73 and the first lower clamping rod 72 are arranged in parallel, the first upper clamping rod 73 is used for clamping the upper surface of the using platform, and the first lower clamping rod 72 is used for clamping the lower surface of the using platform.
A third through hole is formed in the clamping connecting rod 71, the outer edge of the clamping connecting rod 71 at the third through hole is abutted against the abutting block 224, and the abutting block 224 is used for limiting the position of the clamping connecting rod 71.
On the first frame 221 of the second support frame 22, a hinge protrusion 226 is disposed along a direction perpendicular to the plane where the second support frame 22 is located, a fourth through hole is disposed on the hinge protrusion 226, the fourth through hole is coaxial with the third through hole, a hinge shaft 77 is disposed through the third through hole and the fourth through hole, and the clamping frame 7 can rotate around the hinge shaft 77.
The clamping frame 7 further includes a clamping connecting rod 78, a second upper clamping rod 75, and a second lower clamping rod 74, and the structures thereof are the same as those of the clamping connecting rod 71, the first upper clamping rod 73, and the first lower clamping rod 72, and thus the description thereof is omitted.
A second reinforcing bar 76 is provided between the first upper clamping bar 73 and the second upper clamping bar 75, and a first reinforcing bar 67 is provided between the first lower clamping bar 72 and the second lower clamping bar 74.
The clamping device 6 comprises a first clamping handle 61, a first clamping rod 62 and a first clamping support 63 which are fixedly connected in sequence. The first clamping bracket 63 is located below the first upper clamping bar 73.
A fifth through hole is formed in the reinforcing rod 67 close to the first lower clamping rod 72, a thread is arranged in the fifth through hole, a thread matched with the thread of the fifth through hole is arranged on the first clamping rod 62, the first clamping rod 62 penetrates through the fifth through hole and can rotate, and the distance between the first clamping support 63 and the first upper clamping rod 73 can be adjusted by rotating the first clamping handle 61.
The clamping device 6 further comprises a second clamping handle 64, a second clamping rod 65 and a second clamping support 66 which are fixedly connected in sequence. The second clamping bracket 66 is located below the second upper clamping bar 75.
A sixth through hole is formed in the reinforcing rod 67 close to the second lower clamping rod 74, a thread is formed in the sixth through hole, a thread matched with the sixth through hole in a threaded manner is formed in the second clamping rod 65, the second clamping rod 65 penetrates through the sixth through hole and can rotate, and the distance between the second clamping support 66 and the second upper clamping rod 75 can be adjusted by rotating the second clamping handle 64.
Meanwhile, the man-machine interaction testing device can be clamped on the use platform by rotating the first clamping handle 61 and the second clamping handle 64.
As shown in fig. 4 and 5, the arm supporting sub-device includes an arm supporting frame 5, an arm supporting fixing platform 54; the support plate 4 includes a left arm support plate 41 and a right arm support plate 42.
The arm support frame 5 comprises a first arm support rod 51, a second arm support rod 52 and an arm support reinforcing rod 53, wherein the first arm support rod 51 is fixedly connected to the first upper holding rod 73, and an included angle between the first arm support rod 51 and the first upper holding rod 73 is an acute angle. The second arm support bar 52 is fixedly connected to the second upper holding bar 75, and forms an acute angle with the second upper holding bar 75. The arm brace 53 is connected between the first arm brace 51 and the second arm brace 52, and is used to integrate the first arm brace 51 and the second arm brace 52.
The first arm support rod 51 is provided with a strip-shaped through hole 56, and a positioning bolt 55 is fixedly arranged at one end of the arm support reinforcing rod 53 through the through hole 56. Similarly, a through hole (not labeled) is also provided on the second arm support rod 52, and the positioning pin is fixedly mounted at the other end of the arm support reinforcing rod 53 through the through hole on the second arm support rod 52. The adjustment of the position of the arm support reinforcing bar 53 can be achieved by adjusting the positioning pin of the arm support reinforcing bar 53.
The arm supporting and fixing platform 54 is fixed on the arm supporting reinforcing rod 53, and the arm supporting and fixing platform 54 is of a flat plate structure and is square in shape.
The left arm support plate 41 is a flat plate structure, and has a "Z" shape, and includes a first folded edge 411, a second folded edge 412, and a third folded edge 413. One end of the first flange 411 is fixed to the left half of the arm support fixing platform 54, and the other end of the first flange extends outward along the length direction of the arm support reinforcing rod 53, and is bent at a position close to the length of the arm to form a second flange 412, the second flange 412 extends toward the user, and the end of the second flange 412 extends outward again to form a third flange 413, and the left arm support plate 41 is used for the user to place the left arm. The outward direction here is a direction away from the mobile terminal device, i.e., an outward direction, with respect to the mobile terminal device.
The right arm support plate 42 and the left arm support plate 41 are symmetrically arranged, fixed at the right half side of the arm support fixing platform 54, and structurally symmetrical with the left arm support plate 41, and used for placing a right arm of a user.
As shown in fig. 6, the video collecting sub-apparatus includes a video interface converter, a video converter 81, the video interface converter includes a first conversion interface 82 and a second conversion interface 83, which are respectively connected to the video converter 81, one end of the first conversion interface 82 is used for connecting to the mobile terminal, the other end is connected to the first interface of the video converter, the second interface of the video converter 81 is connected to the upper computer through the second conversion interface 83, the video converter 81 is used for performing format conversion on the real-time screen image of the mobile terminal, projecting the information on the screen of the mobile terminal to the video interface, transferring the video signal to the device of the USB signal, and transmitting the video signal to the upper computer by the USB device.
Specifically, screen recording software of the mobile terminal is adopted to track the position and the retention time of the touch screen, the video converter 81 converts a screen picture of the mobile terminal into a video HDMI signal, and then converts the HDMI signal into a USB signal to be transmitted to the computer.
Detailed description of the invention
The human-computer interaction testing device for the mobile terminal is different from the first specific embodiment in that: the device is characterized by further comprising an electric adjusting sub-device, motors are arranged at each adjusting position, a stepping motor is respectively arranged at the connecting position of the mobile terminal support frame device 1 and the supporting seat 2, the connecting position of the eye movement tracking sub-device 3 and the supporting seat 2, the connecting position of the arm supporting frame 5 and the adding support frame 7 and the connecting position of the arm supporting frame 5 and the arm supporting and fixing platform 54, and the relative position and the angle between each part are controlled by controlling the stepping state of each motor.
The electric adjusting sub-device adjusts the eye movement tracking system according to the position information of the eye movement tracking system, adjusts the mobile terminal according to the position information of the mobile terminal, and achieves automatic adjustment of the position of the eye movement tracking system and the position of the mobile terminal; according to the height of a user, the height and the angle of the arm supporting frame are adjusted, so that the arm supporting plate is adjusted.
The electric adjusting sub-device is controlled to perform inching control or continuous control according to needs, for example, the angle and the height of the eye movement tracking system are adjusted through point-to-point control; the angle and the height of the arm supporting plate are adjusted.
Detailed description of the preferred embodiment
The man-machine interaction testing method for the mobile terminal is carried out based on a man-machine interaction testing device for the mobile terminal, and comprises the steps of exporting screen information of the mobile terminal and converting the screen information into screen video information; acquiring eye vision convergence point track information of human eyes, and converting the eye vision convergence point track information into eye track video information; and collecting the screen video information and the eye track video information, and superposing the screen video information and the eye track video information at the same moment in the same picture through coordinate transformation to obtain the running track of the convergence point of the human eyesight on the screen picture of the mobile terminal and obtain a human-computer interaction test result.
The screen information of the mobile terminal comprises screen picture information and touch screen information, the touch screen information comprises touch screen azimuth information and touch screen time information, and the screen picture information and the touch screen information are simultaneously converted into screen video information.
Detailed description of the invention
A man-machine interaction test system for a mobile terminal comprises an eye movement tracking subsystem, a mobile terminal screen acquisition subsystem and a control center, wherein the eye movement tracking subsystem and the mobile terminal screen acquisition subsystem are respectively connected with the control center, the eye movement tracking subsystem is used for obtaining eye movement track information meeting requirements by automatically adjusting the position of an eye movement instrument, and the mobile terminal screen acquisition subsystem is used for obtaining screen video information of the mobile terminal by exporting real-time picture information of a mobile screen; the control center is used for converting the eye movement track information into eye track video information, adjusting the position of the eye tracker according to the eye track image, collecting the eye track video information and the screen image of the mobile terminal, converting coordinates, and overlapping the screen video information and the eye track video information at the same moment to obtain and display a human-computer interaction test result.
The control center obtains eye track video information of the eye tracker, judges the definition of the eye track video information, and adjusts the position of the eye tracker when the definition of the eye track video information is lower than a set value until the definition meets requirements.
And adjusting the position of the eye tracker, including adjusting the height and the angle of each direction of the eye tracker according to the definition of the eye track video information.
And the mobile terminal screen acquisition subsystem projects the screen picture information of the mobile terminal and transmits the screen picture information to the control center.
The control center controls the mobile terminal to export a screen real-time playing image to obtain screen picture information; acquiring touch screen information in a screen recording mode; the control center controls the eye tracker to obtain eye movement track information.
The control center sends out synchronizing signal when opening, and carry out calibration to screen picture moment and eye movement orbit moment, make screen video information and eye rail video information correspond one-to-one on the time axis, according to the definition of eye rail video information, control motor regulation eye tracker angle, height, make eye tracker catch eye vision convergence point position in real time accurately.
Specifically, the control of the control center, as shown in fig. 7, includes the steps of:
s1, starting;
s2, sending synchronous signals to the mobile terminal and the eye tracker at the same time;
s3, collecting mobile terminal data and eye tracker data;
s4, collecting the mobile terminal data and the eye tracker data;
s5, performing coordinate conversion on the data, and converting the data with different coordinates into the same coordinate;
s6, overlapping the mobile terminal data and the eye tracker data converted into the same coordinate;
and S7, ending.
When the data of the eye tracker is collected, the control center also needs to judge the data of the eye tracker and judge whether the definition of the eye track video information is lower than a set value, and if the definition meets the requirement, the data of the eye tracker is good; if the requirement cannot be met, sending an eye tracker position adjusting signal according to the eye tracker data, and controlling the motor to act, wherein the eye tracker is adjusted to move upwards or downwards, or to move leftwards or rightwards, or to adjust the angle according to the eye tracker data, and the receiving judgment is carried out while adjusting until the eye tracker data meets the requirement.
In the actual receiving process, the real-time adjustment can accurately search the convergence point of the eye vision, and the accuracy of the data of the eye tracker is ensured.
Similarly, the control center can also make the mobile terminal more favorable for human eyes to observe by adjusting the angle and the height of the mobile terminal.
Detailed description of the preferred embodiment
The application relates to a human-computer interaction test terminal for a mobile terminal, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor executes the computer program to realize a test method, or a test program of a control center, a control program of an eye tracker and an adjustment program among various components.
Detailed description of the preferred embodiment
A computer-readable storage medium of the present application stores a computer program that, when executed by the processor, implements a test method, or a test program of a control center, a control program of an eye tracker, and an adjustment program between components.
The embodiments of the present invention are preferred embodiments of the present invention, and the scope of the present invention is not limited by these embodiments, so: all equivalent changes made according to the structure, shape and principle of the invention are covered by the protection scope of the invention.
Claims (12)
1. The utility model provides a human-computer interaction testing arrangement to mobile terminal which characterized in that: the eye tracking device comprises an eye tracking sub-device, a mobile terminal sub-device, a video acquisition sub-device and a supporting seat, wherein the eye tracking sub-device comprises an eye tracking support frame device and eye movement equipment, and the eye tracking support frame device is used for supporting the eye movement equipment and is fixed at one end of the supporting seat; the mobile terminal sub-device comprises a mobile terminal support frame device, is used for supporting the mobile terminal and is fixed at the other end of the support seat; the video acquisition sub-device is detachably connected with the mobile terminal through an interface and is used for acquiring a screen picture of the mobile terminal and uploading the screen picture when the video acquisition sub-device is connected with the mobile terminal; the eye movement tracking sub-device is used for collecting a convergent point of the eye vision on the mobile terminal, tracking the position and the retention time of the convergent point on a screen of the mobile terminal, and uploading eye vision track data; the supporting seat adopts an adjustable length structure and is used for adjusting the relative positions of the eye movement tracking sub-device and the mobile terminal sub-device.
2. The human-computer interaction testing device for the mobile terminal according to claim 1, wherein: the mobile terminal sub-device comprises a first support, wherein the first support is used for placing and fixing the mobile terminal, the first support is fixedly arranged at one end of the supporting seat, and a first limiting gear is arranged and used for limiting the position of the mobile terminal on the first support.
3. The human-computer interaction testing device for the mobile terminal according to claim 1, wherein: the eye movement tracking sub-device comprises a second bracket which is fixedly arranged at the other end of the supporting seat; the second support is provided with a second limiting stop and a magnetic attraction piece, the magnetic attraction piece is used for attracting the eye movement tracking system module, and the second limiting stop is used for limiting the position of the eye movement tracking system module on the second support.
4. The human-computer interaction testing device for the mobile terminal according to claim 1, wherein: the video acquisition sub-device comprises a video interface converter and a video converter, wherein one end of the video interface converter is connected with the mobile terminal, the other end of the video interface converter is connected with a first interface of the video converter, a second interface of the video converter is connected with an upper computer, and the video converter is used for converting a real-time screen picture of the mobile terminal and transmitting a conversion result to the upper computer.
5. The human-computer interaction testing device for the mobile terminal according to claim 1, wherein: the supporting seat comprises a first supporting frame and a second supporting frame, the first end of the first supporting frame is connected with the mobile terminal device, the second end of the first supporting frame is movably and fixedly connected with the first end of the second supporting frame, the second end of the second supporting frame is connected with the eye movement tracking sub-device, and the first supporting frame moves along the second supporting frame and is used for adjusting the relative position of the mobile terminal device and the eye movement tracking sub-device.
6. The human-computer interaction testing device for the mobile terminal according to claim 1, wherein: the supporting seat is hinged to the clamping frame, and the clamping device is used for fixing the supporting seat to the using platform.
7. The human-computer interaction testing device for the mobile terminal according to claim 6, wherein: the clamping device comprises an upper clamping rod, a lower clamping rod, a clamping connecting rod and a clamping device, the clamping connecting rod is hinged to a clamping base, the clamping connecting rod is fixedly connected with the upper clamping rod and the lower clamping rod, the clamping connecting rod is located at the same end of the upper clamping rod and the lower clamping rod, the clamping device is rotatably and fixedly connected with the lower clamping rod, the upper clamping rod is used for contacting with the upper surface of a using plane, the lower clamping rod is used for contacting with the lower surface of the using plane, and the clamping device is used for clamping the human-computer interaction testing device on the using platform or loosening the using platform.
8. The human-computer interaction testing device for the mobile terminal according to claim 6, wherein: the arm supporting sub-device is adjustably and fixedly connected with the holding device and is used for supporting the arm.
9. The human-computer interaction testing device for the mobile terminal according to claim 8, wherein: the arm supporting sub-device comprises an arm supporting frame, an arm supporting fixing platform, a left arm supporting plate and a right arm supporting plate, wherein the arm supporting fixing platform is fixedly connected with the left arm supporting plate and the right arm supporting plate at the same time, and the left arm supporting plate and the right arm supporting plate are respectively positioned on two sides of the mobile terminal sub-device; the arm supporting and fixing platform is fixedly connected with the arm supporting frame in an adjustable mode, and the arm supporting frame is fixedly connected with an upper holding rod of the holding device.
10. The human-computer interaction testing device for the mobile terminal according to claim 9, wherein: the mobile terminal sub-device and the clamping device are positioned on the same side of the supporting seat, and the eye movement tracking sub-device is positioned on the other side of the supporting seat opposite to the mobile terminal sub-device.
11. The human-computer interaction testing device for the mobile terminal according to claim 9, wherein: the eye tracking system is characterized by further comprising an electric adjusting sub-device, driving motors are respectively arranged on the eye tracking sub-device and the mobile terminal sub-device, the electric adjusting sub-device adjusts the eye tracking system according to the position information of the eye tracking system, the mobile terminal is adjusted according to the position information of the mobile terminal, and automatic adjustment of the position of the eye tracking system and the position of the mobile terminal is achieved.
12. The human-computer interaction testing device for the mobile terminal according to claim 11, wherein: the electric adjusting sub-device also comprises an arm supporting motor driving device which is connected with the arm supporting frame and used for adjusting the height and the angle of the arm supporting frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011282174.3A CN112578904B (en) | 2020-11-17 | 2020-11-17 | Man-machine interaction testing device for mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011282174.3A CN112578904B (en) | 2020-11-17 | 2020-11-17 | Man-machine interaction testing device for mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112578904A true CN112578904A (en) | 2021-03-30 |
| CN112578904B CN112578904B (en) | 2021-12-14 |
Family
ID=75122678
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011282174.3A Active CN112578904B (en) | 2020-11-17 | 2020-11-17 | Man-machine interaction testing device for mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112578904B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2140681A1 (en) * | 1994-06-17 | 1995-12-18 | Paul C. Chevrette | Wide area coverage infrared search system |
| CN202024039U (en) * | 2010-12-30 | 2011-11-02 | 东莞市康达机电工程有限公司 | Movable engine mounting support |
| CN202361014U (en) * | 2011-11-18 | 2012-08-01 | 刘启瑞 | Multi-joint multi-rotation-direction arm support connector |
| CN103076876A (en) * | 2012-11-22 | 2013-05-01 | 西安电子科技大学 | Character input device and method based on eye-gaze tracking and speech recognition |
| CN206419639U (en) * | 2016-12-14 | 2017-08-18 | 广州市神虎网络科技有限公司 | A kind of hand-held camera cradle head |
| CN206469030U (en) * | 2016-11-04 | 2017-09-05 | 王添辰 | Display automatic tracing support |
| CN107966818A (en) * | 2017-12-26 | 2018-04-27 | 武汉智普天创科技有限公司 | Eyeball tracking wear-type display system |
| CN108095682A (en) * | 2017-12-20 | 2018-06-01 | 武汉智普天创科技有限公司 | The dynamic tracing system of eye |
| CN108683854A (en) * | 2018-07-02 | 2018-10-19 | 羊晓东 | A kind of stabilizer of included Image Acquisition camera |
| CN109681751A (en) * | 2019-01-10 | 2019-04-26 | 淮阴工学院 | A kind of intelligence lazyboot's bracket |
| CN110764613A (en) * | 2019-10-15 | 2020-02-07 | 北京航空航天大学青岛研究院 | Eye movement tracking calibration method based on head-mounted eye movement module |
| CN111144198A (en) * | 2019-11-11 | 2020-05-12 | 珠海格力电器股份有限公司 | Control method of intelligent support and intelligent support |
| CN210716697U (en) * | 2019-07-16 | 2020-06-09 | 深圳市大疆创新科技有限公司 | Bearing structure and cloud platform subassembly |
| CN211344614U (en) * | 2019-09-30 | 2020-08-25 | 张瀚文 | Intelligent follow-up adjustment display support |
| CN111594724A (en) * | 2020-05-18 | 2020-08-28 | 苏州驰夫电子科技有限公司 | Wall-hanging display screen support for computer |
-
2020
- 2020-11-17 CN CN202011282174.3A patent/CN112578904B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2140681A1 (en) * | 1994-06-17 | 1995-12-18 | Paul C. Chevrette | Wide area coverage infrared search system |
| CN202024039U (en) * | 2010-12-30 | 2011-11-02 | 东莞市康达机电工程有限公司 | Movable engine mounting support |
| CN202361014U (en) * | 2011-11-18 | 2012-08-01 | 刘启瑞 | Multi-joint multi-rotation-direction arm support connector |
| CN103076876A (en) * | 2012-11-22 | 2013-05-01 | 西安电子科技大学 | Character input device and method based on eye-gaze tracking and speech recognition |
| CN206469030U (en) * | 2016-11-04 | 2017-09-05 | 王添辰 | Display automatic tracing support |
| CN206419639U (en) * | 2016-12-14 | 2017-08-18 | 广州市神虎网络科技有限公司 | A kind of hand-held camera cradle head |
| CN108095682A (en) * | 2017-12-20 | 2018-06-01 | 武汉智普天创科技有限公司 | The dynamic tracing system of eye |
| CN107966818A (en) * | 2017-12-26 | 2018-04-27 | 武汉智普天创科技有限公司 | Eyeball tracking wear-type display system |
| CN108683854A (en) * | 2018-07-02 | 2018-10-19 | 羊晓东 | A kind of stabilizer of included Image Acquisition camera |
| CN109681751A (en) * | 2019-01-10 | 2019-04-26 | 淮阴工学院 | A kind of intelligence lazyboot's bracket |
| CN210716697U (en) * | 2019-07-16 | 2020-06-09 | 深圳市大疆创新科技有限公司 | Bearing structure and cloud platform subassembly |
| CN211344614U (en) * | 2019-09-30 | 2020-08-25 | 张瀚文 | Intelligent follow-up adjustment display support |
| CN110764613A (en) * | 2019-10-15 | 2020-02-07 | 北京航空航天大学青岛研究院 | Eye movement tracking calibration method based on head-mounted eye movement module |
| CN111144198A (en) * | 2019-11-11 | 2020-05-12 | 珠海格力电器股份有限公司 | Control method of intelligent support and intelligent support |
| CN111594724A (en) * | 2020-05-18 | 2020-08-28 | 苏州驰夫电子科技有限公司 | Wall-hanging display screen support for computer |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112578904B (en) | 2021-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7997730B2 (en) | Explicit raytracing for gimbal-based gazepoint trackers | |
| CN101807110B (en) | Pupil positioning method and system | |
| CN107609516B (en) | Adaptive eye movement method for tracing | |
| CN102657512B (en) | Image acquisition equipment applied to corneal topography instrument | |
| CN101099673A (en) | Surgical instrument positioning method using infrared reflecting ball as symbolic point | |
| CN106767540B (en) | A kind of intersection measurement camera optical axis and reflecting mirror angle error scaling method | |
| CN208476801U (en) | A kind of robot vision identification and detection device | |
| CN112578905B (en) | Man-machine interaction testing method and system for mobile terminal | |
| CN110200585A (en) | A kind of laser beam control system and its method based on fundus imaging technology | |
| CN112578904B (en) | Man-machine interaction testing device for mobile terminal | |
| CN109387131A (en) | A kind of head-up display eye box measuring device and measuring method | |
| CN106204533A (en) | A kind of three-dimensional scanner | |
| CN201675921U (en) | Electric forehead support device | |
| CN208206773U (en) | Steel mesh vision-based detection position regulator and system | |
| CN114125230A (en) | Eagle eye strong vision intelligent sensing-imitating target detection system and method thereof | |
| CN111882365B (en) | Intelligent commodity recommendation system and method for efficient self-service vending machine | |
| CN110338750B (en) | Eyeball tracking equipment | |
| CN208625662U (en) | Rafractive human eye automatic tracking system | |
| CN109307585A (en) | A kind of intelligent test system of nearly mesh formula display performance | |
| CN217716872U (en) | High-precision displacement adjusting device for detecting irregular spherical lens aperture | |
| CN210465964U (en) | Posture estimator modified by handheld stabilizer | |
| CN220208223U (en) | Far-image writing system | |
| CN202875480U (en) | Augmented reality system testing platform based on projector | |
| CN211149479U (en) | Remote iris face acquisition equipment based on cloud platform | |
| CN116539068B (en) | Flexible self-checking adjusting device and method for vision measurement system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |