CN103870146B - Information processing method and electronic equipment - Google Patents
Information processing method and electronic equipment Download PDFInfo
- Publication number
- CN103870146B CN103870146B CN201210550075.8A CN201210550075A CN103870146B CN 103870146 B CN103870146 B CN 103870146B CN 201210550075 A CN201210550075 A CN 201210550075A CN 103870146 B CN103870146 B CN 103870146B
- Authority
- CN
- China
- Prior art keywords
- display
- image
- display object
- electronic device
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention provides an information processing method and electronic equipment, wherein the electronic equipment comprises a display unit, the electronic equipment comprises or is connected with an image acquisition unit, M display objects are arranged on the display unit, then the electronic equipment obtains a first operation image of a first operation body aiming at a first display object in the M display objects through the image acquisition unit, and then the electronic equipment analyzes the first operation image, generates an adjusting instruction and adjusts the display parameters of the first display object according to the adjusting instruction. Therefore, the technical problem that when a plurality of display objects are displayed on the large-screen touch equipment in the prior art, a user needs to select the corresponding display object needing to be started or operated through long-distance touch operation, and the selection mode of the display object of the large-screen touch equipment is single is solved.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to an information processing method and an electronic device.
Background
With the continuous development of science and technology, electronic technology has also gained rapid development, and the variety of electronic products is also more and more, and people also enjoy various conveniences brought by the development of science and technology. People can enjoy comfortable life brought along with the development of science and technology through various types of electronic equipment.
For example, in the prior art, a large-screen interactive device, that is, a touch electronic device of a screen appears, and various applications are displayed on a touch display unit of the electronic device, so that a user can control the corresponding applications to be opened or moved by performing touch operation on the touch display screen of the electronic device, and better use experience can be provided for the user.
However, the inventor of the present application finds the following technical problems or defects in the prior art in the process of implementing the present invention:
in the prior art, when a plurality of display objects are displayed on a large-screen touch device, a user needs to select a corresponding display object to be started or operated through long-distance touch operation, thereby causing a technical problem that the selection mode of the display object of the large-screen touch device is single.
In the prior art, when a display object is moved on a large-screen touch device, a user needs to select the display object on the large-screen touch device and determine the movement of the display object through touch operation, so that the large-screen touch device has a single movement mode of the display object, and the operation of moving the display object by the user is inconvenient.
Disclosure of Invention
The invention provides an information processing method and electronic equipment, which are used for solving the technical problem that when a plurality of display objects are displayed on large-screen touch equipment in the prior art, a user needs to select the corresponding display object needing to be started or operated through long-distance touch operation, so that the selection mode of the display object of the large-screen touch equipment is single, and the specific technical scheme is as follows:
an information processing method is applied to an electronic device, the electronic device comprises a display unit, the electronic device comprises or is connected with an image acquisition unit, M display objects are arranged on the display unit, wherein M is a positive integer greater than or equal to 2, and the method comprises the following steps:
acquiring a first operation image of a first operation body aiming at a first display object in the M display objects through the image acquisition unit;
analyzing the first operation image to generate an adjusting instruction;
and adjusting the display parameters of the first display object according to the adjusting instruction.
Optionally, the analyzing the first operation image to generate an adjustment instruction specifically includes:
analyzing the first operation image to acquire head image information of the operation body in the first operation image;
according to the head image information, the first display object is determined in the M display objects, and an adjusting instruction for the first display object is generated.
Optionally, the adjusting, according to the adjustment instruction, the display parameter of the first display object is specifically:
and adjusting the first display object from a first display effect to a second display effect according to the adjusting instruction.
Optionally, the determining, according to the head image information, the first display object corresponding to the head image in the M display objects and generating a display parameter adjustment instruction for the first display object specifically include:
analyzing the head image information to obtain eye image information in the head image information;
according to the eye image information, the first display object corresponding to the face image is determined in the M display objects, and a display parameter adjusting instruction for the first display object is generated.
Optionally, the adjusting, according to the adjustment instruction, the display parameter of the first display object is specifically:
and executing the adjusting instruction to adjust the first display object from the current first display position to a second display position different from the first display position.
Optionally, the determining, according to the head image information, the first display object in the M display objects and generating a position adjustment instruction for the first display object specifically include:
analyzing the head image and acquiring an eye movement track image in the head image;
and generating a position adjusting instruction aiming at the first display object according to the eye movement track image.
Optionally, the adjusting the first display object from the current first display position to a second display position different from the first display position specifically includes:
determining a display distance between the first display position and the second display position according to the first display position and the second display position;
at least determining N temporary display positions in the display distance, wherein N is a positive integer greater than or equal to 1;
and displaying the first display object from the first display position to the second display position step by step through the N temporary display positions.
Optionally, the generating a position adjustment instruction for a first display object in the M display objects according to the eye movement trajectory image information specifically includes:
determining second display position information of a first display object in the M display objects according to the eyeball motion track image information;
and generating the position adjusting instruction containing the second display position information aiming at the first display object according to the second display position.
Optionally, after the adjusting the display parameter of the first display object according to the adjustment instruction, the method further includes:
the touch operation of a second operation body is detected through a touch detection unit in the electronic equipment, wherein the second operation body is different from the first operation body.
An electronic device, the electronic device comprising:
the display unit is used for displaying M display objects, wherein M is a positive integer greater than or equal to 2;
the acquisition unit is used for acquiring a first operation image of a first operation body aiming at a first display object in the M display objects through the image acquisition unit;
the instruction generating unit is used for analyzing the first operation image and generating an adjusting instruction;
and the execution unit is used for adjusting the display parameters of the first display object according to the adjusting instruction.
Optionally, the instruction generating unit includes:
the analysis module is used for analyzing the first operation image and acquiring first head image information of the operation body in the first operation image;
and the instruction generating module is used for determining the first display object corresponding to the head image in the M display objects according to the head image information and generating an adjusting instruction for the first display object.
Optionally, the execution unit is specifically configured to adjust the first display object from a first display effect to a second display effect according to the adjustment instruction.
Optionally, the execution unit is specifically configured to execute the adjustment instruction, and adjust the first display object from a current first display position to a second display position different from the first display position.
Optionally, the instruction generating module includes:
the analysis submodule is used for analyzing the head image and acquiring an eye movement track image in the head image;
and the instruction generating submodule is used for generating a position adjusting instruction aiming at the first display object according to the eye movement track image.
Optionally, the execution unit specifically includes:
the determining module is used for determining the display distance between the first display position and the second display position according to the first display position and the second display position;
the display position determining module is used for determining at least N temporary display positions in the display distance, wherein N is a positive integer greater than or equal to 1;
and the execution module is used for displaying the first display object from the first display position to the second display position step by step through the N temporary display positions.
The embodiment of the invention collects the image of the electronic equipment corresponding to the user through the image collecting unit of the electronic equipment, analyzes the first operation image aiming at the display object on the display unit according to the image, generates the corresponding adjusting instruction according to the first operation image, and finally adjusts the display parameter of the display object according to the adjusting instruction, thereby solving the technical problem that when a plurality of display objects are displayed on the large-screen touch equipment in the prior art, the user needs to select the corresponding display object needing to be started or operated through long-distance touch operation, so that the selection mode of the display object of the large-screen touch equipment is single, further realizing the selection of the display image through the head image or eye image of the user and the gesture, and adjusting the display image, therefore, the display positioning mode of the electronic equipment is increased, the information processing capacity of the electronic equipment is improved, the operation of a user is facilitated, and the user experience is improved.
In addition, in the embodiment of the invention, the display object on the display unit is adjusted from the first display position to the second display position by analyzing the head image or the eye image or the gesture of the electronic equipment corresponding to the user, therefore, the problem that when the display object is moved on the large-screen touch equipment in the prior art, the user is required to select the display object on the large-screen touch equipment and determine the movement of the display object through touch operation is solved, thereby leading to the technical problems that the moving mode of the large-screen touch equipment to the display object is single, the operation of the user for moving the display object is inconvenient, thereby realizing that the electronic equipment moves the display object by acquiring the head image or the eye image of the user, increasing the moving mode of the electronic equipment to the display object, and the operability of the electronic equipment is improved, the operation of a user is greatly facilitated, and the user experience is improved.
Drawings
FIG. 1 is a flow chart illustrating an information processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an eye-controlled positioning display object according to an embodiment of the invention;
FIG. 3 is a schematic diagram illustrating a gesture-locating display object according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a head-controlled mobile display object according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating a gesture moving a display object according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the invention.
Detailed Description
The invention provides an information processing method and electronic equipment, wherein the electronic equipment comprises a display unit, the electronic equipment comprises or is connected with an image acquisition unit, M display objects are arranged on the display unit, then the electronic equipment obtains a first operation image of a first operation body aiming at a first display object in the M display objects through the image acquisition unit, and then the electronic equipment analyzes the first operation image, generates an adjusting instruction and adjusts the display parameters of the first display object according to the adjusting instruction.
In a simple manner, when the electronic device (large-screen touch device) displays a plurality of display objects on the touch display unit, the electronic device acquires an image in the electronic corresponding area in real time through the image acquisition unit, and if the image includes an operation on the first operation body for the plurality of display objects, the first operation image is analyzed, and then an adjustment instruction is generated according to the first operation image, where the adjustment instruction may adjust the display brightness, the display size, or the display position of the display object.
The technical solutions of the present invention are described in detail with reference to the drawings and the specific embodiments, and it should be understood that the embodiments and the specific technical features in the embodiments of the present invention are only illustrative of the technical solutions of the present invention, and are not restrictive, and the embodiments and the specific technical features in the embodiments of the present invention may be combined with each other without conflict.
Fig. 1 is a flowchart of an information processing method applied to an electronic device, where the electronic device includes a display unit, M display objects are displayed on the display unit, and the electronic device further includes or is connected to an image capturing unit, and the method includes:
And 103, adjusting the display parameters of the first display object according to the adjustment instruction.
Firstly, the electronic device is a large-screen device, and a plurality of M display objects are displayed on the display screen, where the M display objects are arranged according to a certain preset rule (as shown in fig. 2), and in the case shown in fig. 2, if a user needs to operate a display object far away from the display screen or edit a display object far away from the user, in the prior art, the user performs a corresponding touch operation on the display screen to control selection of the display object or move the display object, but this way makes the operation very inconvenient, and the display object determination way of the electronic device is also very single.
In the embodiment of the present invention, the electronic device includes or is connected to an image capturing unit, and the image capturing unit is capable of capturing an image in a preset area corresponding to the electronic device, where the image includes a first operation image of a first operation body on a first display object in M display objects.
In order to ensure that the electronic device can perform accurate positioning according to the first operation image acquired by the image acquisition unit, a user needs to pre-store a standard image for determining a display image in the electronic device before performing the first operation image.
The standard image for determining the display image may be a head image of the user (for example, an image of nodding the head of the user), or an eye image in the head image of the user (for example, a blink image of the user), but an adjustment image of the user may also be pre-stored in the electronic device, and the user may perform fine adjustment on the selection of the display image, for example, the user may save the first image of the right side of the currently displayed object as the head moves, and select the first display object of the coordinates of the currently displayed object as the head moves.
After the standard image for determining the display image is saved, the user can perform precise selection positioning operation on the display object in the following manner:
in an embodiment of the present invention, the electronic device is provided with an eye movement detection module, which is capable of detecting a direction in which an eyeball of a user notices, specifically, the electronic equipment firstly detects the attention direction of the eyeballs of the user through the eye movement detection module, determines a display area on the display unit according to the attention direction of the eyeballs of the user, then detects the display object existing in the display area, when only one display object exists in the display area, the electronic equipment directly determines the display object as the first display object, the electronic device may then adjust the first display object from a first display effect to a second display effect different from the first display effect, specifically, to increase the display brightness of the first display object or to add a corresponding display border to the display edge of the first display.
In order to improve the accuracy of the electronic device for determining the display object, in the embodiment of the present invention, after detecting the eyeball of the user, the electronic device detects the time when the eyeball focuses on a certain area on the display unit, then the electronic device determines whether the time when the eyeball focuses on the area exceeds a preset time threshold (for example, 3 s), when the time exceeds a preset time 3s, the electronic device determines the area as the area selected by the user, then the electronic device determines the display object to be adjusted directly from the display area (as shown in fig. 2), in fig. 2, the electronic device can determine the direction of the attention of the user through the eye movement detection module, then the electronic device determines the dead time of the attention of the user in the coordinate area, if the user's attention-staying time in the left area exceeds a preset time, the electronic device will determine the left area as the user-selected area, and then the electronic device will determine window 1 in the coordinate area as the selected object.
Then, the electronic device increases the display brightness of the window 1, or increases the display range of the window 1, or adds a display frame at the edge of the window 1, so as to prompt the user of the currently selected display object.
Certainly, the display is not necessarily a display object required by the user, and therefore, in the embodiment of the present invention, the electronic device continues to acquire the eye image of the user, and if the electronic device acquires the blink image of the user or the nodding image of the user, the electronic device determines that the display object is the display object required to be selected by the user, and further adjusts the display object to a preset display area.
If the display object determined by the electronic device is not the display object required by the user, the user may adjust the display object by moving the eyes or moving the head, and if the image acquired by the electronic device is a moving image of the eyes of the user, the electronic device determines whether the eyes move left or right, and if the electronic device detects that the eyes move right, the electronic device determines that the user needs to select the first display object on the right of the current display object, for example, as shown in fig. 2, when the display window determined by the electronic device is window 1 and the eyes of the user move right, the electronic device adjusts the window 1 to window 2, and if the eyes of the user continue to move, the electronic device continues to re-determine.
After the display object is determined, the electronic device may acquire eye image information of the user in a preset area, that is, the electronic device extracts an eye image in the head image, and of course, a plurality of acquired images are analyzed here, and then a movement track of an eyeball of the user is obtained through analysis according to the eye image, where the movement track represents that the user needs to adjust the first display object from a first display position to a second display position, for example, when the user's attention moves from a lower left corner to a lower right corner, the electronic device acquires a movement process of the eyeball through an image acquisition unit, and detects a dead time of the user's eyeball at the lower right corner position, that is, an attention time of the user's attention at the lower right corner, and when the dead time reaches or exceeds a preset time, the electronic device determines the lower right corner position as the second display position, the electronic device acquires the movement track of the eyeball, generates a corresponding adjustment instruction according to the movement track, and includes movement track information in the adjustment instruction, so that the electronic device moves the first display object from the first display position to the second display position according to the movement track information.
Of course, in the embodiment of the present invention, when a second display object exists at the second position, the electronic device may adjust the first display object to the second display position, and then adjust the second display object at the second display position to the first display position, that is, the display positions of the first display object and the second display object are swapped, or the first display object directly covers the second display object at the second display position.
Therefore, in the above embodiment, the display trajectory and the display position are determined by the movement of the eyeball and the dead time, so that the user can conveniently select or move the display object on the large-screen electronic device by simple operation.
In addition, in the embodiment of the present invention, in addition to positioning the display object through the eye image, the display object may be determined through a head image and a gesture in the embodiment of the present invention, wherein a specific technical scheme for moving the display object through the head image and the gesture is as follows:
firstly, the electronic device controls an image acquisition unit to acquire image information in a corresponding area of the electronic device in real time and analyzes the image information, wherein the analysis process is to determine whether the image information contains a head image of a user, if the image does not contain the head image of the user, the electronic device discards the image, and acquires a new image again and analyzes the image.
When the image contains the head image of the user, the electronic device first determines the corresponding area of the head image in the image, and then determines the orientation and direction corresponding to the head image according to the position of the head in the head image, so that after the direction is determined, the electronic device will determine a display object in the direction directly on the electronic device, specifically, the electronic device will analyze the collected head image and the collected images, so that the electronic device will determine that the head of the user is deflected to the right, and therefore, the electronic device will generate an adjustment instruction for a first display object arranged at a first position on the right, and then adjust the display effect of the first display object from a first display effect to a second display effect according to the adjustment instruction, for example, the display brightness of the first display object is increased or the display size of the first display object is increased Or adding a frame to the edge display part of the first display object.
When the user determines that the selected display object is the display object required to be used by the user, the user may determine to select the display object through nodding, that is, the electronic device may acquire the nodding image of the user in the acquisition area of the image acquisition unit, and after the electronic device analyzes the image, the electronic device may determine that the display image is the finally selected image.
Of course, if the user finds that the selection is wrong, the user can reselect the display window at any time according to the direction corresponding to the head movement or the gesture, for example, the user can finely adjust the display object through the coordinate deflection of the head, so that the electronic device can accurately determine the display object, and the operation of the user can be greatly facilitated.
After the electronic device determines the display object, the user may also adjust the position of the determined display object through the head, before moving the display object, the user is required to determine the moved display object, the determination of the moved display object in the electronic device may be determined in any manner, but in the embodiment of the present invention, the determination of the display object is determined by the determination manner in the above embodiment, after determining the display object, the electronic device will continue to acquire image information of the user corresponding to the electronic device, of course, the electronic device will not only acquire one image but continuously acquire multiple images, or acquire a first video image, and then the electronic device will simultaneously parse the multiple images, and extract the head images of the user from the multiple images, so that the head movement track of the user can be determined according to the multiple head images, then, according to the motion trajectory, the electronic device determines a movement trajectory of the display object, that is, the electronic device generates a movement trajectory by the head movement of the user, the movement trajectory of the display object is controlled by the user, so that after the movement trajectory is obtained, the electronic device generates a corresponding adjustment instruction, and according to the adjustment instruction, the electronic device moves the determined first display object from the first display position to the second display position.
For example, as shown in fig. 4, it is determined that the window 1 is a display object that needs to be moved on the display unit, and in fig. 4, the head of the user rotates from left to right, at this time, the electronic device acquires head movement information of the user through the image acquisition unit, and certainly, the head movement process is obtained by processing a plurality of images acquired by the image acquisition unit, and then according to the head movement information, the electronic device correspondingly generates an adjustment instruction, where the adjustment instruction includes a movement trajectory, and the movement trajectory is used to control the display window 1 to be displayed from the display position at the lower left corner to the current position operated by the user.
The display position of the display object may be determined by the user by the head movement from row to row, for example in figure 4, the electronic device will determine the starting position according to the course of the movement of the user's head, in which process the starting position is first determined, the initial position is the lower left corner position, then the electronic equipment determines the final display position of the movement through the head image of the user, the final display position is a stop position during the movement of the user, and in fig. 4, the position at which the user's head is most aligned with is the lower right corner position, therefore, the electronic device will determine that the lower right corner position is the final display position, namely, the second display position, the electronic device generates a corresponding adjustment instruction, the adjustment instruction includes information of the first display position, the second display position and the display track, and finally adjusts the window 1 from the first lower left corner position to the lower right corner position according to the adjustment instruction.
In addition, in the embodiment of the present invention, an adjustment instruction may also be generated through a gesture, for example, after the electronic device acquires a gesture image of a user, the electronic device analyzes the positioning direction of the index finger in the finger, as shown in fig. 3, after the electronic device obtains the gesture image, the electronic device determines that the direction pointed by the index finger of the user is the lower right corner position of the display unit, so that the matching result with the standard image is the lower right corner position, and further the electronic device determines that the window 7 needs to be selected by the user, and then the electronic device generates an adjustment instruction corresponding to the window 7, and according to the adjustment instruction, the window 7 raises display brightness, or increases a display range, or adds a display frame, or highlights relative to the display screen. Therefore, the user can determine whether to accurately select through the display effect.
After selecting the display object by the gesture, the user may adjust the position of the display object by the gesture, as shown in fig. 5, the user adjusts the direction from the lower left corner to the direction of the current operation window through the gesture, and in the gesture adjusting process of the user, the electronic equipment records the gesture adjusting process through the image acquisition unit, then generates a moving track according to the gesture adjusting process of the user, the movement trajectory is used to determine the position of window 1 moving from the lower left corner to the position where the current operating window is displayed, of course, if the user's gesture is directed to the lower right corner of the display unit, the electronic device will determine that the window 1 will be displayed at the lower right corner, and therefore, the electronic device generates a corresponding adjusting instruction, and adjusts the window 1 from the lower left corner to the lower right corner for display according to the adjusting instruction.
In order to achieve a better display effect, in an embodiment of the present invention, after the first display position and the second display position are analyzed through the image, the electronic device calculates a display distance between the first display position and the second display position, and determines N temporary display positions in the display distance according to a preset rule, where the preset rule is that the display distance is equally divided, and then the N temporary display positions are determined according to a division result, and then when the display object is adjusted from the first display position to the second display position, the electronic device displays the display object in the N temporary display positions in sequence, so as to display the display object to the second display position step by step, which is simply that the display object has a gradual movement effect when the display object is adjusted from the first display position to the second display position, therefore, the user can clearly see the moving process of the display object, the moving track of the display object can be reflected, and better user experience can be provided for the user.
Of course, in the embodiment of the present invention, after the display object is determined, the display object will move according to the head movement of the user or according to the eyeball movement of the user.
In addition, in the embodiment of the present invention, a second operation body exists, where the second operation body is detected by the touch detection unit, that is, the second operation body is limited to the object of the touch operation.
The embodiment of the invention collects the image of the electronic equipment corresponding to the user through the image collecting unit of the electronic equipment, analyzes the first operation image aiming at the display object on the display unit according to the image, generates the corresponding adjusting instruction according to the first operation image, and finally adjusts the display parameter of the display object according to the adjusting instruction, thereby solving the technical problem that when a plurality of display objects are displayed on the large-screen touch equipment in the prior art, the user needs to select the corresponding display object needing to be started or operated through long-distance touch operation, so that the selection mode of the display object of the large-screen touch equipment is single, further realizing the selection of the display image through the head image or eye image of the user and the gesture, and adjusting the display image, therefore, the display positioning mode of the electronic equipment is increased, the information processing capacity of the electronic equipment is improved, the operation of a user is facilitated, and the user experience is improved.
In addition, in the embodiment of the invention, the display object on the display unit is adjusted from the first display position to the second display position by analyzing the head image or the eye image or the gesture of the electronic equipment corresponding to the user, therefore, the problem that when the display object is moved on the large-screen touch equipment in the prior art, the user is required to select the display object on the large-screen touch equipment and determine the movement of the display object through touch operation is solved, thereby leading to the technical problems that the moving mode of the large-screen touch equipment to the display object is single, the operation of the user for moving the display object is inconvenient, thereby realizing that the electronic equipment moves the display object by acquiring the head image or the eye image of the user, increasing the moving mode of the electronic equipment to the display object, and the operability of the electronic equipment is improved, the operation of a user is greatly facilitated, and the user experience is improved.
Corresponding to an information processing method in the embodiment of the present invention, an embodiment of the present invention further provides an electronic device, and as shown in fig. 6, a specific structural diagram of an electronic device in the embodiment of the present invention is shown, where the electronic device includes:
a display unit 601, configured to display M display objects, where M is a positive integer greater than or equal to 2;
an acquiring unit 602, configured to acquire a first operation image obtained by acquiring, by an image acquisition unit, a first operation of a first operation body on a first display object in the M display objects;
an instruction generating unit 603, configured to parse the first operation image and generate an adjustment instruction;
the execution unit 604 is configured to adjust the display parameter of the first display object according to the adjustment instruction.
The instruction generating unit 603 includes an analyzing module and an instruction generating module, wherein the analyzing module is configured to analyze the first operation image, acquire first head image information of the operation body in the first operation image, and then the instruction generating module is configured to determine, according to the head image information, the first display object corresponding to the head image from among the M display objects, and generate an adjustment instruction for the first display object.
Wherein the instruction generation module further comprises: the analysis submodule is used for analyzing the head image and acquiring an eye movement track image in the head image, and the instruction generation submodule is used for generating a position adjustment instruction for the first display object according to the eye movement track image.
In the electronic device, the execution unit 604 may be configured to adjust the first display object from the first display effect to the second display effect according to the adjustment instruction, and also adjust the first display object from the first display position to the second display position by the user.
When the execution unit is used for adjusting the display object from the first display position to the second display position, the execution unit comprises:
the determining module is used for determining the display distance between the first display position and the second display position according to the first display position and the second display position;
the display position determining module is used for determining at least N temporary display positions in the display distance, wherein N is a positive integer greater than or equal to 1;
and the execution module is used for displaying the first display object from the first display position to the second display position step by step through the N temporary display positions.
One or more embodiments provided by the invention have at least the following technical effects or advantages:
the embodiment of the invention collects the image of the electronic equipment corresponding to the user through the image collecting unit of the electronic equipment, analyzes the first operation image aiming at the display object on the display unit according to the image, generates the corresponding adjusting instruction according to the first operation image, and finally adjusts the display parameter of the display object according to the adjusting instruction, thereby solving the technical problem that when a plurality of display objects are displayed on the large-screen touch equipment in the prior art, the user needs to select the corresponding display object needing to be started or operated through long-distance touch operation, so that the selection mode of the display object of the large-screen touch equipment is single, further realizing the selection of the display image through the head image or eye image of the user and the gesture, and adjusting the display image, therefore, the display positioning mode of the electronic equipment is increased, the information processing capacity of the electronic equipment is improved, the operation of a user is facilitated, and the user experience is improved.
In addition, in the embodiment of the invention, the display object on the display unit is adjusted from the first display position to the second display position by analyzing the head image or the eye image or the gesture of the electronic equipment corresponding to the user, therefore, the problem that when the display object is moved on the large-screen touch equipment in the prior art, the user is required to select the display object on the large-screen touch equipment and determine the movement of the display object through touch operation is solved, thereby leading to the technical problems that the moving mode of the large-screen touch equipment to the display object is single, the operation of the user for moving the display object is inconvenient, thereby realizing that the electronic equipment moves the display object by acquiring the head image or the eye image of the user, increasing the moving mode of the electronic equipment to the display object, and the operability of the electronic equipment is improved, the operation of a user is greatly facilitated, and the user experience is improved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (11)
1. An information processing method is applied to an electronic device, the electronic device comprises a display unit, the electronic device comprises or is connected with an image acquisition unit, M display objects are arranged on the display unit, wherein M is a positive integer greater than or equal to 2, and the method comprises the following steps:
acquiring a first operation image of a first operation body aiming at a first display object in the M display objects through the image acquisition unit;
analyzing the first operation image to generate an adjusting instruction; the method specifically comprises the following steps: analyzing the first operation image to acquire head image information of the first operation body in the first operation image; analyzing the head image information and acquiring an eye movement track image in the head image information; generating a position adjusting instruction aiming at the first display object according to the eye movement track image;
according to the adjusting instruction, adjusting the display parameters of the first display object, including: and executing the position adjusting instruction to adjust the first display object from a current first display position to a second display position different from the first display position.
2. The method of claim 1, wherein the parsing the first operation image to generate an adjustment instruction specifically comprises:
according to the head image information, the first display object is determined in the M display objects, and an adjusting instruction for the first display object is generated.
3. The method according to claim 2, wherein the adjusting the display parameter of the first display object according to the adjustment instruction includes:
and adjusting the first display object from a first display effect to a second display effect according to the adjusting instruction.
4. The method according to claim 3, wherein the determining, according to the header image information, the first display object corresponding to the header image among the M display objects and generating the display parameter adjustment instruction for the first display object includes:
analyzing the head image information to obtain eye image information in the head image information;
according to the eye image information, the first display object corresponding to the head image is determined in the M display objects, and a display parameter adjusting instruction for the first display object is generated.
5. The method of claim 1, wherein the adjusting the first display object from a current first display position to a second display position different from the first display position comprises:
determining a display distance between the first display position and the second display position according to the first display position and the second display position;
at least determining N temporary display positions in the display distance, wherein N is a positive integer greater than or equal to 1;
and displaying the first display object from the first display position to the second display position step by step through the N temporary display positions.
6. The method according to claim 5, wherein the generating a position adjustment instruction for a first display object of the M display objects according to the eye movement trajectory image information specifically includes:
determining second display position information of a first display object in the M display objects according to the eye movement track image information;
and generating the position adjusting instruction containing the second display position information aiming at the first display object according to the second display position.
7. The method of claim 1, wherein after said adjusting display parameters of said first display object in accordance with said adjustment instruction, said method further comprises:
the touch operation of a second operation body is detected through a touch detection unit in the electronic equipment, wherein the second operation body is different from the first operation body.
8. An electronic device, characterized in that the electronic device comprises:
the display unit is used for displaying M display objects, wherein M is a positive integer greater than or equal to 2;
the acquisition unit is used for acquiring a first operation image of a first operation body aiming at a first display object in the M display objects through the image acquisition unit;
the instruction generating unit is used for analyzing the first operation image and generating an adjusting instruction; the instruction generation unit includes: the analysis module is used for analyzing the first operation image and acquiring first head image information of the operation body in the first operation image; the analysis submodule is used for analyzing the head image and acquiring an eye movement track image in the head image; the instruction generation submodule is used for generating a position adjustment instruction aiming at the first display object according to the eye movement track image;
the execution unit is used for adjusting the display parameters of the first display object according to the adjustment instruction, and comprises: and executing the position adjusting instruction to adjust the first display object from a current first display position to a second display position different from the first display position.
9. The electronic device of claim 8, wherein the instruction generation unit further comprises:
and the instruction generating module is used for determining the first display object corresponding to the head image in the M display objects according to the head image information and generating an adjusting instruction for the first display object.
10. The electronic device of claim 9, wherein the execution unit is specifically configured to adjust the first display object from a first display effect to a second display effect according to the adjustment instruction.
11. The electronic device of claim 8, wherein the execution unit specifically includes:
the determining module is used for determining the display distance between the first display position and the second display position according to the first display position and the second display position;
the display position determining module is used for determining at least N temporary display positions in the display distance, wherein N is a positive integer greater than or equal to 1;
and the execution module is used for displaying the first display object from the first display position to the second display position step by step through the N temporary display positions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210550075.8A CN103870146B (en) | 2012-12-17 | 2012-12-17 | Information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210550075.8A CN103870146B (en) | 2012-12-17 | 2012-12-17 | Information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103870146A CN103870146A (en) | 2014-06-18 |
| CN103870146B true CN103870146B (en) | 2020-06-23 |
Family
ID=50908736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210550075.8A Active CN103870146B (en) | 2012-12-17 | 2012-12-17 | Information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103870146B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104699249B (en) * | 2015-03-27 | 2018-04-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| WO2019071594A1 (en) * | 2017-10-09 | 2019-04-18 | 华为技术有限公司 | Display processing method and electronic device |
| CN108920047A (en) * | 2018-05-29 | 2018-11-30 | 努比亚技术有限公司 | A kind of control method of application program, terminal and computer readable storage medium |
| CN113762181A (en) * | 2021-09-13 | 2021-12-07 | 联想(北京)有限公司 | Image processing method and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102301316A (en) * | 2009-12-14 | 2011-12-28 | 松下电器产业株式会社 | User interface apparatus and input method |
| CN102339125A (en) * | 2010-07-23 | 2012-02-01 | 夏普株式会社 | Information equipment and control method and system thereof |
| CN102566747A (en) * | 2010-09-15 | 2012-07-11 | Lg电子株式会社 | Mobile terminal and method for controlling operation of mobile terminal |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3586610B2 (en) * | 2000-02-23 | 2004-11-10 | Ｎｅｃパーソナルプロダクツ株式会社 | Display with automatic angle adjustment function |
| WO2010118292A1 (en) * | 2009-04-09 | 2010-10-14 | Dynavox Systems, Llc | Calibration free, motion tolerant eye-gaze direction detector with contextually aware computer interaction and communication methods |
| JP2010277340A (en) * | 2009-05-28 | 2010-12-09 | Panasonic Corp | Input device and input method |
| CN102592569B (en) * | 2011-01-10 | 2015-03-25 | 联想(北京)有限公司 | Electronic equipment and display method |
| JP5228074B2 (en) * | 2011-03-31 | 2013-07-03 | 株式会社東芝 | Information processing apparatus and display control method |
| CN102708843B (en) * | 2012-05-15 | 2017-02-15 | 中兴通讯股份有限公司 | Terminal image processing method and terminal |
-
2012
- 2012-12-17 CN CN201210550075.8A patent/CN103870146B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102301316A (en) * | 2009-12-14 | 2011-12-28 | 松下电器产业株式会社 | User interface apparatus and input method |
| CN102339125A (en) * | 2010-07-23 | 2012-02-01 | 夏普株式会社 | Information equipment and control method and system thereof |
| CN102566747A (en) * | 2010-09-15 | 2012-07-11 | Lg电子株式会社 | Mobile terminal and method for controlling operation of mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103870146A (en) | 2014-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220382379A1 (en) | Touch Free User Interface | |
| US20210157412A1 (en) | Systems and methods of direct pointing detection for interaction with a digital device | |
| US10565437B2 (en) | Image processing device and method for moving gesture recognition using difference images | |
| US9703373B2 (en) | User interface control using gaze tracking | |
| CN103353935B (en) | A kind of 3D dynamic gesture identification method for intelligent domestic system | |
| US9405373B2 (en) | Recognition apparatus | |
| CN106708270B (en) | Virtual reality equipment display method and device and virtual reality equipment | |
| KR101563312B1 (en) | System for gaze-based providing education content | |
| CN107608508B (en) | Information processing method and electronic equipment | |
| US11809637B2 (en) | Method and device for adjusting the control-display gain of a gesture controlled electronic device | |
| KR20220144890A (en) | Method and system for controlling a device using hand gestures in a multi-user environment | |
| US20170192519A1 (en) | System and method for inputting gestures in 3d scene | |
| KR101631011B1 (en) | Gesture recognition apparatus and control method of gesture recognition apparatus | |
| CN107479712B (en) | Information processing method and device based on head-mounted display equipment | |
| CN103870146B (en) | Information processing method and electronic equipment | |
| US10055011B2 (en) | Interactive system, handheld device remote controller and operating method thereof | |
| JP2012238293A (en) | Input device | |
| CN105912101B (en) | Projection control method and electronic equipment | |
| KR101465894B1 (en) | Mobile terminal for generating control command using marker put on finger and method for generating control command using marker put on finger in terminal | |
| KR20140014868A (en) | Gaze tracking apparatus and method | |
| KR101426378B1 (en) | System and Method for Processing Presentation Event Using Depth Information | |
| KR20180074124A (en) | Method of controlling electronic device with face recognition and electronic device using the same | |
| KR101465896B1 (en) | Mobile terminal for generating control commands using front side camera and rear side camera | |
| KR20130123116A (en) | Apparatus for recognizing gesture by using see-through display and method thereof | |
| CN116820251B (en) | Gesture track interaction method, intelligent glasses and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |