CN106293036B - Interaction method and electronic equipment - Google Patents
Interaction method and electronic equipment Download PDFInfo
- Publication number
- CN106293036B CN106293036B CN201510325727.1A CN201510325727A CN106293036B CN 106293036 B CN106293036 B CN 106293036B CN 201510325727 A CN201510325727 A CN 201510325727A CN 106293036 B CN106293036 B CN 106293036B
- Authority
- CN
- China
- Prior art keywords
- content
- touch
- projection
- electronic device
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses an interaction method and electronic equipment, wherein the interaction method comprises the following steps: projecting first content to a projection surface by using a projection module in the electronic equipment, wherein the first content is a first area in a first image, and the projection module and the electronic equipment synchronously move; when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment, wherein the second content is a second area of the first image; projecting the second content onto the projection surface.
Description
Technical Field
The present invention relates to interaction technologies, and in particular, to an interaction method and an electronic device.
Background
With the increasing screen size of smart phones, people never stop pursuing large screen experience, and meanwhile, the rapid development of projection technology provides a new idea for large screen experience, namely that projection phones are produced at the same time. However, there is no good solution to how to perform efficient interaction on projection screens.
Disclosure of Invention
In order to solve the technical problem, embodiments of the present invention provide an interaction method and an electronic device.
The interaction method provided by the embodiment of the invention comprises the following steps:
projecting first content to a projection surface by using a projection module in the electronic equipment, wherein the first content is a first area in a first image, and the projection module and the electronic equipment synchronously move;
when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment, wherein the second content is a second area of the first image;
projecting the second content onto the projection surface.
The electronic equipment provided by the embodiment of the invention comprises:
the projection module is used for projecting first content to a projection surface, the first content is a first area in a first image, and the projection module and the electronic equipment move synchronously;
the detection module is used for detecting the attitude parameters of the electronic equipment;
the processing module is used for determining second content to be projected according to the attitude parameter of the electronic equipment when the change of the attitude parameter of the electronic equipment is detected, wherein the second content is a second area of the first image;
the projection module is further configured to project the second content onto the projection surface.
In the technical scheme of the embodiment of the invention, the electronic equipment is provided with a projection module, first content can be projected on a projection surface by using the projection module, the first content is a part of a first image, and a touch icon is displayed on the first content. The electronic equipment is further provided with a detection module, such as a gyroscope, the detection module is used for detecting the attitude parameters of the electronic equipment in real time, when the attitude parameters of the electronic equipment change, the orientation of the electronic equipment relative to the projection surface also changes, the projection module determines second content to be projected according to the current attitude parameters of the electronic equipment and projects the second content on the projection surface, wherein the second content is also a part of the first image, but the second content is different from the first content due to the fact that the orientation of the electronic equipment relative to the projection surface changes. The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Drawings
Fig. 1 is a schematic flowchart of an interaction method according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating an interaction method according to a second embodiment of the present invention;
FIG. 3 is a flowchart illustrating an interaction method according to a third embodiment of the present invention;
FIG. 4 is a flowchart illustrating an interaction method according to a fourth embodiment of the present invention;
FIG. 5 is a flowchart illustrating an interaction method according to a fifth embodiment of the present invention;
fig. 6 is a flowchart illustrating an interaction method according to a sixth embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to a first embodiment of the invention;
fig. 8 is a schematic structural diagram of an electronic device according to a second embodiment of the invention;
fig. 9 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention;
fig. 11 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention;
fig. 12 is a schematic structural composition diagram of an electronic device according to a sixth embodiment of the present invention;
FIG. 13 is a first schematic diagram of a projection surface according to an embodiment of the present invention;
FIG. 14 is a schematic diagram of an electronic device according to an embodiment of the invention;
fig. 15 is a second schematic diagram of a projection surface according to an embodiment of the invention.
Detailed Description
So that the manner in which the features and aspects of the embodiments of the present invention can be understood in detail, a more particular description of the embodiments of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings.
Fig. 1 is a schematic flowchart of an interaction method according to a first embodiment of the present invention, where the interaction method in this example is applied to an electronic device, and as shown in fig. 1, the interaction method includes the following steps:
step 101: and projecting first content to a projection surface by using a projection module in the electronic equipment, wherein the first content is a first area in a first image, and the projection module and the electronic equipment synchronously move.
In the embodiment of the invention, the electronic equipment can be a mobile phone, a tablet computer and the like. The electronic device has a projection module, such as a pico projector. The first content can be projected on the projection surface by the projection module.
In the embodiment of the present invention, the first content is a first area in the first image. Referring to fig. 13, the first image may be desktop content of the electronic device. The first area is a portion of the desktop content. In the figure, the solid line frame is the first content, and the dashed line frame is the first image.
In the embodiment of the present invention, when the user stands horizontally (in a designated orientation) in front of the projection surface such as a white wall, it is equivalent to designate the position and orientation of the electronic device, and it can be considered that the first image is virtually presented on the projection surface with the projection direction as the center. The area of the first image projected by the electronic device is then determined relative to the nominal position and orientation (i.e., the projection direction) of the electronic device. I.e. the content of the first image virtually rendered, i.e. the currently projected content, is mapped in the current direction of propagation of the light with the current orientation and a certain area at the current position of the electronic device. For example, when the electronic device projects the projection plane with the nominal orientation at the nominal position, the projection plane displays first content, and the first content is content of the first image in the first area.
Step 102: when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment, wherein the second content is a second area of the first image.
In the embodiment of the invention, the electronic equipment is provided with a detection module, such as a gravity accelerometer, a nine-axis gyroscope and the like. With the detection unit being able to detect the attitude parameters of the electronic device, the attitude parameters of the electronic device may be calibrated by a set of spatial coordinates, such as (x, y, z). Referring to fig. 14, when the posture of the electronic device held by the user changes, for example, upward, downward, leftward, rightward, or a combination of the above, the electronic device utilizes a gravity accelerometer, a gyroscope, and a magnetometer to obtain the offset of the coordinates (x, y, z) of the electronic device on the x, y, and z axes, respectively. When the offset exists, the content projected on the projection plane changes, and the projected content is the content at other positions in the first image and is called as second content. The second content is content at a different position in the first image from the first content, and the second content is a second area of the first image. In general, the first area and the second area have the same area range size, but different image contents.
In the embodiment of the invention, when the change of the attitude parameter of the electronic equipment is detected, the direction of the electronic equipment relative to the projection surface is also changed, the different directions cause different projected contents, and the projected contents are positioned at different positions of the projection surface.
Step 103: projecting the second content onto the projection surface.
Here, the second content is also a part of the first image, but the second content is different from the first content because the orientation of the electronic device with respect to the projection surface is changed. The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Fig. 2 is a flowchart illustrating an interaction method according to a second embodiment of the present invention, where the interaction method in this example is applied to an electronic device, and as shown in fig. 2, the interaction method includes the following steps:
step 201: projecting first content to a projection surface by using a projection module in the electronic equipment, and projecting a cursor focus at a first position of the first content.
The first content is a first area in a first image, and the projection module and the electronic device move synchronously.
In the embodiment of the invention, the electronic equipment can be a mobile phone, a tablet computer and the like. The electronic device has a projection module, such as a pico projector. The first content can be projected on the projection surface by the projection module.
In the embodiment of the present invention, the first content is a first area in the first image. Referring to fig. 13, the first image may be desktop content of the electronic device. The first area is a portion of the desktop content. In the figure, the solid line frame is the first content, and the dashed line frame is the first image. The circle at the center position of the first content in the figure is the cursor focus. The cursor focus is used for positioning a certain touch icon of the first content.
In the embodiment of the present invention, when the user stands horizontally (in a designated orientation) in front of the projection surface such as a white wall, it is equivalent to designate the position and orientation of the electronic device, and it can be considered that the first image is virtually presented on the projection surface with the projection direction as the center. The area of the first image projected by the electronic device is then determined relative to the nominal position and orientation (i.e., the projection direction) of the electronic device. I.e. the content of the first image virtually rendered, i.e. the currently projected content, is mapped in the current direction of propagation of the light with the current orientation and a certain area at the current position of the electronic device. For example, when the electronic device projects the projection plane with the nominal orientation at the nominal position, the projection plane displays first content, and the first content is content of the first image in the first area.
Step 202: and when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment.
The second content is a second region of the first image.
In the embodiment of the invention, the electronic equipment is provided with a detection module, such as a gravity accelerometer, a nine-axis gyroscope and the like. With the detection unit being able to detect the attitude parameters of the electronic device, the attitude parameters of the electronic device may be calibrated by a set of spatial coordinates, such as (x, y, z). Referring to fig. 14, when the posture of the electronic device held by the user changes, for example, upward, downward, leftward, rightward, or a combination of the above, the electronic device utilizes a gravity accelerometer, a gyroscope, and a magnetometer to obtain the offset of the coordinates (x, y, z) of the electronic device on the x, y, and z axes, respectively. When the offset exists, the content projected on the projection plane changes, and the projected content is the content at other positions in the first image and is called as second content. The second content is content at a different position in the first image from the first content, and the second content is a second area of the first image. In general, the first area and the second area have the same area range size, but different image contents.
In the embodiment of the invention, when the change of the attitude parameter of the electronic equipment is detected, the direction of the electronic equipment relative to the projection surface is also changed, the different directions cause different projected contents, and the projected contents are positioned at different positions of the projection surface.
Step 203: projecting the second content onto the projection surface, and projecting a cursor focus at a first position of the second content.
Here, the second content is also a part of the first image, but the second content is different from the first content because the orientation of the electronic device with respect to the projection surface is changed. Referring to fig. 15, the second content is shown in the solid line box, and it can be seen that the second content is different content from the first content, and the first image is shown in the dashed line box. The circle at the center position of the second content in the figure is the cursor focus. The cursor focus is used for positioning a certain touch icon of the second content. Typically, the cursor focus is fixed at a certain position of the first content or the second content.
In the embodiment of the present invention, as the user wants to see the position change in the first image (i.e. the posture change of the electronic device), the focus of the cursor falls on some operable touch icons on the second content, such as an application icon or some buttons.
Step 204: generating a first operation instruction when the touch operation aiming at the second content is obtained on a touch display module of the electronic equipment; and responding to the first operation instruction, executing the operation related to the second content and projecting an operation interface on a projection surface.
In the embodiment of the invention, the touch display module can be a touch display screen. When a user clicks the touch display screen of the electronic equipment to trigger a click event, the electronic equipment determines the coordinate of the cursor focus falling on the second content at the moment, judges whether the coordinate is within the range of a clickable touch icon, and if so, triggers the touch icon, for example, when the touch icon is an application icon, the operation of opening the application is executed, and an operation interface is projected on the projection surface.
The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Fig. 3 is a flowchart illustrating an interaction method according to a third embodiment of the present invention, where the interaction method in this example is applied to an electronic device, and as shown in fig. 3, the interaction method includes the following steps:
step 301: projecting first content to a projection surface by using a projection module in the electronic equipment, and projecting a cursor focus at a first position of the first content.
The first content is a first area in a first image, and the projection module and the electronic device move synchronously.
In the embodiment of the invention, the electronic equipment can be a mobile phone, a tablet computer and the like. The electronic device has a projection module, such as a pico projector. The first content can be projected on the projection surface by the projection module.
In the embodiment of the present invention, the first content is a first area in the first image. Referring to fig. 13, the first image may be desktop content of the electronic device. The first area is a portion of the desktop content. In the figure, the solid line frame is the first content, and the dashed line frame is the first image. The circle at the center position of the first content in the figure is the cursor focus. The cursor focus is used for positioning a certain touch icon of the first content.
In the embodiment of the invention, the first content comprises N touch control icons, and N is more than or equal to 1.
In the embodiment of the present invention, when the user stands horizontally (in a designated orientation) in front of the projection surface such as a white wall, it is equivalent to designate the position and orientation of the electronic device, and it can be considered that the first image is virtually presented on the projection surface with the projection direction as the center. The area of the first image projected by the electronic device is then determined relative to the nominal position and orientation (i.e., the projection direction) of the electronic device. I.e. the content of the first image virtually rendered, i.e. the currently projected content, is mapped in the current direction of propagation of the light with the current orientation and a certain area at the current position of the electronic device. For example, when the electronic device projects the projection plane with the nominal orientation at the nominal position, the projection plane displays first content, and the first content is content of the first image in the first area.
Step 302: and when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment.
The second content is a second region of the first image.
In the embodiment of the invention, the electronic equipment is provided with a detection module, such as a gravity accelerometer, a nine-axis gyroscope and the like. With the detection unit being able to detect the attitude parameters of the electronic device, the attitude parameters of the electronic device may be calibrated by a set of spatial coordinates, such as (x, y, z). Referring to fig. 14, when the posture of the electronic device held by the user changes, for example, upward, downward, leftward, rightward, or a combination of the above, the electronic device utilizes a gravity accelerometer, a gyroscope, and a magnetometer to obtain the offset of the coordinates (x, y, z) of the electronic device on the x, y, and z axes, respectively. When the offset exists, the content projected on the projection plane changes, and the projected content is the content at other positions in the first image and is called as second content. The second content is content at a different position in the first image from the first content, and the second content is a second area of the first image. In general, the first area and the second area have the same area range size, but different image contents.
In the embodiment of the invention, when the change of the attitude parameter of the electronic equipment is detected, the direction of the electronic equipment relative to the projection surface is also changed, the different directions cause different projected contents, and the projected contents are positioned at different positions of the projection surface.
Step 303: projecting the second content onto the projection surface, and projecting a cursor focus at a first position of the second content.
Here, the second content is also a part of the first image, but the second content is different from the first content because the orientation of the electronic device with respect to the projection surface is changed. Referring to fig. 15, the second content is shown in the solid line box, and it can be seen that the second content is different content from the first content, and the first image is shown in the dashed line box. The circle at the center position of the second content in the figure is the cursor focus. The cursor focus is used for positioning a certain touch icon of the second content. Typically, the cursor focus is fixed at a certain position of the first content or the second content.
In the embodiment of the present invention, the second content includes M touch icons, M is greater than or equal to 1, and the first content and the second content may have the same touch icon.
In the embodiment of the present invention, as the user wants to see the position change in the first image (i.e. the posture change of the electronic device), the focus of the cursor falls on some operable touch icons on the second content, such as an application icon or some buttons.
Step 304: when the gesture parameter of the electronic equipment is detected to be changed, the cursor focus is switched from a first touch icon position in the first content to a second touch icon position in the second content.
Step 305: when the cursor focus is focused to a first touch icon, obtaining a first touch operation aiming at the first touch icon on a touch display module.
In the embodiment of the present invention, the first touch operation may be set as a long-press operation.
Step 306: and judging whether the first touch operation meets a first preset condition, and determining to select the first touch icon when the first touch operation meets the first preset condition.
Specifically, it is determined whether the touch duration of the first touch operation is greater than or equal to a preset duration, for example, 1s, and if so, it is determined that the first touch icon is selected.
Step 307: and obtaining a second touch operation aiming at the first touch icon on a touch display module, and determining a position parameter to be moved of the first touch icon based on the second touch operation.
Here, the second touch operation is a sliding operation, and the position where the sliding operation is stopped is a position where the first touch icon is to be moved.
Step 308: generating the first operation instruction based on the position parameter to be moved, wherein the first operation instruction is used for indicating that the first touch icon is moved to the position to be moved.
Step 309: and responding to the first operation instruction, executing the operation related to the first touch icon, and projecting an operation interface on a projection surface.
According to the embodiment of the invention, the touch icon can be moved to a new position, and the dragging operation is executed.
The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Fig. 4 is a flowchart illustrating an interaction method according to a fourth embodiment of the present invention, where the interaction method in this example is applied to an electronic device, and as shown in fig. 4, the interaction method includes the following steps:
step 401: projecting first content to a projection surface by using a projection module in the electronic equipment, and projecting a cursor focus at a first position of the first content.
The first content is a first area in a first image, and the projection module and the electronic device move synchronously.
In the embodiment of the invention, the electronic equipment can be a mobile phone, a tablet computer and the like. The electronic device has a projection module, such as a pico projector. The first content can be projected on the projection surface by the projection module.
In the embodiment of the present invention, the first content is a first area in the first image. Referring to fig. 13, the first image may be desktop content of the electronic device. The first area is a portion of the desktop content. In the figure, the solid line frame is the first content, and the dashed line frame is the first image. The circle at the center position of the first content in the figure is the cursor focus. The cursor focus is used for positioning a certain touch icon of the first content.
In the embodiment of the present invention, when the user stands horizontally (in a designated orientation) in front of the projection surface such as a white wall, it is equivalent to designate the position and orientation of the electronic device, and it can be considered that the first image is virtually presented on the projection surface with the projection direction as the center. The area of the first image projected by the electronic device is then determined relative to the nominal position and orientation (i.e., the projection direction) of the electronic device. I.e. the content of the first image virtually rendered, i.e. the currently projected content, is mapped in the current direction of propagation of the light with the current orientation and a certain area at the current position of the electronic device. For example, when the electronic device projects the projection plane with the nominal orientation at the nominal position, the projection plane displays first content, and the first content is content of the first image in the first area.
Step 402: when the change of the attitude parameters of the electronic equipment is detected, the direction of the projection direction of the electronic equipment relative to the projection plane is determined according to the attitude parameters of the electronic equipment.
Step 403: and determining the projected second content according to the direction of the projection direction of the electronic equipment relative to the projection surface. The second content is a second region of the first image.
In the embodiment of the invention, the electronic equipment is provided with a detection module, such as a gravity accelerometer, a nine-axis gyroscope and the like. With the detection unit being able to detect the attitude parameters of the electronic device, the attitude parameters of the electronic device may be calibrated by a set of spatial coordinates, such as (x, y, z). Referring to fig. 14, when the posture of the electronic device held by the user changes, for example, upward, downward, leftward, rightward, or a combination of the above, the electronic device utilizes a gravity accelerometer, a gyroscope, and a magnetometer to obtain the offset of the coordinates (x, y, z) of the electronic device on the x, y, and z axes, respectively. When the offset exists, the content projected on the projection plane changes, and the projected content is the content at other positions in the first image and is called as second content. The second content is content at a different position in the first image from the first content, and the second content is a second area of the first image. In general, the first area and the second area have the same area range size, but different image contents.
In the embodiment of the invention, when the change of the attitude parameter of the electronic equipment is detected, the direction of the electronic equipment relative to the projection surface is also changed, the different directions cause different projected contents, and the projected contents are positioned at different positions of the projection surface.
Step 404: when the projection direction of the electronic equipment changes relative to the direction of the projection surface, the projected second content is continuously updated, and the cursor focus is projected at the first position of the second content.
Here, the second content is also a part of the first image, but the second content is different from the first content because the orientation of the electronic device with respect to the projection surface is changed. Referring to fig. 15, the second content is shown in the solid line box, and it can be seen that the second content is different content from the first content, and the first image is shown in the dashed line box. The circle at the center position of the second content in the figure is the cursor focus. The cursor focus is used for positioning a certain touch icon of the second content. Typically, the cursor focus is fixed at a certain position of the first content or the second content.
In the embodiment of the present invention, as the user wants to see the position change in the first image (i.e. the posture change of the electronic device), the focus of the cursor falls on some operable touch icons on the second content, such as an application icon or some buttons.
Step 405: generating a first operation instruction when the touch operation aiming at the second content is obtained on a touch display module of the electronic equipment; and responding to the first operation instruction, executing the operation related to the second content and projecting an operation interface on a projection surface.
In the embodiment of the invention, the touch display module can be a touch display screen. When a user clicks the touch display screen of the electronic equipment to trigger a click event, the electronic equipment determines the coordinate of the cursor focus falling on the second content at the moment, judges whether the coordinate is within the range of a clickable touch icon, and if so, triggers the touch icon, for example, when the touch icon is an application icon, the operation of opening the application is executed, and an operation interface is projected on the projection surface.
The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Fig. 5 is a schematic flowchart of an interaction method according to a fifth embodiment of the present invention, where the interaction method in this example is applied to an electronic device, and as shown in fig. 5, the interaction method includes the following steps:
step 501: and projecting first content to a projection surface by using a projection module in the electronic equipment, wherein the first content is a first area in a first image, and the projection module and the electronic equipment synchronously move.
In the embodiment of the invention, the electronic equipment can be a mobile phone, a tablet computer and the like. The electronic device has a projection module, such as a pico projector. The first content can be projected on the projection surface by the projection module.
In the embodiment of the present invention, the first content is a first area in the first image. Referring to fig. 13, the first image may be desktop content of the electronic device. The first area is a portion of the desktop content. In the figure, the solid line frame is the first content, and the dashed line frame is the first image.
In the embodiment of the present invention, when the user stands horizontally (in a designated orientation) in front of the projection surface such as a white wall, it is equivalent to designate the position and orientation of the electronic device, and it can be considered that the first image is virtually presented on the projection surface with the projection direction as the center. The area of the first image projected by the electronic device is then determined relative to the nominal position and orientation (i.e., the projection direction) of the electronic device. I.e. the content of the first image virtually rendered, i.e. the currently projected content, is mapped in the current direction of propagation of the light with the current orientation and a certain area at the current position of the electronic device. For example, when the electronic device projects the projection plane with the nominal orientation at the nominal position, the projection plane displays first content, and the first content is content of the first image in the first area.
Step 502: when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment, wherein the second content is a second area of the first image.
In the embodiment of the invention, the electronic equipment is provided with a detection module, such as a gravity accelerometer, a nine-axis gyroscope and the like. With the detection unit being able to detect the attitude parameters of the electronic device, the attitude parameters of the electronic device may be calibrated by a set of spatial coordinates, such as (x, y, z). Referring to fig. 14, when the posture of the electronic device held by the user changes, for example, upward, downward, leftward, rightward, or a combination of the above, the electronic device utilizes a gravity accelerometer, a gyroscope, and a magnetometer to obtain the offset of the coordinates (x, y, z) of the electronic device on the x, y, and z axes, respectively. When the offset exists, the content projected on the projection plane changes, and the projected content is the content at other positions in the first image and is called as second content. The second content is content at a different position in the first image from the first content, and the second content is a second area of the first image. In general, the first area and the second area have the same area range size, but different image contents.
In the embodiment of the invention, when the change of the attitude parameter of the electronic equipment is detected, the direction of the electronic equipment relative to the projection surface is also changed, the different directions cause different projected contents, and the projected contents are positioned at different positions of the projection surface.
Step 503: projecting the second content onto the projection surface.
Here, the second content is also a part of the first image, but the second content is different from the first content because the orientation of the electronic device with respect to the projection surface is changed.
Step 504: generating a second operation instruction when a third touch operation meeting a third preset condition is obtained on the touch display module; and responding to the second operation instruction, and projecting third content in the second image on the projection surface.
In the embodiment of the present invention, the third touch operation may be a left-slide operation and a right-slide operation. The content projected on the projection surface is correspondingly switched to the left and the right. For example, when the first image is displayed on the front projection surface, after the third touch operation is obtained, the second image is displayed on the projection surface, and third content in the second image is displayed, where the third content is a part of the second image.
The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Fig. 6 is a flowchart illustrating an interaction method according to a sixth embodiment of the present invention, where the interaction method in this example is applied to an electronic device, and as shown in fig. 6, the interaction method includes the following steps:
step 601: and projecting first content to a projection surface by using a projection module in the electronic equipment, wherein the first content is a first area in a first image, and the projection module and the electronic equipment synchronously move.
In the embodiment of the invention, the electronic equipment can be a mobile phone, a tablet computer and the like. The electronic device has a projection module, such as a pico projector. The first content can be projected on the projection surface by the projection module.
In the embodiment of the present invention, the first content is a first area in the first image. Referring to fig. 13, the first image may be desktop content of the electronic device. The first area is a portion of the desktop content. In the figure, the solid line frame is the first content, and the dashed line frame is the first image.
In the embodiment of the present invention, when the user stands horizontally (in a designated orientation) in front of the projection surface such as a white wall, it is equivalent to designate the position and orientation of the electronic device, and it can be considered that the first image is virtually presented on the projection surface with the projection direction as the center. The area of the first image projected by the electronic device is then determined relative to the nominal position and orientation (i.e., the projection direction) of the electronic device. I.e. the content of the first image virtually rendered, i.e. the currently projected content, is mapped in the current direction of propagation of the light with the current orientation and a certain area at the current position of the electronic device. For example, when the electronic device projects the projection plane with the nominal orientation at the nominal position, the projection plane displays first content, and the first content is content of the first image in the first area.
Step 602: when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment, wherein the second content is a second area of the first image.
In the embodiment of the invention, the electronic equipment is provided with a detection module, such as a gravity accelerometer, a nine-axis gyroscope and the like. With the detection unit being able to detect the attitude parameters of the electronic device, the attitude parameters of the electronic device may be calibrated by a set of spatial coordinates, such as (x, y, z). Referring to fig. 14, when the posture of the electronic device held by the user changes, for example, upward, downward, leftward, rightward, or a combination of the above, the electronic device utilizes a gravity accelerometer, a gyroscope, and a magnetometer to obtain the offset of the coordinates (x, y, z) of the electronic device on the x, y, and z axes, respectively. When the offset exists, the content projected on the projection plane changes, and the projected content is the content at other positions in the first image and is called as second content. The second content is content at a different position in the first image from the first content, and the second content is a second area of the first image. In general, the first area and the second area have the same area range size, but different image contents.
In the embodiment of the invention, when the change of the attitude parameter of the electronic equipment is detected, the direction of the electronic equipment relative to the projection surface is also changed, the different directions cause different projected contents, and the projected contents are positioned at different positions of the projection surface.
Step 603: projecting the second content onto the projection surface.
Here, the second content is also a part of the first image, but the second content is different from the first content because the orientation of the electronic device with respect to the projection surface is changed.
Step 604: displaying the first image on a touch display module of the electronic equipment; and identifying the current projection content projected on the projection surface on the first image.
In the embodiment of the present invention, all the first images are displayed on the touch display module, a part of the first images is displayed on the projection surface, and the current projection content projected on the projection surface is identified on the touch display module, for example, by a frame.
The technical scheme of the embodiment of the invention can dynamically and continuously change the display content on the projection surface. And the center of the projection content is provided with a cursor focus, when a user positions the cursor focus at a position to be selected, the content on the projection surface can be operated by triggering operation on the electronic equipment, and the interaction is convenient and the accuracy is high.
Fig. 7 is a schematic structural composition diagram of an electronic device according to a first embodiment of the present invention, and as shown in fig. 7, the electronic device includes:
the projection module 71 is configured to project first content onto a projection surface, where the first content is a first area in a first image, and the projection module moves synchronously with the electronic device;
a detection module 72 for detecting an attitude parameter of the electronic device;
the processing module 73 is configured to determine, when it is detected that an attitude parameter of the electronic device changes, second content to be projected according to the attitude parameter of the electronic device, where the second content is a second area of the first image;
the projection module 71 is further configured to project the second content onto the projection plane.
Those skilled in the art will appreciate that the functions implemented by the modules in the electronic device shown in fig. 7 can be understood by referring to the related description of the aforementioned interaction method.
Fig. 8 is a schematic structural composition diagram of an electronic device according to a second embodiment of the present invention, and as shown in fig. 8, the electronic device includes:
the projection module 81 is configured to project first content onto a projection surface, where the first content is a first area in a first image, and the projection module and the electronic device move synchronously;
a detection module 82, configured to detect an attitude parameter of the electronic device;
the processing module 83 is configured to determine, according to the attitude parameter of the electronic device, second content to be projected when it is detected that the attitude parameter of the electronic device changes, where the second content is a second area of the first image;
the projection module 81 is further configured to project the second content onto the projection surface.
In an embodiment of the present invention, the electronic device further includes:
a touch display module 84, configured to generate a first operation instruction when obtaining a touch operation for the second content;
and the response module 85 is configured to respond to the first operation instruction, execute an operation related to the second content, and project an operation interface on the projection surface.
The projection module 81 is further configured to project a cursor focus at a first position of the first content and the second content.
Those skilled in the art will appreciate that the functions implemented by the modules in the electronic device shown in fig. 8 can be understood by referring to the related description of the aforementioned interaction method.
Fig. 9 is a schematic structural composition diagram of an electronic device according to a third embodiment of the present invention, and as shown in fig. 9, the electronic device includes:
the projection module 91 is configured to project first content onto a projection surface, where the first content is a first area in a first image, and the projection module moves synchronously with the electronic device;
a detection module 92, configured to detect an attitude parameter of the electronic device;
the processing module 93 is configured to determine, when it is detected that an attitude parameter of the electronic device changes, second content to be projected according to the attitude parameter of the electronic device, where the second content is a second area of the first image;
the projection module 91 is further configured to project the second content onto the projection surface.
In an embodiment of the present invention, the electronic device further includes:
a touch display module 94, configured to generate a first operation instruction when obtaining a touch operation for the second content;
and a response module 95, configured to respond to the first operation instruction, execute an operation related to the second content, and project an operation interface on the projection surface.
The projection module 91 is further configured to project a cursor focus at a first position of the first content and the second content.
In the embodiment of the invention, the first content comprises N touch control icons, the second content comprises M touch control icons, N is more than or equal to 1, and M is more than or equal to 1; the first content and the second content may have the same touch icon;
the projection module 91 is further configured to switch the cursor focus from a first touch icon position in the first content to a second touch icon position in the second content when detecting that the gesture parameter of the electronic device changes.
The touch display module 94 is further configured to obtain a first touch operation for a first touch icon when the cursor focus is focused on the first touch icon;
the electronic device further includes: a determining module 96, configured to determine whether the first touch operation satisfies a first predetermined condition;
a second determining module 97, configured to determine that the first touch icon is selected when the first touch operation meets a first predetermined condition;
the touch display module 94 is further configured to obtain a second touch operation for the first touch icon;
the electronic device further includes: a third determining module 98, configured to determine, based on the second touch operation, a to-be-moved position parameter of the first touch icon;
a generating module 99, configured to generate the first operation instruction based on the to-be-moved position parameter, where the first operation instruction is used to instruct to move the first touch icon to the to-be-moved position.
Those skilled in the art will appreciate that the functions implemented by the modules in the electronic device shown in fig. 9 can be understood by referring to the related description of the aforementioned interaction method.
Fig. 10 is a schematic structural composition diagram of an electronic device according to a fourth embodiment of the present invention, and as shown in fig. 10, the electronic device includes:
the projection module 11 is configured to project first content onto a projection surface, where the first content is a first area in a first image, and the projection module and the electronic device move synchronously;
the detection module 12 is used for detecting attitude parameters of the electronic equipment;
the processing module 13 is configured to determine, when it is detected that an attitude parameter of the electronic device changes, second content to be projected according to the attitude parameter of the electronic device, where the second content is a second area of the first image;
the projection module 11 is further configured to project the second content onto the projection surface.
In an embodiment of the present invention, the electronic device further includes:
the touch display module 14 is configured to generate a first operation instruction when obtaining a touch operation for the second content;
and the response module 15 is configured to, in response to the first operation instruction, execute an operation related to the second content and project an operation interface on the projection surface.
The projection module 11 is further configured to project a cursor focus at a first position of the first content and the second content.
In an embodiment of the present invention, the electronic device further includes:
the first determining module 16 is configured to determine, according to the electronic device posture parameter, an orientation of a projection direction of the electronic device relative to a projection plane; determining the projected second content according to the direction of the projection direction of the electronic equipment relative to the projection plane;
the projection module 11 is further configured to continuously update the projected second content when the projection direction of the electronic device changes relative to the orientation of the projection plane.
Those skilled in the art will appreciate that the functions implemented by the modules in the electronic device shown in fig. 10 can be understood by referring to the related description of the aforementioned interaction method.
Fig. 11 is a schematic structural composition diagram of an electronic device according to a fifth embodiment of the present invention, and as shown in fig. 11, the electronic device includes:
the projection module 21 is configured to project first content onto a projection surface, where the first content is a first area in a first image, and the projection module and the electronic device move synchronously;
the detection module 22 is used for detecting the attitude parameters of the electronic equipment;
the processing module 23 is configured to determine, when it is detected that an attitude parameter of the electronic device changes, second content to be projected according to the attitude parameter of the electronic device, where the second content is a second area of the first image;
the projection module 21 is further configured to project the second content onto the projection surface.
In an embodiment of the present invention, the electronic device further includes:
the touch display module 24 is configured to generate a first operation instruction when obtaining a touch operation for the second content;
and the response module 25 is configured to, in response to the first operation instruction, execute an operation related to the second content and project an operation interface on the projection surface.
The projection module 21 is further configured to project a cursor focus at a first position of the first content and the second content.
In the embodiment of the present invention, the touch display module 24 is further configured to generate a second operation instruction when a third touch operation meeting a third predetermined condition is obtained;
the projection module 21 is further configured to project, in response to the second operation instruction, third content in the second image on the projection surface.
Those skilled in the art will appreciate that the functions implemented by the modules in the electronic device shown in fig. 11 can be understood by referring to the related description of the aforementioned interaction method.
Fig. 12 is a schematic structural composition diagram of an electronic device according to a sixth embodiment of the present invention, and as shown in fig. 12, the electronic device includes:
the projection module 31 is configured to project first content onto a projection surface, where the first content is a first area in a first image, and the projection module and the electronic device move synchronously;
a detection module 32, configured to detect an attitude parameter of the electronic device;
the processing module 33 is configured to determine, when it is detected that an attitude parameter of the electronic device changes, second content to be projected according to the attitude parameter of the electronic device, where the second content is a second area of the first image;
the projection module 31 is further configured to project the second content onto the projection surface.
In an embodiment of the present invention, the electronic device further includes:
the touch display module 34 is configured to generate a first operation instruction when obtaining a touch operation for the second content;
and the response module 35 is configured to respond to the first operation instruction, execute an operation related to the second content, and project an operation interface on the projection surface.
The projection module 31 is further configured to project a cursor focus at a first position of the first content and the second content.
In the embodiment of the present invention, the touch display module 34 is further configured to display the first image; and identifying the current projection content projected on the projection surface on the first image.
Those skilled in the art will appreciate that the functions implemented by the modules in the electronic device shown in fig. 12 can be understood by referring to the related description of the aforementioned interaction method.
Those skilled in the art will understand that the implementation functions of each unit in the electronic device in the embodiment of the present invention can be understood by referring to the related description of the information processing method. The functions of the units in the electronic device in the embodiments of the present invention may be implemented by a program running on a processor, or may be implemented by specific logic circuits.
The technical schemes described in the embodiments of the present invention can be combined arbitrarily without conflict.
In the embodiments provided in the present invention, it should be understood that the disclosed method and intelligent device may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one second processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.
Claims (12)
1. An interaction method for an electronic device, the interaction method comprising:
projecting first content to a projection surface by using a projection module in the electronic equipment, wherein the first content is a first area in a first image, and the projection module and the electronic equipment synchronously move;
when the change of the attitude parameter of the electronic equipment is detected, determining second content to be projected according to the attitude parameter of the electronic equipment, wherein the second content is a second area of the first image;
projecting the second content onto the projection surface;
the first content comprises N touch control icons, the second content comprises M touch control icons, N is not less than 1, and M is not less than 1; the first content and the second content may have the same touch icon; the method further comprises the following steps:
when the gesture parameter of the electronic equipment is detected to be changed, the focus of the cursor is switched from a first touch icon position in the first content to a second touch icon position in the second content;
the method further comprises the following steps:
displaying the first image on a touch display module of the electronic equipment;
and identifying the current projection content projected on the projection surface on the first image.
2. The interaction method of claim 1, the method further comprising:
generating a first operation instruction when the touch operation aiming at the second content is obtained on a touch display module of the electronic equipment;
and responding to the first operation instruction, executing the operation related to the second content and projecting an operation interface on a projection surface.
3. The interaction method of claim 2, the method further comprising:
projecting a cursor focus at a first location of the first content and the second content.
4. The interaction method of claim 3, the method further comprising:
determining the direction of the projection direction of the electronic equipment relative to the projection plane according to the attitude parameters of the electronic equipment;
determining the projected second content according to the direction of the projection direction of the electronic equipment relative to the projection plane;
when the projection direction of the electronic equipment changes relative to the direction of the projection surface, the projected second content is continuously updated.
5. The interaction method according to claim 2, wherein generating a first operation instruction when the touch operation for the second content is obtained on the touch display module of the electronic device comprises:
when the cursor focus is focused to a first touch icon, obtaining a first touch operation aiming at the first touch icon on a touch display module;
judging whether the first touch operation meets a first preset condition or not;
when the first touch operation meets a first preset condition, determining that the first touch icon is selected;
obtaining a second touch operation aiming at the first touch icon on a touch display module;
determining a position parameter to be moved of the first touch icon based on the second touch operation;
generating the first operation instruction based on the position parameter to be moved, wherein the first operation instruction is used for indicating that the first touch icon is moved to the position to be moved.
6. The interaction method of claim 1, the method further comprising:
generating a second operation instruction when a third touch operation meeting a third preset condition is obtained on the touch display module;
and responding to the second operation instruction, and projecting third content in the second image on the projection surface.
7. An electronic device, the electronic device comprising:
the projection module is used for projecting first content to a projection surface, the first content is a first area in a first image, and the projection module and the electronic equipment move synchronously;
the detection module is used for detecting the attitude parameters of the electronic equipment;
the processing module is used for determining second content to be projected according to the attitude parameter of the electronic equipment when the change of the attitude parameter of the electronic equipment is detected, wherein the second content is a second area of the first image;
the projection module is further configured to project the second content onto the projection surface;
the first content comprises N touch control icons, the second content comprises M touch control icons, N is not less than 1, and M is not less than 1; the first content and the second content may have the same touch icon;
the projection module is further used for switching the cursor focus from a first touch icon position in the first content to a second touch icon position in the second content when the change of the attitude parameter of the electronic equipment is detected;
the touch display module is used for displaying the first image; and identifying the current projection content projected on the projection surface on the first image.
8. The electronic device of claim 7, wherein the touch display module is further configured to generate a first operation instruction when obtaining a touch operation for the second content;
the electronic device further includes:
and the response module is used for responding to the first operation instruction, executing the operation related to the second content and projecting an operation interface on the projection surface.
9. The electronic device of claim 8, the projection module further to project a cursor focus at a first location of the first content and the second content.
10. The electronic device of claim 9, further comprising:
the first determination module is used for determining the direction of the projection direction of the electronic equipment relative to a projection plane according to the electronic equipment attitude parameter; determining the projected second content according to the direction of the projection direction of the electronic equipment relative to the projection plane;
the projection module is further configured to continuously update the projected second content when the projection direction of the electronic device changes relative to the direction of the projection surface.
11. The electronic device of claim 8, the touch display module further configured to obtain a first touch operation for a first touch icon when the cursor focus is in focus to the first touch icon;
the electronic device further includes: the judging module is used for judging whether the first touch operation meets a first preset condition;
the second determining module is used for determining that the first touch icon is selected when the first touch operation meets a first preset condition;
the touch display module is further used for obtaining a second touch operation aiming at the first touch icon;
the electronic device further includes: a third determining module, configured to determine, based on the second touch operation, a position parameter to be moved of the first touch icon;
a generating module, configured to generate the first operation instruction based on the to-be-moved position parameter, where the first operation instruction is used to instruct to move the first touch icon to the to-be-moved position.
12. The electronic device of claim 7, wherein the touch display module is further configured to generate a second operation instruction when a third touch operation meeting a third predetermined condition is obtained;
and the projection module is further used for responding to the second operation instruction and projecting third content in the second image on the projection surface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510325727.1A CN106293036B (en) | 2015-06-12 | 2015-06-12 | Interaction method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510325727.1A CN106293036B (en) | 2015-06-12 | 2015-06-12 | Interaction method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106293036A CN106293036A (en) | 2017-01-04 |
| CN106293036B true CN106293036B (en) | 2021-02-19 |
Family
ID=57650701
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510325727.1A Active CN106293036B (en) | 2015-06-12 | 2015-06-12 | Interaction method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106293036B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107120582A (en) * | 2017-06-13 | 2017-09-01 | 王金锁 | A kind of MWI |
| CN112732162A (en) * | 2021-03-30 | 2021-04-30 | 北京芯海视界三维科技有限公司 | Projection interaction method, device and system and computer storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102945146A (en) * | 2012-10-29 | 2013-02-27 | 海信集团有限公司 | Display method and system for help information of projector equipment |
| CN104243883A (en) * | 2014-09-22 | 2014-12-24 | 联想(北京)有限公司 | Projection method and electronic device |
| CN104573675A (en) * | 2015-01-29 | 2015-04-29 | 百度在线网络技术（北京）有限公司 | Operating image displaying method and device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20110071349A (en) * | 2009-12-21 | 2011-06-29 | 삼성전자주식회사 | Method and apparatus for controlling external output of a portable terminal |
| US9134799B2 (en) * | 2010-07-16 | 2015-09-15 | Qualcomm Incorporated | Interacting with a projected user interface using orientation sensors |
| CN102012621B (en) * | 2010-10-29 | 2013-01-09 | 鸿富锦精密工业（深圳）有限公司 | Micro projection device with interactive function and projection method thereof |
| JP5679803B2 (en) * | 2010-12-24 | 2015-03-04 | 京セラ株式会社 | Portable electronic devices |
| CN104580967B (en) * | 2013-10-24 | 2019-02-05 | 中国移动通信集团公司 | A kind of map projection's method based on portable projector and the device for projection |
| KR20160026482A (en) * | 2014-09-01 | 2016-03-09 | 삼성전자주식회사 | Movile device and projecing method for the same |
-
2015
- 2015-06-12 CN CN201510325727.1A patent/CN106293036B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102945146A (en) * | 2012-10-29 | 2013-02-27 | 海信集团有限公司 | Display method and system for help information of projector equipment |
| CN104243883A (en) * | 2014-09-22 | 2014-12-24 | 联想(北京)有限公司 | Projection method and electronic device |
| CN104573675A (en) * | 2015-01-29 | 2015-04-29 | 百度在线网络技术（北京）有限公司 | Operating image displaying method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106293036A (en) | 2017-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11727650B2 (en) | Systems, methods, and graphical user interfaces for displaying and manipulating virtual objects in augmented reality environments | |
| CN107913520B (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| EP2548103B1 (en) | Pointer device to navigate a projected user interface | |
| US11054978B2 (en) | Portable device and method for controlling brightness of the same | |
| US20140198030A1 (en) | Image projection device, image projection system, and control method | |
| US9310991B2 (en) | Method and apparatus for navigating content on screen using pointing device | |
| US9544556B2 (en) | Projection control apparatus and projection control method | |
| JP7005161B2 (en) | Electronic devices and their control methods | |
| US9483112B2 (en) | Eye tracking in remote desktop client | |
| CN110502162B (en) | Folder creating method and terminal equipment | |
| US20200202629A1 (en) | System and method for head mounted device input | |
| JP2012238293A (en) | Input device | |
| CN110192169B (en) | Menu processing method and device in virtual scene and storage medium | |
| JP6686345B2 (en) | Method, system and program for detecting operation event | |
| CN106293036B (en) | Interaction method and electronic equipment | |
| JP2014115876A (en) | Remote operation method of terminal to be operated using three-dimentional touch panel | |
| CN106293037B (en) | Interaction method and electronic equipment | |
| JP6075193B2 (en) | Mobile terminal device | |
| JP7005160B2 (en) | Electronic devices and their control methods | |
| JP6686319B2 (en) | Image projection device and image display system | |
| EP3264203A1 (en) | Intelligent interaction method, equipment and system | |
| US20150205374A1 (en) | Information processing method and electronic device | |
| CN107924272B (en) | Information processing apparatus, information processing method, and program | |
| US20210027750A1 (en) | Display apparatus, display system, and display method | |
| KR101165388B1 (en) | Method for controlling screen using different kind of input devices and terminal unit thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |