CN116700659B

CN116700659B - Interface interaction method and electronic equipment

Info

Publication number: CN116700659B
Application number: CN202211072079.XA
Authority: CN
Inventors: 陈宇
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-09-02
Filing date: 2022-09-02
Publication date: 2024-03-08
Anticipated expiration: 2042-09-02
Also published as: CN116700659A

Abstract

An interface interaction method and electronic equipment, comprising: the electronic equipment displays a first user interface, wherein the first user interface displays cursor points and weft tracks and warp tracks where the cursor points are positioned; the cursor point is one of the points where the weft track and the warp track intersect on the surface of the sphere, and the cursor point represents the spatial direction of the sound source position of the audio relative to the user; the electronic equipment acquires a first operation; under the condition that the first operation is sliding operation along a first direction, a cursor point in a first user interface slides along a weft track where the cursor point is positioned, and a warp track where the cursor point is positioned changes along with the sliding of the cursor point on the weft track; under the condition that the first operation is a sliding operation along the second direction, the cursor point in the first user interface slides along the warp track where the cursor point is located, and the weft track where the cursor point is located changes along with the sliding of the cursor point on the warp track. The embodiment of the application is used for adjusting the spatial position of the audio.

Description

Interface interaction method and electronic equipment

Technical Field

The application relates to the technical field of terminals, in particular to an interface interaction method and electronic equipment.

Background

When a user listens to audio with a headset, the user can generally adjust the volume of the audio by only using a volume key, and the source of the sound is at the ear. However, the perception of sound by people also includes a more dimensional experience, merely adjusting the audio volume, resulting in poor user perception of sound.

Disclosure of Invention

The embodiment of the application provides an interface interaction method and electronic equipment, which are used for adjusting the spatial position of audio.

In a first aspect, an embodiment of the present application provides an interface interaction method, where the method is applied to an electronic device, and the method includes: the electronic equipment displays a first user interface, wherein the first user interface displays cursor points and weft tracks and warp tracks where the cursor points are positioned; the cursor point is one point where the weft track and the warp track intersect on the surface of the sphere, and the cursor point represents the spatial direction of the sound source position of the audio relative to the user; the electronic equipment acquires a first operation; when the first operation is a sliding operation along a first direction, the cursor point in the first user interface slides along a weft track where the cursor point is located, and the warp track where the cursor point is located changes along with the sliding of the cursor point on the weft track; the first direction is a direction corresponding to the weft track;

Under the condition that the first operation is a sliding operation along a second direction, the cursor point in the first user interface slides along a meridian track where the cursor point is located, and the meridian track where the cursor point is located changes along with the sliding of the cursor point on the meridian track; the second direction is a direction corresponding to the warp track.

The first direction is a transverse direction, namely a direction perpendicular to the plane of the warp track; the second direction is longitudinal, namely, the direction perpendicular to the plane of the weft track, and the first operation is the sliding operation of the screen of the user touch electronic equipment. The first user interface may refer to the relevant descriptions of fig. 2B, fig. 9 and fig. 13, and the first operation may refer to the relevant descriptions of fig. 2B, fig. 3 and fig. 4A and fig. 4B, and fig. 14, which are not repeated.

In the embodiment of the application, the electronic equipment can adjust the position of the audio in the space by sliding transversely or longitudinally, and the user can simulate the space sound source point by sliding the cursor point to experience the sound effect of the sound source point in different positions. Further, the three-dimensional sound source space position is on the two-dimensional screen, adjustment and interaction often have certain difficulty, and user learning and adaptation are needed.

In one possible implementation manner, the cursor point in the first user interface slides along a weft track where the cursor point is located, and a warp track where the cursor point is located changes along with the sliding of the cursor point on the weft track, which specifically includes:

at a first moment, the first user interface displays the cursor point, a first weft track and a first warp track, wherein the cursor point is positioned at a first position of the first weft track;

at a second moment, the first user interface displays the cursor point, a first weft track and a second warp track, wherein the cursor point is positioned at a second position of the first weft track; the second warp track is a warp track obtained by rotating the first warp track along the sliding direction of the cursor point by taking a first straight line as a rotation axis, the first position and the second position are positions of different points of the first weft track, and the first straight line is a straight line perpendicular to the direction of the first weft track and passing through the center of the first weft track.

The sliding of the cursor point may refer to the related descriptions of fig. 7A and fig. 7B, which are not repeated.

In this application embodiment, at user's transversely gliding in-process, the weft track is unchangeable, and the cursor point slides on the weft track, and warp slides thereupon to can ensure the change on a track, guarantee that the user can effectual control warp orbital position, let interactive process user understand more easily and more convenient operation.

In one possible implementation manner, the cursor point in the first user interface slides along a meridian track where the cursor point is located, and a weft track where the cursor point is located changes along with the sliding of the cursor point on the meridian track, which specifically includes:

at a third moment, the first user interface displays the cursor point, a first weft track and a first warp track, wherein the cursor point is positioned at a third position of the first warp track;

at a fourth time, the first user interface displays the cursor point, the second weft track and the first warp track, wherein the cursor point is positioned at a fourth position of the first warp track; the second weft track is a weft track obtained by translating and shrinking the first weft track along the sliding direction of the cursor point by taking a first straight line as an axis, the third position and the fourth position are positions of different points of the first warp track, and the first straight line is a straight line perpendicular to the direction of the first weft track and passing through the center of the first weft track.

In this application embodiment, at the vertically gliding in-process of user, warp track is unchangeable, and the cursor point slides on warp track, and the weft slides thereupon to can ensure the change on a track, guarantee that the user can effectual control warp orbital position, let interactive process user understand more easily and operate more conveniently.

In one possible implementation, in a case where the electronic device displays the first user interface, the method further includes: and responding to a second operation, wherein the electronic equipment adjusts the sound source distance, the sound source distance is the length between the sound source position and the user position, and the second operation is the operation of sliding the sound source distance control in the first user interface by the user. Therefore, the electronic equipment can also adjust the direction of the audio frequency between the spatial positions and the users, improve the adjustable dimension and ensure to be more in line with the flexibility of the audio frequency in the spatial position adjusting process.

The third operation may refer to the related description of the adjustment button for the user sliding audio distance in fig. 2B, which is not repeated.

In one possible implementation, in a case where the electronic device displays the first user interface, the method further includes:

in response to a third operation, the electronic device adjusts the cursor point to a preselected cursor point, displays the weft track to a preselected weft track, adjusts the warp track to a preselected warp track, and adjusts the sound source distance to a preselected sound source distance; the third operation is an operation of clicking a recommended sound source position control in the first user interface by a user; the preselected cursor point is a cursor point where the recommended sound source position is located; the preselected weft track is a weft track corresponding to the recommended sound source position; the preselected meridian track is a meridian track corresponding to the recommended sound source position; the preselected sound source distance is from the recommended sound source distance. Therefore, the user can restore the adjusted position to the recommended sound source position, the adjustment result is quickened, the operation process is simplified, and the convenience and the high efficiency of the operation are further improved.

The third operation may refer to the operation of clicking the recommended position of the user in fig. 2B and fig. 13, and is specifically referred to the related description, which is not repeated.

In one possible implementation, after the electronic device displays the first user interface, the method further includes: responding to a first operation, the electronic equipment collects first sliding data, wherein the first sliding data are coordinates of a sliding starting point and a current sliding point of the first operation; the electronic equipment judges whether the cursor point is triggered to move or not based on the first sliding data; under the condition that the cursor point is triggered to move, the electronic equipment determines a sliding direction based on the first sliding data; the sliding direction includes the first direction and the second direction. Therefore, the electronic equipment firstly determines whether to trigger sliding, and when the sliding direction is determined, the accuracy of the moving time and the moving direction of the cursor point can be ensured.

In one possible implementation manner, the electronic device determines whether to trigger the cursor point to move based on the first sliding data, and specifically includes: the electronic device determines a lateral sliding distance |dx| and a longitudinal sliding distance |dy| from the sliding start point to the current sliding point; the electronic device judges whether the |dx| and the |dy| are both smaller than or equal to a sliding threshold distance m; if the position of the cursor point is smaller than or equal to the position of the cursor point, the electronic equipment determines that the cursor point is not triggered to move; otherwise, the electronic equipment triggers the cursor point to move. In this way, under the condition that the user performs the sliding operation, the sliding distance is too short, and the user may touch the screen by mistake or click the control, so that the accuracy of triggering the movement of the cursor point can be ensured.

In one possible implementation manner, the electronic device determines a sliding direction based on the first sliding data, and specifically includes: in the case where |dx| is greater than |dy|, the electronic apparatus determines a sliding direction as a first direction; in the case where the |dx| is smaller than the |dy|, the electronic apparatus determines the sliding direction to be the second direction. Thus, the sliding direction of the user can be accurately determined, and the necessity of determining the sliding direction can be ensured when the cursor point is triggered to move.

under the condition that the first operation is not finished, the electronic equipment collects second sliding data, wherein the second sliding data is the coordinates of a sliding point of the first operation which is collected last time;

the electronic device determines a second position and a second meridian track of the cursor point based on the second sliding data, the third sliding data and last sliding result data; the third sliding data is the position of a sliding point of a first operation acquired by the electronic equipment last time, and the last sliding result data is a first position, a first weft track and a first warp track of the cursor point displayed by the third sliding data;

The electronic device displays based on the second position of the cursor point, the first weft track and the second warp track.

In the embodiment of the application, the electronic device can calculate the data needed to be displayed next based on the lateral sliding displacement condition of the user and the data acquired and displayed last time, namely the second position of the cursor point, the first weft track and the second warp track, the electronic device does not need to convert the two-dimensional coordinates into the three-dimensional space, and the data needed to be displayed can be calculated only through the position relation between the ellipse and the cursor point, so that the simplicity of calculation and the high efficiency of processing are ensured.

In one possible implementation manner, the electronic device determines the second position and the second meridian track of the cursor point based on the second sliding data, the third sliding data and the last sliding result data, and specifically includes:

the electronic device determining a lateral sliding displacement Δx based on the second sliding data and the third sliding data;

the electronic device determining a lateral threshold range [ x_min, x_max ] based on the first weft track;

the electronic device determining an abscissa x' of a second location of the cursor point based on the Δx, the [ x_min, x_max ] and the first location of the cursor point;

The electronic device determining an ordinate y 'of the second position of the cursor point based on the x' and the first weft track;

the electronic device determines the second warp track based on the x ', the y', and the first warp track.

In the embodiment of the application, in the sliding process of the user, the electronic device continuously collects sliding data and further determines the cursor point and two tracks to be displayed next based on the displayed result, so that the display accuracy can be ensured. In addition, conversion between a three-dimensional space and two dimensions is not needed, and the three-dimensional effect is displayed only through two-dimensional calculation, so that the calculation efficiency is ensured.

In one possible implementation, the electronic device determines, based on the Δx, the [ x_min, x_max ] and the first position of the cursor point, an abscissa x' of the second position of the cursor point, specifically including:

the first position of the cursor point comprises a first coordinate (x, y) and a first spherical position, the spherical position representing that the first position of the cursor point is on the front or back of the sphere;

the electronic device determines a first abscissa x of a second position of the cursor point based on the (x, y), the first spherical position, and the Δx _p ；

At said x _p In the case of being greater than or equal to the minimum value x_min of the lateral threshold range and less than or equal to the maximum value x_max of the lateral threshold range, the electronic device will send the x _p Determining a second abscissa x', determining the second spherical position as the same spherical position as the first spherical position;

in the event that the first abscissa is greater than the x_max, the electronic device determines the determination as x_max- (x) _p -x_max), determining the second spherical position as a spherical position opposite to the first spherical position;

in the event that the first abscissa is less than the x_min, the electronic device determines the x' as x_min+ (x_min-x) _p ) Determining the second spherical position as a spherical position opposite the first spherical position;

the second abscissa is the abscissa of the cursor point corresponding to the sliding point acquired last time; the second spherical position is the spherical position of the cursor point corresponding to the sliding point acquired last time.

Therefore, the determination of the abscissa skillfully utilizes the conversion relation between the abscissa range and the front and back sides, and the accuracy of the cursor point and the high efficiency of calculation are ensured.

the electronic device determines a third position and a third weft track of the cursor point based on the second sliding data, the third sliding data and last sliding result data; the third sliding data is the position of a sliding point of a first operation acquired by the electronic equipment last time, and the last sliding result data is a first position, a first weft track and a first warp track of the cursor point displayed by the third sliding data;

the electronic device displays based on a third location of the cursor point, the third weft track, and the first warp track.

In one possible implementation manner, the electronic device determines a third position and a third weft track of the cursor point based on the second sliding data, the third sliding data and the last sliding result data, and specifically includes:

the electronic device determining a longitudinal sliding displacement ay based on the second sliding data and the third sliding data;

the electronic device determines a longitudinal threshold range [ y_min, y_max ];

the electronic equipment determines a circle center ordinate k 'of the third weft track and an ordinate y' of a third position of the cursor point based on the delta y, the [ y_min, y_max ], the first position of the cursor point and the circle center ordinate k of the first weft track;

the electronic device determining a long axis of the third weft track based on the center coordinates of the sphere and the k';

the electronic device determining a minor axis of the third weft track based on a similarity ratio of the initial weft track to the first weft track and the major axis;

determining the third weft track based on the k ", the major axis and the minor axis;

the electronic device determines an abscissa x "of a third location of the cursor point based on the ordinate y" and the first linear track.

In one possible implementation manner, the electronic device determines, based on the Δy, the [ y_min, y_max ], the first position of the cursor point, and the center ordinate k of the first weft track, the center ordinate k″ of the third weft track, and the ordinate y″ of the third position of the cursor point, specifically including:

the electronic device determines a first ordinate y of a third position of the cursor point based on the (x, y), the first spherical position, and the Δy _p Determining a first center ordinate k of the third weft track based on the k, the first spherical position, and the Δy _p ；

At said y _p In the case of being greater than or equal to the minimum value y_min of the longitudinal threshold range and less than or equal to the maximum value y_max of the longitudinal threshold range, the electronic device will y _p Determining a second ordinate y ", and determining said k _p Determining a second center ordinate k″ of the third weft track, and determining the third spherical position as the same spherical position as the first spherical position;

in the event that y is greater than y_max, the electronic device determines y' as y_max- (y) _p -y_max), determining said k "as y_max- (k) _p -y_max), determining the third spherical position as a spherical position opposite to the first spherical position;

in the event that the y is less than the y_min, the electronic device determines the y' as y_min+ (y_min-y) _p ) The k' is determined as y_min+ (y_min-k) _p ) Determining the third spherical position as a spherical position opposite the first spherical position;

the second ordinate is the ordinate of the cursor point corresponding to the sliding point acquired last time; the third spherical position is the spherical position of the sliding point which is acquired last time and corresponds to the cursor point, and the second circle center ordinate is the circle center ordinate of the sliding point which is acquired last time and corresponds to the third weft track. Therefore, the determination of the ordinate and the weft track of the cursor point skillfully utilizes the conversion relation between the ordinate range and the front and back sides, and the accuracy of the cursor point and the high calculation efficiency are ensured.

In one possible implementation manner, the first user interface includes a spatial audio adjustment option, where the spatial audio adjustment option includes an azimuth angle, a pitch angle and a distance, and the azimuth angle characterizes an angle formed by a straight line where the direction of the sound source is located and a meridian track plane when the user is in a plane view; the pitch angle represents an included angle formed by a straight line where the direction of the sound source is located and a weft track plane when a user is in plane view; the distance characterizes the length between the sound source position and the user position;

in the case where the first operation is a sliding operation in a first direction, the azimuth angle correspondingly changes;

in the case where the first operation is a sliding operation in the second direction, the pitch angle correspondingly changes.

In the embodiment of the application, the user slides and adjusts the cursor point, which is finally used for determining which direction of the audio in the space is in the user, so that the azimuth angle and the pitch angle can be determined in the sliding process, and the direction of the three-dimensional space can be converted, so that the electronic equipment can further process the audio information, and the result of the sliding direction representation can be provided for the user.

In one possible implementation manner, in a case that the first operation is a sliding operation along a first direction, the azimuth angle correspondingly changes, specifically includes:

In the case of determining the abscissa x 'of the cursor point at the second position and the maximum value x_m of the lateral threshold range, the electronic device determines the azimuth angle θ' of the second position of the cursor point based on the first relation;

wherein the first relation isThe theta_m is the azimuth angle when the abscissa of the cursor point is at the maximum value; the theta is the azimuth angle of the cursor point at the first position; the x is the abscissa of the cursor point at the first position, and the second position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time;

in the case that the first operation is a sliding operation in the second direction, the pitch angle correspondingly changes, specifically including:

in the case of determining the ordinate y″ of the cursor point at the third position and the maximum value y_m of the longitudinal threshold range, the electronic device determines the pitch angle β″ of the cursor point at the third position based on the second relation;

wherein the second relation isThe beta_m is a pitch angle when the ordinate of the cursor point is at the maximum value; the beta is the pitch angle of the cursor point at the first position; the y is the ordinate of the cursor point at the first position, and the third position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time;

Wherein the maximum value x_m of the lateral threshold range comprises a maximum value x_max and a minimum value x_min of the lateral threshold range; the maximum value of the longitudinal threshold range comprises a maximum value y_max and a minimum value y_min of the longitudinal threshold range; the first position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time.

In this embodiment of the present application, the electronic device may preset two relations, and connect a relation between azimuth and abscissa and a relation between elevation and ordinate. Therefore, the azimuth angle and the pitch angle can be rapidly determined, the relation between the display position of the two-dimensional plane cursor point and the three-dimensional attitude angle does not need to be calculated, and the simplicity degree of calculation and the processing efficiency can be improved while certain accuracy is ensured.

In a second aspect, an embodiment of the present application provides an electronic device, including: one or more processors and one or more memories; the one or more processors are coupled with the one or more memories, the one or more memories for storing computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform:

Displaying a first user interface, wherein the first user interface displays a cursor point and a weft track and a warp track where the cursor point is positioned; the cursor point is one point where the weft track and the warp track intersect on the surface of the sphere, and the cursor point represents the spatial direction of the sound source position of the audio relative to the user; acquiring a first operation; when the first operation is a sliding operation along a first direction, the cursor point in the first user interface slides along a weft track where the cursor point is located, and the warp track where the cursor point is located changes along with the sliding of the cursor point on the weft track; the first direction is a direction corresponding to the weft track; under the condition that the first operation is a sliding operation along a second direction, the cursor point in the first user interface slides along a meridian track where the cursor point is located, and the meridian track where the cursor point is located changes along with the sliding of the cursor point on the meridian track; the second direction is a direction corresponding to the warp track.

In one possible implementation, in a case where the electronic device displays the first user interface, the electronic device further performs: and responding to a second operation, namely, the operation of sliding the sound source distance control in the first user interface by the user, wherein the sound source distance is the length between the sound source position and the user position.

Therefore, the electronic equipment can also adjust the direction of the audio frequency between the spatial positions and the users, improve the adjustable dimension and ensure to be more in line with the flexibility of the audio frequency in the spatial position adjusting process.

In one possible implementation, in a case where the electronic device displays the first user interface, the electronic device further performs:

In response to a third operation, adjusting the cursor point to be a preselected cursor point, displaying the weft track to be a preselected weft track, adjusting the warp track to be a preselected warp track, and adjusting the sound source distance to be a preselected sound source distance; the third operation is an operation of clicking a recommended sound source position control in the first user interface by a user; the preselected cursor point is a cursor point where the recommended sound source position is located; the preselected weft track is a weft track corresponding to the recommended sound source position; the preselected meridian track is a meridian track corresponding to the recommended sound source position; the preselected sound source distance is from the recommended sound source distance.

Therefore, the user can restore the adjusted position to the recommended sound source position, the adjustment result is quickened, the operation process is simplified, and the convenience and the high efficiency of the operation are further improved.

In one possible implementation, after the electronic device displays the first user interface, the electronic device further performs: responding to a first operation, and collecting first sliding data, wherein the first sliding data are coordinates of a sliding starting point and a current sliding point of the first operation; judging whether to trigger the cursor point to move or not based on the first sliding data; determining a sliding direction based on the first sliding data under the condition that the cursor point movement is triggered; the sliding direction includes the first direction and the second direction. Therefore, the electronic equipment firstly determines whether to trigger sliding, and when the sliding direction is determined, the accuracy of the moving time and the moving direction of the cursor point can be ensured.

In one possible implementation manner, the electronic device determines whether to trigger the cursor point to move based on the first sliding data, and specifically performs:

determining a lateral sliding distance |dx| and a longitudinal sliding distance |dy| from the sliding start point to the current sliding point;

judging whether the |dx| and the |dy| are smaller than or equal to a sliding threshold distance m; if the position of the cursor point is smaller than or equal to the position of the cursor point, the electronic equipment determines that the cursor point is not triggered to move; otherwise, the electronic equipment triggers the cursor point to move. In this way, under the condition that the user performs the sliding operation, the sliding distance is too short, and the user may touch the screen by mistake or click the control, so that the accuracy of triggering the movement of the cursor point can be ensured.

In one possible implementation, the electronic device determines a sliding direction based on the first sliding data, specifically performing: determining a sliding direction as a first direction in a case where the |dx| is greater than the |dy|; and in the case where the |dx| is smaller than the |dy|, determining the sliding direction as the second direction. Thus, the sliding direction of the user can be accurately determined, and the necessity of determining the sliding direction can be ensured when the cursor point is triggered to move.

In one possible implementation manner, the cursor point in the first user interface slides along a weft track where the cursor point is located, and a warp track where the cursor point is located changes along with the sliding of the cursor point on the weft track, specifically performing:

acquiring second sliding data under the condition that the first operation is not finished yet, wherein the second sliding data is the coordinates of a sliding point of the first operation acquired last time;

determining a second position and a second meridian track of the cursor point based on the second sliding data, third sliding data and last sliding result data; the third sliding data is the position of a sliding point of a first operation acquired by the electronic equipment last time, and the last sliding result data is a first position, a first weft track and a first warp track of the cursor point displayed by the third sliding data;

and displaying based on the second position of the cursor point, the first weft track and the second warp track.

In one possible implementation, the electronic device determines the second position and the second meridian track of the cursor point based on the second sliding data, the third sliding data, and the last sliding result data, specifically performing:

determining a lateral sliding displacement Δx based on the second sliding data and the third sliding data;

determining a lateral threshold range [ x_min, x_max ] based on the first weft track;

determining an abscissa x' of a second location of the cursor point based on the Δx, the [ x_min, x_max ] and the first location of the cursor point;

determining an ordinate y 'of the second position of the cursor point based on the x' and the first weft track;

the second warp track is determined based on the x ', the y', and the first warp track.

In one possible implementation, the electronic device determines an abscissa x' of the second position of the cursor point based on the Δx, the [ x_min, x_max ] and the first position of the cursor point, specifically performs:

determining a first abscissa x of a second position of the cursor point based on the (x, y), the first spherical position and the Δx _p ；

At said x _p Greater than or equal to the minimum value x_min of the lateral threshold range and less than or equal to the maximum value x_max of the lateral threshold range, the x is determined _p Determining a second abscissa x', determining the second spherical position as the same spherical position as the first spherical position;

in the case that the first abscissa is greater than the x_max, determining the first abscissa as x_max- (x) _p -x_max), determining the second spherical position as being the same as the first spherical positionA reversed spherical position;

in the case that the first abscissa is less than the x_min, the x' is determined as x_min+ (x_min-x) _p ) Determining the second spherical position as a spherical position opposite the first spherical position;

the second abscissa is the abscissa of the cursor point corresponding to the sliding point acquired last time; the second spherical position is the spherical position of the cursor point corresponding to the sliding point acquired last time. Therefore, the determination of the abscissa skillfully utilizes the conversion relation between the abscissa range and the front and back sides, and the accuracy of the cursor point and the high efficiency of calculation are ensured.

In one possible implementation manner, the cursor point in the first user interface slides along a meridian track where the cursor point is located, and a weft track where the cursor point is located changes along with the sliding of the cursor point on the meridian track, specifically performing:

determining a third position and a third weft track of the cursor point based on the second sliding data, the third sliding data and the last sliding result data; the third sliding data is the position of a sliding point of a first operation acquired by the electronic equipment last time, and the last sliding result data is a first position, a first weft track and a first warp track of the cursor point displayed by the third sliding data;

And displaying based on a third position of the cursor point, the third weft track and the first warp track.

In one possible implementation, the electronic device determines the third position and the third weft track of the cursor point based on the second sliding data, the third sliding data, and the last sliding result data, and specifically performs:

determining a longitudinal sliding displacement Δy based on the second sliding data and the third sliding data;

determining a longitudinal threshold range [ y_min, y_max ];

determining a center ordinate k 'of the third weft track and an ordinate y' of a third position of the cursor point based on the Δy, the [ y_min, y_max ], the first position of the cursor point and the center ordinate k of the first weft track;

Determining a major axis of the third weft track based on the center coordinates of the sphere and the k';

determining a minor axis of the third weft track based on the similarity ratio of the initial weft track to the first weft track and the major axis;

an abscissa x "of the third location of the cursor point is determined based on the ordinate y" and the first linear track.

In one possible implementation, determining the center ordinate k″ of the third weft track and the ordinate y″ of the third position of the cursor point based on the Δy, the [ y_min, y_max ], the first position of the cursor point and the center ordinate k of the first weft track specifically performs:

determining a first ordinate y of a third position of the cursor point based on the (x, y), the first spherical position and the Δy _p Determining a first center ordinate k of the third weft track based on the k, the first spherical position, and the Δy _p ；

At said y _p Greater than or equal to the minimum value y_min of the longitudinal threshold range and less than or equal to the maximum value y_max of the longitudinal threshold range, the y is determined _p Determining a second ordinate y ", and determining said k _p Determining a second center ordinate k″ of the third weft track, and determining the third spherical position as the same spherical position as the first spherical position;

in the case where the y is less than the y_min, the y' is determined as y_min+ (y_min-y) _p ) The k' is determined as y_min+ (y_min-k) _p ) Determining the third spherical position as a spherical position opposite the first spherical position;

In one possible implementation, in the case where the first operation is a sliding operation along a first direction, the azimuth angle changes correspondingly, specifically performing:

determining an azimuth angle theta 'of the second position of the cursor point by a first relation under the condition that the abscissa x' of the cursor point at the second position and the maximum value x_m of a transverse threshold range are determined;

determining a pitch angle beta 'of the third position of the cursor point based on a second relation under the condition that the ordinate y' of the cursor point at the third position and the most value y_m of a longitudinal threshold range are determined;

In a third aspect, embodiments of the present application provide a chip system, where the chip system is applied to an electronic device, and the chip system includes one or more processors, where the processors are configured to invoke computer instructions to cause the electronic device to perform the interface interaction method according to the first aspect or any possible implementation manner of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform the interface interaction method according to the first aspect or any one of the possible implementations of the first aspect.

In a fifth aspect, embodiments of the present application provide a computer-readable storage medium comprising instructions that, when executed on an electronic device, cause the electronic device to perform the interface interaction method according to the first aspect or any one of the possible implementations of the first aspect.

Drawings

FIGS. 1A-1C are schematic views of a set of spherical motions according to embodiments of the present application;

FIGS. 2A-2B are a set of user interface diagrams provided by embodiments of the present application;

FIG. 3 is a schematic view of a user sliding operation according to an embodiment of the present application;

Fig. 4A to fig. 4B are schematic views of another user sliding operation provided in the embodiments of the present application;

fig. 5A to 5C are schematic software structures of an electronic device according to an embodiment of the present application;

FIGS. 6A-6B are schematic flow diagrams of a method for interactive computation of lateral sliding according to embodiments of the present application;

FIGS. 7A-7B are schematic diagrams of a set of user laterally sliding cursor points provided in embodiments of the present application;

fig. 8A to 8B are schematic diagrams of a set of cursor points and track drawing results provided in the embodiments of the present application;

FIG. 9 is a schematic diagram of a user interface provided by an embodiment of the present application;

FIGS. 10A-10B are schematic flow diagrams of a method for interactive computing of longitudinal sliding according to embodiments of the present application;

FIGS. 11A-11B are schematic diagrams of a set of user longitudinally sliding cursor points provided in embodiments of the present application;

fig. 12A to 12B are schematic diagrams of another set of cursor and track drawing results provided in the embodiments of the present application;

FIG. 13 is a schematic diagram of another user interface provided by an embodiment of the present application;

FIG. 14 is a flowchart of a method for spherical motion interaction according to an embodiment of the present application;

fig. 15 is a schematic software structure of an electronic device according to an embodiment of the present application;

Fig. 16 is a schematic hardware structure of an electronic device 100 according to an embodiment of the present application.

Detailed Description

The terminology used in the following embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates to the contrary. It should also be understood that the term "and/or" as used in this application refers to and encompasses any or all possible combinations of one or more of the listed items.

When a user listens to music, the user often places an audio playing device at a certain point in a spatial location, so that the user can perceive the direction and distance of the audio in the space. While the user is wearing the headphones, the audio is typically in the ear directly, and the user does not perceive the direction and distance of the sound source. Therefore, when the user wears the earphone, in order to simulate the perception of the audio heard by the user in the space, the effect of the user for perceiving the space audio is improved, and the user can adjust the sound source position of the space audio through the electronic equipment. For example, the user may adjust the direction and distance between the spatial audio and the user. Therefore, how to adjust the direction and distance of the sound source for the scene of the spatial audio is a problem to be solved in the present application.

The screen of the electronic equipment is a two-dimensional plane, the dimension of user operation regulation and control is also two-dimensional, and in the application scene, the electronic equipment needs to display the three-dimensional space audio effect through a two-dimensional picture. For the direction of spatial audio, the electronic device may determine the location of the user (or the location where the person accepts the sound) as the center of a sphere, and each point of the sphere may be represented as the direction of audio. The user can change the direction of the spatial audio by adjusting the position of the spherical cursor point.

In this embodiment of the present application, for an application scenario of spherical motion, an interactive display manner and an electronic device are provided.

The longitude and latitude may describe any position of the earth in a geographic coordinate system. According to the embodiment of the application, the process that the cursor point is positioned on the spherical surface or the position is moved is calibrated by using the longitude and latitude lines, and the effect of moving the cursor point on the spherical surface can be displayed. In the embodiment of the present application, a circle passing through the upper and lower vertices (up and down directions) of the sphere surface is referred to as a warp track, and a circle parallel to the horizontal plane (left and right directions) is referred to as a weft track. The track warp track and the weft track of the sphere are in an elliptic shape on a two-dimensional plane.

Fig. 1A to 1C are schematic views showing a set of spherical motions according to an embodiment of the present application. As shown in fig. 1A, the electronic device may display a warp track 102 and a weft track 103 to represent the sphere 101, where the warp track 102 and the weft track 103 are two circular tracks (in three dimensions) intersecting perpendicularly, and the warp track 102 and the weft track 103 intersect at a P0 cursor point on the front of the sphere 101. The current P0 point position indicates that the cursor is positioned directly in front of the sphere 101. The sphere 101 may be formed by O ₀ Is a sphere with a center and a length a being a radius.

In order to more clearly show the spatial relationship among the sphere 101, the warp rail 102, and the weft rail 103, a spatial coordinate system X-axis, Y-axis, and Z-axis is established with the point O on the upper left of the sphere 101 as the origin of the three-dimensional space. Wherein the positive direction of the X axis is rightward, the positive direction of the Y axis is downward, and the positive direction of the Z axis is forward. The X-axis and Y-axis can be practically used when calculated in two-dimensional plane interactions and displays, represented by solid lines, while the Z-axis is not used alone, and is therefore represented by dashed lines. In the actual calculation process, the plane where the screen of the electronic device is located is an XOY plane, and the electronic device may establish a coordinate system with the upper left corner of the screen as an origin, or may establish a coordinate system with the center of a sphere as an origin (not shown).

The auxiliary lines X, Y and Z and the sphere 101 are not displayed when the electronic device is actually displayed. As shown in fig. 1B, the electronic device may display only the warp track 102, the weft track 103, and an intersection point P0 of the two tracks for representing the current position. The warp rail 102, the weft rail 103, and the intersection point P0 may be changed according to the user's operation, and P0 may be on the front surface of the sphere, or may be on the back surface of the sphere. As shown in fig. 1C, the electronic device may display P0 as a point on the front and back sides of the sphere.

Alternatively, the portions of the two tracks (warp track 102 and weft track 103) located on the front of sphere 101 are visible to the user and therefore can be shown as solid lines; the two tracks are located on the back of the sphere 101, so that the user cannot see the two tracks, and the electronic device can display the two tracks in a manner that the transparency of the track closer to the back is greater, or the electronic device can display all of the two tracks, wherein the transparency of the other track on the back of the sphere is greater, for example, the transparency of the warp track is a solid line, and the transparency of the weft track on the back of the sphere is increased. In this way, it is possible to effectively distinguish whether the position of the track is in the front or the back portion. The front and back sides of the two rails may also be distinguished by other means, without limitation.

Optionally, in the case that P0 is at the front position of the sphere, the P0 cursor point is displayed on the surface of the warp track and the weft track, i.e. the cursor point covers both tracks; in contrast, in the case where P0 is at the back position of the sphere, the P0 cursor point is displayed below the warp and weft tracks, i.e., both tracks cover the cursor point. The position of the cursor point is always located on the surface of the sphere, so that the display sequence is that of the front and the back, and the front is covered and the back is that of the front and the back of the cursor display.

In the embodiment of the application, the electronic equipment can display the movement condition of the three-dimensional sphere surface position through the two-dimensional plane.

The user slides left and right to adjust the warp track and slides up and down to adjust the weft track. With the effect of three-dimensional space, the user slides left and right, and the cursor point slides along the weft track where the cursor point is located, and the warp track where the cursor point is located changes along with the sliding of the cursor point on the weft track. That is, the warp rail rotates clockwise or counterclockwise about an axis (Y axis) in the up-down direction as a rotation axis. The user slides up and down, the cursor point slides along the meridian track where the cursor point is located, the weft track where the cursor point is located changes along with the sliding of the cursor point on the meridian track, namely, the weft track is parallel to the XOZ plane and scales up and down by taking the point on the Y axis as the circle center, namely, the radius of the weft track changes along with the change. In view of the display effect of the two-dimensional plane, the elliptical long axis (Y-axis direction) of the warp track is unchanged when the user slides left and right, the short axis is increased or decreased, the maximum short axis is equal to the long axis, and the minimum short axis is 0, namely a vertical line is presented. The ellipse of the weft rail is moved horizontally along the Y-axis direction by the user, and the ellipse is enlarged or reduced, and in the up-and-down sliding process, the ellipse slides to the position with the longest major axis, and the radius of the major axis is the radius of the circle.

In the above process, the electronic device can adjust the position of the audio in the space by sliding horizontally or longitudinally, and the user can simulate the space sound source point by sliding the cursor point to experience the sound effect of the sound source point in different positions. Further, the three-dimensional sound source space position is on the two-dimensional screen, adjustment and interaction often have certain difficulty, and user learning and adaptation are needed.

The whole interaction flow is described below according to the display of the electronic device and the operation of the user:

first, the electronic device displays a user interface of the initial position of the cursor relative to the sphere.

Fig. 2A-2B are a set of user interface diagrams disclosed in embodiments of the present application. As shown in fig. 2A, a user opens a display interface of an electronic device, which may display user interface 210. The user interface 210 may include a plurality of applications. Such as weather, calendar, mail, settings, application store, notes, gallery, XX211, phone, short message, browser and camera, etc. The positions of the icons of the application programs and the names of the corresponding application programs can be adjusted according to the preference of the user, which is not limited in the embodiment of the present application. In this embodiment of the present application, when the XX211 application is opened, the electronic device may display a position of a point on the sphere, and when the user operates to change the position of the point, neither the name nor the pattern of the XX211 application is limited. For example, XX may be a music application, or may be a spatial audio (spatial audio) application.

It should be noted that, the interface schematic diagram of the electronic device shown in fig. 2A is an exemplary illustration of the embodiment of the present application, and the interface schematic diagram of the electronic device may also be other types, which is not limited in the embodiment of the present application.

In fig. 2A, the user may click on the XX211 control in the user interface 210 (sphere interactive interface), and after the electronic device receives an operation on the XX211 control, the user interface 220 shown in fig. 2B may be displayed.

As shown in fig. 2B, a spherical position interaction pattern 221 may be displayed in the user interface 220. Specific descriptions that may be made in the spherical position interaction pattern 221 may be referred to the related descriptions in fig. 1A to 1C. In the case where the electronic device enters the XX application, the electronic device displays that the cursor position is the position directly in front of the sphere, i.e., the point P0 in fig. 2B. In the user interface 220, the user can slide the screen, adjust the cursor point P0, and the warp track 102 and the weft track 103. In the embodiment of the present application, the size of the display and the position of the display of the spherical position interaction pattern 221 are not limited.

Alternatively, as shown in FIG. 2B, the user interface 220 may display a menu bar 223 of spatial audio adjustments. Menu bar 223 may include three adjustment options, azimuth (azimuth), pitch (elevation), and distance (distance). The azimuth angle represents an included angle formed by a straight line where the direction of the sound source is positioned and a meridian track plane when the user is in plane view; the pitch angle represents the angle formed by the straight line where the direction of the sound source is located and the plane of the weft track when the user is in plane view, and the distance represents the length between the position of the sound source and the center of sphere (the position of the user), for example, the current azimuth angle is 0 degree, the pitch angle is 0 degree and the distance is 100m.

Alternatively, as shown in fig. 2B, for the sound source distance (distance) in the menu bar 223 described above, the user interface 220 may include a sound source distance adjustment bar 222, and the user may slide the sound source distance control to increase or decrease the distance. For example, the user slides the distance control a decreasing distance to the left and a increasing distance to the right. Therefore, the electronic equipment can also adjust the direction of the audio frequency between the spatial positions and the users, improve the adjustable dimension and ensure to be more in line with the flexibility of the audio frequency in the spatial position adjusting process.

Optionally, as shown in fig. 2B, the user interface 220 further includes a "recommended position (recommended position)" (recommended sound source position) control, which the user clicks, the electronic device can adjust the position of the sound source to the spatial position recommended by the electronic device. In particular, the electronic device may store a preselected cursor point, a preselected weft track, a preselected warp track (corresponding to a particular (preselected) azimuth angle and (preselected) pitch angle), and a preselected source distance. The preselected cursor point is the cursor point where the recommended sound source position is located; the preselected weft track is a weft track corresponding to the recommended sound source position; the preselected warp track is a warp track corresponding to the recommended sound source position; the sound source distance is the recommended sound source distance. And in response to the operation of the user for touching the recommended position control, the electronic equipment adjusts the cursor point to be a preselected cursor point, displays the weft track to be a preselected weft track, adjusts the warp track to be a preselected warp track, and adjusts the sound source distance to be a sound source distance. Therefore, the user can restore the adjusted position to the recommended sound source position, the adjustment result is quickened, the operation process is simplified, and the convenience and the high efficiency of the operation are further improved.

Illustratively, as shown in FIG. 13, the electronic device displays a user interface 1310, and after the user clicks the recommended position control, the electronic device displays a user interface 220 as shown in FIG. 2B. The pre-selected azimuth angle and the pre-selected pitch angle are 0 degrees, and the azimuth angle is adjusted from 75 degrees to 0 degree; adjusting the pitch angle from 60 degrees to 0 degrees; the recommended pre-selected sound source distance remains unchanged at 100 m. The above-described preselected azimuth angle, preselected pitch angle, and preselected source distance are exemplary descriptions and are not limiting.

It should be noted that, in the above-mentioned user interface 220, the electronic device is adjusted with respect to the spatial direction and position of the audio 1, and at this time, the electronic device has already activated the function of the spatial audio, and may be manually adjusted (manual) by the user. The user may also select an auto-adjust button, and the electronic device performs auto-adjustment (auto).

When the electronic device first displays the user interface 220, the cursor point P0 is located at the point directly in front of the sphere. The electronic device may preset the current coordinate system to XOY. The sphere in the XOY plane is sphere 101 (shown as a circle) in FIG. 1A with the center of the circle being O ₀ The radius is a. The warp track 102 is an ellipse with its long axis parallel to the Y axis and the weft track 103 is an ellipse with its upper axis parallel to the X axis. At this time, the long axis of the two tracks (warp track 102 and weft track 103) is 2a and the short axis is 2b, where a >b>0。

Illustratively, in the plane of XOY (the XOY plane at this time is taken as the sphere center O ₀ Plane of origin), two tracks that the electronic device can draw and display can be represented as: (in this case, the two tracks are standard ellipses)

The weft track 103 (long axis in X axis) is:

warp track 102 (long axis in Y-axis) is:

illustratively, in the plane of XOY (where the XOY plane is the plane with the upper left corner of the screen as the origin), two tracks that the electronic device can draw and display can be represented as:

the weft track 103 (long axis in X axis) is:

warp track 102 (long axis in Y-axis) is:

at this time, (m, n) is the coordinates of the center point.

It should be noted that, the major axes of the weft rail 103 and the warp rail 102 are not necessarily equal, and the minor axes are not necessarily equal, so that the following description may also be extended to the above formula for convenience of description, which is not limited in the embodiment of the present application.

Optionally, the warp track and the weft track are highlighted on the front and implicitly on the back. As shown in fig. 2B, the front side of the track displayed by the electronic device is displayed by a solid line, and the closer the back side of the track is to the point of the front and back sides, the greater the track transparency, and the track at the back side of the sphere displays a gradient color. Further, the lower half of the weft track may be denoted as the sphere front and the corresponding upper half as the sphere back; the upper half of the weft track may also be denoted as the sphere front and the corresponding lower half as the sphere back. The left half of the warp track may be denoted as the sphere front and the corresponding right half as the sphere back; the left half of the weft track may be denoted as the sphere back; the corresponding right half may be denoted as sphere face.

The user can slide up and down or left and right. For example, as shown in fig. 2B, in response to a (rightward) sliding operation of the AB track of the user, the electronic device may move P0 in the clockwise direction along the weft track, and the warp track changes. In response to a (upward) sliding operation of the AC trajectory of the user, the electronic device may move P0 upward along the warp rail, and the weft rail is changed up and down.

After the electronic device displays the user interface of the spherical interaction, the user can adjust the position of the cursor point on the surface of the sphere through sliding operation. The user can slide left and right when adjusting the position of the cursor point, and adjust and carry out the weft track; and the warp track is adjusted by sliding up and down. The following describes the interaction procedure of the electronic device in detail in connection with the sliding operation of the user. The cursor point moves, the corresponding track changes, the moving direction of the cursor point can be divided into a transverse direction and a vertical direction, the corresponding track also comprises a transverse weft track and a longitudinal warp track, and the processing procedure of displaying the electronic equipment is described below aiming at the movement of the cursor point by a user:

in order to conveniently represent the interaction condition, the change condition of the user sliding process and the interaction pattern of the spherical position is more concisely represented, the following graph can be directly represented by two tracks on the spherical surface, the positions of the cursor points and related auxiliary line contents, and the positions of the cursor points on the spherical surface can represent the direction of the sound source.

And under the condition that the electronic equipment detects the sliding operation of a user, judging whether the cursor point is touched to move or not.

Under the condition that the electronic equipment displays the sphere interactive interface, the electronic equipment can respond to the sliding operation to judge whether the cursor point is triggered to move. Under the condition that the electronic equipment does not move, the positions of the cursor points and the two tracks do not need to be changed; in the case of judging movement, the electronic apparatus may judge the sliding direction of the user, displaying the change of the cursor point and the two tracks based on the sliding operation.

The electronic equipment judges whether the transverse sliding distance or the longitudinal sliding distance is larger than a sliding threshold distance, and under the condition that the transverse sliding distance or the longitudinal sliding distance is larger than the sliding threshold distance, the movement of the trigger cursor point can be determined; otherwise, judging that the cursor point is not triggered to move.

The user clicks on the screen to start sliding, the sliding start point is (x 0, y 0), and the current sliding point is (x 1, y 1). Knowing the sliding threshold distance m, the electronic device may determine that the displacement of the current lateral movement is dx=x1-x 0, the lateral sliding distance being noted as |dx|= |x1-x0|; the displacement of the longitudinal movement is dy=y1-y 0, and the longitudinal sliding distance is |dy|= |y1-y0|. In the case where the electronic apparatus judges that |dy|is not more than m (|dy| < m) and |dx|isnot more than m (|dx| > m), it may be determined that the cursor point is not currently moved; in the case where the electronic apparatus determines |dy| > m (|dy|Σ m) or |dx| > m (|dy|Σ m), the moving cursor point may be determined. If and only if the electronic device judges that the cursor point is triggered to move, the electronic device can start to move corresponding to the display track and the cursor point, and if the electronic device judges that the cursor point is not moved, the electronic device displays the track and the cursor point.

Specifically, the electronic apparatus determines a slide start point to be (x 0, y 0), a current slide point to be (x 1, y 1), and calculates |dy| and |dx| in response to a slide operation by the user. In the case where |dy|is not more than m (|dy| < m) and |dx|is not more than m (|dx| > m), if the electronic apparatus detects that the sliding operation is ended, the cursor point movement is not triggered, that is, the cursor point and the track are not displayed to be moved. If the electronic equipment detects that the sliding operation is continued, the condition of dy| > m (dy|not less than m) or |dx| > m (dy|not less than m) is reached, and the electronic equipment can display the moving cursor point and the track. In the case where |dy|is less than or equal to m and |dx| is less than or equal to m, the cursor point and the track continue to change with the sliding operation by the user until the sliding operation ends.

In the sliding process, the user can slide transversely or longitudinally, the electronic equipment can periodically acquire the position of the touch screen of the user through the screen, namely (x 1, y 1), and the electronic equipment acquires the data of the sliding point, so that the sliding point can be correspondingly calculated.

Optionally, at time T0, the electronic device detects that the user starts sliding, and obtains a sliding start point (x 0, y 0), at time T1, the electronic device detects that the sliding point is (x 1, y 1), and judges that |dy|is less than or equal to m (|dy| < m) and |dx|is less than or equal to m (|dx| > m), the electronic device may determine not to trigger the moving cursor point. At the time T2, the electronic device detects that the user finishes the sliding operation, and may not trigger the cursor point to move, i.e., the displayed user interface is unchanged.

Alternatively, at time T0, the electronic apparatus detects that the user starts sliding, and acquires a sliding start point (x 0, y 0), and at time T1, the electronic apparatus detects that the sliding point is (x 1, y 1), and judges that |dy|+.m (|dy| < m) and |dx|+.m (|dx| > m). At the time T3, the electronic device detects that the sliding point is (x 2, y 2), and judges dy| > m (dy|is not less than m) or |dx| > m (dy|is not less than m), the electronic device can determine to trigger to move the cursor point, determine the sliding direction, calculate the sliding process and display the sliding process on the user interface. At time T4, the electronic device detects that the user has finished sliding, and the electronic device may end the user sliding.

Illustratively, fig. 3 is a schematic diagram of a user sliding operation that is illustratively shown in an embodiment of the present application. As shown in fig. 3, the screen on which the user slides is determined as the XOY plane, the electronic device determines the start point of the sliding as the a point (x 0, y 0) in response to the sliding operation, the user sliding trajectory as the dotted line 302, and when the user slides between the ACs, the electronic device may determine that |dy|m and |dx|m, and the electronic device does not display the track and the movement of the cursor point. After the sliding operation passes through the point C, the electronic device determines |dx| > m, and the electronic device may further determine the sliding direction and need to display the movement of the cursor point and the track.

For example, as shown in fig. 3, if the electronic device detects that the user ends the sliding operation between sliding to AC, it may be determined that the cursor point is not triggered to move, and the electronic device may display that the cursor point and the track are unchanged, that is, keep the original position for display.

In the above process, under the condition that the user performs the sliding operation, the sliding distance is too short, which may be that the user touches the screen by mistake or clicks the control, so that the accuracy of triggering the movement of the cursor point can be ensured.

And under the condition that the movement of the cursor point is triggered, the electronic equipment judges the sliding direction based on the sliding operation of the user.

The electronic apparatus determines whether the direction of sliding is lateral or longitudinal based on the lateral sliding distance |dx| and the longitudinal sliding distance |dy|, and further determines whether sliding is left or right, or up or down based on the positive and negative of the sliding displacement.

Under the condition of |dy| > |dx|, the electronic equipment longitudinally slides, namely the cursor point slides along the warp direction, and the weft changes up and down; further, the electronic device determines the direction of longitudinal sliding based on the positive and negative directions of dy, and in the case where dy >0, the electronic device determines that the cursor point slides downward along the meridian direction (Y-axis positive direction); the weft yarn slides down. In the case where dy <0, the electronic device determines that the cursor point slides upward along the meridian direction (Y-axis negative direction); the weft yarn slides upwards to change.

Under the condition of |dy| < |dx|, the electronic equipment transversely slides, namely the cursor point slides along the weft direction, and the warp changes left and right; further, the electronic device determines the direction of the lateral sliding based on the positive and negative of dx, and in the case that dx >0, the electronic device determines that the cursor point slides rightward along the weft direction (X-axis positive direction); the weft yarn slides and changes rightward. In the case where dx <0, the electronic device determines that the cursor point slides leftward along the weft direction (X-axis negative direction); the weft yarn is changed by sliding leftwards.

In the case of |dy|= |dx|, the electronic device does not move the track and the cursor point. The electronic device can further collect the sliding points and repeat the process.

Fig. 4A to 4B are schematic views illustrating another user sliding operation according to an embodiment of the present application. As shown in fig. 4A, the user's sliding track on the screen is a dashed line AF, with the AF lateral or longitudinal sliding distance being greater than the sliding threshold distance (e.g., the electronic device has decided |dy| > m). The electronic device may compare the magnitudes of the lateral sliding distance |dx| and the longitudinal sliding distance |dy| as shown in fig. 4A, the electronic device may determine the longitudinal sliding, and dy=y2—y0<0, so that the user slides from a (x 0, Y0) to F (x 2, Y2), sliding the distance of |dy| in the negative Y-axis direction. It can be determined that sliding in the Y-axis direction from a (x 0, Y0) to G (x 0, Y2) is performed with a longitudinal sliding displacement AG.

Illustratively, as shown in fig. 4B, the user's sliding track on the screen is a dashed line AI, which is a lateral or longitudinal sliding distance greater than the sliding threshold distance (e.g., the electronic device has determined |dx| > m). The electronic device may compare the magnitudes of the lateral sliding distance |dx| and the longitudinal sliding distance |dy|, as shown in fig. 4B, |dx| > dy|, the electronic device may determine the longitudinal sliding, and dx=x3-x0 >0, so that the user slides from a (X0, y 0) to I (X3, y 3), sliding the distance of |dy| in the positive direction of the X-axis. It can be determined that sliding in the X-axis direction from a (X0, y 0) to H (X3, y 0) is a lateral sliding displacement AH.

In the above embodiment, the direction of the sliding of the user can be accurately determined, and the sliding direction is determined again when the movement of the cursor point is triggered, so that the necessity of determining the direction can be ensured.

Under the condition that the electronic equipment determines that the touch cursor point moves, continuously collecting the position of the sliding point, determining coordinates of the warp track, the weft track and the cursor point based on the position of the sliding point and the last sliding result, and displaying the changed warp track, the changed weft track and the changed cursor point.

When the electronic device detects the sliding, the electronic device may continuously collect the touch point of the operation, and the electronic device may determine the display result (the cursor point, the warp track and the weft track) of the time based on the display results (the last cursor point, the last warp track and the last weft track) of the touch point collected at the time and the last touch point.

In the sliding process, the electronic device may determine a position where the touch point is continuously collected. For example, the last sliding point has a coordinate (x _i-1 ，y _i-1 ) The corresponding cursor point coordinates are (x, y); this sliding point has a coordinate (x) _i ，y _i ) The corresponding cursor point coordinates need to be calculated. In the sliding process, the lateral displacement between the front touch point and the rear touch point acquired by the electronic equipment is deltax=x _i -x _i-1 Longitudinal displacement is Δy=y _i -y _i-1 。

And under the condition that the transverse movement is judged, the electronic equipment calculates and displays the change process of the warp track and the change process of the cursor point. (during the transverse movement, the weft track is unchanged and only the warp track is changed)

From the three-dimensional perspective, the user slides left and right, the position of the cursor coordinates slides along the weft track (sliding left, weft track rotating clockwise; sliding left, weft track rotating counterclockwise), and the warp track rotates along the Y-axis direction. In the two-dimensional plane, the user slides left and right, the ellipse of the weft track does not change, the long axis (length in the Y-axis direction) of the ellipse of the warp track does not change, and the short axis increases or decreases along with the sliding of the user.

Fig. 6A to fig. 6B are schematic flow diagrams of a method for interactive computation of lateral sliding, where, as shown in fig. 6A, in a process of lateral sliding by a user, the interactive computation of an electronic device may include, but is not limited to, the following steps:

In this embodiment, the first positions of the first weft track, the first warp track and the cursor point refer to the sliding result data (last sliding result data) processed and displayed by the last acquired sliding point in the sliding operation of the electronic device.

S11: the electronic device determines a lateral sliding displacement, a first weft track, and a lateral axis threshold range.

The electronic device stores the last acquired coordinates (x _i-1 ，y _i-1 ) (third sliding data) and acquires the sliding point coordinates (x _i ，y _i ) (second sliding data) the lateral sliding displacement can be calculated as Δx=x _i -x _i-1 。

The first weft rail is a weft rail determined before this sliding operation or after the end of the last sliding operation. Fig. 5A and 5B are exemplary schematic orbital views of a set of spherically moving cursor points as disclosed in embodiments of the present application. As shown in FIG. 5A, if the current ellipse is calculated according to the XOY coordinate system with the center of the circle as the origin, the expression of the first weft track isAs shown in FIG. 5B, the expression of the weft track is +.>Wherein, the longitudinal sliding operation of the user changes the ellipse of the weft track, and the center of the ellipse moves to the point O1 (0, k). Wherein, k is less than or equal to a. K=0 in fig. 5A. a1 is less than or equal to a; b1 is equal to or less than b, a1=a, b1=b in fig. 5A.

The electronic device can first determine a cross-axis threshold range [ x_min, x_max ] based on the expression of the first weft track, and can then determine a cursor sliding point based on the cross-axis threshold range. Illustratively, as in fig. 5A, x_min= -a; x_max=a. As in fig. 5B, x_min= -a1; x_max=a1.

S12: the electronic device determines a second abscissa of a second location of the cursor point.

The electronic device may determine an abscissa x' of the second position of the cursor point based on Δx, [ x_min, x_max ] and the first position of the cursor point.

In this embodiment of the present application, the first position of the cursor point is the cursor point position determined by the last time the sliding point is acquired, and the second position of the cursor point is in the process of sliding laterally, and this time the cursor point position to be determined by the sliding point is acquired. The cursor point position includes coordinates and a spherical position, the spherical position representing the position of the cursor point on the front or back of the sphere. The first position may comprise a first coordinate (x, y) and a first spherical position, and the second position comprises a second coordinate (x ', y') and a second spherical position. The second warp track is the warp track that needs to be determined this time the sliding point is acquired. As shown in fig. 6B, a method of determining the abscissa x' of the second position of the cursor point may include, but is not limited to, the following steps:

S121: the electronic device determines a first abscissa of a second position of the cursor point based on the first coordinate, the lateral sliding displacement, and the first spherical position.

The electronic device determines a lateral sliding displacement Δx in the X-axis direction based on the user's left-right sliding. Wherein Δx may be positive or negative, the user slides to the right, Δx is positive, indicating that the cursor point changes counterclockwise along the weft track; the user slides to the left, Δx is negative, indicating that the cursor point is changing clockwise along the weft track.

The electronic equipment judges whether the first spherical surface position is the front surface or the back surface of the sphere. The electronic device can compare the first coordinate (x, y) with the ordinate k of the circle center of the first weft track to determine the front and back positions of the sphere where the previous cursor point is located.

Alternatively, as shown in fig. 5A. In the first weft track elliptical expression, a cursor point representation positioned at the upper half part of the elliptical track is positioned at the back; the cursor point of the lower half part is positioned on the front surface of the sphere. The electronic equipment can compare the ordinate of the first position of the cursor point with the ordinate k of the circle center of the first weft track, and the first position of the cursor point is positioned on the back of the sphere under the condition that y is larger than k; in the case of y < k, the first position of the cursor point is on the front of the sphere. In fig. 5C, in the ellipse of the first weft track, the cursor point located at the lower half of the ellipse track is shown to be located at the back; the cursor point on the upper half is located on the front of the sphere. Under the condition that the electronic equipment can judge that y is less than k, the first position of the cursor point is positioned on the back of the sphere; in the case of y > k, the first position of the cursor point is on the front of the sphere.

After determining the first spherical position, the electronic device determines a first abscissa of a second position of the cursor point as x with the first position of the cursor point being in front _p =x+Δx; determining a first abscissa of a second position of the cursor point as x with the first position of the cursor point at the back _p ＝x-Δx。

Illustratively, as shown in fig. 5A, the ordinate k of the center of the first weft track is 0, the ordinate y of the first position P0 (x, y) of the cursor point is less than k, and the electronic device may determine that P0 is on the front of the sphere. At this time, the first abscissa of the second position of the cursor point is x _p ＝x+Δx。

In the embodiment of the present application, the first abscissa x _p The abscissa of the second coordinate, which is not yet determined as the second position of the cursor point, is an intermediate value in the determination process.

S122: the electronic equipment judges whether the first abscissa exceeds a threshold range of the horizontal axis; in the case that it is within the horizontal axis threshold range, the electronic device executes S123; otherwise, the electronic device performs S124.

Due to the first abscissa x of the electronic device _p During the sliding change, the electronic device needs to determine whether it is within the horizontal axis threshold range, and when it is within the horizontal axis threshold range, the electronic device executes S123 to determine that the first abscissa x' is the second abscissa (the finally determined abscissa) of the second position of the cursor point; when not within the horizontal axis threshold range, the electronic device needs to re-determine the second horizontal axis of the second position of the cursor point, i.e., execute S124.

Specifically, the electronic device determines a first abscissa x of the second position of the cursor point _p Whether or not to be in [ x ]_min，x_max]In the case that x_min is less than or equal to x' isless than or equal to x_max, the abscissa of the cursor is determined to be within the threshold range of the horizontal axis. Otherwise, it is not within the horizontal axis threshold range.

S123: the electronic device determines a second abscissa of the second location of the cursor point from the first abscissa and determines the second spherical location as the same spherical location as the first spherical location.

In the case of a horizontal axis threshold, the electronic device may determine that the second abscissa of the second position of the cursor point is the first abscissa, that is, in the case that the first position of the cursor point is on the front, determine that the second abscissa of the second position of the cursor point is x' =x+Δx=x _p The method comprises the steps of carrying out a first treatment on the surface of the Determining a second abscissa of a second position of the cursor point as x' =x- Δx=x in a case where the first position of the last cursor point is on the back side _p 。

S124: the electronic device determines whether a first abscissa of the second location of the cursor point is less than a minimum value of the horizontal axis threshold range. In the case of being smaller, the electronic device may perform S126; if not, S125 is executed.

Specifically, the electronic device may determine whether x 'is less than x_min, and if so (x' < x_min), the electronic device executes S126; if not (x' > x_max), the electronic device then executes S125.

S125: the electronic device determines a second abscissa of a second position of the cursor point as x_max- (x) _p -x_max), and determining the second spherical position as the spherical position opposite to the first spherical position.

S126: the electronic device determines a second abscissa of the second position of the cursor point as x_min+ (x_min-x) _p ) And determining the second spherical position as a spherical position opposite the first spherical position.

Specifically, the electronic device needs to ensure that the first abscissa of the second position of the cursor point is within the horizontal axis threshold range [ x_min, x_max ]. The electronics determine if the abscissa x' of the cursor point is within x min, x max.

In the case of being within [ x_min, x_max ], the electronic device keeps x' =x+Δx unchanged the abscissa of the second position of the cursor point in the case that the first position of the cursor point is on the front, and determines that the second position of the cursor point is also on the front (same as the first spherical position); when the first position of the cursor point is on the back surface, the abscissa of the second position of the cursor point is kept unchanged by x' =x- Δx, and the second position of the cursor point is determined to be the back surface (same as the first spherical surface position).

At a position other than [ x_min, x_max]The case in the inner part is divided into two cases: if the electronic device determines that x' < x_min, determining a second abscissa as x_min+ (x_min-x) _p The method comprises the steps of carrying out a first treatment on the surface of the In case the electronic device determines that x' > x_max, determining the second abscissa as x_max- (x) _p -x_max). The second spherical position of the cursor point is determined to be opposite to the surface where the first spherical position of the cursor point is located, so that the second spherical position can be determined.

The second abscissa of the second position of the cursor point is the abscissa of the cursor point determined corresponding to the last acquired sliding point.

Fig. 7A and 7B are schematic diagrams of an exemplary disclosed set of user laterally sliding cursor points according to embodiments of the present application. As shown in fig. 7A, the user slides to the right and the cursor rotates counterclockwise along the weft track. The slide start point of several slide operations is Q1. In the case where the user performs the slide 1 operation, the slide point slides to Q2 (lateral displacement), and the cursor point displayed by the electronic device can slide from Q1 'to Q2'. In the sliding 1 operation process, the cursor points are all positioned on the front surface of the sphere. In the case where the user performs the slide 2 operation, the slide point slides to Q3, and the cursor point displayed by the electronic device can slide from Q1 'to Q3'. The cursor point slides from the front of the sphere to the back of the sphere. In the case where the user performs the slide 3 operation, the slide point slides to Q4, and the cursor point displayed by the electronic device can slide from Q1 'to Q4'. During the sliding 3 operation, the cursor point slides from the front of the sphere to the front of the sphere through the back of the sphere. In the sliding process, the electronic device can collect a plurality of sliding points, one sliding point is collected each time, and the corresponding cursor point needs to be calculated.

As shown in fig. 7B, the user slides to the left and the cursor rotates clockwise along the weft track. The slide starting point of several slide operations is G1. In the case where the user performs the slide 4 operation, the slide point slides to G2, and the cursor point displayed by the electronic device may slide from G1 'to G2'. In the sliding 4 operation process, the cursor points are all positioned on the front surface of the sphere. In the case where the user performs the slide 5 operation, the slide point slides to G3, and the cursor point displayed by the electronic device may slide from G1 'to G3'. The cursor point slides from the front of the sphere to the back of the sphere.

S13: the electronic device determines an ordinate of the second position of the cursor point based on the second abscissa of the second position of the cursor point and the second spherical position and the first latitudinal track.

In S12 the electronic device may determine its ordinate y ' based on the abscissa x ' of the cursor point, a second abscissa x ' of the second position of the cursor point.

The electronic device knows the expression of the first weft track and can find y 'by substituting x' into the above-mentioned first weft track expression. Where x_min < x ' < x_max, two ordinate axes, i.e., y '1 and y '2, can be determined, (y '1>k > y ' 2). As shown in fig. 5A and 5B, in the case where the electronic device determines that the second spherical position is on the front, the ordinate of the second position of the cursor point is determined to be y'2; and determining the ordinate of the second position of the cursor point as y'1 under the condition that the second spherical position is determined to be at the back surface. In the case where x ' =x_min or x ' =x_max, the electronic device may directly determine that one y ' is the ordinate of the second position of the cursor point. As shown in fig. 5C, in the case where the electronic device determines that the second spherical position is on the front, the ordinate of the second position of the cursor point is determined to be y'1; and determining the ordinate of the second position of the cursor point as y'2 under the condition that the second spherical position is determined to be at the back surface.

Illustratively, as shown in fig. 5B, the expression of the first weft track is:

the electronic device may substitute x ' into the above expression to obtain y '1 and y '2. In the case where the electronic device determines that the updated cursor point is positive, since y '2<k, it can determine (x ', y ' 2) as the second coordinate of the finally determined cursor point.

In summary, the electronic device may obtain the second coordinate of the cursor point (x ', y') as the user slides.

S14: the electronic device determines a second meridian track based on the second coordinates of the cursor point.

In the sliding process, the cursor point passes through the meridian track, the meridian track is an ellipse with the short axis changed and the long axis unchanged, and the electronic equipment can calculate the short axis in the ellipse based on the second position of the cursor point, so that the expression of the meridian track can be determined.

Illustratively, taking the example that the center of the meridian trajectory is the origin of the XOY coordinate system, the standard elliptical expression for the meridian trajectory is:

where b 'is unknown, substituting (x', y ') into the above expression, b' can be determined, and thus the expression of the warp track as the user slides can be determined.

Illustratively, taking the example where the upper left corner of the screen is the origin of the XOY coordinate system, the elliptical expression for the meridian trajectory is:

Where b "is unknown, substituting (x ', y') into the above expression, b" can be determined, and thus the expression of the warp track as the user slides can be determined.

The meaning of the above two exemplary parameters a, x, y, m and n may refer to the related descriptions in fig. 2A to 2B, and are not repeated.

After the electronic device determines the expressions of (x', y ") and the warp trajectory, the cursor point may be drawn and displayed, wherein the warp trajectory changes according to the changes in the expressions, moving along the weft trajectory.

Fig. 8A and 8B are exemplary diagrams of a set of cursor points and track drawing results, which are exemplary shown in the embodiments of the present application. As shown in fig. 5A, an icon displayed as a starting point is slid in the electronic device, and a cursor point P0; as shown in fig. 8A, the electronic device displays an icon that slides along the weft track to the cursor point P2. The cursor point is arranged on the front surface of the sphere before and after sliding.

Illustratively, as shown in fig. 5A, a cursor point P0 of the start point is slid in the electronic device; as shown in fig. 8B, the electronic device displays an icon that slides along the weft track to the cursor point P3. The cursor point slides from the front of the sphere to the back of the sphere.

Further, the electronic device may calculate an azimuth of the electronic device based on the second abscissa and draw according to the calculated azimuth.

In a possible implementation manner, the electronic device stores an azimuth angle theta_m when the abscissa of the cursor point is at the maximum value, and an azimuth angle theta of the cursor point at the first position; in the above process, the electronic device calculates the abscissa x' of the second position and the maximum value x_m of the lateral threshold range. The electronic device may be based on the first relationAn azimuth angle θ' of the second location of the cursor point is determined. The first position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time, the second position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time, and the maximum value of the longitudinal threshold range comprises the maximum value y_max and the minimum value y_min of the transverse threshold range.

Illustratively, the previous cursor point is at P0 (first position in fig. 1A), the azimuth angle θ corresponding to x is 0 degrees, and the azimuth angle corresponding to the rightmost end x_max of the weft track is 135 degrees; the leftmost end x_min of the weft yarn, corresponding azimuth angle315 degrees. Let the second position of the cursor point be located at point P1, x' be located between x and x_max on the front of the sphere. The electronic device may be based on So that the azimuth angle θ' of this cursor point can be calculated. θ_m is 135 and is exemplary and not limiting.

In the above embodiment, the electronic device may preset a relation, and connect the relation between the azimuth and the abscissa. Therefore, the azimuth angle can be rapidly determined, the relation between the display position of the two-dimensional plane cursor point and the three-dimensional attitude is not required to be calculated, and the simplicity degree of calculation and the processing efficiency can be improved while certain accuracy is ensured.

In another possible embodiment, the azimuth of the cursor point satisfies the formulaKnowing the abscissa x', the preset angle t and the maximum value a1 of the weft track of this cursor point, the electronic device can determine the azimuth angle θ of this cursor point. />Where t is a preset angle (which may be positive or negative, determined based on actual needs). As shown in fig. 2B, since the point immediately before the weft rail is the point P0, the point P0 is not the lowest point of the weft rail but the point to the left. Thus, t may be the angle between the lowest point of the weft track to the center of the circle and the point P0, where t is negative.

In the above embodiment, the electronic device determines the azimuth angle, and needs to establish a relationship between the two-dimensional planar cursor point and the three-dimensional attitude, so that the accuracy of the azimuth angle can be ensured.

Fig. 9 is a schematic diagram of a user interface illustratively shown in an embodiment of the present application. As shown in fig. 9, the electronic device may display a user interface 910 based on a user sliding operation to the right. In user interface 910, the electronic device may slide from point P0 in fig. 2B to point P1 in fig. 9, adjusting the azimuth from 0 degrees to 75 degrees.

Under the condition that the longitudinal movement is judged, the electronic equipment calculates and displays the change process of the weft track and the change process of the cursor point. (during the longitudinal movement, the warp track is unchanged and only the weft track is changed)

From the perspective of three dimensions, the user slides up and down, the position of the cursor coordinates slides along the warp track (up, down) while the weft track changes along the Y-axis direction. In the two-dimensional plane, the user slides up and down, the warp track does not change, and the weft track increases or decreases up and down along with the sliding of the user.

Fig. 10A to fig. 10B are schematic flow diagrams of a method for interactive computing of longitudinal sliding, where, as shown in fig. 10A, in a process of longitudinal sliding of a user, the interactive computing of an electronic device may include, but is not limited to, the following steps:

S21: the electronic device determines a longitudinal sliding displacement, a first warp track, and a center of a circle and a longitudinal threshold range of the first weft track.

The electronic device stores the last acquired coordinates (x _i-1 ，y _i-1 ) (third sliding data) and acquires the sliding point coordinates (x _i ，y _i ) (second sliding data) the longitudinal sliding displacement can be calculated as Δy=y _i -y _i-1 。

The first weft track is a warp track determined before this sliding operation or after the end of the last sliding operation. For example, as shown in fig. 8A and 8B, the expression of the warp track may be:as shown in FIG. 5A, the expression of warp track is +.>B1=b at this time.

After the electronic equipment determines the last acquisition sliding point, calculating the circle center of the first weft track (namely the circle center of the first weft track) and storing the circle center. Of course, the electronic device page may determine the expression of the first weft track, and determine the center of the first weft track by the expression of the first weft track.

Illustratively, as shown in FIG. 5B, the expression of the weft track isIn the first weft track ellipse, the center of the circle moves to be the point O1 (0, k).

Since the long axis of the warp track does not change during the lateral sliding, the range of threshold values for the longitudinal axis [ y_min, y_max ] may be fixed. For example, y_min= -a; y_max=a.

S22: and the electronic equipment determines the ordinate of the circle center of the third weft track and the ordinate of the third position of the cursor point.

And in the process of longitudinally sliding the third position of the cursor point, the cursor point position to be determined of the sliding point is acquired this time, and the third position comprises a third coordinate (x ', y') and a third spherical position. The third weft track is the weft track that this time the slip point is acquired to be determined.

The electronic device may determine the center ordinate k "of the third weft track and the ordinate y" of the third position of the cursor point based on ay, [ y_min, y_max ], the first position of the cursor point and the center ordinate k of the first weft track.

As shown in FIG. 10B, a method of determining the center coordinate k "and the ordinate y" of the third position of the cursor point may include, but is not limited to, the steps of:

s221: the electronic equipment calculates a first ordinate of a third position of the cursor point and a first circle center ordinate of a third weft track based on the longitudinal sliding displacement and the circle center ordinate of the first weft track and the first spherical position.

The electronic device determines a longitudinal sliding displacement deltay in the Y-axis direction based on the user's up-and-down sliding. Wherein Δy may be positive or negative, the user slides down, Δy is positive, indicating that the cursor point slides down along the meridian track; the user slides up, Δy is negative, indicating that the cursor point slides up along the meridian track.

The center coordinates of the previous latitude line track are known as (0, k), and the ordinate of the previous cursor point is known as y. Let the longitudinal sliding displacement of the user be deltay. The electronic device can calculate that the first center ordinate of the third weft track is k _p A first ordinate y of a third position of the cursor point _p 。

The electronic device may store a first spherical position, and determine whether the first spherical position is a front or a back. K in case the first spherical position is in front _p ＝k+Δy，y _p =y+Δy. In the case of the upper first spherical position being at the back, k _p ＝k-Δy，y _p ＝y-Δy。

S222: the electronic equipment judges whether the ordinate of the first circle center exceeds the threshold range of the longitudinal axis; in the case that it is within the vertical axis threshold range, the electronic device performs S223; otherwise, the electronic device performs S224.

The electronic equipment judges whether y_min is less than or equal to y _p And y_max is less than or equal to. When y_min is less than or equal to y _p In case y_max is less than or equal to, the electronic device determines y _p Is within a vertical axis threshold range; when y_min is not less than y _p In case y_max is less than or equal to, the electronic device determines y _p Is not within the vertical axis threshold range. Y is as described above _p Judging to be k _p The present invention is not limited thereto.

S223: the electronic device determines a first ordinate of a third position of the cursor point as its second ordinate, a first center ordinate of a third weft track as its second center ordinate, and a third spherical position as the same spherical position as the first spherical position.

At k _p In the case of a threshold value range of the vertical axis, the first vertical coordinate of the third position of the cursor point is determined as the final second vertical coordinate, and the first center vertical coordinate k of the third weft track is determined _p Is determined as its second centre ordinate k ". That is, in the case where the first spherical position is on the front, the second ordinate is determined as y "=y+Δy=y _p The second center ordinate is determined as k "=k+Δy=k _p The method comprises the steps of carrying out a first treatment on the surface of the At the first stageWith the spherical position at the back, the second ordinate is determined as x "y" = y- Δy, and the second center ordinate is determined as k "= k- Δy = k _p 。

S224: the electronic device determines whether the first center ordinate is less than a minimum value of the vertical axis threshold range (or whether the first ordinate is less than a minimum value of the vertical axis threshold range). In the case of being smaller, the electronic device may perform S226; in the case of not less, S225 is performed.

The electronic device determines whether k ' satisfies k ' (or y ') < y_min. In the case where k "satisfies k" < y_min, determining k "(or y") < y_min, S226 may be performed; in the case where k "(or y') > y_max is determined, S225 may be performed.

S225: the electronic device determines the second circle center ordinate of the third weft track as y_max- (k) _p -y_max), determining the second ordinate of the third position of the cursor point as y_max- (y) _p -y_max), and determining the third spherical position as the spherical position opposite to the first spherical position.

S226: the electronic device determines the second center ordinate of the third weft track as y_min+ (y_min-k) _p ) The second ordinate of the third position of the cursor point is determined as y_min+ (y_min-y) _p ) And determining the third spherical position as a spherical position opposite the first spherical position.

In particular, the electronic device needs to ensure that this cursor ordinate is within the vertical axis threshold range [ y_min, y_max ]. The electronics determine whether the ordinate y "or k" of the cursor point is within y min, y max.

When the electronic device is in [ y_min, y_max ] and the first spherical position is in the front, keeping the ordinate of the third position of the cursor point y "=y+Δy unchanged, keeping the ordinate of the center of the circle of the third weft track k" =k+Δy unchanged, and determining that the third spherical position is also in the front (same as the first spherical position); in the case where the first spherical position is on the back, the ordinate of the third position of the cursor point is kept constant y "=y- Δy, and the ordinate of the center of the circle of the third weft track is kept constant k" =k- Δy, and the third spherical position is determined to be also on the back (same as the first spherical position).

At a position other than [ y_min, y_max]The case in the inner part is divided into two cases: the electronic device judges y _p (k _p ) In the case of < y_min, the second ordinate is determined as y_min+ (y_min-y) _p ) The second center ordinate is determined as y_min+ (y_min-k "); in the event that the electronic device determines y "(k") > y_max, the second ordinate is determined to be y_max- (y) _p -y_max), the second centre ordinate being determined as y_max- (k) _p Y_max). The third spherical position of the cursor point is determined to be opposite to the first spherical position, so that the third spherical position can be determined.

The second ordinate of the third position of the cursor point is the ordinate of the cursor point corresponding to the last acquired sliding point, and the second circle center ordinate is the ordinate of the circle center of the third weft track corresponding to the last acquired sliding point.

In summary, the electronic device may determine the center ordinate of the weft track as (0, k ") and the cursor point ordinate y". And a third spherical position.

Fig. 11A and 11B are schematic diagrams of an exemplary disclosed set of user longitudinally sliding cursor points according to an embodiment of the present application. As shown in fig. 11A, the user slides upward and the cursor moves upward along the meridian track (front face). The slide starting point of several slide operations is R1. In the case where the user performs the slide 6 operation, the slide point slides to R2 (longitudinal displacement), and the cursor point displayed by the electronic device can slide from R1 'to R2'. In the sliding 6 operation process, the cursor points are all on the front surface of the sphere. In the case where the user performs the slide 7 operation, the slide point slides to R3, and the cursor point displayed by the electronic device can slide from R1 'to R3'. The cursor point slides from the front of the sphere to the back of the sphere.

As shown in fig. 11B, the user slides to the left and the cursor moves downward along the meridian track. The slide starting point of several slide operations is F1. In the case of a user sliding 8 operation, the cursor point displayed by the electronic device may slide from F1' to F2 ". During the sliding 8 operation, the sliding point slides to F2, and the cursor points are all on the front surface of the sphere. In the case where the user performs the slide 9 operation, the slide point slides to F3, and the cursor point displayed by the electronic device can slide from F1 'to F3'. The cursor point slides from the front of the sphere to the back of the sphere.

S23: the electronic device determines a major axis and a minor axis of the third weft track based on the center coordinates of the sphere and the second center ordinate of the third weft track.

The electronic device may determine the long axis of the third weft track based on the expression of the circle (the circle of the projection of the sphere in the XOY plane) and the center ordinate of the third weft track.

The electronic device may substitute k "into the expression of the circle to determine two coordinate points or one coordinate point of the same ordinate.

Alternatively, the electronic device obtains two points (x_min, k ") and (x_max, k") located on the circle in the case of determining the two coordinate points. The electronic device may determine major axis 2 x a2 as x_max-x_min. Where x_max > x_min. Thus, half of the major axis of the weft-orbit ellipse can be calculated as a2.

Specifically, due to the left and right vertices of the weft orbit ellipse and the circle x ² +y ² ＝a ² Intersecting, the electronic equipment can determine the long axis of the weft track through the circle center coordinates of the elliptical track, and substitutes k' as y into the expression of the circle to obtain two abscissa coordinates, so that the long axis of the weft track ellipse is calculated.

Alternatively, the electronic device may determine the major axis, the hypotenuse sphere radius a, and a right angle side of |k| based on the Pythagorean theorem, resulting inThe long axis is 2 x a1.

Further, the electronic device can determine a minor axis of the third weft track based on a similarity ratio of the initial weft track to the first weft track and the major axis.

Since the weft track is (maximally) similar to the initial weft track during the weft track change, the minor axis length can be determined according to the similarity ratio of the initial weft track to the current third weft track.

The similarity ratio is:

/>

wherein, a and b are preset, the electronic device is known, and the meaning of the preset, the electronic device can refer to the description above and is not repeated. Where a2 is known to the electronic device, b2 can be found. The minor axis is 2×b2.

So far, the electronic device can determine that the expression of the weft track is:

s24: the electronic device determines an abscissa of the third location of the cursor point based on the second ordinate of the third location of the cursor point and the first linear trajectory.

The electronic device may substitute y "into the expression of the first linear trajectory, and may obtain one abscissa or two abscissas. In the case of two abscissas, the electronic device may determine an abscissa of a third position of the cursor point based on the third spherical position.

The first linear track has the expression ofThe electronic device may substitute y "for x" or x "1 and x" 2.

In the case where the electronic device determines x "1 and x" 2, it may be determined whether x "1 and x" 2 are greater than 0 or less than 0, respectively, and the abscissa is selected.

The electronic equipment judges that the left half part of the current first warp track is the front surface of the sphere and the right half part is the back surface of the sphere; the left half part is the reverse side of the sphere, and the right half part is the obverse side of the sphere. The electronic device may make the determination based on the abscissa x of the first spherical position and the first position of the cursor point.

Specifically, the first coordinate of the cursor point is (x, y). The electronic equipment determines that the first spherical position is in the front of the sphere, and x is less than 0; or determining that the first spherical position is on the reverse side of the sphere, and x >0, the electronic device may determine that the portion of x <0 is the front side and the portion of x >0 is the reverse side. The electronic device determines that the first spherical position is in the front of the sphere, and x >0; or the first sphere position is on the reverse side of the sphere, and x <0, the electronic device may determine that the portion of x >0 is the front side and the portion of x <0 is the reverse side.

In a possible embodiment, the part of the third warp yarn track with the abscissa less than 0 is the front side of the third warp yarn track, and the part greater than 0 is the back side of the third warp yarn track. Illustratively, in fig. 2B, the right half of the third warp track is the back side and the left half is the front side.

In another possible embodiment, the portion of the third warp yarn track with the abscissa less than 0 is the reverse side of the third warp yarn track, and the portion greater than 0 is the obverse side of the third warp yarn track. Illustratively, in fig. 8A, the right half of the third warp track is the front face and the left half is the back face.

After the electronic device determines the expression of the third coordinate (x ", y"), the third spherical position, and the third weft track, the electronic device may draw and display, wherein the cursor point moves along the weft track, and the weft track changes according to the change of the expression.

Fig. 12A and 12B are exemplary diagrams of another set of cursor and track rendering results, which are exemplary shown in the embodiments of the present application. As shown in fig. 8A, an icon displayed as a starting point is slid in the electronic device, and a cursor point P2; as shown in fig. 12A, the electronic device displays an icon that slides along the meridian track to the cursor point P4. The cursor point is arranged on the front surface of the sphere before and after sliding.

Illustratively, as shown in fig. 8A, a cursor point P2 of the start point is slid in the electronic device; as shown in fig. 12B, the electronic device displays an icon that slides along the meridian track to the cursor point P5. The cursor point slides from the front of the sphere to the back of the sphere.

Further, the electronic device may calculate a pitch angle of the electronic device based on the second ordinate, and draw according to the calculated pitch angle.

In a possible implementation manner, the electronic device stores a pitch angle beta_m when the ordinate of the cursor point is at the maximum value, and the pitch angle beta of the cursor point at the first position; in the above process, the electronic device calculates the ordinate y″ of the third position and the maximum value y_m of the longitudinal threshold range. The electronic device can be based on the second relationThe pitch angle beta "of the third position of the cursor point is determined. The third position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time; the first position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time; the maximum value y_m of the longitudinal threshold range comprises the maximum value y_max and the minimum value y_min of said longitudinal threshold range.

Illustratively, the electronic device cursor point is at P0 (in fig. 1A) (first position), and the pitch angle β corresponding to y is 0 degrees; the uppermost end y_max of the warp is provided with a corresponding pitch angle of 135 degrees; the lowest end y_min of the weft is corresponding to 315 degrees of pitch angle. Assuming that the sliding cursor point is at point P4 (in fig. 12A), y "is located between y and y_max on the front of the sphere. The electronic device may be based onSo that the pitch angle beta "of this cursor point can be calculated. Beta_m is 135, which is exemplary and not limiting.

In the above embodiment, the electronic device may preset a relational expression, and connect the relationship between the pitch angle and the ordinate. Therefore, the pitch angle can be rapidly determined, the relation between the display position of the two-dimensional plane cursor point and the pitch angle in the three-dimensional space is not required to be calculated, and the simplicity degree of calculation and the processing efficiency can be increased while certain accuracy is ensured.

In another possible embodiment, the pitch angle of the cursor point satisfies the formulaKnowing the preset angles of the ordinate y ", h of the cursor point and the maximum value a of the meridian trajectory, the electronic device can determine the pitch angle β.Where h is a preset angle (which may be positive or negative, determined based on actual needs). As shown in fig. 9, since the cursor point is not the rightmost point of the meridian track, but is a point to the left. Thus, h may be the right-most point of the weft track to the center of the circle, and the angle between the cursor points, where h is negative.

In the above embodiment, the electronic device determines the pitch angle, and needs to establish a relationship between the two-dimensional planar cursor point and the three-dimensional attitude, so that the accuracy of the pitch angle can be ensured.

Fig. 13 is another user interface schematic diagram exemplarily shown in an embodiment of the present application. As shown in fig. 13, the electronic device may display a user interface 1310 based on a user up sliding operation. In user interface 1310, the electronic device may slide from the cursor point in fig. 9 to the cursor point in fig. 13, adjusting the pitch angle from 0 degrees to 60 degrees.

In the sliding process, the sliding points are continuously collected, and the lateral displacement Δx between two sliding points continuously collected in front and back is almost short, so that the positions of the front and back cursor points are generally the same plane of the sphere, and the plane where the sphere is located may also be changed once, but due to the very dense collection frequency, Δx does not undergo two or more changes. The same applies to the longitudinal displacement Δy.

Fig. 14 is a flow chart of a method for spherical motion interaction according to an embodiment of the present application. As shown in fig. 14, the interface interaction method in spatial audio may include, but is not limited to, the following steps:

In the embodiment of the application, the position of the cursor point on the spherical surface may represent the sound source direction of the spatial audio.

S1401: the electronic device collects first sliding data in response to a first operation.

The first operation refers to a sliding operation of a screen of the electronic device touched by a user, and may be specifically described with reference to fig. 3, fig. 4A, and fig. 4B, which are not repeated.

The first slide data may include a slide start point and a current slide point of the first operator. For example, the slide start point is (x 0, y 0), and the current slide point is (x 1, y 1).

S1402: the electronic device determines whether to trigger movement of a cursor point for a first operation based on the first sliding data. In the case of triggering, the electronic device executes S1404; otherwise (not triggered), the electronic device executes S1403.

Specifically, the electronic device calculates the lateral movement displacement as dx=x1-x0, and the lateral sliding distance as |dx|= |x1-x0|; the longitudinal displacement is dy=y1-y0, and the longitudinal sliding distance is |dy|= |y1-y0|. The electronic device may store a sliding threshold distance m.

The electronic device determines whether to trigger movement of the cursor point for the first operation based on the lateral sliding distance, the longitudinal sliding distance, and the sliding threshold distance m. In the case where the electronic apparatus determines that |dy|++m (|dy| < m) and |dx|++m (|dx| > m), the cursor point movement for the first operation may not be triggered; in the case where the electronic device determines |dy| > m (|dy|Σm) or |dx| > m (|dy|Σm), the cursor point movement for the first operation may be triggered. For specific description, reference may be made to the related description of fig. 3, which is not repeated.

S1403: the electronic device determines whether the first operation is ended.

The electronic device detecting whether the first operation is ended, and if the electronic device cannot detect the first operation of the user, determining that the first operation is ended, the electronic device executing S1405; in the case where the first operation can be detected, it is determined that the first operation is not ended, the electronic apparatus executes S1401, that is, continues to acquire the first slide data.

In this embodiment of the present application, the first sliding data indicates that the electronic device has not started to change the longitude track, the latitude track, and the cursor point.

S1404: the electronic device determines a sliding direction based on the first sliding data.

In the event that the electronic device determines to trigger movement of the cursor point for the first operation, the electronic device determines a sliding direction based on the first sliding data.

Specifically, the electronic device may compare the lateral sliding distance and the longitudinal sliding distance, and determine the longitudinal sliding if the lateral sliding distance is greater than the longitudinal sliding distance; determining a lateral slip if the lateral slip distance is less than the longitudinal slip distance; in the case where the lateral sliding distance is less than the longitudinal sliding distance, it is determined that the cursor point movement for the first operation is not triggered. The electronic device may perform S1403 in a case where it is determined that the cursor point movement for the first operation is not triggered.

The description of S1404 may refer to the description of fig. 4A and fig. 4B, which are not repeated.

S1405: the electronic device displays the warp track, the weft track and the cursor point unchanged.

When the cursor point movement aiming at the first operation is triggered and the first operation is ended, the electronic equipment can display that the warp track, the weft track and the cursor point are unchanged, namely, the cursor point, the warp track and the weft track are kept unchanged.

S1406: the electronic device determines whether the first operation is ended. In the case of ending, the electronic apparatus executes S1407; without ending, the electronic device executes S1408.

The description of S1406 may refer to the related description of S1403, which is not described in detail.

S1407: the electronic device stops collecting data and stores the sliding result data.

And under the condition that the first operation is finished, the electronic equipment stops collecting the sliding data and stores the sliding result data. The sliding data is the data of the touch point of the first operation detected by the electronic equipment. The sliding result data comprises a meridian track, a latitude track (including the center coordinates of the latitude track), coordinates of a cursor point and spherical positions.

S1408: the electronic device collects second sliding data.

And under the condition that the first operation is not finished, the electronic equipment collects second sliding data. The second sliding data is the coordinates of the current touch point (the coordinates of the last touch point, i.e., the sliding point coordinates acquired this time) acquired for the first operation.

S1409: the electronic device determines coordinates of the warp track, the weft track and the cursor point based on the second sliding data, the third sliding data, the sliding direction and the last sliding result data, and displays the changed warp track, weft track and cursor point.

The third sliding data is for the coordinates of the last sliding (touch) point acquired by the first operation.

The electronic device may determine coordinates of the warp track, the weft track, and the cursor point based on the second sliding data and the third sliding data and the sliding direction, and display the changed warp track, weft track, and cursor point.

The description of S1409 may refer to the descriptions of S11 to S14 and S21 to S24, which are not described in detail.

After the processing in S1409 is completed, the first operation has not yet ended, and the electronic device needs to continuously collect and display the sliding data. The processes of S1408 and S1409 are looped until the first operation ends.

In the above embodiment, the electronic device can adjust the position of the audio in space by sliding horizontally or longitudinally, and the user can simulate the spatial sound source point by sliding the cursor point, so as to experience the sound effect of the sound source point in different positions. Further, the three-dimensional sound source space position is on the two-dimensional screen, adjustment and interaction often have certain difficulty, and user learning and adaptation are needed. The electronic equipment can calculate the data needed to be displayed next based on the lateral sliding displacement condition of the user and the data acquired and displayed last time, namely the second position of the cursor point, the first weft track and the second warp track, the electronic equipment does not need to convert the two-dimensional coordinates into the three-dimensional space, and the data needed to be displayed can be calculated only through the position relation between the ellipse and the cursor point, so that the simplicity of calculation and the high efficiency of processing are ensured.

Fig. 15 is a schematic software structure of an electronic device according to an embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the system is divided into four layers, from top to bottom, an application layer, an application framework layer, runtime (run time) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 15, the application package may include applications (also referred to as applications) such as cameras, gallery, map, navigation, music, and spatial audio (spatial audio).

In the embodiment of the present application, the method related to fig. 14 is not limited by spatial audio application processing, but may also be music application processing.

The application framework layer provides an application programming interface (Application Programming Interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 15, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is for providing communication functions of the electronic device. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification presented in the form of a chart or scroll bar text in the system top status bar, such as a notification of a background running application, or a notification presented on a screen in the form of a dialog interface. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

The Runtime (run time) includes core libraries and virtual machines. Run time is responsible for scheduling and management of the system.

The core library consists of two parts: one part is the function that the programming language (e.g., java language) needs to call, and the other part is the core library of the system.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the programming files (e.g., java files) of the application layer and the application framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface Manager (Surface Manager), media library (Media Libraries), three-dimensional graphics processing library (e.g., openGL ES), two-dimensional graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of two-Dimensional (2D) and three-Dimensional (3D) layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing 3D graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The kernel layer at least comprises a display driver, a camera driver, an audio driver, a sensor driver and a virtual card driver.

The workflow of the electronic device software and hardware is illustrated below in connection with a shooting scenario.

The electronic device may provide an interactive schematic of sound source direction adjustment and sound source distance adjustment through a spatial audio application (music application). The electronic device can detect the sliding operation of the user through the spatial audio application, calculate the position of the cursor point based on the sliding operation processing, and express the warp track and the weft track, and then can call the window manager, the graphic processing library and the like to draw and display. Specific processes may refer to fig. 14 and related descriptions, and are not repeated.

The following describes the apparatus according to the embodiments of the present application.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (Universal Serial Bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (Subscriber Identification Module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (Application Processor, AP), a modem processor, a graphics processor (Graphics Processing unit, GPU), an image signal processor (Image Signal Processor, ISP), a controller, a memory, a video codec, a digital signal processor (Digital Signal Processor, DSP), a baseband processor, and/or a Neural network processor (Neural-network Processing Unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

It is understood that an AE system may also be included in the processor 110. The AE system may be specifically provided in the ISP. AE systems may be used to enable automatic adjustment of exposure parameters. Alternatively, the AE system may also be integrated in other processor chips. The embodiments of the present application are not limited in this regard.

In the embodiments provided herein, the electronic device 100 may perform the exposure intensity adjustment method through the processor 110.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices 100, such as AR devices, etc.

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), an Active-matrix Organic Light-Emitting Diode (AMOLED) or an Active-matrix Organic Light-Emitting Diode (Matrix Organic Light Emitting Diode), a flexible Light-Emitting Diode (Flex), a Mini LED, a Micro-OLED, a quantum dot Light-Emitting Diode (Quantum Dot Light Emitting Diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement acquisition functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image or video visible to naked eyes. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (Charge Coupled Device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to an ISP to be converted into a digital image or video signal. The ISP outputs digital image or video signals to the DSP for processing. The DSP converts digital image or video signals into standard RGB, YUV, etc. format image or video signals. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1. For example, in some embodiments, the electronic device 100 may acquire images of a plurality of exposure coefficients using the N cameras 193, and in turn, in the video post-processing, the electronic device 100 may synthesize an HDR image by an HDR technique from the images of the plurality of exposure coefficients. In the embodiment of the application, the electronic device can acquire the N-frame first image through the camera 193.

The digital signal processor is used to process digital signals, and may process other digital signals in addition to digital image or video signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (Moving Picture Experts Group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a Neural-Network (NN) computing processor, and can rapidly process input information by referencing a biological Neural Network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image video playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on.

As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection …" depending on the context. Similarly, the phrase "at the time of determination …" or "if detected (a stated condition or event)" may be interpreted to mean "if determined …" or "in response to determination …" or "at the time of detection (a stated condition or event)" or "in response to detection (a stated condition or event)" depending on the context.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

Claims

1. An interface interaction method, wherein the method is applied to an electronic device, and the method comprises:

the electronic equipment displays a first user interface, wherein the first user interface displays cursor points and weft tracks and warp tracks where the cursor points are positioned; the cursor point is one point where the weft track and the warp track intersect on the surface of the sphere, and the cursor point represents the spatial direction of the sound source position of the audio relative to the user;

the electronic equipment acquires a first operation;

when the first operation is a sliding operation along a first direction, the cursor point in the first user interface slides along a weft track where the cursor point is located, and the warp track where the cursor point is located changes along with the sliding of the cursor point on the weft track; the first direction is a direction corresponding to the weft track, the long axis of the weft track is positioned in the direction of the longitudinal axis of the sphere, the long axis is kept unchanged, and the short axis is increased or decreased;

Under the condition that the first operation is a sliding operation along a second direction, the cursor point in the first user interface slides along a meridian track where the cursor point is located, and the meridian track where the cursor point is located changes along with the sliding of the cursor point on the meridian track; the second direction is the direction corresponding to the warp track; the ellipse of the weft track is enlarged or reduced along the longitudinal axis of the sphere.

2. The method of claim 1, wherein in the case where the electronic device displays the first user interface, the method further comprises:

and responding to a second operation, wherein the electronic equipment adjusts the sound source distance, the sound source distance is the length between the sound source position and the user position, and the second operation is the operation of sliding the sound source distance control in the first user interface by the user.

3. The method of claim 2, wherein in the case where the electronic device displays the first user interface, the method further comprises:

in response to a third operation, the electronic device adjusts the cursor point to a preselected cursor point, displays the weft track to a preselected weft track, adjusts the warp track to a preselected warp track, and adjusts the sound source distance to a preselected sound source distance;

The third operation is an operation of clicking a recommended sound source position control in the first user interface by a user; the preselected cursor point is a cursor point where the recommended sound source position is located; the preselected weft track is a weft track corresponding to the recommended sound source position; the preselected meridian track is a meridian track corresponding to the recommended sound source position; the preselected source distance is a recommended source distance.

4. The method of claim 1, wherein after the electronic device displays the first user interface, the method further comprises:

responding to the first operation, the electronic equipment collects first sliding data, wherein the first sliding data are coordinates of a sliding starting point and a current sliding point of the first operation;

the electronic equipment judges whether the cursor point is triggered to move or not based on the first sliding data;

under the condition that the cursor point is triggered to move, the electronic equipment determines a sliding direction based on the first sliding data; the sliding direction includes the first direction and the second direction.

5. The method according to any one of claims 1-4, wherein the cursor point in the first user interface slides along a weft track along which the cursor point is located, and a warp track along which the cursor point is located changes with the cursor point sliding on the weft track, specifically including:

Under the condition that the first operation is not finished, the electronic equipment collects second sliding data, wherein the second sliding data is the coordinates of a sliding point of the first operation, which is collected last time;

the electronic device determines a second position and a second meridian track of the cursor point based on the second sliding data, the third sliding data and last sliding result data; the third sliding data is the position of the sliding point of the first operation acquired by the electronic equipment last time, and the last sliding result data is a first position, a first weft track and a first warp track of the cursor point displayed for the third sliding data;

6. The method of claim 5, wherein the electronic device determines a second position and a second meridian trajectory of the cursor point based on the second sliding data, third sliding data, and last sliding result data, comprising:

7. The method according to claim 6, wherein the electronic device determines an abscissa x' of the second position of the cursor point based on the Δx, the [ x_min, x_max ] and the first position of the cursor point, in particular comprising:

At said x _p Greater than or equal to a minimum value x min of the lateral threshold range and less than or equal to the lateral threshold In case of a maximum value x_max of the range of values, the electronic device will send the x _p Determining a second abscissa x', determining the second spherical position as the same spherical position as the first spherical position;

in the event that the first abscissa is greater than the x_max, the electronic device determines the x' as x_max- (x) _p -x_max), determining the second spherical position as a spherical position opposite to the first spherical position;

8. The method according to any one of claims 1-4, wherein the cursor point in the first user interface slides along a meridian track along which the cursor point is located, and the meridian track along which the cursor point is located changes with the sliding of the cursor point on the meridian track, specifically including:

9. The method according to claim 8, wherein the electronic device determines a third position and a third weft track of the cursor point based on the second slip data, a third slip data and last slip result data, in particular comprising:

the electronic device determines a minor axis of the third weft track based on a similarity ratio of the initial weft track to the first weft track and the major axis:

10. The method according to claim 9, wherein the electronic device determines the center ordinate k "of the third weft track and the ordinate y" of the third position of the cursor point based on the Δy, the [ y_min, y_max ], the first position of the cursor point and the center ordinate k of the first weft track, in particular comprising:

in the event that y is greater than y_max, the electronic device determines y' as y_max- (y) _p -y_max), determining said k "as y_max- (k) _p -y_max), determining the third spherical position as a spherical position opposite to the first spherical position:

the second ordinate is the ordinate of the cursor point corresponding to the sliding point acquired last time; the third spherical position is the spherical position of the sliding point which is acquired last time and corresponds to the cursor point, and the second circle center ordinate is the circle center ordinate of the sliding point which is acquired last time and corresponds to the third weft track.

11. The method of any of claims 1-4, wherein the first user interface comprises a spatial audio adjustment option comprising an azimuth angle, a pitch angle, and a distance, the azimuth angle characterizing an angle of a line along which the direction of the sound source is located with respect to a plane of a meridian trajectory when the user is in plane; the pitch angle represents an included angle formed by a straight line where the direction of the sound source is located and a weft track plane when a user is in plane view; the distance characterizes the length between the sound source position and the user position;

12. The method according to claim 11, wherein in case the first operation is a sliding operation in a first direction, the azimuth angle corresponds to a change, in particular comprising:

wherein the second relation is The beta_m is the ordinate of the cursor point at the maximum valueA pitch angle; the beta is the pitch angle of the cursor point at the first position; the y is the ordinate of the cursor point at the first position, and the third position of the cursor point is the cursor point position corresponding to the sliding point of the first operation acquired last time;

13. An electronic device, comprising: one or more processors and one or more memories; the one or more processors being coupled with the one or more memories, the one or more memories being configured to store computer program code, the computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any of claims 1-12.

14. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method according to any of claims 1-12.