CN109743438B - Method and device for sending multimedia information - Google Patents

Method and device for sending multimedia information Download PDF

Info

Publication number
CN109743438B
CN109743438B CN201810631374.1A CN201810631374A CN109743438B CN 109743438 B CN109743438 B CN 109743438B CN 201810631374 A CN201810631374 A CN 201810631374A CN 109743438 B CN109743438 B CN 109743438B
Authority
CN
China
Prior art keywords
application
mobile terminal
target
multimedia information
moving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810631374.1A
Other languages
Chinese (zh)
Other versions
CN109743438A (en
Inventor
方迟
鲁威
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN201810631374.1A priority Critical patent/CN109743438B/en
Priority to US16/981,274 priority patent/US11262856B2/en
Priority to PCT/CN2019/086292 priority patent/WO2019214696A1/en
Priority to SG11202011206UA priority patent/SG11202011206UA/en
Publication of CN109743438A publication Critical patent/CN109743438A/en
Priority to PCT/CN2019/087862 priority patent/WO2019242450A1/en
Application granted granted Critical
Publication of CN109743438B publication Critical patent/CN109743438B/en
Priority to US17/022,001 priority patent/US11029822B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

The application discloses a method and a device for sending multimedia information, wherein the method comprises the following steps: determining target multimedia information in the target multimedia application in response to a selection operation of a user; responding to the operation of a mobile phone of a user, and obtaining the moving direction and the moving displacement of the mobile terminal and the position coordinates of each application relative to the mobile terminal; determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application; and if the preset conditions are met, triggering to send the target multimedia information to the target application. Therefore, the multimedia application jumps to other applications without multiple selection operations, multimedia information in the multimedia application is directly shared to other applications through the operation mode of the mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, and the operation mode of the mobile phone is extremely convenient and fast, so that the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.

Description

Method and device for sending multimedia information
Technical Field
The present application relates to the field of electronic information technologies, and in particular, to a method and an apparatus for transmitting multimedia information.
Background
When a user uses multimedia applications (applications, abbreviated as APPs) such as a camera, a gallery and a recorder in a mobile terminal, the user is likely to face a demand for sharing multimedia information with other applications, that is, multimedia information to be shared in the multimedia applications needs to be sent to other applications. For example, a certain image is selected in the gallery application, the image is shared and sent to the friend circle of the WeChat application, and the jump from the gallery application to the WeChat application is realized.
In the prior art, a user selects certain multimedia information in a multimedia application, then selects sharing in an operation page, and finally selects other applications in a skipped sharing page, such as a WeChat application, a microblog application, a QQ application and the like, so that the multimedia information can be sent to the other applications.
However, the inventor finds that in the prior art, multimedia information can be shared from a media application to other applications only by performing multiple selection operations, the whole sharing process is complex, high in difficulty, more in related operations and low in convenience, so that the multimedia information sharing efficiency is low, and the user experience is affected.
Disclosure of Invention
The technical problem to be solved by the application is to provide a method and a device for sending multimedia information, the multimedia application does not need to skip to other applications through multiple selection operations, the multimedia information in the multimedia application is directly shared to other applications through the operation mode of a mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, the operation mode of the mobile phone is extremely convenient, and therefore the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.
In a first aspect, an embodiment of the present application provides a method for sending multimedia information, where the method includes:
determining target multimedia information in a target multimedia application;
obtaining the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal, wherein the position coordinates of each application refer to the position coordinates of each application relative to the mobile terminal;
determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application;
and if the preset conditions are met, triggering to send the target multimedia information to the target application.
Preferably, if the preset condition is met, triggering to send the target multimedia information to the target application includes:
obtaining the position distance between the mobile terminal and the target application according to the moving direction, the moving displacement and the position coordinate of the target application;
and if the position distance is smaller than a preset distance, triggering to send the target multimedia information to the target application.
Preferably, the obtaining the position distance between the mobile terminal and the target application according to the moving direction, the moving displacement, and the position coordinate of the target application includes:
obtaining the current position coordinate of the mobile terminal according to the moving direction and the moving displacement;
and obtaining the position distance between the mobile terminal and the target application according to the current position coordinate of the mobile terminal and the position coordinate of the target application.
Preferably, if the preset condition is met, triggering to send the target multimedia information to the target application includes:
if the moving direction and the moving displacement are not changed within the preset time, triggering to send the target multimedia information to the target application; or the like, or, alternatively,
if the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application; or the like, or, alternatively,
and if a preset button on the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application.
Preferably, the obtaining of the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal includes:
analyzing and obtaining the moving direction according to the data of a gyroscope sensor when the mobile terminal moves; the gyroscope sensor is arranged in the mobile terminal;
obtaining the movement displacement through integration of data of an acceleration sensor when the mobile terminal moves, wherein the acceleration sensor is arranged in the mobile terminal;
and obtaining the position coordinates of each application according to the preset layout rule of each application.
Preferably, the obtaining method of the movement displacement of the mobile terminal includes:
acquiring an external environment image when the mobile terminal moves through a camera on the mobile terminal;
obtaining the distance between any two adjacent frames in the external environment image;
and adding the distances between any two adjacent frames in the external environment image to obtain the movement displacement of the mobile terminal.
Preferably, the method further comprises the following steps:
and according to the preset layout rule, laying out the applications.
Preferably, the laying out the applications according to the preset laying out rule specifically includes:
and according to a preset tiling rule, tiling each application on a preset plane, wherein the preset plane comprises at least one surface of a hexahedron taking the mobile terminal as a body center.
Preferably, the moving direction includes at least one of:
up, down, left, right, forward and backward.
Preferably, the target multimedia information includes at least one of the following:
image information, video information, and audio information.
In a second aspect, an embodiment of the present application provides an apparatus for sending multimedia information, where the apparatus includes:
a first determining unit for determining target multimedia information in a target multimedia application;
the mobile terminal comprises an obtaining unit, a processing unit and a processing unit, wherein the obtaining unit is used for obtaining the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal, and the position coordinates of each application refer to the position coordinates of each application relative to the mobile terminal;
the second determining unit is used for determining the target application displayed on the screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application;
and the trigger sending unit is used for triggering the target multimedia information to be sent to the target application if a preset condition is met.
In a third aspect, an embodiment of the present application provides a mobile terminal, including: at least one memory and at least one processor;
the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute any one of the methods for sending the multimedia information.
In a fourth aspect, the present application provides a storage medium for storing program code for executing the method for transmitting multimedia information described in any one of the above.
In a fifth aspect, the present application provides a computer program product including instructions, which when run on a computer, cause the computer to perform any one of the above methods for transmitting multimedia information.
Compared with the prior art, the method has the advantages that:
by adopting the technical scheme of the embodiment of the application, firstly, the target multimedia information is determined in the target multimedia application in response to the selection operation of a user; secondly, responding to the operation of the mobile phone of the user, and obtaining the moving direction and the moving displacement of the mobile terminal and the position coordinates of each application relative to the mobile terminal; then, determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application; and finally, if the preset condition is met, triggering to send the target multimedia information to the target application. Therefore, the multimedia application jumps to other applications without multiple selection operations, multimedia information in the multimedia application is directly shared to other applications through the operation mode of the mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, and the operation mode of the mobile phone is extremely convenient and fast, so that the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments described in the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of a system framework related to an application scenario in an embodiment of the present application;
fig. 2 is a flowchart illustrating a method for sending multimedia information according to an embodiment of the present disclosure;
fig. 3 is a flowchart illustrating another method for sending multimedia information according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a default plane provided in an embodiment of the present application;
fig. 5 is a schematic diagram of application tiling on a virtual plane according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an apparatus for sending multimedia information according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The inventor finds that, when a user uses a multimedia application such as a camera, a gallery and a recorder in a mobile terminal and needs other applications to share multimedia information, for example, a certain image in the gallery application needs to be shared and sent to a friend circle of a WeChat application. In the prior art, a user selects an image in a gallery application, then selects sharing on an image operation page, and finally selects a WeChat application friend circle in a skipped sharing page and sends the image information to the WeChat application friend circle. However, in the prior art, the image information sharing process is complex, difficult, and more operations such as selection are involved, and the convenience degree is low, so that the efficiency of sharing the image information is low, and the experience of the user is influenced.
In order to solve this problem, in the embodiment of the present application, first, in response to a selection operation by a user, target multimedia information is determined in a target multimedia application; secondly, responding to the operation of the mobile phone of the user, and obtaining the moving direction and the moving displacement of the mobile terminal and the position coordinates of each application relative to the mobile terminal; then, determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application; and finally, if the preset condition is met, triggering to send the target multimedia information to the target application. Therefore, the multimedia application jumps to other applications without multiple selection operations, multimedia information in the multimedia application is directly shared to other applications through the operation mode of the mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, and the operation mode of the mobile phone is extremely convenient and fast, so that the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.
For example, one of the scenarios in the embodiment of the present application may be applied to the scenario shown in fig. 1. The scene comprises a processor 101 of the mobile terminal and a screen 102 of the mobile terminal, wherein in response to the operation that a user selects multimedia information in a target multimedia application displayed on the screen 102 of the mobile terminal, the processor 101 determines the target multimedia information in the target multimedia application; in response to an operation of moving the mobile terminal by a user, the processor 101 obtains a moving direction, a moving displacement, and position coordinates of each application relative to the mobile terminal; the processor 101 determines a target application displayed on the screen 102 of the mobile terminal after moving according to the moving direction, the moving displacement and the position coordinates of each application; the processor 101 judges whether a preset condition is met, and if yes, the processor 101 triggers to send the target multimedia information to the target application.
It is to be understood that, in the above application scenario, although the actions of the embodiments of the present application are described as being performed by the processor 101; however, the present application is not limited in terms of executing a subject as long as the actions disclosed in the embodiments of the present application are executed.
It is to be understood that the above scenario is only one example of a scenario provided in the embodiment of the present application, and the embodiment of the present application is not limited to this scenario.
The following describes in detail a specific implementation manner of the method and apparatus for sending multimedia information in the embodiments of the present application by using embodiments with reference to the drawings.
Exemplary method
Referring to fig. 2, a flowchart of a method for sending multimedia information in an embodiment of the present application is shown. In this embodiment, the method may include, for example, the steps of:
step 201: target multimedia information is determined in a target multimedia application.
When a user using a multimedia application in a mobile terminal faces a need to send multimedia information to be shared in the multimedia application to other applications, for example, a certain image information in a gallery application needs to be shared to a WeChat friend circle. The user selects certain multimedia information from the multimedia application interface displayed by the mobile terminal as the target multimedia information, namely, the target multimedia information is determined to be obtained in response to the operation that the user selects the multimedia information from the multimedia application interface displayed by the mobile terminal screen.
The mobile terminal may be any mobile or portable electronic device, including but not limited to a smart phone, a mobile computer, a tablet computer, a Personal Digital Assistant (abbreviated as PDA), a media player, and the like. The target multimedia information actually refers to multimedia information to be shared in the target multimedia application, and common multimedia information includes image information, video information, and audio information. Thus, in some implementations of the present embodiment, the target multimedia information includes at least one of image information, video information, and audio information. For example, in response to an operation of selecting a certain image in a gallery interface displayed by the mobile terminal, the image information is determined to be obtained as the target multimedia information.
Step 202: the method comprises the steps of obtaining the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal, wherein the position coordinates of each application refer to the position coordinates of each application relative to the mobile terminal.
It is understood that after determining the target multimedia information, it is required to explicitly send the target multimedia information to which application. In order to solve the problem that multiple selection operations are complex and tedious in the prior art, specifically, a user moves a mobile terminal to change a display target multimedia application of a screen of the mobile terminal into a display other application, so that the user can determine that one application in the other applications is a target application for sharing and sending target multimedia information. In order to be able to determine the applications displayed by the mobile terminal after movement, it is necessary to obtain the movement direction of the mobile terminal, the movement displacement, and the position coordinates of each application.
When a user moves the mobile terminal, the mobile terminal generally adopts an upward (downward, leftward, rightward, forward or backward) moving mode, so that the screen of the mobile terminal displays other applications above (below, leftward, directional, forward or backward) the target multimedia application on the virtual plane. Thus, in some embodiments of this embodiment, the direction of movement comprises at least one of: up, down, left, right, forward and backward.
The position coordinates of each application refer to the position coordinates of the mobile terminal before the mobile terminal is moved, and may be understood as the position coordinates of each application, which are determined as the position coordinates of the mobile terminal, in the coordinate system, by establishing the coordinate system with the mobile terminal as the center.
The moving direction of the mobile terminal is generally obtained by analyzing data obtained by a gyroscope sensor arranged in the mobile terminal when the mobile terminal moves; the movement displacement of the mobile terminal may be obtained by, for example, performing an integral calculation or the like on data obtained by an acceleration sensor provided in the mobile terminal while the mobile terminal is moving, for example, obtaining a velocity from acceleration data and obtaining a displacement. Since each application laid on the virtual plane has a certain preset layout rule, that is, each application is laid according to the preset layout rule, specific contents refer to the following embodiments, and the position coordinates of each application can be obtained based on the preset layout rule. Thus, in some implementations of this embodiment, the step 202 may include, for example, the steps of:
step 2021: analyzing and obtaining the moving direction according to the data of a gyroscope sensor when the mobile terminal moves, wherein the gyroscope sensor is arranged in the mobile terminal;
step 2022: obtaining the movement displacement through integration of data of an acceleration sensor when the mobile terminal moves, wherein the acceleration sensor is arranged in the mobile terminal;
step 2023: and obtaining the position coordinates of each application according to the preset layout rule of each application.
It should be noted that the movement displacement of the mobile terminal may also be obtained by accumulating distances between every two adjacent external environment images obtained by a camera provided in the mobile terminal when the mobile terminal moves, for example. Therefore, in some embodiments of this embodiment, the obtaining manner of the movement displacement of the mobile terminal in step 202 may include:
step a: acquiring an external environment image when the mobile terminal moves through a camera on the mobile terminal;
step b: obtaining the distance between any two adjacent frames in the external environment image;
step c: and adding the distances between any two adjacent frames in the external environment image to obtain the movement displacement of the mobile terminal.
For example, it takes 3 seconds for the mobile terminal to move, the camera captures an external environment image when the mobile terminal moves, and if the camera captures an image at a frequency of 30 frames per second, 90 frames of external environment images within 3 seconds of the mobile terminal moving are obtained. And determining the moving distance of the mobile terminal for shooting the two frames of images based on the position change of the reference object in the external environment in each two adjacent frames of images, and adding the distances between any two adjacent frames in 90 frames of external environment images to obtain the moving displacement of the mobile terminal for 3 seconds.
It should be further noted that, the manner of obtaining the movement displacement of the mobile terminal based on the acceleration sensor data is more suitable for a scenario where the movement speed of the mobile terminal is fast, and the movement displacement obtained by calculating and integrating the acceleration and the time in this scenario has a better effect. The method for acquiring the mobile displacement of the mobile terminal based on the external environment image shot by the camera is more suitable for scenes that the mobile terminal is slow in moving speed and stable in moving, and the mobile displacement acquired in the scene in an image processing mode has higher accuracy. Of course, the two ways can be combined, and the obtained moving displacement is higher in accuracy.
Step 203: and determining the target application displayed on the screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application.
It is understood that after the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal are obtained in step 202, the moving direction and the moving displacement of the mobile terminal are clarified under the condition that the position coordinates of each application of the mobile terminal before relative movement is clarified, and which application of the other applications corresponds to the moved mobile terminal can be naturally obtained, that is, the target application displayed on the screen of the moved mobile terminal can be determined.
Step 204: and if the preset conditions are met, triggering to send the target multimedia information to the target application.
It should be noted that, because the mobile terminal actually moves close to other applications in each application, after the target application is determined in step 203, if the location distance between the mobile terminal after moving and the target application is small enough, that is, the location distance is smaller than the preset distance, it is considered that the purpose of the mobile operation of the user is to send the target multimedia information to the target application, and therefore, after step 203, for example, the location distance between the mobile terminal and the target application may be obtained, and then the size of the location distance and the preset distance is determined, so as to determine whether to trigger the operation of sending the target multimedia information. Therefore, in some embodiments of this embodiment, the step 204 may include, for example, the following steps:
step 2041: obtaining the position distance between the mobile terminal and the target application according to the moving direction, the moving displacement and the position coordinate of the target application;
step 2042: and if the position distance is smaller than a preset distance, triggering to send the target multimedia information to the target application.
The position distance between the mobile terminal and the target application refers to the distance between the position of the mobile terminal and the position of the target application after movement, and the specific calculation mode is obtained by using a distance formula according to the position coordinates of the two positions. The position coordinates of the target application can be obtained from the position coordinates of each application, and the position coordinates of the mobile terminal after the movement are obtained based on the movement direction and the movement displacement of the mobile terminal. Therefore, in some embodiments of this embodiment, the step 2041 may include, for example, the following steps:
step a: obtaining the current position coordinate of the mobile terminal according to the moving direction and the moving displacement;
step b: and obtaining the position distance between the mobile terminal and the target application according to the current position coordinate of the mobile terminal and the position coordinate of the target application.
It should be noted that, in addition to the above-mentioned position distance being smaller than the preset distance as the preset condition, other conditions may be set as the preset condition, for example, the moving direction and the moving displacement of the mobile terminal are changed in any way within a period of time; as another example, the mobile terminal screen is touched; for another example, when a preset button on the screen of the mobile terminal is touched, and the like, any one of the conditions is met, the target multimedia information can be triggered to be sent to the target application. Therefore, in some embodiments of this embodiment, the step 204 may specifically be, for example: if the moving direction and the moving displacement are not changed within the preset time, triggering to send the target multimedia information to the target application; or, if the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application; or if a preset button on the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application.
For example, after the target application displayed on the screen of the mobile terminal after movement is determined, the user does not move the mobile terminal any more within a preset time, that is, the moving direction and the moving displacement of the mobile terminal are not changed, and then the target multimedia information is triggered to be sent to the target application. For another example, after the target application displayed on the screen of the mobile terminal after the movement is determined, the user touches the screen of the mobile terminal, and then the target multimedia information is triggered to be sent to the target application. For another example, after determining the target application displayed on the screen of the mobile terminal after the movement, the user touches a preset button on the screen of the mobile terminal, and the preset button is triggered to send the target multimedia information to the target application.
Through various implementation manners provided by the embodiment, firstly, in response to the selection operation of a user, target multimedia information is determined in a target multimedia application; secondly, responding to the operation of the mobile phone of the user, and obtaining the moving direction and the moving displacement of the mobile terminal and the position coordinates of each application relative to the mobile terminal; then, determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application; and finally, if the preset condition is met, triggering to send the target multimedia information to the target application. Therefore, the multimedia application jumps to other applications without multiple selection operations, multimedia information in the multimedia application is directly shared to other applications through the operation mode of the mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, and the operation mode of the mobile phone is extremely convenient and fast, so that the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.
It is important to note that, in the above embodiments, each application is actually laid out on the virtual plane in advance based on the preset layout rule, that is, before the target multimedia information is determined, each application should be laid out, so that other application interfaces are displayed on the screen when the mobile terminal moves later. Therefore, referring to fig. 3, a flow chart of another method for sending multimedia information in the embodiment of the present application is shown. In this embodiment, the method may include, for example, the steps of:
step 301: and according to the preset layout rule, laying out the applications.
Step 302: target multimedia information is determined in a target multimedia application.
Step 303: the method comprises the steps of obtaining the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal, wherein the position coordinates of each application refer to the position coordinates of each application relative to the mobile terminal.
Step 304: and determining the target application displayed on the screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application.
Step 305: and if the preset conditions are met, triggering to send the target multimedia information to the target application.
It should be noted that, considering that the complete display of each application is not overlapped, each application is generally laid in a planar layout by using a tiling mode, assuming that the mobile terminal is a particle, the most common plane relative to the particle includes each plane of a hexahedron with the particle as a center, and therefore, each application can be tiled on any one or more surfaces of the hexahedron based on a preset tiling rule. Therefore, in some embodiments of this embodiment, the step 301 may specifically be, for example: and according to a preset tiling rule, tiling each application on a preset plane, wherein the preset plane comprises at least one surface of a hexahedron taking the mobile terminal as a body center. For example, as shown in the schematic diagram of the preset plane shown in fig. 4, a straight parallelepiped centered on the mobile terminal, such as a cube, a cuboid, etc., is determined, where the straight parallelepiped includes six planes, i.e., an upper plane 401, a lower plane 402, a left plane 403, a right plane 404, a front plane 405, and a rear plane 406, and the preset plane is one or more of the six planes; the target multimedia applications displayed by the mobile terminal before moving are only tiled on one plane, and only one target multimedia application is displayed.
It should be noted that the tiling mode may be the same for any surface of the aforementioned straight parallelepiped, such as any surface of a cube or a rectangular parallelepiped. For example, as shown in the schematic view of application tiling on the virtual plane shown in fig. 5, the target multimedia application displayed by the mobile terminal before moving is application a, application B is directly above application a, application C is directly below application a, application D is directly above application a, and application E is directly to the right of application a. If the mobile terminal is moved upwards, the screen displays the application B, if the mobile terminal is moved downwards, the screen displays the application C, if the mobile terminal is moved leftwards, the screen displays the application D, and if the mobile terminal is moved rightwards, the screen displays the application E.
Assuming that the virtual plane shown in fig. 5 is a rear plane of a straight parallelepiped with the mobile terminal as a body center, for example, the mobile terminal is moved upward, the screen displays application B, at this time, the distance between the mobile terminal and the application B is greater than the preset distance and does not satisfy the preset condition, the mobile terminal is moved backward, the screen still displays the application B until the distance between the mobile terminal and the application B is less than the preset distance, and the target multimedia information is triggered to be sent to the application B. Of course, after the mobile terminal moves upwards and the mobile terminal screen displays the application B, if the mobile terminal does not move any more within a preset time, the mobile terminal screen is touched or a preset button on the mobile terminal screen is touched, the target multimedia information may be triggered to be sent to the application B. In addition, the moving directions of downward movement, leftward movement, rightward movement and the like are similar to the upward movement, and can be reasonably derived, and the details are not repeated.
It should be further noted that the above steps 302 to 305 are the same as the specific implementation of the steps 201 to 204, and are not described again.
Taking the example that a user is browsing a WeChat friend evaluation circle by using a smart phone and wants to share an image M in a gallery to the WeChat friend evaluation circle, after finding the image M in the gallery, responding to the operation of selecting the image M in a gallery interface displayed on a screen of the smart phone by the user, and determining the image M as target multimedia information; supposing that each application is tiled on a rear plane of a cube taking a smart phone as a body center based on a preset layout rule, the rear plane is a virtual plane, the vertical distance between the rear plane and the body center (the smart phone) is 25mm, wherein the WeChat application is tiled and laid at a position 20mm right to the left of a gallery application, the moving direction, the moving displacement of the mobile terminal are 20mm left, 20mm backward and the position coordinates of each application are obtained in response to the operation of moving the mobile terminal by a user, and the target application displayed on the screen of the mobile terminal after moving is determined to be WeChat application according to the moving direction, the moving displacement and the position coordinates of each application; and if the distance between the moved mobile terminal and the position of the WeChat application is less than the preset distance of 8mm, triggering to send the image M to the WeChat application, wherein the interface of the WeChat application is a friend circle interface, so that the image M in the gallery application is sent to the WeChat application friend circle.
Through various implementation manners provided by the embodiment, firstly, in response to the selection operation of a user, target multimedia information is determined in a target multimedia application; secondly, responding to the operation of the mobile phone of the user, and obtaining the moving direction and the moving displacement of the mobile terminal and the position coordinates of each application relative to the mobile terminal; then, determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application; and finally, if the preset condition is met, triggering to send the target multimedia information to the target application. Therefore, the multimedia application jumps to other applications without multiple selection operations, multimedia information in the multimedia application is directly shared to other applications through the operation mode of the mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, and the operation mode of the mobile phone is extremely convenient and fast, so that the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.
Exemplary devices
Referring to fig. 6, a schematic structural diagram of an apparatus for sending multimedia information in an embodiment of the present application is shown. In this embodiment, the apparatus may specifically include:
a first determining unit 601, configured to determine target multimedia information in a target multimedia application;
an obtaining unit 602, configured to obtain a moving direction, a moving displacement, and position coordinates of each application of the mobile terminal, where the position coordinates of each application refer to position coordinates of each application relative to the mobile terminal;
a second determining unit 603, configured to determine, according to the moving direction, the moving displacement, and the position coordinates of each application, a target application displayed on the screen of the mobile terminal;
a trigger sending unit 604, configured to trigger sending the target multimedia information to the target application if a preset condition is met.
Optionally, the trigger sending unit 604 includes:
the first obtaining subunit is configured to obtain a position distance between the mobile terminal and the target application according to the moving direction, the moving displacement, and the position coordinate of the target application;
and the first trigger sending subunit is used for triggering to send the target multimedia information to the target application if the position distance is smaller than a preset distance.
Optionally, the first obtaining subunit includes:
a first obtaining module, configured to obtain a current position coordinate of the mobile terminal according to the moving direction and the moving displacement;
and the second obtaining module is used for obtaining the position distance between the mobile terminal and the target application according to the current position coordinate of the mobile terminal and the position coordinate of the target application.
Optionally, the trigger sending unit 604 is specifically configured to:
if the moving direction and the moving displacement are not changed within the preset time, triggering to send the target multimedia information to the target application; or the like, or, alternatively,
if the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application; or the like, or, alternatively,
and if a preset button on the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application.
Optionally, the obtaining unit 602 includes:
the second obtaining subunit is used for analyzing and obtaining the moving direction according to the data of the gyroscope sensor when the mobile terminal moves; the gyroscope sensor is arranged in the mobile terminal;
the third obtaining subunit is configured to obtain the movement displacement through integration of data of an acceleration sensor when the mobile terminal moves, where the acceleration sensor is disposed in the mobile terminal;
and the fourth obtaining subunit is configured to obtain the position coordinates of each application according to the preset layout rule of each application.
Optionally, the obtaining unit 602 further includes:
a fifth obtaining subunit, configured to obtain, through a camera on the mobile terminal, an external environment image when the mobile terminal moves;
a sixth obtaining subunit, configured to obtain a distance between any two adjacent frames in the external environment image;
and the seventh obtaining subunit is configured to add distances between any two adjacent frames in the external environment image to obtain the movement displacement of the mobile terminal.
Optionally, the apparatus further comprises:
and the layout unit is used for laying out the applications according to the preset layout rule.
Optionally, the layout unit is specifically configured to:
and according to a preset tiling rule, tiling each application on a preset plane, wherein the preset plane comprises at least one surface of a hexahedron taking the mobile terminal as a body center.
Optionally, the moving direction includes at least one of the following:
up, down, left, right, forward and backward.
Optionally, the target multimedia information at least includes one of the following:
image information, video information, and audio information.
Through various implementation manners provided by the embodiment, the first determining unit is configured to determine the target multimedia information in the target multimedia application; the obtaining unit is used for obtaining the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal, wherein the position coordinates of each application refer to the position coordinates of each application relative to the mobile terminal; the second determining unit is used for determining the target application displayed on the screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application; and the trigger sending unit is used for triggering the target multimedia information to be sent to the target application if a preset condition is met. Therefore, the multimedia application jumps to other applications without multiple selection operations, multimedia information in the multimedia application is directly shared to other applications through the operation mode of the mobile phone after target multimedia information is selected, the whole sharing process is simple and easy to understand, and the operation mode of the mobile phone is extremely convenient and fast, so that the efficiency of sharing the multimedia information is improved, and the experience of a user is improved.
An embodiment of the present invention further provides a mobile terminal, where a hardware structure of the mobile terminal may be as shown in fig. 7, and the hardware structure includes: at least one memory 701 and at least one processor 702;
the memory 701 is used for storing program codes, and the processor 702 is used for calling the program codes stored in the memory 701 to execute the method for sending multimedia information provided by the above embodiment.
In addition, an embodiment of the present invention further provides a storage medium, where the storage medium is used to store a program code, and the program code is used to execute the method for sending multimedia information provided in the foregoing embodiment.
In addition, the embodiment of the present invention also provides a computer program product including instructions, which when run on a computer, causes the computer to execute the method for sending multimedia information provided by the above embodiment.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a preferred embodiment of the present application and is not intended to limit the present application in any way. Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application. Those skilled in the art can now make numerous possible variations and modifications to the disclosed embodiments, or modify equivalent embodiments, using the methods and techniques disclosed above, without departing from the scope of the claimed embodiments. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present application still fall within the protection scope of the technical solution of the present application without departing from the content of the technical solution of the present application.

Claims (13)

1. A method for transmitting multimedia information, comprising:
according to a preset layout rule, all applications of the mobile terminal are laid out;
determining target multimedia information in a target multimedia application;
obtaining the moving direction and the moving displacement of the mobile terminal and the position coordinates of each application, wherein the position coordinates of each application refer to the position coordinates of each application of the mobile terminal before moving relatively, and the position coordinates of each application are obtained based on the preset layout rule;
determining a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement and the position coordinates of each application, wherein the target application refers to an application corresponding to the position of the mobile terminal after moving in each application, and the position of the mobile terminal after moving is determined according to the moving direction and the moving displacement;
and if the preset conditions are met, triggering to send the target multimedia information to the target application.
2. The method of claim 1, wherein the triggering the sending of the target multimedia information to the target application if a preset condition is met comprises:
obtaining the position distance between the mobile terminal and the target application according to the moving direction, the moving displacement and the position coordinate of the target application;
and if the position distance is smaller than a preset distance, triggering to send the target multimedia information to the target application.
3. The method according to claim 2, wherein the obtaining the position distance between the mobile terminal and the target application according to the moving direction, the moving displacement and the position coordinate of the target application comprises:
obtaining the current position coordinate of the mobile terminal according to the moving direction and the moving displacement;
and obtaining the position distance between the mobile terminal and the target application according to the current position coordinate of the mobile terminal and the position coordinate of the target application.
4. The method according to claim 1, wherein if a preset condition is met, triggering sending of the target multimedia information to the target application is specifically:
if the moving direction and the moving displacement are not changed within the preset time, triggering to send the target multimedia information to the target application; or the like, or, alternatively,
if the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application; or the like, or, alternatively,
and if a preset button on the screen of the mobile terminal is touched, triggering to send the target multimedia information to the target application.
5. The method according to claim 1, wherein the obtaining of the moving direction, the moving displacement and the position coordinates of each application of the mobile terminal comprises:
analyzing and obtaining the moving direction according to the data of a gyroscope sensor when the mobile terminal moves; the gyroscope sensor is arranged in the mobile terminal;
obtaining the movement displacement through integration of data of an acceleration sensor when the mobile terminal moves, wherein the acceleration sensor is arranged in the mobile terminal;
and obtaining the position coordinates of each application according to the preset layout rule of each application.
6. The method according to claim 5, wherein the obtaining of the movement displacement of the mobile terminal comprises:
acquiring an external environment image when the mobile terminal moves through a camera on the mobile terminal;
obtaining the distance between any two adjacent frames in the external environment image;
and adding the distances between any two adjacent frames in the external environment image to obtain the movement displacement of the mobile terminal.
7. The method according to claim 1, wherein the laying out the applications according to the preset laying out rule specifically comprises:
and according to the preset layout rule, tiling each application on a preset plane, wherein the preset plane comprises at least one surface of a hexahedron taking the mobile terminal as a body center.
8. The method of claim 1, wherein the moving direction comprises at least one of:
up, down, left, right, forward and backward.
9. The method of claim 1, wherein the target multimedia information comprises at least one of:
image information, video information, and audio information.
10. An apparatus for transmitting multimedia information, comprising:
the layout unit is used for laying out all applications of the mobile terminal according to a preset layout rule;
a first determining unit for determining target multimedia information in a target multimedia application;
an obtaining unit, configured to obtain a moving direction, a moving displacement, and position coordinates of each application of the mobile terminal, where the position coordinates of each application refer to position coordinates of each application of the mobile terminal before the mobile terminal moves, and the position coordinates of each application are obtained based on the preset layout rule;
a second determining unit, configured to determine a target application displayed on a screen of the mobile terminal according to the moving direction, the moving displacement, and the position coordinates of each application, where the target application refers to an application corresponding to the position of the mobile terminal after moving in each application, and the position of the mobile terminal after moving is determined according to the moving direction and the moving displacement;
and the trigger sending unit is used for triggering the target multimedia information to be sent to the target application if a preset condition is met.
11. A mobile terminal, comprising: at least one memory and at least one processor;
wherein the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the method for transmitting multimedia information according to any one of claims 1-9.
12. A storage medium storing program code executable by at least one processor to perform the method of transmitting multimedia information of any one of claims 1-9.
13. A computer-readable medium comprising instructions that store a computer program which, when run on a computer, causes the computer to perform the method of transmitting multimedia information of any of claims 1-9.
CN201810631374.1A 2018-05-11 2018-06-19 Method and device for sending multimedia information Active CN109743438B (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN201810631374.1A CN109743438B (en) 2018-06-19 2018-06-19 Method and device for sending multimedia information
US16/981,274 US11262856B2 (en) 2018-05-11 2019-05-09 Interaction method, device and equipment for operable object
PCT/CN2019/086292 WO2019214696A1 (en) 2018-05-11 2019-05-09 Method, device, and apparatus for interacting with operation object
SG11202011206UA SG11202011206UA (en) 2018-05-11 2019-05-09 Interaction method, device and equipment for operable object
PCT/CN2019/087862 WO2019242450A1 (en) 2018-06-19 2019-05-21 Data transmission method and apparatus, and mobile terminal
US17/022,001 US11029822B2 (en) 2018-06-19 2020-09-15 Data transmission method, device and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810631374.1A CN109743438B (en) 2018-06-19 2018-06-19 Method and device for sending multimedia information

Publications (2)

Publication Number Publication Date
CN109743438A CN109743438A (en) 2019-05-10
CN109743438B true CN109743438B (en) 2020-05-15

Family

ID=66354332

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810631374.1A Active CN109743438B (en) 2018-05-11 2018-06-19 Method and device for sending multimedia information

Country Status (1)

Country Link
CN (1) CN109743438B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019214696A1 (en) * 2018-05-11 2019-11-14 北京字节跳动网络技术有限公司 Method, device, and apparatus for interacting with operation object
CN109753209B (en) 2018-06-21 2020-05-05 北京字节跳动网络技术有限公司 Application program starting method, device and equipment
WO2019242450A1 (en) * 2018-06-19 2019-12-26 北京字节跳动网络技术有限公司 Data transmission method and apparatus, and mobile terminal
CN110830359B (en) * 2019-09-30 2022-03-25 咪咕动漫有限公司 Multimedia information sharing method, electronic equipment and storage medium
CN114710694B (en) * 2022-04-12 2023-05-30 深圳市瑞云科技有限公司 Distributed plug flow method in cloud game scene

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8155121B2 (en) * 2007-03-27 2012-04-10 Ricoh Co. Ltd. Detection of physical movement for document sharing
US10200824B2 (en) * 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
CN105094567B (en) * 2015-08-20 2020-11-17 Tcl科技集团股份有限公司 Intelligent terminal operation implementation method and system based on gravity sensing
CN105430168A (en) * 2015-10-30 2016-03-23 努比亚技术有限公司 Mobile terminal and file sharing method
CN106603846A (en) * 2016-12-19 2017-04-26 联想(北京)有限公司 Method for transmitting file and smartphone
CN107590006B (en) * 2017-09-05 2019-02-05 Oppo广东移动通信有限公司 Document handling method, device and mobile terminal
CN107704167B (en) * 2017-09-15 2019-08-13 珠海格力电器股份有限公司 A kind of data sharing method, device and electronic equipment
CN107770369A (en) * 2017-09-28 2018-03-06 努比亚技术有限公司 Control method, device and the computer-readable recording medium of mobile terminal

Also Published As

Publication number Publication date
CN109743438A (en) 2019-05-10

Similar Documents

Publication Publication Date Title
CN109743438B (en) Method and device for sending multimedia information
US9514512B2 (en) Method and apparatus for laying out image using image recognition
US9972134B2 (en) Adaptive smoothing based on user focus on a target object
US20180329598A1 (en) Method and apparatus for dynamic display box management
CN108027936B (en) Methods, systems, and media for presenting interactive elements within video content
CN108024073B (en) Video editing method and device and intelligent mobile terminal
CN108200477B (en) Method, device and equipment for generating and playing video file
CN110430450A (en) A kind of method, apparatus and electronic equipment of video location
CN109753199B (en) Application page display method and mobile terminal
CN109753212B (en) Document transmission method and device and mobile terminal
CN109587188B (en) Method and device for determining relative position relationship between terminal devices and electronic device
CN107705275B (en) Photographing method and mobile terminal
KR20140110646A (en) User termial and method for displaying screen in the user terminal
KR102100667B1 (en) Apparatus and method for generating an image in a portable terminal
CN109753209B (en) Application program starting method, device and equipment
CN109753146B (en) Method for starting application by mobile terminal and mobile terminal
JP2019191988A (en) Electronic apparatus, control method of electronic apparatus, program, and storage medium
CN104580967A (en) Map projection method based on portable projector, and device for projection
US11029822B2 (en) Data transmission method, device and mobile terminal
CN109472873B (en) Three-dimensional model generation method, device and hardware device
US11262856B2 (en) Interaction method, device and equipment for operable object
JP5960836B2 (en) Image display system, electronic device, program, and image display method
JP6122082B1 (en) Program, system and method
US11494049B2 (en) Method and device for displaying application icon, and storage medium
TWI748439B (en) Positioning method and device based on shared map, electronic equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant