CN109275338A - A kind for the treatment of method and apparatus of multimedia file - Google Patents

A kind for the treatment of method and apparatus of multimedia file Download PDF

Info

Publication number
CN109275338A
CN109275338A CN201780031274.9A CN201780031274A CN109275338A CN 109275338 A CN109275338 A CN 109275338A CN 201780031274 A CN201780031274 A CN 201780031274A CN 109275338 A CN109275338 A CN 109275338A
Authority
CN
China
Prior art keywords
multimedia file
angle
terminal device
feature point
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201780031274.9A
Other languages
Chinese (zh)
Inventor
黄邦邦
高华江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN109275338A publication Critical patent/CN109275338A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A kind for the treatment of method and apparatus of multimedia file, is related to multimedia technology field, can adjust the display direction of multimedia file before terminal device shows multimedia file, improve user experience.This method may include: that terminal device obtains the first multimedia file, which includes image or video；And terminal device is in the case where the display direction and first direction for determining the first multimedia file are inconsistent, adjust the display direction of first multimedia file, wherein, the display direction of first multimedia file is vertical with the ground direction of the first multimedia file, and the direction in the ground direction of first multimedia file is left, first direction is preset direction on the display interface for show the first multimedia file.

Description

A kind for the treatment of method and apparatus of multimedia file Technical field
The present embodiments relate to multimedia technology field more particularly to a kind for the treatment of method and apparatus of multimedia file.
Background technique
With the fast development of multimedia technology, terminal device browsing multimedia file (such as image, video etc.) can be used in more and more users, during user's browsing multimedia file, the direction of the multimedia file shown on terminal device may not be consistent with the visual angle of user, that is the display direction of multimedia file is incorrect, may be unfavorable for user in this way and watch multimedia file.
Currently, user can manually adjust the display direction of image by taking piece image as an example.Specifically, when the poor direction of the image shown on the terminal device, user can be manually rotated image, for example, user can select rotation image in picture editting's option on the image software of terminal device, and select corresponding angle (such as 90 °), or user can rotate freely image with finger by the touch screen of terminal device, to adjust the display direction of image.
However, in the above method, since after terminal device shows image, user manually adjusts the display direction of image according to actual needs, and for video file, user can not adjust the display direction of video file, poor user experience.
Summary of the invention
The application provides a kind for the treatment of method and apparatus of multimedia file, can adjust the display direction of multimedia file before terminal device shows multimedia file, improve user experience.
In order to achieve the above objectives, the application adopts the following technical scheme that
The application provides a kind of processing method of multimedia file, and this method may include: that terminal device obtains the first multimedia file；In the case where the terminal device determines that the display direction of the first multimedia file and first direction are inconsistent, the terminal device adjusts the display direction of first multimedia file, first multimedia file includes image or video, the display direction of first multimedia file is vertical with the ground direction of first multimedia file, and the direction in the ground direction of the first multimedia file is left, first direction is preset direction on the display interface for show first multimedia file.
The processing method of multimedia file provided by the present application, terminal device obtains matchmaker's file more than one (the first multimedia file as escribed above), and when direction (such as above-mentioned first direction) preset on the display direction of first multimedia file and the display interface of the terminal device is inconsistent, the direction of adjustable first multimedia file of terminal device, then the terminal device shows the first multimedia file adjusted or saves first multimedia file adjusted.Compared with prior art, in the embodiment of the present invention, on the one hand, since terminal device can be before showing the first multimedia file, the display direction of the first multimedia file is adjusted, then shows first multimedia file again, or first multimedia file is stored in the terminal device, the display direction that the first multimedia file is manually adjusted without user, can be improved user experience；On the other hand, terminal device can also adjust the display direction of video, can be improved user Watch the user experience of video.
In the first optional implementation of first aspect, terminal device determines the display direction of the first multimedia file and the inconsistent method of first direction may include: the local feature that terminal device extracts the first multimedia file, and terminal device determines first angle according to the local feature of the first multimedia file, and the terminal device is not when first angle is 0 °, determine that display direction and the first direction of the first multimedia file are inconsistent, wherein, the local feature of first multimedia file includes at least a pair of of characteristic point of the first multimedia file, first angle is along rotating clockwise from the display direction of the first multimedia file to the rotation angle of first direction.
In the application, terminal device can be according to the content of the first multimedia file, extract the local feature of first multimedia file, to which terminal device can be according to the local feature of first multimedia file, first angle is accurately determined to a certain extent, and then determines whether the display direction of first multimedia file consistent with direction (i.e. first direction) preset on the display interface of the terminal device.
In second of optional implementation of first aspect, if the local feature of above-mentioned first multimedia file includes a pair of of characteristic point of the first multimedia file, a pair of of characteristic point of first multimedia file includes fisrt feature point and second feature point, then terminal device may include: coordinate (X of the terminal device according to fisrt feature point according to the method that the local feature of the first multimedia file determines first angle1,Y1) and second feature point coordinate (X2,Y2), determine first angle.
In the application, terminal device extracts after the coordinate of first multimedia a pair of of characteristic point, the terminal device can accurately determine first angle according to the coordinate of a pair of of characteristic point of extraction, so as to adjust the display direction of the first multimedia file according to first angle.
In the third optional implementation of first aspect, when the direction that fisrt feature point is directed toward second feature point is consistent with the display direction of first multimedia file, terminal device is according to the coordinate (X of fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), if the method for determining first angle may include: Y2> Y1, and X2=X1, terminal device determine first angle be 0 °；If Y2=Y1, and X2< X1, terminal device determine first angle be 90 °；If Y2< Y1, and X2=X1, terminal device determine first angle be 180 °；If Y2=Y1, and X2> X1, terminal device determine first angle be 270 °.
In the application, a pair of of characteristic point of first multimedia file can be a pair of of the characteristic point being drawn up with the consistent side of display direction of the first multimedia file, then terminal device can determine first angle using the above method, to adjust the display direction of the first multimedia file according to first angle.
In the 4th kind of optional implementation of first aspect, when the direction that fisrt feature point is directed toward second feature point is consistent with second direction, the second direction is that the display direction of the first multimedia file rotates clockwise the direction after 90 °, and terminal device is according to the coordinate (X of fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), if the method for determining first angle may include: Y2=Y1, and X2> X1, terminal device determine first angle be 0 °；If Y2>Y1, and X2=X1, determine that first angle is 90 °；If Y2=Y1, and X2< X1, determine that first angle is 180 °；If Y2< Y1, and X2=X1, determine that first angle is 270 °.
In the application, a pair of of characteristic point that a pair of of characteristic point of first multimedia file can also be drawn up for the side after rotating clockwise 90 ° with the display direction of the first multimedia file, then terminal device can determine first angle using the above method, to adjust the display direction of the first multimedia file according to first angle.
In the 5th kind of optional implementation of first aspect, the processing method of multimedia file provided by the present application can also include: that terminal device shows the first multimedia file adjusted.
In the application, after terminal device adjusts the display direction of the first multimedia file according to first angle, which can directly display first multimedia file adjusted, so, the display direction that the first multimedia file is manually adjusted without user, can be improved user experience.
Second aspect, the application provide a kind of processing unit of multimedia file, and the apparatus may include obtain module and adjustment module.Wherein, obtaining module can be used for obtaining the first multimedia file, which may include image or video；Adjustment module can be used in the case where the display direction and first direction for determining the first multimedia file are inconsistent, adjust the display direction of first multimedia file, the display direction of first multimedia file is vertical with the ground direction of first multimedia file, and the direction in the ground direction of the first multimedia file is left, which is preset direction on the display interface for show the first multimedia file.
In the first optional implementation of second aspect, the processing unit of multimedia file provided by the present application can also include determining module, the determining module can be used for extracting the local feature for the first multimedia file that above-mentioned acquisition module obtains, and the determining module can determine first angle according to the local feature of first multimedia file, and when first angle is not 0 °, the determining module determines that the display direction of the first multimedia file and first direction are inconsistent, wherein, the local feature of first multimedia file includes at least a pair of of characteristic point of the first multimedia file, first angle is along rotating from the display direction of the first multimedia file to the rotation angle of institute's first direction clockwise.
In second of optional implementation of second aspect, above-mentioned determining module is specifically used for, when the local feature of the first multimedia file includes a pair of of characteristic point of the first multimedia file, when a pair of of characteristic point of first multimedia file includes fisrt feature point and second feature point, according to the coordinate (X of fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine first angle.
In the third optional implementation of second aspect, when the direction that fisrt feature point is directed toward second feature point is consistent with the display direction of the first multimedia file, above-mentioned determining module is specifically used for, if Y2> Y1, and X2=X1, determine that first angle is 0 °；If Y2=Y1, and X2< X1, determine that first angle is 90 °；If Y2< Y1, and X2=X1, determine that first angle is 180 °；If Y2=Y1, and X2> X1, determine that first angle is 270 °.
In the 4th kind of optional implementation of second aspect, when the direction that fisrt feature point is directed toward second feature point is consistent with second direction, the second direction is that the display direction of the first multimedia file rotates clockwise the direction after 90 °, and above-mentioned determining module is specifically used for, if Y2=Y1, and X2> X1, determine that first angle is 0 °；If Y2>Y1, and X2=X1, determine that first angle is 90 °；If Y2=Y1, and X2< X1, determine that first angle is 180 °；If Y2< Y1, and X2=X1, determine that first angle is 270 °.
In the 5th kind of optional implementation of second aspect, the processing unit of multimedia file provided by the present application can also include display module, which is displayed for the first multimedia file adjusted.
The description of the related content and technical effect of second aspect may refer to above-mentioned to first aspect and its associated description of the related content of various optional implementations and technical effect, and details are not described herein again.
The third aspect, the application provide a kind of processing unit of multimedia file, and the apparatus may include places Reason device and the memory being of coupled connections with the processor；The memory is for storing computer instruction, when the apparatus is operative, the processor executes the computer instruction of memory storage, so that the device executes the processing method of the multimedia file as described in one of any in claim first aspect and its various optional implementations.
Fourth aspect, the application provide a kind of computer readable storage medium, which may include computer instruction.When the computer instruction is run in the processing unit of multimedia file so that the device execute in above-mentioned first aspect and its various optional implementations it is one of any described in multimedia file processing method.
5th aspect, the application provides a kind of computer program product including computer instruction, when the computer program product is run in the processing unit of multimedia file so that the device execute in above-mentioned first aspect and its various optional implementations it is one of any described in multimedia file processing method.
The description of related content and technical effect of the third aspect to the 5th aspect may refer to above-mentioned to first aspect and its associated description of the related content of various optional implementations and technical effect, and details are not described herein again.
Detailed description of the invention
Fig. 1 is the schematic diagram of the display direction of multimedia file provided in an embodiment of the present invention；
Fig. 2 is the hardware schematic of mobile phone provided in an embodiment of the present invention；
Fig. 3 is the processing method schematic diagram one of multimedia file provided in an embodiment of the present invention；
Fig. 4 is the schematic diagram of the first direction in terminal device provided in an embodiment of the present invention；
Fig. 5 is the display direction of multimedia file provided in an embodiment of the present invention and the relation schematic diagram one of first direction；
Fig. 6 is the display direction of multimedia file provided in an embodiment of the present invention and the relation schematic diagram two of first direction；
Fig. 7 is the effect diagram that multimedia file is shown on terminal device provided in an embodiment of the present invention；
Fig. 8 is the processing method schematic diagram two of multimedia file provided in an embodiment of the present invention；
Fig. 9 is the method schematic diagram one provided in an embodiment of the present invention that local feature is extracted in multimedia file；
Figure 10 is the method schematic diagram two provided in an embodiment of the present invention that local feature is extracted in multimedia file；
Figure 11 is the schematic diagram of first angle provided in an embodiment of the present invention；
Figure 12 is that the seat calibration method provided in an embodiment of the present invention that a pair of of characteristic point is extracted in multimedia file is intended to one；
Figure 13 is the method schematic diagram two of the coordinate provided in an embodiment of the present invention that a pair of of characteristic point is extracted in multimedia file；
Figure 14 (a) is the method schematic diagram one of determining first angle provided in an embodiment of the present invention；
Figure 14 (b) is the method schematic diagram two of determining first angle provided in an embodiment of the present invention；
Figure 14 (c) is the method schematic diagram three of determining first angle provided in an embodiment of the present invention；
Figure 14 (d) is the method schematic diagram four of determining first angle provided in an embodiment of the present invention；
Figure 15 is the coordinate provided in an embodiment of the present invention that a pair of of characteristic point is extracted in multimedia file Method schematic diagram three；
Figure 16 (a) is the method schematic diagram five of determining first angle provided in an embodiment of the present invention；
Figure 16 (b) is the method schematic diagram six of determining first angle provided in an embodiment of the present invention；
Figure 16 (c) is the method schematic diagram seven of determining first angle provided in an embodiment of the present invention；
Figure 16 (d) is the method schematic diagram eight of determining first angle provided in an embodiment of the present invention；
Figure 17 is the processing method schematic diagram three of multimedia file provided in an embodiment of the present invention；
Figure 18 is a kind of structural schematic diagram one of terminal device provided in an embodiment of the present invention；
Figure 19 is a kind of structural schematic diagram two of terminal device provided in an embodiment of the present invention.
Specific embodiment
The terms "and/or", only a kind of incidence relation for describing affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.
Term " first " and " second " in the specification and claims of the embodiment of the present invention etc. are rather than to be used for the particular order of description object for distinguishing different objects.For example, fisrt feature point and second feature point etc. are rather than to be used for the particular order of Expressive Features point for distinguishing different characteristic points.
In embodiments of the present invention, " illustrative " or " such as " etc. words for indicate make example, illustration or explanation.Be described as in the embodiment of the present invention " illustrative " or " such as " any embodiment or design scheme be not necessarily to be construed as than other embodiments or design scheme more preferably or more advantage.Specifically, use " illustrative " or " such as " etc. words be intended to that related notion is presented in specific ways.
Some concepts involved in the treating method and apparatus to multimedia file provided in an embodiment of the present invention illustrate below.
The display direction of multimedia file: it is vertical with the ground direction of the multimedia file in the multimedia file, and leave the direction in the ground direction of multimedia file.Illustratively, by taking multimedia file is image as an example, as shown in Figure 1, respectively illustrating the display direction (in Fig. 1, the display direction of multimedia file is illustrated with OM) of multimedia file in Fig. 1 (a), Fig. 1 (b) and Fig. 1 (c).
The ground direction of multimedia file: in multimedia file, for the object in the multimedia file, the direction (i.e. the horizontal plane vertical with the gravity direction of the object) on ground locating for the object is the ground direction of the multimedia file, in the multimedia file as shown in Fig. 1 (a), the horizontal plane X'Y' vertical with the gravity direction of personage in the multimedia file is the ground direction of the multimedia file.
The embodiment of the present invention provides a kind for the treatment of method and apparatus of multimedia file, terminal device can be before showing the first multimedia file, the display direction for adjusting the first multimedia file manually adjusts the display direction of the first multimedia file without user, can be improved user experience；On the other hand, terminal device can also adjust the display direction of video, can be improved the user experience that user watches video.
Terminal device provided in an embodiment of the present invention can be mobile phone, tablet computer, laptop, Ultra-Mobile PC (ultra-mobile personal computer, UMPC), net book or personal digital assistant (personal Digital Assistant, PDA) etc..
Illustratively, the embodiment of the present invention introduces the hardware configuration of terminal device so that terminal device is mobile phone as an example.Each component parts of mobile phone provided in an embodiment of the present invention is specifically introduced below with reference to Fig. 2.Such as Shown in Fig. 2, mobile phone provided in an embodiment of the present invention includes: the components such as processor 20, radio frequency (radio frequency, RF) circuit 21, power supply 22, memory 23, input unit 24, display unit 25 and voicefrequency circuit 26.It will be appreciated by those skilled in the art that, the structure of mobile phone shown in Figure 2 does not constitute the restriction to mobile phone, it may include the more or fewer components of component such as shown in Fig. 2, perhaps certain components in component as shown in Figure 2 can be combined or can be different from component layout as shown in Figure 2.
Processor 20 is the control centre of mobile phone, utilizes the various pieces of various interfaces and connection whole mobile phone.By running or executing the software program and/or module that are stored in memory 23, and the data that calling is stored in memory 23, the various functions and processing data of mobile phone are executed, to carry out integral monitoring to mobile phone.Optionally, processor 20 may include one or more processing units.Optionally, processor 20 can integrate application processor and modem processor, wherein the main processing operation system of application processor, user interface and application program etc.；Modem processor mainly handles wireless communication.It is understood that above-mentioned modem processor may be the processor with 20 individualism of processor.
RF circuit 21 can be used for receive and send messages or communication process in, send and receive signal.For example, being handled after the downlink information of base station is received to processor 20；In addition, the data of uplink are sent to base station.In general, RF circuit includes but is not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (low noise amplifier, LNA) and duplexer etc..It is wirelessly communicated in addition, mobile phone can also be realized by the other equipment in RF circuit 21 and network.Any communication standard or agreement can be used in wireless communication, including but not limited to global system for mobile communications (global system of mobile communication, GSM), general packet radio service (general packet radio service, GPRS), CDMA (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), LTE, Email and short message service (short messaging service, SM S) etc..
Power supply 22 can be used for all parts power supply of mobile phone, and power supply 22 can be battery.Optionally, power supply can be logically contiguous by power-supply management system and processor 20, to realize the functions such as management charging, electric discharge and power managed by power-supply management system.
Memory 23 can be used for storing software program and/or module, and processor 20 is stored in the software program and/or module of memory 23 by operation, thereby executing the various function application and data processing of mobile phone.Memory 23 can mainly include storing program area and storage data area, wherein storing program area can application program (such as sound-playing function, image player function etc.) needed for storage program area, at least one function etc.；Storage data area, which can be stored, uses created data (such as audio data, image data, phone directory etc.) etc. according to mobile phone.In addition, memory 23 may include high-speed random access memory, it can also include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Input unit 24 can be used for receiving the number or character information of input, and generate key signals input related with the user setting of mobile phone and function control.Specifically, input unit 34 may include touch screen 241 and other input equipments 242.Touch screen 241, also referred to as touch panel, the touch operation (for example user uses the operations of any suitable object or attachment on touch screen 241 or near touch screen 241 such as finger, stylus) of collectable user on it or nearby, and corresponding attachment device is driven according to preset formula.Optionally, touch screen 241 may include both touch detecting apparatus and touch controller. Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 20, and can receive order that processor 20 is sent and be executed.Furthermore, it is possible to realize touch screen 241 using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.Other input equipments 242 can include but is not limited to one of physical keyboard, function key (such as volume control button, power switch button etc.), trace ball, mouse and operating stick etc. or a variety of.
Display unit 25 can be used for showing information input by user or be supplied to the information of user and the various menus of mobile phone.Display unit 25 may include display panel 251.Optionally, display panel 251 can be configured using the forms such as liquid crystal display (liquid crystal display, LCD), Organic Light Emitting Diode (organic light-emitting diode, OLED).Further, touch screen 241 can cover display panel 251, after touch screen 241 detects touch operation on it or nearby, processor 20 is sent to determine the type of touch event, is followed by subsequent processing device 20 according to the type of touch event and corresponding visual output is provided on display panel 251.Although touch screen 241 and display panel 251 are to output and input function as two independent components come realize mobile phone, in some embodiments it is possible to touch screen 241 and display panel 251 is integrated and that realizes mobile phone output and input function in Fig. 2.
Voicefrequency circuit 26, loudspeaker 261 and microphone 262, for providing the audio interface between user and mobile phone.On the one hand, the electric signal after voicefrequency circuit 26 can convert the audio data received, is transferred to loudspeaker 261, is converted to voice signal output by loudspeaker 261.On the other hand, the voice signal of collection is converted to electric signal by microphone 262, audio data is converted to after being received by voicefrequency circuit 26, audio data is exported again by processor 20 to RF circuit 21 to be sent to such as another mobile phone, or audio data is exported to memory 23 by processor 20 to be further processed.
Optionally, mobile phone as shown in Figure 2 can also include various sensors.Such as gyro sensor, humidity flowmeter sensor, infrared sensor, magnetometer sensor etc., details are not described herein.
Optionally, mobile phone as shown in Figure 2 can also include Wi-Fi module, bluetooth module etc., and details are not described herein.
The processing method of multimedia file provided in an embodiment of the present invention can be applied in the scene (below referred to as scene one) of display multimedia file, also can be applied to the terminal device and obtains multimedia file and save in the scene (referred to as scene two below) of the multimedia file.
Specifically, in scene one, during terminal device shows multimedia file, terminal device may determine that whether the display direction of the multimedia file is consistent with preset direction on the display interface of the terminal device, if the display direction of the multimedia file and preset direction on the display interface of the terminal device are inconsistent, if the multimedia file is image, terminal device can first adjust the display direction of the image, then show the image；If the multimedia file is video, then terminal device can show each frame image of the video by adjusting the display direction of each video frame (i.e. each frame image) of the video.
In scene two, during terminal device obtains the first multimedia file from network or other equipment, terminal device is got after the multimedia file, the terminal may determine that, if the multimedia file when being shown on the terminal device, the display direction of the terminal device whether the display with the terminal device Preset direction is consistent on interface, then, if the multimedia file is image, terminal device can first adjust the display direction of the image, then save the image；If the multimedia file is video, then terminal device can save each frame image of the video by adjusting the display direction of each video frame (i.e. each frame image) of the video.
It should be noted that, in the embodiment of the present invention, the method that terminal device adjusts the display direction of image is identical with the method for each frame image in adjustment video, below by taking multimedia file is image as an example, it is directed to above two scene (i.e. scene one and scene two) respectively, as exemplary to the processing method of multimedia file provided in an embodiment of the present invention.
Scene one:
As shown in figure 3, the processing method of multimedia file provided in an embodiment of the present invention may include S101-S106 in scene one:
S101, terminal device obtain the first multimedia file.
Wherein, the first multimedia file may include image or video, and the embodiment of the present invention introduces the processing method of multimedia file using the first multimedia file as image.
In the embodiment of the present invention, terminal device can obtain the first multimedia file from internet or in other equipment, first multimedia file can be scene image, character image, animal painting or building object image, character image etc., and the embodiment of the present invention does not limit the classification of the first multimedia file.
S102, terminal device receive the idsplay order of user.
In the embodiment of the present invention, user is during using terminal the first multimedia file of equipment browse, user can trigger idsplay order, the idsplay order can show the button of first multimedia file for user by touch screen or key selection, then intelligent terminal can receive the idsplay order of user, and prepare to show first multimedia file.
S103, terminal device determine whether the display direction of the first multimedia file and first direction are consistent.
Wherein, the display direction of first multimedia file is vertical with the ground direction of the first multimedia file, and leave the ground direction of first multimedia file direction (such as, the display direction OM of each image as shown in Figure 1), first direction is preset direction on the display interface (i.e. the display interface of the terminal device) for show first multimedia file.
Illustratively, as shown in figure 4, on display interface on terminal device shown in Fig. 4, it is assumed that the bottom end boundary WH of the display interface is known as reference line, then first direction VK is vertical with reference line WH, and is directed toward the direction of the top margin UI of the display interface.
In the embodiment of the present invention, in conjunction with the above-mentioned introduction to first direction, known to, when showing the first multimedia file on the terminal device, the display direction of first multimedia file may be consistent with first direction, may also be inconsistent with first direction, when terminal device determines that the display direction of the first multimedia file and first direction are inconsistent, which can determine the display direction for needing to adjust first multimedia file.
In the embodiment of the present invention, in the case where terminal device determines display direction and the above-mentioned first direction unanimous circumstances of the first multimedia file, following S104 can be executed after S103, in the case where terminal device determines that the display direction of the first multimedia file and above-mentioned first direction are inconsistent, following S104-S105 can be executed after S103:
S104, terminal device determine the first multimedia file display direction and above-mentioned first direction unanimous circumstances under, terminal device shows the first multimedia file.
In the embodiment of the present invention, if the display direction of the first multimedia file is consistent with first direction, then terminal device directly displays first multimedia file, such as, the display direction OM of first multimedia file as shown in Figure 5 is consistent with the first direction VK on display interface, can show first multimedia file.
S105, terminal device determine the display direction of the first multimedia file and above-mentioned first direction it is inconsistent in the case where, terminal device adjust the first multimedia file display direction.
In the embodiment of the present invention, if the display direction of the first multimedia file and first direction are inconsistent, which adjusts the display direction of first multimedia file first, so that the display direction of first multimedia file adjusted is consistent with first direction.If not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, as shown in Figure 6, it can be seen that the display direction OM of the first multimedia file and the upper first direction VK of display interface are inconsistent, the then display direction of adjustable first multimedia file of terminal device, such as the first multimedia file in such as Fig. 6 is rotated clockwise 90 °, so that the display direction OM of first multimedia file is consistent with the first direction VK on display interface.
S106, terminal device show the first multimedia file adjusted.
In the embodiment of the present invention, above-mentioned terminal device adjusts after the display direction of the first multimedia file, the terminal device can show first multimedia file, such as, Fig. 7 is the first multimedia file shown on the terminal device after terminal device adjusts the display direction of the first multimedia file as shown in FIG. 6.
It can be understood that, in the embodiment of the present invention, when the first multimedia file is video, terminal device adjusts each frame image of the video by method described in above-mentioned S101-S106, then each frame image for showing the video again, to complete the broadcasting of the video.
The processing method of multimedia file provided in an embodiment of the present invention, terminal device obtains matchmaker's file more than one (the first multimedia file as escribed above), and when direction (such as above-mentioned first direction) preset on the display direction of first multimedia file and the display interface of the terminal device is inconsistent, the direction of adjustable first multimedia file of terminal device, then the terminal device shows the first multimedia file adjusted.Compared with prior art, in the embodiment of the present invention, on the one hand, since terminal device can be before showing the first multimedia file, adjust the display direction of the first multimedia file, then first multimedia file is shown again, and the display direction of the first multimedia file is manually adjusted without user, can be improved user experience；On the other hand, terminal device can also adjust the display direction of video, can be improved the user experience that user watches video.
Optionally, in conjunction with Fig. 3, as shown in figure 8, above-mentioned S103 can specifically be realized by S103a-S103c in the embodiment of the present invention:
S103a, terminal device extract the local feature of the first multimedia file.
Wherein, the local feature of the first multimedia file includes at least a pair of of characteristic point of first multimedia file.
In the embodiment of the present invention, after terminal device obtains the first multimedia file, which can be with The related algorithm for using pattern-recognition first, detects the content of first multimedia file, and then terminal device is according to the local feature of the contents extraction of first multimedia file first multimedia file.For example, the terminal device can extract the features such as eyes, mouth, eyebrow or nose in the facial image when terminal device detects that the first multimedia file is facial image.Specifically, the local feature that terminal device extracts can be at least a pair of of characteristic point of first multimedia file, so that terminal device determines whether the display direction of the first multimedia file and first direction are consistent according to the local feature of the first multimedia file (i.e. this at least one to characteristic point).
Illustratively, as shown in figure 9, if first multimedia file is facial image, the characteristic point that can be extracted from each eyes of face in the image, using two characteristic points on two eyes as a pair of of characteristic point；It can also be from a characteristic point be extracted in the image on the nose of face, from a characteristic point is extracted in the image on the mouth of face, using the two characteristic points as a pair of of characteristic point.As shown in Figure 10, if first multimedia file is building object image, so the terminal device can extract a characteristic point in the roof of building from the image, and a characteristic point is extracted at the room bottom of building from the image, using the two characteristic points as a pair of of characteristic point.
It should be noted that, in the embodiment of the present invention, above-mentioned at least a pair of of characteristic point can the according to first multimedia file actual content, and at least a pair of of the characteristic point extracted according to actual needs, the embodiment of the present invention do not limit the particular content (not limiting at least a pair of of characteristic point as which characteristic point in image) of at least a pair of of characteristic point.
S103b, terminal device determine first angle according to the local feature of the first multimedia file, which is along rotating clockwise from the display direction of the first multimedia file to the rotation angle of first direction.
Illustratively, in the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file, such as Figure 11 are shown on the terminal device, in the first multimedia file shown in the figure (a) in Figure 11 and figure (b), the display direction of first multimedia file is OM, first direction is VK, first angle θ, which is to rotate along clockwise direction from the display direction OM of the first multimedia file to the rotation angle of first direction VK.
In the embodiment of the present invention, terminal device can determine first angle according to the local feature of the first multimedia file, specifically, terminal device determines first angle according at least a pair of of characteristic point in the local feature of the first media file, so that the terminal device can determine whether the display direction of the first multimedia file and first direction are consistent according to the first angle.
Optionally, in the embodiment of the present invention, by taking the local feature of the first multimedia file includes a pair of of characteristic point of first multimedia file as an example, above-mentioned S103b can specifically be realized by S103b1:
S103b1, terminal device are according to the coordinate (X of fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine first angle.
In the embodiment of the present invention, the local feature for the first multimedia file that terminal device extracts can be the coordinate of at least a pair of of characteristic point in first multimedia file, as shown in figure 12, coordinate system is established on the display interface of terminal device, in the coordinate system, with the first direction of the display interface, i.e. if the WK in Figure 12 is the longitudinal axis, with display interface bottom end boundary and the direction vertical with first direction, i.e. if the WH in Figure 12 is horizontal axis, first multimedia file is shown on the display interface of the terminal device, corresponding a pair of of the coordinate value of each pixel in first multimedia file.For example, a pair of of feature that terminal device extracts The coordinate of a characteristic point P in point is (X1,Y1), the coordinate of another characteristic point Q is (X2,Y2), then terminal device can determine first angle according to fisrt feature point and second feature point.
It should be noted that, in the embodiment of the present invention, for terminal device when extracting the local feature of the first multimedia file, that is, when extracting the coordinate of at least a pair of of characteristic point in first multimedia file, which can extract the coordinate of at least a pair of of characteristic point in a different direction.Since terminal device can extract the coordinate of characteristic point in different directions, which determines first angle according to different methods.
Optionally, in the embodiment of the present invention, a pair of of characteristic point of first multimedia file can be with are as follows: a pair of of the characteristic point being drawn up with the consistent side of display direction of the first multimedia file, a pair of of characteristic point of first multimedia file can be with are as follows: a pair of of characteristic point that the side after rotating clockwise 90 ° with the display direction of the first multimedia file is drawn up, when illustrating above-mentioned a pair of of characteristic point as the characteristic point on different directions using two kinds of situations of A and B separately below, the method that determines first angle.
It should be noted that, usually, when showing a multimedia file on the terminal device, the display direction and the inconsistent situation of first direction of multimedia file usually include: the rotation that the multimedia file occurs 90 °, 180 ° or 270 °, in the embodiment of the present invention, it is rotated by 90 ° respectively by multimedia file, for 180 ° and 270 °, the method for illustrating to determine above-mentioned first angle.
A, when the direction that fisrt feature point is directed toward second feature point is consistent with the display direction of the first multimedia file, terminal device is according to the coordinate (X of fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine first angle.
In the embodiment of the present invention, it is assumed that first multimedia file is building object image, and as shown in figure 13, the fisrt feature point in the first multimedia file can take a point Q (X on the roof of the building2,Y2), second feature point can take a point P (X at the room bottom of the building1,Y1), above-mentioned A can specifically include A1-A4:
If A1, Y2> Y1, and X2=X1, terminal device determine the first angle be 0 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, and as shown in Figure 14 (a), in a pair of of characteristic point of the first multimedia file, the coordinate of fisrt feature point P is (X1,Y1), the coordinate of second feature point Q is (X2,Y2), fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction be PN, the display direction of the first multimedia file is OM, first direction WK.In Figure 14 (a), fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with the display direction OM of the first multimedia file, i.e. fisrt feature point (X1,Y1) and second feature point (X2,Y2) on the display direction of the first multimedia file.
In the embodiment of the present invention, since the direction of the longitudinal axis of the first coordinate system is consistent with first direction, according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2> Y1' and X2=X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with first direction WK, and due to the fisrt feature of the first multimedia file point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with the display direction OM of the first multimedia file, therefore, illustrate that the display direction OM of the first multimedia file is consistent with first direction WK, then terminal device determine first angle θ be 0 °.
If A2, Y2=Y1, and X2< X1, terminal device determine first angle be 90 °.
In the embodiment of the present invention, if the display direction of the first multimedia file is not adjusted, in terminal device The first multimedia file of upper display, as shown in Figure 14 (b), according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2=Y1, and X2< X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN and first direction WK it is inconsistent, and due to the fisrt feature of the first multimedia file point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN and the display direction of the first multimedia file be that OM is consistent, therefore the display direction OM and first direction WK of the first multimedia file of explanation are inconsistent, again since direction PN is rotated clockwise after 90 °, it can be consistent with first direction WK, illustrate the display direction OM of the first multimedia file after being rotated by 90 ° counterclockwise, can be consistent with first direction WK, therefore terminal device determines that first angle θ is 90 °.
If A3, Y2< Y1, and X2=X1, terminal device determine first angle be 180 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, as shown in Figure 14 (c), according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2< Y1, and X2=X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN and first direction WK it is inconsistent, and due to the fisrt feature of the first multimedia file point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with the display direction OM of the first multimedia file, therefore, illustrate that the display direction OM and first direction WK of the first multimedia file are inconsistent, again since direction PN is rotated clockwise after 180 °, it can be consistent with first direction WK, illustrate that the display direction OM of the first multimedia file, can be consistent with first direction WK after 180 ° of rotation counterclockwise, therefore terminal device determines that first angle θ is 180 °.
If A4, Y2=Y1, and X2> X1, terminal device determine first angle be 270 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, i.e., the first multimedia file is shown on the terminal device, as shown in Figure 14 (d), according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2=Y1, and X2> X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN and first direction WK it is inconsistent, and due to the fisrt feature of the first multimedia file point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with the display direction OM of the file of the first multimedia file, therefore, illustrate that the display direction OM and first direction WK of the first multimedia file are inconsistent, again since direction PN is rotated clockwise after 270 °, it can be consistent with first direction WK, illustrate that the display direction OM of the first multimedia file, can be consistent with first direction WK after 270 ° of rotation counterclockwise, therefore terminal device determines that first angle θ is 270 °
B, fisrt feature point be directed toward second feature point direction it is consistent with second direction, which rotates clockwise the direction after 90 ° for the display direction of the first multimedia file, and terminal device is according to the coordinate (X of fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine first angle.
In the embodiment of the present invention, it is assumed that the first multimedia file is facial image, and as shown in figure 15, the fisrt feature point in the first multimedia file can take a point P (X on the eyes of the face1,Y1), second feature point can remove a point Q (X on another eye of the face2,Y2), above-mentioned B can specifically include B1-B4:
If B1, Y2=Y1, and X2> X1, terminal device determine first angle be 0 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, and as shown in Figure 16 (a), in a pair of of characteristic point of the first multimedia file, the coordinate of fisrt feature point P is (X1,Y1), the coordinate of second feature point Q is (X2,Y2), fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction be PN, the display direction of the first multimedia file is OM, and above-mentioned second direction is that the display direction OM of the first multimedia file rotates clockwise the direction after 90 °, is denoted as RT, first direction WK.In Figure 16 (a), fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with second direction RT, direction PN and the display direction OM of the first multimedia file are inconsistent, and as shown in Figure 16 (a), direction PN is along be rotated by 90 ° counterclockwise can be consistent with the display direction OM of the first multimedia file.It is found that fisrt feature point (X1,Y1) and second feature point (X2,Y2) on the direction (i.e. second direction RT) vertical with the first multimedia display direction.
In the embodiment of the present invention, since the direction of the longitudinal axis of the first coordinate system is consistent with first direction, according to fisrt feature point and second feature point, work as Y2=Y1, and X2> X1When, illustrate fisrt feature point (X1,Y1) be directed toward second feature point direction PN and first direction WK it is inconsistent, as shown in Figure 16 (a), direction PN can be consistent with first direction WK along counterclockwise be rotated by 90 °, and due to fisrt feature point (X1,Y1) be directed toward second feature point direction PN it is consistent with second direction RT, that is the display direction OM of direction PN and the first multimedia file are inconsistent, as shown in Figure 16 (a), direction PN is along be rotated by 90 ° counterclockwise can be consistent with the display direction OM of the first multimedia file, therefore, know that the display direction OM of the first multimedia file is consistent with first direction WK, then terminal device determines that first angle θ is 0 °.
If B2, Y2>Y1, and X2=X1, terminal device determine first angle be 90 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, as shown in Figure 16 (b), according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2>Y1, and X2=X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with first direction WK, and due to fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with second direction RT, that is the display direction OM of direction PN and the first multimedia file are inconsistent, and as shown in Figure 16 (b), direction PN is along be rotated by 90 ° counterclockwise can be consistent with the display direction OM of the first multimedia file, then first direction WK is along be rotated by 90 ° counterclockwise can be consistent with the display direction OM of the first multimedia file, that is the display direction OM of the first multimedia file rotates clockwise 90 ° can be consistent with first direction WK, therefore, terminal device determines that first angle θ is 90 °.
If B3, Y2=Y1, and X2< X1, terminal device determine first angle be 180 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, as shown in Figure 16 (c), according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2=Y1, and X2< X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN and first direction WK it is inconsistent, as shown in Figure 16 (c), direction PN rotates clockwise 90 ° can be consistent with first direction WK, and due to fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with second direction RT, that is the display direction OM of direction PN and the first multimedia file are inconsistent, and as shown in Figure 16 (c), direction PN is along be rotated by 90 ° counterclockwise can be consistent with the display direction OM of the first multimedia file, to known to, the display direction OM of first multimedia file rotates clockwise 180 ° can be consistent with first direction WK, and therefore, terminal device determines that first angle θ is 180 °.
If B4, Y2< Y1, and X2=X1, terminal device determine first angle be 270 °.
In the embodiment of the present invention, if not adjusting the display direction of the first multimedia file, the first multimedia file is shown on the terminal device, as shown in Figure 16 (d), according to fisrt feature point (X1,Y1) and second feature point (X2,Y2), work as Y2< Y1, and X2=X1When, illustrate fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN and first direction WK it is inconsistent, as shown in Figure 16 (d), direction PN rotates clockwise 180 ° can be consistent with first direction WK, and due to fisrt feature point (X1,Y1) it is directed toward second feature point (X2,Y2) direction PN it is consistent with second direction RT, that is the display direction OM of direction PN and the first multimedia file are inconsistent, and as shown in Figure 16 (d), direction PN is along be rotated by 90 ° counterclockwise can be consistent with the display direction OM of the first multimedia file, to known to, the display direction OM of first multimedia file rotates clockwise 270 ° can be consistent with first direction WK, and therefore, terminal device determines that first angle θ is 270 °.
Optionally, in the embodiment of the present invention, the local feature for the first multimedia file that terminal device extracts may include multipair characteristic point, multipair characteristic point may include above-mentioned A and or B described in characteristic point, then terminal device can determine multiple angles by the method for determination first angle described in above-mentioned A and or B, to determine first angle according to this multiple angle.
Illustratively, in the embodiment of the present invention, assuming that terminal device can extract 20 pairs of characteristic points, wherein 5 pairs of characteristic points are the characteristic point extracted according to above-mentioned A situation, 15 pairs are the characteristic point extracted according to above-mentioned B situation, terminal device is according to the method and 5 pairs of characteristic points for determining first angle in A situation, determine 5 angles, terminal device is according to the method and 10 pairs of characteristic points for determining first angle in B situation, determine 10 angles, then terminal device determines first angle from this 20 angles, such as, one angle of the maximum probability occurred in 20 angles can be determined as first angle by the terminal device.The terminal device can also determine that first angle, the embodiment of the present invention are not especially limited using the method that other are satisfied the use demand from multiple angles.
S103c, terminal device determine whether the display direction of the first multimedia file is consistent with first direction according to first angle.
Wherein, when first angle is 0 °, terminal device determines that the display direction of the first multimedia file is consistent with first direction；When first angle is not 0 °, terminal device determines that the display direction of the first multimedia file and first direction are inconsistent.
In the embodiment of the present invention, first angle can be determined by above-mentioned A and B, when first angle is 0 °, known to, terminal device determines that the display direction of the first multimedia file is consistent with first direction, the terminal device is not necessarily to adjust the display direction of the first multimedia file, which can directly display first multimedia file；When first angle is not 0 ° (such as can be 90 °, 180 ° or 270 ° in above-described embodiment), the terminal device needs to adjust the display direction of first multimedia file, and then the terminal device shows the first multimedia file adjusted again.
In the embodiment of the present invention, if terminal device adjusts the display direction of the first multimedia file, to may include: terminal device determine that first angle is 90 ° according to the local feature of the first multimedia file, so first multimedia file can be rotated clockwise 90 ° by the terminal device, then show the first multimedia file (the first multimedia file i.e. after adjustment display direction) after the rotation；If terminal device determines that first angle is 180 ° according to the local feature of the first multimedia file, which can rotate clockwise 180 ° for first multimedia file, then show the first multimedia file after the rotation；Such as Fruit terminal device determines that first angle is 180 ° according to the local feature of the first multimedia file, then first multimedia file can be rotated clockwise 270 ° by the terminal device, then shows the first multimedia file after the rotation.
Optionally, in the embodiment of the present invention, when being other angles in addition to that mentioned above for first angle, the embodiment of the present invention can also determine first angle according to the coordinate of at least a pair of of characteristic point of first multimedia file in a coordinate system, to adjust the display direction of the first multimedia file according to first angle.
Optionally, the processing method of multimedia file provided in an embodiment of the present invention, terminal device adjusts the display direction of the first multimedia file, and after showing first multimedia file, whether the display result that user can feed back the first multimedia file is correct, so, terminal device can adjust the method for determining first angle according to the feedback result of user, correctly to show first multimedia file, and terminal device can pass through the big data (i.e. a large amount of recognition result of user feedback) of collection user feedback, to optimize the characteristic point for needing to extract in multimedia file (extracting more accurate characteristic point), and optimization calculates the strategy and algorithm of rotation angle according to characteristic point, to improve the accuracy for determining rotation angle.For example, terminal device can readjust the display direction of first multimedia file using other local features of first multimedia file when the display direction of the first multimedia file of user feedback is incorrect；When the display direction of the first multimedia file of user feedback is correct, the terminal device can adjust the display direction of other multimedia files using the other local feature of one species when adjusting other multimedia files identical with the first multimedia file classification next time.
Scene two:
As shown in figure 17, in scene two, the processing method of multimedia file provided in an embodiment of the present invention may include:
S201, terminal device obtain the first multimedia file.
In the embodiment of the present invention, terminal obtains the first multimedia file, and first multimedia file is stored in the terminal device, for user's browsing.
Above-mentioned above-described embodiment of associated description in to(for) S101 may refer to for the specific descriptions of S201, details are not described herein again.
S202, terminal device determine whether the display direction of the first multimedia file and first direction are consistent.
In the embodiment of the present invention, terminal device is got after the first multimedia file, before the terminal device saves first multimedia file, terminal may determine that, if whether the display direction and first direction of first multimedia file are consistent when showing first multimedia file on the terminal device.
Other descriptions for S201, specifically may refer to for the associated description of S103 (including S103a-S103c) in above-described embodiment, details are not described herein again.
S203, terminal device determine the first multimedia file display direction and above-mentioned first direction unanimous circumstances under, terminal device save the first multimedia file.
In the embodiment of the present invention, when terminal device determines that the display direction of the first multimedia file is consistent with above-mentioned first direction, which directly saves first multimedia file, for user's browsing.
Other descriptions for S203, specifically may refer to the associated description in above-mentioned implementation for S104, details are not described herein again.
S204, determine that the display direction of the first multimedia file and above-mentioned first direction are different in terminal device In the case where cause, terminal device adjusts the display direction of the first multimedia file.
Above-described embodiment of associated description in to(for) S105 may refer to for the specific descriptions of S204.Details are not described herein again.
S205, terminal device save the first multimedia file adjusted.
In the embodiment of the present invention, when terminal device determines that the display direction of the first multimedia file and above-mentioned first direction are inconsistent, the terminal device can first adjust the display direction of first multimedia file, then the first multimedia file adjusted is stored in the terminal device, to when user triggers idsplay order, during the terminal device shows first multimedia file, it can guarantee that the display direction of first multimedia file is consistent with first direction, manually adjust the display direction of first multimedia file again without user.
The processing method of multimedia file provided in an embodiment of the present invention, terminal device obtains matchmaker's file more than one (the first multimedia file as escribed above), and when direction (such as above-mentioned first direction) preset on the display direction of first multimedia file and the display interface of the terminal device is inconsistent, the direction of adjustable first multimedia file of terminal device, then the terminal device saves the first multimedia file adjusted.Compared with prior art, in the embodiment of the present invention, on the one hand, since terminal device can be after obtaining the first multimedia file, before showing the first multimedia file, adjust the display direction of the first multimedia file, then first multimedia file is stored in the terminal device, when the terminal device shows first multimedia file, it can guarantee that the display direction of first multimedia file is consistent with first direction, the display direction that the first multimedia file is manually adjusted without user, can be improved user experience；On the other hand, terminal device can also adjust the display direction of video, can be improved the user experience that user watches video.
It is above-mentioned that mainly scheme provided in an embodiment of the present invention is described from the angle of terminal device.It is understood that terminal device etc. is in order to realize the above functions, it comprises execute the corresponding hardware configuration of each function and/or software module.Those skilled in the art should be readily appreciated that, unit and algorithm steps described in conjunction with the examples disclosed in the embodiments of the present disclosure, and the embodiment of the present invention can be realized with the combining form of hardware or hardware and computer software.Some function is executed in a manner of hardware or computer software driving hardware actually, specific application and design constraint depending on technical solution.Professional technician can use different methods to achieve the described function each specific application, but this realization is it is not considered that exceed scope of the present application.
Two or more functions can also be integrated in a processing module according to the division that above method example carries out functional module to terminal device for example, each functional module of each function division can be corresponded to by the embodiment of the present invention.Above-mentioned integrated module both can take the form of hardware realization, can also be realized in the form of software function module.It should be noted that being schematically that only a kind of logical function partition, there may be another division manner in actual implementation to the division of module in the embodiment of the present invention.
In the case where functional module each using corresponding each function division, Figure 18 shows a kind of possible structural schematic diagram of terminal device involved in above-described embodiment, and as shown in figure 18, terminal device may include: to obtain module 30 and adjustment module 31.Obtain S101 and S201 that module 30 can be used for that terminal device is supported to execute in above method embodiment；Adjustment module 31 can be used for that terminal device is supported to hold S105 and S204 in row above method embodiment.Optionally, as shown in figure 18, which can also include receiving module 32, determining module 33, display module 34 and memory module 35.The S102 that receiving module 32 can be used for that terminal device is supported to execute in above method embodiment；The S103 (including S103a, S103b (including S103b1), S103c) and S202 that determining module 33 can be used for that terminal device is supported to execute in above method embodiment；The S104 and S106 that display module 34 can be used for that terminal device is supported to execute in above method embodiment；The S203 and S205 that memory module 35 can be used for that terminal device is supported to execute in above method embodiment.Wherein, all related contents for each step that above method embodiment is related to can quote the function description of corresponding function module, and details are not described herein.
Using integrated unit, Figure 19 shows a kind of possible structural schematic diagram of terminal device involved in above-described embodiment.As shown in figure 19, terminal device may include: processing module 40 and communication module 41.Processing module 40 can be used for the movement to terminal device and carry out control management, such as, processing module 40 can be used for that terminal device is supported to execute S101, S103 (including S103a, S103b (including S103b1), S103c), S104, S105, S106, S201, S202 and S204 in above method embodiment, and/or other processes for techniques described herein.Communication module 41 can be used for supporting the communication of terminal device Yu other network entities, such as, the S102 that communication module 41 can be used for that terminal device is supported to execute in above method embodiment, optionally, as shown in figure 19, the terminal device can also include memory module 42, for supporting terminal device to execute the program code and data of the S203 and S205 and storage terminal device in above method embodiment.
Wherein, processing module 40 can be processor or controller (such as can be above-mentioned processor 20 as shown in Figure 2), such as it can be central processing unit (central processing unit, CPU), general processor, digital signal processor (digital signal processor, DSP), specific integrated circuit (application-specific integrated circuit, ASIC), field programmable gate array (field programmable gate array, ) or other programmable logic device FPGA, transistor logic, hardware component or any combination thereof.It, which may be implemented or executes, combines various illustrative logic blocks, module and circuit described in disclosure of the embodiment of the present invention.Above-mentioned processor is also possible to realize the combination of computing function, such as combines comprising one or more microprocessors, DSP and the combination of microprocessor etc..Communication module 41 can be transceiver, transmission circuit or communication interface etc. (such as can be above-mentioned RF circuit 31 as shown in Figure 2).Memory module 42 can be memory.
When processing module 40 is processor, communication module 41 is transceiver, and when memory module 42 is memory, processor, transceiver and memory can be connected by bus.Bus can be Peripheral Component Interconnect standard (peripheral component interconnect, PCI) bus or expanding the industrial standard structure (extended Industry standard architecture, EISA) bus etc..Bus can be divided into address bus, data/address bus, control bus etc..
In the above-described embodiments, it can be realized wholly or partly by software, hardware, firmware or any combination thereof.When being realized using software program, can entirely or partly realize in the form of a computer program product.The computer program product includes one or more computer instructions.When loading and execute on computers the computer instruction, entirely or partly generate according to the process or function in the embodiment of the present invention.The computer can be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction may be stored in a computer readable storage medium, or calculate from one Machine readable storage medium storing program for executing is transmitted to another computer readable storage medium, such as, the computer instruction can be transmitted from a web-site, computer, server or data center by wired (such as coaxial cable, optical fiber, Digital Subscriber Line (digital subscriber line, DSL)) mode or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or data center.The computer readable storage medium can be any usable medium that computer can access or include the data storage devices such as one or more usable mediums integrated server, data center.The usable medium can be magnetic medium (such as, floppy disk, disk, tape), optical medium (such as, digital video disk (digital video disc, )) or semiconductor medium (such as solid state hard disk (solid state drives, SSD)) etc. DVD.
Through the above description of the embodiments, it is apparent to those skilled in the art that, for convenience and simplicity of description, only the example of the division of the above functional modules, in practical application, it can according to need and be completed by different functional modules above-mentioned function distribution, i.e., the internal structure of device is divided into different functional modules, to complete all or part of the functions described above.The specific work process of the system, apparatus, and unit of foregoing description, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method may be implemented in other ways.Such as, the apparatus embodiments described above are merely exemplary, such as, the division of the module or unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, and component shown as a unit may or may not be physical unit, it can and it is in one place, or may be distributed over multiple network units.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in each embodiment of the application can integrate in one processing unit, it is also possible to each unit and physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated unit both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product, can store in a computer readable storage medium.Based on this understanding, substantially all or part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products the technical solution of the application in other words, the computer software product is stored in a storage medium, it uses including some instructions so that a computer equipment (can be personal computer, server or the network equipment etc.) or processor execute all or part of the steps of each embodiment the method for the application.And storage medium above-mentioned includes: the various media that can store program code such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic or disk.
The above, the only specific embodiment of the application, but the protection scope of the application does not limit to In this, any change or replacement within the technical scope of the present application should all be covered within the scope of protection of this application.Therefore, the protection scope of the application should be based on the protection scope of the described claims.

Claims (14)

  1. A kind of processing method of multimedia file characterized by comprising
    The first multimedia file is obtained, first multimedia file includes image or video；
    In the case where the display direction and first direction for determining first multimedia file are inconsistent, adjust the display direction of first multimedia file, the display direction of first multimedia file is vertical with the ground direction of first multimedia file, and the direction in the ground direction of first multimedia file is left, the first direction is preset direction on the display interface for show first multimedia file.
  2. The method according to claim 1, wherein determining that the display direction of first multimedia file and first direction are inconsistent, comprising:
    The local feature of first multimedia file is extracted, the local feature of first multimedia file includes at least a pair of of characteristic point of first multimedia file；
    First angle is determined according to the local feature of first multimedia file, and the first angle is along rotating clockwise from the display direction of first multimedia file to the rotation angle of the first direction；
    When the first angle is not 0 °, determine that the display direction of first multimedia file and first direction are inconsistent.
  3. According to the method described in claim 2, it is characterized in that,
    If the local feature of first multimedia file includes a pair of of characteristic point of first multimedia file, a pair of of characteristic point of first multimedia file includes fisrt feature point and second feature point, then the local feature according to first multimedia file determines first angle, comprising:
    According to the coordinate (X of the fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine the first angle.
  4. According to the method described in claim 3, it is characterized in that, the fisrt feature point direction of being directed toward the second feature point is consistent with the display direction of first multimedia file, the coordinate (X according to the fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine the first angle, comprising:
    If Y2> Y1, and X2=X1, determine that the first angle is 0 °；
    If Y2=Y1, and X2< X1, determine that the first angle is 90 °；
    If Y2< Y1, and X2=X1, determine that the first angle is 180 °；
    If Y2=Y1, and X2> X1, determine that the first angle is 270 °.
  5. According to the method for claim 3, it is characterized in that, the direction that the fisrt feature point is directed toward the second feature point is consistent with second direction, the second direction is that the display direction of first multimedia file rotates clockwise the direction after 90 °, the coordinate (X according to the fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine the first angle, comprising:
    If Y2=Y1, and X2> X1, determine that the first angle is 0 °；
    If Y2>Y1, and X2=X1, determine that the first angle is 90 °；
    If Y2=Y1, and X2< X1, determine that the first angle is 180 °；
    If Y2< Y1, and X2=X1, determine that the first angle is 270 °.
  6. According to claim 1 to method described in 5 any one, which is characterized in that the method also includes:
    Show the first multimedia file adjusted.
  7. A kind of processing unit of multimedia file characterized by comprising obtain module and adjustment module；
    The acquisition module, for obtaining the first multimedia file, first multimedia file includes image or video；
    The adjustment module, for in the case where the display direction and first direction for determining first multimedia file are inconsistent, adjust the display direction of first multimedia file, the display direction of first multimedia file is vertical with the ground direction of first multimedia file, and the direction in the ground direction of first multimedia file is left, the first direction is preset direction on the display interface for show first multimedia file.
  8. Device according to claim 7, which is characterized in that described device further includes determining module；
    The determining module, for extracting the local feature for first multimedia file that the acquisition module obtains, the local feature of first multimedia file includes at least a pair of of characteristic point of first multimedia file；
    First angle is determined according to the local feature of first multimedia file, and the first angle is along rotating clockwise from the display direction of first multimedia file to the rotation angle of the first direction；
    When the first angle is not 0 °, determine that the display direction of first multimedia file and first direction are inconsistent.
  9. Device according to claim 8, which is characterized in that
    If the local feature of first multimedia file includes a pair of of characteristic point of first multimedia file, a pair of of characteristic point of first multimedia file includes fisrt feature point and second feature point, then the determining module is specifically used for the coordinate (X according to the fisrt feature point1,Y1) and second feature point coordinate (X2,Y2), determine the first angle.
  10. Device according to claim 9, which is characterized in that the direction that the fisrt feature point is directed toward the second feature point is consistent with the display direction of first multimedia file, and the determining module is specifically used for,
    If Y2> Y1, and X2=X1, determine that the first angle is 0 °；
    If Y2=Y1, and X2< X1, determine that the first angle is 90 °；
    If Y2< Y1, and X2=X1, determine that the first angle is 180 °；
    If Y2=Y1, and X2> X1, determine that the first angle is 270 °.
  11. Device according to claim 9, which is characterized in that the direction that the fisrt feature point is directed toward the second feature point is consistent with second direction, the second direction is that the display direction of first multimedia file rotates clockwise the direction after 90 °, the determining module, is specifically used for
    If Y2=Y1, and X2> X1, determine that the first angle is 0 °；
    If Y2>Y1, and X2=X1, determine that the first angle is 90 °；
    If Y2=Y1, and X2< X1, determine that the first angle is 180 °；
    If Y2< Y1, and X2=X1, determine that the first angle is 270 °.
  12. According to device described in claim 7 to 12 any one, which is characterized in that described device further includes display module；
    The display module, for showing the first multimedia file adjusted.
  13. A kind of processing unit of multimedia file, which is characterized in that including processor and the memory being of coupled connections with the processor；
    The memory is for storing computer instruction, and when described device operation, the processor executes the computer instruction of the memory storage, so that described device executes the processing method of the multimedia file as described in claim 1 to 6 any one.
  14. A kind of computer readable storage medium, it is characterized in that, including computer instruction, when the computer instruction for showing on the device of multimedia file when running, so that described device executes the processing method of the multimedia file as described in claim 1 to 6 any one.
CN201780031274.9A 2017-05-23 2017-05-23 A kind for the treatment of method and apparatus of multimedia file Pending CN109275338A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/085585 WO2018214035A1 (en) 2017-05-23 2017-05-23 Method and apparatus for processing multimedia file

Publications (1)

Publication Number Publication Date
CN109275338A true CN109275338A (en) 2019-01-25

Family

ID=64396157

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780031274.9A Pending CN109275338A (en) 2017-05-23 2017-05-23 A kind for the treatment of method and apparatus of multimedia file

Country Status (2)

Country Link
CN (1) CN109275338A (en)
WO (1) WO2018214035A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102245100A (en) * 2008-12-10 2011-11-16 皇家飞利浦电子股份有限公司 Graphical representations
CN102934157A (en) * 2011-03-04 2013-02-13 松下电器产业株式会社 Display device and method of switching display direction
CN103838367A (en) * 2011-11-22 2014-06-04 英属维京群岛速位互动股份有限公司 Orientation correction method for electronic device used to perform facial recognition and electronic device thereof
CN103885611A (en) * 2014-04-22 2014-06-25 锤子科技（北京）有限公司 Method and device for adjusting image
JP2016174388A (en) * 2016-05-09 2016-09-29 京セラ株式会社 Mobile terminal device, program and display control method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102843496B (en) * 2011-06-21 2016-04-27 联想(北京)有限公司 A kind of video acquisition processing method and portable electric appts
CN102915188B (en) * 2011-08-01 2015-07-29 中国移动通信集团公司 A kind of method of display state of control terminal screen and device
JP2013197625A (en) * 2012-03-15 2013-09-30 Omron Corp Terminal, display screen drawing direction correction method and program, and computer readable recording medium
CN103631395B (en) * 2012-08-24 2017-06-09 宏达国际电子股份有限公司 Adjust the method and its relevant apparatus of image display direction

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102245100A (en) * 2008-12-10 2011-11-16 皇家飞利浦电子股份有限公司 Graphical representations
CN102934157A (en) * 2011-03-04 2013-02-13 松下电器产业株式会社 Display device and method of switching display direction
CN103838367A (en) * 2011-11-22 2014-06-04 英属维京群岛速位互动股份有限公司 Orientation correction method for electronic device used to perform facial recognition and electronic device thereof
CN103885611A (en) * 2014-04-22 2014-06-25 锤子科技（北京）有限公司 Method and device for adjusting image
JP2016174388A (en) * 2016-05-09 2016-09-29 京セラ株式会社 Mobile terminal device, program and display control method

Also Published As

Publication number Publication date
WO2018214035A1 (en) 2018-11-29

Similar Documents

Publication Publication Date Title
US20220155919A1 (en) Method for Displaying Different Application Shortcuts on Different Screens
EP3342172B1 (en) Method of controlling the sharing of videos and electronic device adapted thereto
CN106357897B (en) The acquisition methods and device of drop information
US10193834B2 (en) Method and apparatus for downloading and displaying pictures
CN107241784B (en) Internet of things access method and device
CN104636047B (en) The method, apparatus and touch screen terminal operated to the object in list
CN106484555B (en) The method and mobile terminal of abnormality detection and recovery
CN103455256A (en) Method and terminal for rotating display picture of screen
US20170109756A1 (en) User Unsubscription Prediction Method and Apparatus
WO2018103441A1 (en) Network positioning method and terminal device
CN104407804A (en) Screen capturing method and screen capturing device as well as electronic device
CN104991699B (en) A kind of method and apparatus of video display control
CN104200211A (en) Image binaryzation method and device
TW201515682A (en) Methods and terminal for data acquisition
WO2018049903A1 (en) Data migration method and related devices
WO2019011108A1 (en) Iris recognition method and related product
CN109493821A (en) Screen brightness regulation method, device and storage medium
CN110442310A (en) Application data processing method, device, storage medium and terminal device
CN109656431A (en) Information display method, device and storage medium
WO2018214745A1 (en) Application control method and related product
CN110113782A (en) Data transmission method, device and storage medium
CN107678822B (en) A kind of information processing method and device, terminal and readable storage medium storing program for executing
CN103871050A (en) Image partition method, device and terminal
WO2018219090A1 (en) Method for rapidly searching for applications and related products
CN109687922A (en) Signal monitoring method, device, storage medium and the mobile terminal of wireless network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190125

RJ01 Rejection of invention patent application after publication