CN108536343B - Control display method and device, terminal and storage medium - Google Patents
Control display method and device, terminal and storage medium Download PDFInfo
- Publication number
- CN108536343B CN108536343B CN201711470404.7A CN201711470404A CN108536343B CN 108536343 B CN108536343 B CN 108536343B CN 201711470404 A CN201711470404 A CN 201711470404A CN 108536343 B CN108536343 B CN 108536343B
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- information
- terminal
- multimedia file
- application program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000012545 processing Methods 0.000 claims abstract description 101
- 230000006870 function Effects 0.000 claims description 112
- 238000012549 training Methods 0.000 claims description 42
- 230000001960 triggered effect Effects 0.000 claims description 9
- 238000010801 machine learning Methods 0.000 claims description 7
- 238000013461 design Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 7
- 230000003993 interaction Effects 0.000 abstract description 3
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 210000002569 neuron Anatomy 0.000 description 5
- 238000003066 decision tree Methods 0.000 description 4
- 238000012706 support-vector machine Methods 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 210000004027 cell Anatomy 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Abstract
The application discloses a control display method, a control display device, a terminal and a storage medium, and belongs to the technical field of human-computer interaction. The method comprises the following steps: when the mobile terminal collects a multimedia file, acquiring first terminal description information of the mobile terminal, wherein the first terminal description information comprises application program running information and position information; determining a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal; and after the mobile terminal finishes collecting the multimedia file, displaying the first processing function control. The mobile terminal can acquire the running information and the position information of the application program when acquiring the multimedia file and can display the corresponding first processing function control when acquiring the multimedia file, so that the embodiment of the invention can enable the mobile terminal to intelligently display the processing function control corresponding to the acquired multimedia file, thereby realizing the effects of saving user operation steps and improving the processing efficiency of the multimedia file.
Description
Technical Field
The embodiment of the invention relates to the technical field of human-computer interaction, in particular to a control display method, a control display device, a control display terminal and a storage medium.
Background
With the increasing functions of devices such as a camera and a microphone installed in the mobile terminal, a user can use the devices to collect multimedia files anytime and anywhere.
In the related art, when a user acquires a multimedia file using at least one device of a camera and a microphone, the mobile terminal stores the corresponding multimedia file after the user finishes the acquisition. When the user needs to check or use the multimedia file, the user is required to open the folders layer by layer according to the path for storing the multimedia file until the multimedia file is found.
Since multimedia files are usually obtained by opening a plurality of layers of folders, the user operation steps of the mobile terminal are complicated when the multimedia files need to be displayed or processed, and the processing efficiency is low.
Disclosure of Invention
The control display method, the control display device, the terminal and the storage medium provided by the embodiment of the invention can solve the problems of complicated user operation steps and low processing efficiency when the mobile terminal needs to display or process the multimedia file. The technical scheme is as follows:
in a first aspect, a control display method is provided, where the method includes:
when a mobile terminal collects a multimedia file, acquiring first terminal description information of the mobile terminal, wherein the first terminal description information comprises application program running information and position information, the application program running information is used for indicating a first application program running in the mobile terminal, and the position information is used for indicating the current geographic position of the mobile terminal;
determining a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal;
and displaying the first processing function control after the mobile terminal finishes collecting the multimedia file.
In a second aspect, an apparatus for displaying a control is provided, the apparatus comprising:
the information acquisition module is configured to acquire first terminal description information of a mobile terminal when the mobile terminal acquires a multimedia file, wherein the first terminal description information comprises application program running information and position information, the application program running information is used for indicating a first application program running in a preset time period of the mobile terminal, and the position information is used for indicating the current geographic position of the mobile terminal;
the control determining module is configured to determine a processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal;
and the control display module is configured to display the processing function control after the mobile terminal finishes collecting the multimedia file.
In a third aspect, a terminal is provided, where the terminal includes a processor, a memory connected to the processor, and program instructions stored in the memory, and when the processor executes the program instructions, the control display method provided in the first aspect is implemented.
In a fourth aspect, a computer readable medium has program instructions stored thereon, and the program instructions, when executed by a processor, implement the control presentation method provided in the first aspect.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
when the mobile terminal collects a multimedia file, acquiring first terminal description information of the mobile terminal, wherein the first terminal description information comprises application program running information and position information, the application program running information is used for indicating a first application program running in the mobile terminal, and the position information is used for indicating the current geographic position of the mobile terminal; determining a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal; and after the mobile terminal finishes collecting the multimedia file, displaying the first processing function control. The method and the device can solve the problems that the steps are complicated and the processing efficiency is low when the multimedia file needs to be displayed or processed by the mobile terminal; the mobile terminal can acquire the running information and the position information of the application program when acquiring the multimedia file and can display the corresponding first processing function control when acquiring the multimedia file, so that the embodiment of the invention can enable the mobile terminal to intelligently display the processing function control corresponding to the acquired multimedia file, thereby realizing the effects of saving user operation steps and improving the processing efficiency of the multimedia file.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flow chart illustrating a control presentation method in accordance with an exemplary embodiment of the present invention;
fig. 2 is a table showing a correspondence relationship between first terminal description information and a first processing function control according to the embodiment shown in fig. 1;
FIG. 3 is a flow chart illustrating another method for widget presentation in accordance with an exemplary embodiment of the present invention;
fig. 4 is a schematic diagram of a terminal description information processing flow provided based on the embodiment shown in fig. 3;
FIG. 5 is a schematic diagram of a data transfer provided based on the embodiment shown in FIG. 3;
fig. 6 is a block diagram illustrating a structure of a control display apparatus according to an embodiment of the present application;
fig. 7 is a block diagram of a terminal according to an exemplary embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
First, several terms referred to in the present application will be described.
First terminal description information: refers to a set of information comprising application running information and location information.
And application program running information: for indicating a first application running in the mobile terminal. The specific implementation form may be a collection of identifications of the application programs, or may be an identification of a single application program. For example, the application running information may be a set { a application, B application, C application, D application }, or may be a flag "B application," which is not limited in this application. Optionally, the application running information may include a program type, the program type being used to indicate a design purpose of the first application, the program type including at least one of the following types: entertainment game type, office application type, chat social type, video playing type, financial financing type, shopping application type, map navigation type, learning education type and book reading type.
Position information: refers to information indicating the current geographical location of the mobile terminal. The geographic position may be determined by a Satellite Navigation chip embedded in the mobile terminal, wherein the Satellite Navigation System used by the Navigation chip may be one of a GPS System (Global Positioning System), a BDS System (BeiDou navajustalte System, BeiDou Satellite Navigation System), a GLONASS System (Global Navigation Satellite System), or a GALILEO System (GALILEO navajuste System). Alternatively, the location information may be latitude and longitude coordinate information or information of a geographical area. When the location information includes the area type, the area type is used to indicate a geographical area where the mobile terminal is currently located. The region type includes at least one of the following types: home zone type, office zone type, mall zone type, school zone type, attraction zone type, dining zone type, bank zone type, hospital zone type, theater zone type, station zone type, hotel zone type, attraction zone type, and road zone type.
Multimedia files: including picture files, video files, and audio files. The multimedia file records information in a multimedia form and can be opened or played through a corresponding application program. The picture file may include a still picture file or a moving picture file. The video file may include a video file recorded by a camera, a video file synthesized by software, a screen recording file for recording a screen of the mobile terminal, and the like. The audio file includes a sound recording file or a music file, etc. It should be noted that the embodiment of the present invention is only an exemplary manner for illustrating some possible implementations of the multimedia file, and does not limit the specific display form of the multimedia file. Optionally, in other possible implementations, the multimedia file may also be a sensing data file collected by other sensors. For example, temperature record data collected by a mobile terminal equipped with a temperature sensor, humidity record data collected by a mobile terminal equipped with a humidity sensor, air quality record data collected by a mobile terminal equipped with an air quality detection component, and the like.
A first processing functionality control: refers to a functionality control for processing a multimedia file, and may perform specified operations with respect to the multimedia file. The first processing function control can have different implementation forms according to different types of corresponding multimedia files. For example, when the multimedia file is a picture file, the first processing functionality control may be at least one of a copy functionality control, a share functionality control, a text recognition functionality control, an attachment add functionality control, a create folder functionality control, and an image beautification functionality control. When the multimedia file is a video file, the first processing function control may be at least one of a copy function control, a share function control, an audio extraction function control, a subtitle extraction function control, an attachment addition function control, and a folder creation function control. When the multimedia file is an audio file, the first processing functionality control may be at least one of a copy functionality control, a share functionality control, a voice recognition functionality control, an attachment add functionality control, and a create folder functionality control. The function control added to the attachment is used for creating a new mail or a short message and adding the multimedia file as the attachment to the mail or the short message. The function of creating the folder function control is to create a folder and store the multimedia file in the folder. It should be noted that, in the embodiment of the present invention, a specific display manner of the first processing function control is not limited.
And (3) prediction model: is a mathematical model for predicting the corresponding first processing functionality control based on the input program run information and position information.
The predictive model is a machine learning model obtained from the first training sample. And the first training sample contains terminal description information marked with the corresponding processing function control.
Optionally, the training samples are stored in a sample repository. The sample library comprises at least one training sample, and each training sample contains terminal description information corresponding to the corresponding processing function control.
Optionally, the format of the perceptual data is the format of the data input to the predictive model. Such as: the terminal description information may be in the form of a multi-dimensional vector or matrix.
Alternatively, the predictive models include, but are not limited to: a Support Vector Machine (SVM), a Deep Neural Network (DNN) model, a Recurrent Neural Network (RNN) model, an embedding (embedding) model, a Gradient Boosting Decision Tree (GBDT) model, etc., which are not listed herein.
The support vector machine is a classification method based on a statistical learning theory. Given a set of training samples, the support vector machine performs two classes of classification by using supervised learning. The interval is maximized in the feature space, and finally, the given training samples are divided into two types.
The DNN model is a deep learning framework. The DNN model includes an input layer, at least one hidden layer (or intermediate layer), and an output layer. Optionally, the input layer, the at least one hidden layer (or intermediate layer), and the output layer each include at least one neuron for processing the received data. Alternatively, the number of neurons between different layers may be the same; alternatively, it may be different.
The RNN model is a neural network with a feedback structure. In the RNN model, the output of a neuron can be directly applied to itself at the next time stamp, i.e., the input of the i-th layer neuron at time m includes its own output at time (m-1) in addition to the output of the (i-1) layer neuron at that time.
The embedding model is based on an entity and a relationship distributed vector representation, considering the relationship in each triplet instance as a translation from the entity head to the entity tail. The triple instance comprises a subject, a relation and an object, and can be expressed as (subject, relation and object); the subject is an entity head, and the object is an entity tail. Such as: dad of minim is damming, then represented by the triplet instance as (minim, dad, damming).
The GBDT model is an iterative decision tree algorithm that consists of a number of decision trees, with the results of all trees added together as the final result. Each node of the decision tree obtains a predicted value, and taking age as an example, the predicted value is an average value of ages of all people belonging to the node corresponding to the age.
The mobile terminal in the embodiment of the invention can be provided with different multimedia file acquisition devices according to application scenes. Multimedia file capture devices include, but are not limited to, cameras and microphones. The multimedia file acquisition device can be integrated in the terminal and is integrated with the terminal. The multimedia file collection assembly can be embedded in the mobile terminal as a module, such as a module with a fixed space size. For example, embedded in a cell phone, tablet, or wearable device.
Optionally, the terminal includes but is not limited to: at least one of a cell phone, a tablet, a wearable device, a smart robot, a smart home device, and a laptop portable computer.
Optionally, the terminal may be equipped with an operating system, where the operating system includes but is not limited to: IOS (iPhone OS) system, Android (Android) system, and Windows Phone system.
Please refer to fig. 1, which is a flowchart illustrating a control display method according to an exemplary embodiment of the present invention. The control display method comprises the following steps.
In the embodiment of the invention, the mobile terminal collects the multimedia files through the camera or the microphone. For example, the mobile terminal may acquire a video file through the cooperation of the camera and the microphone, may acquire an audio file through a separate microphone, and may take a picture file through the camera. When the mobile terminal detects that the related device in the mobile terminal is in a state of collecting the multimedia file, the mobile terminal acquires the description information of the first terminal.
The first terminal description information includes application program running information and position information at the same time, so that the mobile terminal can respectively acquire the application program running information and the position information through related devices. For the application running information, the mobile terminal can be obtained by reading the data in the related data structure. For example, when the operating system hosted in the mobile terminal is an android operating system, the mobile terminal may determine the first application running in the mobile terminal by acquiring an identification of an activity (activity) in an activity stack (activity stack). For example, the active identifiers of the active stack from the top of the stack to the bottom are "a application", "B application", and "C application", respectively, so that the application running in the foreground in the mobile terminal is the a application, and the applications running in the background and having a time from short to long to open the a application are the B application and the C application, respectively. In the embodiment of the present invention, the application running information may be an application running in a background, or an application running in a foreground in the mobile terminal in a preset time period.
Optionally, in a possible manner of the embodiment of the present invention, when the application running information is used to indicate an application running in a background, the mobile terminal may obtain the first terminal description information through the following steps.
1-1) acquiring the position information when the mobile terminal collects the multimedia file.
1-2) detecting whether the number s of the applications running in the background of the mobile terminal is less than m.
The mobile terminal will detect if the number s of applications running in the background is less than m. And the s and the m are positive integers, and the mobile terminals of the s and the m are preset data according to developers or users.
1-3) when s is not less than m, determining the first m application programs running in the background of the mobile terminal as the first application program
1-4) when s is smaller than m, determining s application programs running in the background of the mobile terminal as a first application program;
1-5) acquiring application program running information according to the determined first application program.
1-6) acquiring the position information and the application program running information as first terminal description information.
In the embodiment of the invention, the mobile terminal continues to execute the steps 1-5) and 1-6) after the step 1-2) is selected to execute the step 1-3) or execute the steps 1-4), the step 1-3) or execute the step 1-4) according to the magnitude relation between the value s and the value m. For example, a developer or a user may set m to 3, meaning that 3 functionality controls need to be displayed after the multimedia file is completely collected. s is the number of the current applications running in the background of the mobile terminal, and if the operating system loaded in the mobile terminal is an android system and 5 applications are stored in the active stack and an application runs in the foreground, it indicates that the current programs running in the background of the mobile terminal are 4 (i.e., a difference value of 5 to 1), and are respectively an "a application", a "B application", a "C application", and a "D application". When s is not less than m, step 3) is executed, that is, the first 3 applications are acquired from the top of the active stack to the bottom of the stack, namely, the applications are "a application", "B application", and "C application", respectively. For another example, when the number of applications running in the background is 2, the mobile terminal determines the two applications as the first application because the number s of applications running in the background is less than the value m.
Optionally, in another possible manner of the embodiment of the present invention, when the application running information is used to indicate n applications that have run in the foreground in the mobile terminal within a preset time period, the mobile terminal may obtain the first terminal description information through the following steps.
2-1) acquiring position information when the mobile terminal collects the multimedia file;
2-2) determining n application programs which are operated in the foreground of the mobile terminal within a preset time period as first application programs, wherein n is a positive integer;
2-3) acquiring application program running information according to the determined first application program;
2-4) acquiring the position information and the application program running information as first terminal description information.
In the embodiment of the invention, the mobile terminal can take the application program running in the background as the first application program, and the mobile terminal can also take the application program running in the foreground of the mobile terminal in a preset time period as the first application program. For example, if the predetermined time period is 10 minutes, the mobile terminal may determine the applications that have been run in the foreground within 10 minutes of backtracking from the current system time by reading the application running record. For example, the value n is preset to be 3 in the mobile terminal. If the mobile terminal runs the "E application program", "F application program", and "G application program" in the foreground within the above 10 minutes, the mobile terminal determines the above 3 application programs as the first application program, and if the preset limited value n is 2, the mobile terminal determines the 2 application programs whose running time in the foreground is closest to the current system time as the first application program. For example, if the current system time is 18:00, the time when the "E application" starts to run in the foreground is 17:52, the time when the "F application" starts to run in the foreground is 17:56, the time when the "G application" starts to run in the foreground is 17:58, the mobile terminal determines the "F application" and the "G application" as the first application. Then, the mobile terminal will generate the running information of the application program, such as the program identifier set { F application program, G application program } according to the information of the first application program. Subsequently, the mobile terminal may acquire the location information and the application information as first terminal description information, and if the location information is an office area type, the first terminal description information may be a data set { (F application, G application), (office area) }.
And step 120, determining a first processing function control corresponding to the multimedia file according to the first terminal description information of the mobile terminal.
In the embodiment of the invention, the mobile terminal determines the first processing function control corresponding to the multimedia file according to the first terminal description information of the mobile terminal. It should be noted that the execution time of this step is executed in the process of acquiring the multimedia file by the mobile terminal. Namely, in the process of acquiring the multimedia file by the mobile terminal, the mobile terminal determines a first processing function control corresponding to the multimedia file according to the first terminal description information of the mobile terminal. For example, when the mobile terminal starts a camera and a shutter is triggered, the mobile terminal determines a first function processing control corresponding to the multimedia file according to the first terminal description information. For another example, after the mobile terminal starts a camera and starts to shoot a video file, the mobile terminal determines a first function processing control corresponding to the multimedia file according to the first terminal description information. For another example, when the mobile terminal starts a microphone recording, the mobile terminal determines a first function processing control corresponding to the multimedia file according to the first terminal description information.
Optionally, please refer to fig. 2, which is a table of correspondence between the first terminal description information and the first processing function control according to the embodiment shown in fig. 1. In the table shown in fig. 2, X1 represents "application launch information", X2 represents "location information", and Y represents "first processing functionality control", where Y takes 3 and represents 3 first processing functionality controls. In the table shown in fig. 2, there are listed 13 possible correspondences. Under the corresponding relation, the mobile terminal determines the corresponding first processing function control by table lookup according to the specific contents of X1 and X2 in the first terminal description information.
For the data listed in the table for X1, a1 represents an entertainment game type application, a2 represents an office application type application, A3 represents a chat social type application, a4 represents a video play type application, a5 represents a financial financing type application, a6 represents a shopping application type application, a7 represents a map navigation type application, A8 represents a learning education type application, and a9 represents a book reading type application.
For the data of X2 column in the table, L1 represents a residential area type, L2 represents an office area type, L3 represents a mall area type, L4 represents a school area type, L5 represents an attraction area type, L6 represents a dining area type, L7 represents a bank area type, L8 represents a hospital area type, L9 represents a theater area type, L10 represents a station area type, L11 represents a hotel area type, L12 represents a recreation area type, and L13 represents a road area type.
For the data of the Y column in the table, C1 represents a copy function control, C2 represents a share function control, C3 represents a text recognition function control, C4 represents a voice recognition function control, C5 represents an attachment addition function control, C6 represents a create folder function control, and C7 represents an image beautification function control.
For example, taking the first line of data as an example, "application running information" is an entertainment game type application and a chat social type application, and "location information" is a residential area type. Under the first terminal description information, the corresponding first processing function controls are a sharing function control, an image beautifying function control and a copying function control. After the user takes photos or records videos in a residential area such as a home, the user can directly see the sharing function control, the image beautifying function control and the copying function control in the user interface, so that the steps of user operation are saved, and the processing efficiency of the multimedia files is improved.
And step 130, after the mobile terminal finishes collecting the multimedia file, displaying the first processing function control.
In the implementation of the invention, the mobile terminal displays the first processing function control after the multimedia file is acquired. After the mobile terminal finishes collecting the multimedia files, the mobile terminal has a corresponding user interface according to the types of the multimedia files. Therefore, the mobile terminal displays the first processing function control in the corresponding user interface according to the corresponding use scene.
In a possible manner of the embodiment of the present invention, when the mobile terminal finishes shooting a picture file, finishes shooting a video file, or finishes recording an audio file, the terminal may pop up a specified number of first function processing controls in the current user interface. The display form can be a popup window, a suspension button, a side bar exhaling state or a notification bar unfolding state and the like.
In summary, in this embodiment, when the mobile terminal collects a multimedia file, first terminal description information of the mobile terminal is obtained, where the first terminal description information includes application program running information and location information, the application program running information is used to indicate a first application program running in the mobile terminal, and the location information is used to indicate a current geographic location of the mobile terminal; determining a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal; and after the mobile terminal finishes collecting the multimedia file, displaying the first processing function control. The method and the device can solve the problems that the steps are complicated and the processing efficiency is low when the multimedia file needs to be displayed or processed by the mobile terminal; the mobile terminal can acquire the running information and the position information of the application program when acquiring the multimedia file and can display the corresponding first processing function control when acquiring the multimedia file, so that the embodiment of the invention can enable the mobile terminal to intelligently display the processing function control corresponding to the acquired multimedia file, thereby realizing the effects of saving user operation steps and improving the processing efficiency of the multimedia file.
The embodiment of the invention also provides a control display method, which can train a prediction model through a machine learning method, so that the mobile terminal can determine the first processing function control more intelligently by using the trained model.
Please refer to fig. 3, which is a flowchart illustrating another control presentation method according to an exemplary embodiment of the present invention. The control display method comprises the following steps.
In the implementation of the present invention, the execution process of step 301 is the same as the execution process of step 110, and is not described herein again.
Schematically, the information processing flow diagram is described with reference to the terminal shown in fig. 4. The terminal description information input into the prediction model may have several sets, and the several sets of terminal description information are input into the prediction model. It should be noted that the terminal description information may be preprocessed before being input into the prediction model. In the preprocessing, the mobile terminal converts the format of the terminal description information into a format that meets the requirements of the prediction model. In an embodiment of the present invention, the mobile terminal may input terminal description information into the prediction model. And after the terminal description information is processed by the prediction model, outputting a first processing function control.
The prediction model is a machine learning model obtained by training a first training sample in advance, and the training sample includes terminal description information labeled with a corresponding processing function control. The prediction model may be implemented by any algorithm with classification capability, which is not limited in this embodiment.
And 303, displaying the first processing function control after the mobile terminal finishes collecting the multimedia file.
In the implementation of the present invention, the execution process of step 303 is the same as the execution process of step 130, and is not described herein again.
And step 306, training the prediction model through the second training sample to obtain an updated prediction model.
In the embodiment of the invention, the mobile terminal can train the prediction model through the second training sample when the processor resource occupation is lower than the specified threshold value, so as to obtain the updated prediction model. The specified threshold may be a preset value such as 30% or 40%.
In one possible implementation of the embodiment of the invention, the prediction model can perform information interaction with other program components. Please refer to fig. 5, which is a schematic diagram of data transmission according to the embodiment shown in fig. 3. In fig. 5, four stages of data transfer in time are represented using reference numerals S1 to S4, and the multimedia file collection application in the mobile terminal first transfers a notification message to the predictive model that collection of a multimedia file has started after collection of the multimedia file has started. Alternatively, in another possible implementation, the processor in the terminal may actively obtain a message that the multimedia file starts to be collected. Subsequently, the processor in the mobile terminal may obtain the position information from the satellite navigation chip, and then read the application program running information from the memory. The processor then inputs the location information and the application run information (i.e., the first terminal description information) into the predictive model. And the prediction model determines a corresponding first processing function control according to the first terminal description information, and after the prediction model determines the first processing function control, the prediction model feeds back the identifier of the first processing function control to the processor. And after obtaining the identifier of the first processing function control, the processor displays the first processing function control on the corresponding user interface.
To sum up, in the control display method provided in this embodiment, when a mobile terminal collects a multimedia file, first terminal description information of the mobile terminal is obtained, where the first terminal description information includes application program running information and location information, the program running information and the location information are input into a prediction model, and a first processing function control corresponding to the multimedia file is obtained, where the prediction model is a machine learning model obtained by training a first training sample in advance, the first training sample includes terminal description information labeled with a corresponding processing function control, after the collection of the multimedia file by the mobile terminal is completed, the first processing function control is displayed, whether the first processing function control is triggered or not is detected, when the first processing function control is triggered, a second training sample is generated, and the second training sample includes the first terminal description information labeled with the first processing function control, and training the prediction model through the second training sample to obtain an updated prediction model, and training the prediction model again by using the second training sample. Therefore, the intelligent degree of the prediction model can be closer to the use habit of the user along with the use of the user, and the intelligent degree of providing the first processing function control is improved on the basis of improving the processing efficiency of the multimedia file.
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.
Referring to fig. 6, a block diagram of a control presentation apparatus, which may be implemented as part or all of a terminal through software, hardware, or a combination of the two, according to an embodiment of the present application is shown. The apparatus may include: information acquisition module 610, control determination module 620, and control presentation module 630.
The information acquiring module 610 is configured to acquire first terminal description information of a mobile terminal when the mobile terminal acquires a multimedia file, where the first terminal description information includes application program running information and location information, the application program running information is used for indicating a first application program running in the mobile terminal, and the location information is used for indicating a geographic location where the mobile terminal is currently located;
a control determining module 620, configured to determine a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal;
a control display module 630, configured to display the first processing function control after the mobile terminal finishes collecting the multimedia file;
optionally, the control determining module 620 is configured to input the program running information and the position information into a prediction model, and obtain the first processing function control corresponding to the multimedia file, where the prediction model is a machine learning model obtained by training a first training sample in advance, and the first training sample includes terminal description information labeled with the corresponding processing function control.
Optionally, the apparatus further comprises a detection module, a generation module and a training module;
the detection module configured to detect whether the first processing functionality control is triggered;
the generating module is configured to generate a second training sample when the first processing function control is triggered, where the second training sample contains the first terminal description information marked with the first processing function control;
the training module is configured to train the prediction model through the second training sample to obtain an updated prediction model.
Optionally, the information obtaining module 610 is configured to obtain the location information when the mobile terminal collects a multimedia file; detecting whether the number s of application programs running in the background of the mobile terminal is less than m, wherein s and m are positive integers; when s is not less than m, determining the first m application programs running in the background of the mobile terminal as the first application program; when s is smaller than m, determining s application programs running in the background of the mobile terminal as the first application program; acquiring the application program running information according to the determined first application program; and acquiring the position information and the application program running information as the first terminal description information.
Optionally, the information obtaining module 610 is configured to obtain the location information when the mobile terminal collects a multimedia file; determining n application programs which are operated in a foreground in the mobile terminal within a preset time period as the first application program, wherein n is a positive integer; acquiring the application program running information according to the determined first application program; and acquiring the position information and the application program running information as the first terminal description information.
Optionally, the multimedia file related to the apparatus includes: at least one of a picture file, a video file, and an audio file.
Optionally, the application running information related to the apparatus includes a program type, and the program type is used for indicating a design purpose of the first application.
Optionally, the type of program involved by the apparatus comprises at least one of the following types: entertainment game type, office application type, chat social type, video playing type, financial financing type, shopping application type, map navigation type, learning education type and book reading type.
Optionally, the location information related to the apparatus includes a region type, and the region type is used to indicate a geographic region where the mobile terminal is currently located.
Optionally, the type of area involved by the apparatus comprises at least one of the following types: home zone type, office zone type, mall zone type, school zone type, attraction zone type, dining zone type, bank zone type, hospital zone type, theater zone type, station zone type, hotel zone type, attraction zone type, and road zone type.
Optionally, the processing functionality control involved in the apparatus comprises at least one of the following functionality controls: copying function control, sharing function control, character recognition function control, voice recognition function control, accessory adding function control, folder creating function control and image beautifying function control.
The present application further provides a computer-readable medium, on which program instructions are stored, and when the program instructions are executed by a processor, the control display method provided by the above method embodiments is implemented.
The present application further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the control exhibition method provided by the above method embodiments.
Referring to fig. 7, a block diagram of a terminal according to an exemplary embodiment of the present application is shown. A terminal in the present application may include one or more of the following components: a processor 710, a memory 720, and a satellite navigation chip 730.
Optionally, the processor 710, when executing the program instructions in the memory 720, implements the control presentation method provided in the following method embodiments.
The Memory 720 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 720 includes a non-transitory computer-readable medium. The memory 720 may be used to store instructions, programs, code sets, or instruction sets. The memory 720 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the various method embodiments described above, and the like; the storage data area may store data created according to the use of the terminal, and the like.
The satellite navigation chip 730 may be at least one of a GPS system navigation chip, a BDS system navigation chip, a GLONASS system navigation chip, and a GALILEO system navigation chip.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (14)
1. A control display method is characterized by comprising the following steps:
when a mobile terminal collects a multimedia file, acquiring first terminal description information of the mobile terminal, wherein the first terminal description information comprises application program running information and position information, the application program running information is used for indicating a first application program which runs in a background or a foreground in the mobile terminal, and the position information is used for indicating the current geographic position of the mobile terminal;
determining a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal, wherein different application program running information corresponds to different first processing function controls, different position information corresponds to different first processing function controls, and the same application program running information and different position information correspond to different first processing function controls;
and displaying the first processing function control after the mobile terminal finishes collecting the multimedia file.
2. The method according to claim 1, wherein the determining the processing function control corresponding to the multimedia file according to the first terminal description information of the mobile terminal comprises:
and inputting the program running information and the position information into a prediction model to obtain the first processing function control corresponding to the multimedia file, wherein the prediction model is a machine learning model obtained by training through a first training sample in advance, and the first training sample comprises terminal description information marked with the corresponding processing function control.
3. The method of claim 2, further comprising:
detecting whether the first processing functionality control is triggered;
generating a second training sample when the first processing function control is triggered, wherein the second training sample contains the first terminal description information marked with the first processing function control;
and training the prediction model through the second training sample to obtain an updated prediction model.
4. The method according to claim 1, wherein the obtaining the first terminal description information of the mobile terminal when the mobile terminal collects the multimedia file comprises:
when the mobile terminal collects the multimedia file, the position information is obtained;
detecting whether the number s of application programs running in the background of the mobile terminal is less than m, wherein s and m are positive integers;
when s is not less than m, determining the first m application programs running in the background of the mobile terminal as the first application program;
when s is smaller than m, determining s application programs running in the background of the mobile terminal as the first application program;
acquiring the application program running information according to the determined first application program;
and acquiring the position information and the application program running information as the first terminal description information.
5. The method according to claim 1, wherein the obtaining the first terminal description information of the mobile terminal when the mobile terminal collects the multimedia file comprises:
when the mobile terminal collects the multimedia file, the position information is obtained;
determining n application programs which are operated in a foreground in the mobile terminal within a preset time period as the first application program, wherein n is a positive integer;
acquiring the application program running information according to the determined first application program;
and acquiring the position information and the application program running information as the first terminal description information.
6. The method according to any of claims 1 to 5, wherein the multimedia file comprises: at least one of a picture file, a video file, and an audio file.
7. The method according to any one of claims 1 to 5, wherein the application running information includes a program type indicating a design use of the first application.
8. The method of claim 7, wherein the program type comprises at least one of the following types:
entertainment game type, office application type, chat social type, video playing type, financial financing type, shopping application type, map navigation type, learning education type and book reading type.
9. The method according to any of claims 1 to 5, wherein the location information comprises a zone type, and the zone type is used for indicating a geographical area where the mobile terminal is currently located.
10. The method of claim 9, wherein the region type comprises at least one of the following types:
home zone type, office zone type, mall zone type, school zone type, attraction zone type, dining zone type, bank zone type, hospital zone type, theater zone type, station zone type, hotel zone type, attraction zone type, and road zone type.
11. The method of any of claims 1 to 5, wherein the processing functionality control comprises at least one of:
copying function control, sharing function control, character recognition function control, voice recognition function control, accessory adding function control, folder creating function control and image beautifying function control.
12. An apparatus for presenting controls, the apparatus comprising:
the information acquisition module is configured to acquire first terminal description information of a mobile terminal when the mobile terminal acquires a multimedia file, wherein the first terminal description information comprises application program running information and position information, the application program running information is used for indicating a first application program which runs in a background or a foreground in the mobile terminal, and the position information is used for indicating the current geographic position of the mobile terminal;
the control determining module is configured to determine a first processing function control corresponding to the multimedia file according to first terminal description information of the mobile terminal, wherein different application program running information corresponds to different first processing function controls, different position information corresponds to different first processing function controls, and the same application program running information and different position information correspond to different first processing function controls;
and the control display module is configured to display the first processing function control after the mobile terminal finishes collecting the multimedia file.
13. A terminal, comprising a processor, a memory coupled to the processor, and program instructions stored on the memory, wherein the processor, when executing the program instructions, implements the control presentation method of any of claims 1 to 11.
14. A computer-readable storage medium, having stored thereon program instructions which, when executed by a processor, implement the control presentation method of any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711470404.7A CN108536343B (en) | 2017-12-29 | 2017-12-29 | Control display method and device, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711470404.7A CN108536343B (en) | 2017-12-29 | 2017-12-29 | Control display method and device, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108536343A CN108536343A (en) | 2018-09-14 |
| CN108536343B true CN108536343B (en) | 2020-06-09 |
Family
ID=63489833
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711470404.7A Expired - Fee Related CN108536343B (en) | 2017-12-29 | 2017-12-29 | Control display method and device, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108536343B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111079053A (en) * | 2019-12-19 | 2020-04-28 | 北京安兔兔科技有限公司 | Product information display method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103019542A (en) * | 2012-11-28 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method for quickly photographing under screen locking interface |
| WO2015132622A1 (en) * | 2014-03-02 | 2015-09-11 | Onesnaps Technology Private Limited | Single mode & automatically visual media capture and excuting associate functions(s) |
| CN106855771A (en) * | 2015-12-09 | 2017-06-16 | 阿里巴巴集团控股有限公司 | A kind of data processing method, device and intelligent terminal |
| CN107045444A (en) * | 2017-04-18 | 2017-08-15 | 广东小天才科技有限公司 | A kind of application program recommends method and device |
| CN107295170A (en) * | 2017-06-20 | 2017-10-24 | 维沃移动通信有限公司 | The display methods and electronic equipment of a kind of touch-control bar |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107172367A (en) * | 2016-03-07 | 2017-09-15 | 赛尔莱博股份有限公司 | Image generating method and device with the geographical paster based on positional information |
-
2017
- 2017-12-29 CN CN201711470404.7A patent/CN108536343B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103019542A (en) * | 2012-11-28 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method for quickly photographing under screen locking interface |
| WO2015132622A1 (en) * | 2014-03-02 | 2015-09-11 | Onesnaps Technology Private Limited | Single mode & automatically visual media capture and excuting associate functions(s) |
| CN106855771A (en) * | 2015-12-09 | 2017-06-16 | 阿里巴巴集团控股有限公司 | A kind of data processing method, device and intelligent terminal |
| CN107045444A (en) * | 2017-04-18 | 2017-08-15 | 广东小天才科技有限公司 | A kind of application program recommends method and device |
| CN107295170A (en) * | 2017-06-20 | 2017-10-24 | 维沃移动通信有限公司 | The display methods and electronic equipment of a kind of touch-control bar |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108536343A (en) | 2018-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11483268B2 (en) | Content navigation with automated curation | |
| CN110286976B (en) | Interface display method, device, terminal and storage medium | |
| CN111476306B (en) | Object detection method, device, equipment and storage medium based on artificial intelligence | |
| CN110168530B (en) | Electronic device and method of operating the same | |
| CN106575361B (en) | Method for providing visual sound image and electronic equipment for implementing the method | |
| CN109189879B (en) | Electronic book display method and device | |
| CN105808782A (en) | Adding method and device for picture labels | |
| US10769196B2 (en) | Method and apparatus for displaying electronic photo, and mobile device | |
| KR20180049786A (en) | Data recognition model construction apparatus and method for constructing data recognition model thereof, and data recognition apparatus and method for recognizing data thereof | |
| CN112214636A (en) | Audio file recommendation method and device, electronic equipment and readable storage medium | |
| CN111506758A (en) | Method and device for determining article name, computer equipment and storage medium | |
| US20190012347A1 (en) | Information processing device, method of processing information, and method of providing information | |
| CN112188228A (en) | Live broadcast method and device, computer readable storage medium and electronic equipment | |
| CN111276168B (en) | Electronic device for generating video including character and method thereof | |
| CN111800445B (en) | Message pushing method and device, storage medium and electronic equipment | |
| KR102316846B1 (en) | Method for sorting a media content and electronic device implementing the same | |
| CN111950255B (en) | Poem generation method, device, equipment and storage medium | |
| EP2960816A1 (en) | Method and apparatus for managing data | |
| CN108536343B (en) | Control display method and device, terminal and storage medium | |
| KR20170098113A (en) | Method for creating image group of electronic device and electronic device thereof | |
| CN116580707A (en) | Method and device for generating action video based on voice | |
| CN108255917B (en) | Image management method and device and electronic device | |
| CN110837557A (en) | Abstract generation method, device, equipment and medium | |
| KR102348852B1 (en) | Method for extracting objects and apparatus therefor | |
| US20210224310A1 (en) | Electronic device and story generation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200609 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |