CN109426522A - Interface processing method, device, equipment, medium and the operating system of mobile device - Google Patents

Interface processing method, device, equipment, medium and the operating system of mobile device Download PDF

Info

Publication number
CN109426522A
CN109426522A CN201710726005.6A CN201710726005A CN109426522A CN 109426522 A CN109426522 A CN 109426522A CN 201710726005 A CN201710726005 A CN 201710726005A CN 109426522 A CN109426522 A CN 109426522A
Authority
CN
China
Prior art keywords
interface
mobile device
image
external environment
background
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710726005.6A
Other languages
Chinese (zh)
Inventor
杭旭晨
胡旭升
吴凡
李鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Banma Zhixing Network Hongkong Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201710726005.6A priority Critical patent/CN109426522A/en
Publication of CN109426522A publication Critical patent/CN109426522A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/001Texturing; Colouring; Generation of texture or colour

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the present application provides interface processing method, device, equipment, medium and the operating system of a kind of mobile device, and method therein specifically includes: obtaining the corresponding image of external environment of mobile device;According to the corresponding image of the external environment, determine that at least partly the background image of interface element, the tone of the background image and the tone of the external environment corresponding image match in the interface of the mobile device;At least partly background of interface element is set in the interface of the mobile device by the background image.The clarity and readability at the interface of mobile device can be improved in the embodiment of the present application.

Description

Interface processing method, device, equipment, medium and the operating system of mobile device
Technical field
This application involves mobile device technologys, interface processing method, one kind more particularly to a kind of mobile device The interface processor unit of mobile device, a kind of equipment, a kind of machine readable media and a kind of operating system based on equipment.
Background technique
With the development of mobile device technology, the function of the mobile units such as reverse image, automobile data recorder becomes increasingly abundant, because This brings great convenience to user.Current mobile unit would generally provide UI (user interface, User Interface), no Only the contents such as operation interface, image, video can be showed by boundary's user oriented of mobile unit, but also may be implemented man-machine Interaction.
In practical applications, the interface of mobile unit is easy to be influenced by vehicle external environment, and then influences user for vehicle Carry the normal use of equipment.For example, the interface of mobile unit is easy to cause not see when vehicle external environment is excessively bright, for another example, work as vehicle It is easy to cause the interface of mobile unit excessively dazzling etc. when external environment is excessively dark again.
Summary of the invention
The technical problem to be solved in the embodiments of the present application is that providing a kind of interface processing method of mobile device, Ke Yiti The clarity and readability at the interface of high mobile device.
Correspondingly, the embodiment of the present application also provides a kind of interface processor unit of mobile device, equipment, machine readable Jie Matter and operating system for equipment, to guarantee the implementation and application of the above method.
To solve the above-mentioned problems, the embodiment of the present application discloses a kind of interface processing method of mobile device, comprising:
Obtain the corresponding image of external environment of mobile device;
According to the corresponding image of the external environment, at least partly interface element is determined in the interface of the mobile device Background image, the tone of the background image and the tone of the external environment corresponding image match;
At least partly background of interface element is set in the interface of the mobile device by the background image.
The embodiment of the present application also discloses a kind of interface processor unit of mobile device, comprising:
Image collection module, the corresponding image of external environment for obtaining mobile device;
Background image determining module, for determining the boundary of the mobile device according to the corresponding image of the external environment At least partly background image of interface element in face, the color of the tone of the background image and the external environment corresponding image Phase modulation matching;And
Background setup module, for setting the background image in the interface of the mobile device at least partly interface The background of element.
The embodiment of the present application also discloses a kind of equipment, comprising:
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors When, so that the equipment executes method described in aforementioned one or more.
The embodiment of the present application also discloses one or more machine readable medias, is stored thereon with instruction, when by one or When multiple processors execute, so that equipment executes method described in aforementioned one or more.
The embodiment of the present application also discloses a kind of operating system for equipment, comprising:
Image acquisition unit, the corresponding image of external environment for obtaining mobile device;
Background image determination unit, for determining the boundary of the mobile device according to the corresponding image of the external environment At least partly background image of interface element in face, the color of the tone of the background image and the external environment corresponding image It adjusts consistent;And
Background setting unit, for setting the background image in the interface of the mobile device at least partly interface The background of element.
The embodiment of the present application also discloses a kind of interface processing method of mobile device, comprising: obtains the outer of mobile device The corresponding information of portion's environment;According to the corresponding information of the external environment, determine in the interface of the mobile device at least partly The background image of interface element, the tone phase that the tone of the background image is characterized with information corresponding to the external environment Match;At least partly background of interface element is set in the interface of the mobile device by the background image.
The embodiment of the present application also discloses a kind of interface processor unit of mobile device, comprising:
Data obtaining module, the corresponding information of external environment for obtaining mobile device;
Background image determining module, for determining the boundary of the mobile device according to the corresponding information of the external environment Information institute table corresponding at least partly background image of interface element in face, the tone of the background image and the external environment The tone of sign matches;
Background image setup module, for setting the background image in the interface of the mobile device at least partly The background of interface element.
The embodiment of the present application also discloses a kind of equipment, comprising:
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors When, so that the equipment executes method described in aforementioned one or more.
The embodiment of the present application also discloses one or more machine readable medias, is stored thereon with instruction, when by one or When multiple processors execute, so that equipment executes method described in aforementioned one or more.
The embodiment of the present application also discloses a kind of operating system for equipment, comprising:
Information acquisition unit, the corresponding information of external environment for obtaining mobile device;
Background image determination unit, for determining the boundary of the mobile device according to the corresponding information of the external environment Information institute table corresponding at least partly background image of interface element in face, the tone of the background image and the external environment The tone of sign matches;
Background image setting unit, for setting the background image in the interface of the mobile device at least partly The background of interface element.
Compared with existing scheme, the embodiment of the present application includes the following advantages:
At least partly background image corresponding to the background at the interface of interface element in mobile device in the embodiment of the present application Tone and the tone of external environment correspondence image can match, therefore at least partly interface element in the interface of the embodiment of the present application Can be adapted with external environment, in this way, it is possible to prevente effectively from the excessively bright interface for leading to mobile device of external environment do not see, with And external environment secretly leads to excessively dazzling etc. the situations in the interface of mobile device excessively, therefore can be improved mobile device interface it is clear Clear degree and readability, that is, the compatible degree between the interface of mobile device and external environment can be improved in the embodiment of the present application, into And the interface of intelligence beauty can be provided a user.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoided The unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
Detailed description of the invention
Fig. 1 is a kind of step flow chart of the interface processing method embodiment of mobile device of the application;
Fig. 2 is a kind of step flow chart of the interface processing method embodiment of mobile device of the application;
Fig. 3 is a kind of step flow chart of the interface processing method embodiment of mobile device of the application;
Fig. 4 is a kind of structural block diagram of the interface processor unit embodiment of mobile device of the application;
Fig. 5 is a kind of structural block diagram of the interface processor unit embodiment of mobile device of the application;
Fig. 6 is the hardware structural diagram for the mobile device that one embodiment of the application provides;
Fig. 7 is the hardware structural diagram for the mobile device that another embodiment of the application provides;
Fig. 8 is the schematic diagram for the operating system that one embodiment of the application provides;
Fig. 9 is the schematic diagram for the operating system that another embodiment of the application provides;.
Specific embodiment
In order to make the above objects, features, and advantages of the present application more apparent, with reference to the accompanying drawing and it is specific real Applying mode, the present application will be further described in detail.
In the embodiment of the present application, background can be used for indicating the bottom at interface;Prospect is on the background at interface, for rendering The content for needing to show;Background image is used to indicate to be used to draw the bottom figure at the position of corresponding interface element in interface Picture.Interface element refers to the series of elements for meeting user's interactive requirements that the interface that can meet interaction demand is included, interface The example of element may include: window, dialog box, menu, scroll bar, figure etc..
The embodiment of the present application provides a kind of interface processing scheme of mobile device, the available mobile device of the program The corresponding image of external environment;According to the corresponding image of the external environment, at least portion is determined in the interface of the mobile device The background image of boundary surface element, the tone of the background image and the tone of the external environment corresponding image match; At least partly background of interface element is set in the interface of the mobile device by the background image;Since the application is implemented In example in the interface of mobile device at least partly the tone of background image corresponding to the background of interface element and external environment it is right Answering the tone of image can match, therefore at least partly interface element can be in the interface of mobile device in the embodiment of the present application The external environment of mobile device is adapted, in this way, it is possible to prevente effectively from the excessively bright interface for leading to mobile device of external environment is seen not Clearly and external environment secretly leads to excessively dazzling etc. the situations in the interface of external equipment excessively, therefore can be improved the boundary of mobile device The clarity and readability in face;Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application The unintelligible bring security risk in interface can also be avoided, the safety of driving is improved.
In the embodiment of the present application, mobile device usually has a display screen, can be used family obtain whenever and wherever possible it is various Information.Above-mentioned mobile device specifically includes but unlimited: (dynamic image is special by smart phone, tablet computer, E-book reader, MP3 Family's compression standard audio level 3, Moving Picture Experts Group Audio Layer III) player, MP4 (dynamic image expert's compression standard audio level 4, Moving Picture Experts Group Audio Layer IV) is broadcast It puts device, pocket computer on knee, intelligent automobile, mobile unit, desktop computer, set-top box, intelligent TV set, wearable set It is standby etc..
The embodiment of the present application is mainly illustrated the interface processing scheme of mobile device by taking mobile unit as an example.It is vehicle-mounted to set The standby electronic equipment that can be used for indicating to be applied to vehicle, the mobile unit can provide a user vehicle-mounted user's navigation, driving note Record, phone, music, online FM (frequency modulation, Frequency Modulation), weather, the functions such as take pictures;Also, this is vehicle-mounted to set It is standby that UI can be provided, not only the contents such as operation interface, image, video can be showed to user by UI, but also may be implemented Human-computer interaction.According to some embodiments, the example of above-mentioned mobile unit may include: that automatic navigator, driving recording, intelligence are complete Shield rearview mirror, electronic eyes, reversing radar, vehicle-carrying DVD (digital versatile disc, Digital Versatile Disc) etc..
The example of onboard operations system corresponding to above-mentioned mobile unit may include: WinCE, Linux, IOS, Android, YunOS, QNX etc., above-mentioned onboard operations system can be user and vehicle-mounted hardware interface, while may be vehicle-mounted hardware and The interface of upper layer software (applications);The function of above-mentioned onboard operations system may include: to manage hardware, software and the data money of onboard system Source, the operation of control program, improve man-machine interface, provide for upper layer software (applications) support, allow mobile device resource and receive number According to, signal, audio, video play a role to the maximum extent, various forms of UI are provided, good driving ring is provided a user Border, and auxiliary driving, semi-automatic driving, even automatic Pilot are effectively provided.It is appreciated that the embodiment of the present application is for specific Mobile device and its corresponding onboard operations system it is without restriction.
Referring to Fig.1, a kind of step flow chart of the interface processing method embodiment of mobile device of the application is shown, is had Body may include steps of:
Step 101, the corresponding image of external environment for obtaining mobile device;
Step 102, according to the corresponding image of the external environment, determine in the interface of the mobile device at least partly boundary The background image of surface element, the tone of the background image and the tone of the external environment corresponding image match;
The background image is set in the interface of the mobile device at least partly back of interface element by step 103 Scape.
In the embodiment of the present application, external environment can be used for indicating external environment locating for mobile device, optionally, above-mentioned outer Portion's environment may include: the ambient enviroment of mobile device, for example, the front and/or rear of mobile device and/or side and/or The environment of lower section.
In practical applications, step 101 can obtain the corresponding image of external environment by camera.Optionally, above-mentioned Camera may include: front camera and/or rear camera and/or side view camera and/or lower section camera etc., can be with Understand, the quantity of above-mentioned front camera and/or rear camera and/or side view camera and/or lower section camera can be One or more.By above-mentioned front camera and/or rear camera and/or side view camera and/or lower section camera, The corresponding image of environment in the front and/or rear and/or side and/or lower section of external environment can be obtained respectively.
According to some embodiments, the corresponding image of external environment that camera can be acquired in real time, as external environment Corresponding image;However, the mode of above-mentioned acquisition image, by operation spent by the easy interface processing for increasing mobile device Amount.
In practical applications, external environment can be corresponding with and hold time, the internal and external environment of holding time can not It changes or occurs small change.For example, vehicle, during straight trip, the environment in front of mobile unit can be one It does not change in fixing time or occurs small change.Therefore, in order to reduce spent by the interface processing of mobile device Operand, some embodiments of the present application can realize the interface processing frequency for mobile device by the acquisition process of image The control of rate.
In a kind of alternative embodiment of the application, acquisition side corresponding to the corresponding image of above-mentioned acquisition external environment Formula can specifically include:
The corresponding figure of external environment of acquisition modes 1, the mobile device acquired according to the first during cycle, acquisition camera Picture, the corresponding image of external environment as mobile device;And/or
Acquisition modes 2, the corresponding video of external environment for obtaining the mobile device that camera acquires, according in the video Similarity between adjacent two frame obtains the corresponding image of external environment of mobile device from the video;And/or
Acquisition modes 3, according to the second during cycle, the corresponding video of external environment of the mobile device acquired from camera Middle extraction first frame obtains the external environment of mobile device according to the similarity between adjacent first frame from the first frame Corresponding image.
Acquisition modes 1 can carry out the acquisition of image according to the first during cycle;First during cycle can be by this field Technical staff sets according to practical application request, can also be set by the user, for example, first during cycle can be 60s, 90s Deng.Alternatively, being expert under the scape of parking lot, first during cycle can also be determined according to speed and running distance, the first preset week Phase can be inversely proportional with speed, and directly proportional to running distance, it will be understood that the embodiment of the present application is preset for specific first Period and its method of determination are without restriction.
Acquisition modes 2 can obtain external according to the similarity between two frame adjacent in the video from the video The corresponding image of environment meets prerequisite namely changes greatly it is possible thereby to monitor to obtain the similarity between adjacent two frame Frame, the corresponding image of external environment as mobile device.
Acquisition modes 3 can be first, in accordance with the second during cycle, from the corresponding video of external environment that camera acquires First frame is extracted, the number of first frame can be greater than 1.It is alternatively possible to first frame is stored in the first store path, for reading It takes.Each first frame can then be read from first store path, and according to the similarity between adjacent first frame, from described the The corresponding image of external environment is obtained in one frame.Since first frame is the video frame extracted according to the second during cycle, therefore The extraction of first frame can play the screening effect of video frame, obtain external environment from the first frame in this way, can reduce The operand of corresponding image.In a kind of application example of the application, it is assumed that video frame includes: F1、F2、…Fi..., wherein I is positive integer, it assumes that the second during cycle is 10 video frames corresponding time, that is, can mention every 10 video frames A first frame is taken, then can extract F1、F11、F21、F31Etc. video frames as first frame, and calculate adjacent first frame (with F1With F11) between similarity.Wherein, the method for determination of the second during cycle is similar with the method for determination of the first during cycle mode, And therefore not to repeat here, cross-referenced.
In a kind of alternative embodiment of the application, the color of adjacent two frame (former frame and present frame) can be obtained respectively Histogram, the color histogram can be used for describing the distribution situation of tone in a frame image, can reveal that each in a frame image The appearance quantity of pixel under a gray scale;Further, it is possible to compare the color histogram of adjacent two frame by image recognition algorithm Figure, to obtain the color similarity between adjacent two frame, and it is current less than the first similarity threshold to get color similarity Frame, as image.For example, the color similarity may include: the difference between the appearance quantity of adjacent each tone of two frames, it is above-mentioned First similarity threshold can be determined by those skilled in the art according to practical application request.
In another alternative embodiment of the application, it can be directed to adjacent two frame, calculate the gray value of all pixels point The average value of difference obtains the gray scale difference average value of adjacent two frame, as the gray scale difference similarity between adjacent two frame, and obtains Present frame to similarity less than the second similarity threshold, as the corresponding image of external environment.
In a kind of application example of the application, the calculating process of gray value difference is referred to formula (1), and gray scale difference is flat The calculating process of mean value is referred to formula (2).
Yt=Xt-Xt-1 (1)
Wherein, XtAnd Xt-1Respectively indicate the present frame and former frame in adjacent two frame, YtIndicate XtAnd Xt-1Corresponding difference Image, the error image may include multiple pixels, and the value of each pixel represents gray value difference,Indicate the differential chart As corresponding gray scale difference average value, M and N respectively indicate the width and height of image, and i and j respectively indicate the row and column element of image Number.
It is appreciated that above-mentioned color similarity and gray scale difference similarity be intended only as in the embodiment of the present application adjacent two frame it Between similarity alternative embodiment, in fact, the embodiment of the present application is without restriction for the embodiments mode of similarity.
To sum up, above-mentioned acquisition modes 1 control the acquisition opportunity of the corresponding image of external environment, with pre- according to first The period is set to the subsequent corresponding image of step 102 offer external environment, it is possible thereby to realize the interface for mobile device Manage the control of frequency.Above-mentioned acquisition modes 2 can be obtained from the video according to the similarity between two frame adjacent in video The frame that similarity between adjacent two frame meets prerequisite namely changes greatly also can as the corresponding image of external environment The enough control for realizing the interface processing frequency for mobile device.Above-mentioned acquisition modes 3 can be in conjunction with acquisition modes 1 and acquisition side Formula 2 obtains the corresponding image of external environment.Therefore, above-mentioned acquisition modes 1, acquisition modes 2 and acquisition modes 3 can reduce Operand spent by the interface processing of mobile device.
It is appreciated that above-mentioned acquisition modes 1, acquisition modes 2 and acquisition modes 3 be intended only as obtaining external environment it is corresponding The alternative embodiment of image, in fact, the embodiment of the present application is not added for obtaining the detailed process of the corresponding image of external environment With limitation.
Step 102 can obtain the corresponding image of external environment according to step 101, determine in the interface of mobile device at least The background image of part interface element, wherein the tone of the background image acquired is corresponding with the external environment The tone of image can match.
In the embodiment of the present application, it is big color effect that tone, which refers to the general inclination of a width picture-in-picture complexion coloured silk,.Color Tune may include: dominant hue and/or auxiliary tone.
Wherein, dominant hue can be used for indicating the basic tendency of the primary color of image and the color appearance of image.One frame figure Although it is inclined that it for example is partially blue or partially red that image, which is generally to have a kind of tendency in color, as that can use multiple color Warm or colder etc., the basic tendency of color appearance is exactly the dominant hue of a frame image.For example, being transferred in terms of changes in temperature to mass-tone Row divides, available: " warm tones ", " cool tone " and " semi-tone ".Generally, red, orange, yellow is to indicate warm colour It adjusts;Green, blue, black indicate cool tone;And grey, purple, white then indicate semi-tone;The brightness of cool tone is higher, Its overall feeling is warmer, and warm-toned brightness is higher, and overall feeling is more colder.Auxiliary tone is only secondary and dominant hue vision The complementary colors of area is the auxiliary tone for setting off dominant hue by contrast, supporting dominant hue, playing fusion dominant hue effect.
The color of the tone image corresponding with external environment of the background image acquired due to the embodiment of the present application Tune can match, therefore can make that at least partly interface element is adapted with external environment in the interface of mobile device.Wherein, it carries on the back The tone of the tone of scape image image corresponding with external environment matches, and can specifically include: the tone of background image and outer The tone of the corresponding image of portion's environment is identical, similar or related.
It is above-mentioned according to the corresponding image of the external environment in a kind of alternative embodiment of the application, determine the shifting The process of at least partly background image of interface element may include: that the acquisition external environment is corresponding in the interface of dynamic equipment The tone of image;According to the tone, at least partly background image of interface element is generated in the interface of the mobile device.By It is generated in the tone that background image is foundation image, therefore the phase between the tone of background image and the tone of image may be implemented Matching.
The embodiment of the present application can use arbitrary tone acquisition methods, obtain the color of the corresponding image of the external environment It adjusts.For example, a kind of tone acquisition methods can first determine whether to constitute the color of each pixel of the corresponding image of external environment; Then, the tone of the corresponding image of external environment is determined using the pixel quantity of various colors, corresponding determination process can To include: the dominant hue by the maximum color of accounting as the corresponding image of external environment, wherein above-mentioned accounting can be image In certain color pixel quantity for being included account for the ratio of all pixels point quantity in image.It is appreciated that can be by accounting not It is the largest color, the auxiliary tone as the corresponding image of external environment.It is appreciated that the embodiment of the present application is for specific color Adjust acquisition methods without restriction.
The tone of image can be applied to the background image at the interface of mobile device by the embodiment of the present application, so that the background Image changes with external environment, and then provides a user the interface of clarity and readable preferable mobile device, is answering For drive a vehicle scene when, the safety of driving can also be improved.
According to some embodiments, the background image generated according to the tone can be the uniform background image of color, It can be the background image of linear gradient, wherein the stereovision of background image can be enhanced in the background image of linear gradient.
A kind of process of background image that linear gradient is generated according to tone is provided herein, wherein can extract tone HSV (i.e. coloration Hue, saturation degree Saturation and lightness Value), according to the HSV of tone, setting starting color and termination face Color, and linear color rendering device and gradual change direction are set, and then according to linear color rendering device and gradual change direction, by tone HSV change of gradient is carried out on painting canvas, to generate the background image of linear gradient.It is appreciated that the back of above-mentioned linear gradient The generating process of scape image is intended only as example, in fact, those skilled in the art can use arbitrary image processing tool To generate the background image of linear gradient according to tone, the embodiment of the present application is for the Background according to tone generation linear gradient The detailed process of picture is without restriction.
In a kind of embodiment of the application, the behaviour for the tone for obtaining described image can be executed respectively by different applications Make and generate according to the tone operation of background image, application herein may include: system application (operating system it is included or The application that person provides) and/or nonsystematic application (application of user installation).For example, first applies the available external rings The tone of the corresponding image in border, and send the tone to the second application, then second application can be raw according to the tone At background image.Wherein, the first application can send the tone to the second application by interprocess communication mode, optionally, Above-mentioned interprocess communication mode may include: broadcast, AIDL (Android Interface Definition Language, Android Interface Definition Language) etc..It is appreciated that the embodiment of the present application is for obtaining the corresponding image of the external environment The specific executing subject of the operation of tone and the operation according to tone generation background image is without restriction.
It is above-mentioned according to the corresponding image of the external environment in another alternative embodiment of the application, determine described in The process of at least partly background image of interface element may include: corresponding to the external environment in the interface of mobile device Image carries out Gaussian Blur processing, to obtain corresponding Gaussian Blur image, as at least portion in the interface of the mobile device The background image of boundary surface element.Since above-mentioned Gaussian Blur image is to carry out height on the basis of external environment corresponding image What this Fuzzy Processing obtained, therefore above-mentioned Gaussian Blur image can retain tone (such as mass-tone of the corresponding image of external environment Adjust), therefore matching between the tone for the tone image corresponding with external environment that background image may be implemented.
Also, above-mentioned Gaussian Blur processing can be by the pixel color in the corresponding image of external environment around certain pixel Value is got up by Gaussian curve statistics, and mathematically average weighted calculation method obtains the average color of this Gaussian curve for use, The color value of the pixel is adjusted to the average color, in this way, the color value of each pixel is taken being averaged for neighboring pixel Value, this is a kind of smoothing techniques of pixel color value, and the partial pixel point of the corresponding image of external environment is made to lose details, real Existing Gaussian Blur processing.Since the background image of the embodiment of the present application is to carry out height on the basis of external environment corresponding image What this Fuzzy Processing obtained, therefore can be improved the contrast between the background and prospect at the interface of mobile device, improve prospect Legibility and clarity.
The background image that step 103 can obtain step 102 is set as in the interface of the mobile device at least partly The background of interface element, to use the Background at least partly in the background of interface element in the interface of the mobile device Picture.In practical applications, background and prospect can be overlapped, to obtain the interface of mobile device.
In a kind of alternative embodiment of the application, the corresponding image of the external environment can be carried out by the first application high This Fuzzy Processing, to obtain corresponding Gaussian Blur image.Then the method can also include: that the first application is sent out to third application Send the store path of the Gaussian Blur image and/or the Gaussian Blur image;It is described to set institute for the background image The process for stating at least partly background of interface element in the interface of mobile device may include: that third is applied the Gaussian Blur Image is set as in the interface of the mobile device at least partly background of interface element.Wherein, the first application and the herein It can be identical or not that three applications, which can be applied for system application or nonsystematic application, third with the second application above-mentioned, Same application.First application can send the Gaussian Blur image and/or institute to third application by interprocess communication mode State the store path of Gaussian Blur image.
In another alternative embodiment of the application, the interface of the mobile device can be card form interface, described Card form interface may include at least one card, wherein as the interface element at the card form interface, card can be friendship The supporting body of mutual information, is usually presented in a manner of rectangle, and the form that the card of page format can be concentrated with one provides quick And relevant information;One of the characteristics of card is interactivity, that is, card can not only provide information, but also can be used Another mild and roundabout mode goes to require once to interact.
It is above-mentioned to set the movement for the background image in the case where the interface of mobile device is card form interface The process of at least partly background of interface element may include: in the interface of equipment
Set above-mentioned background image to the background of card in above-mentioned card form interface;And/or
Set above-mentioned background image to the wallpaper background at above-mentioned card form interface.
In the embodiment of the present application, wallpaper can be used for indicating background picture used in the display screen of mobile device, the application Embodiment can set above-mentioned background image to the wallpaper at entire card form interface, and/or, above-mentioned background image can be set It is set to the background of card included by above-mentioned card form interface.
It is appreciated that above-mentioned card form interface is intended only as the alternative embodiment at the interface of mobile device, in fact, arbitrarily Interface (such as list type interface) within the protection scope at the interface of the mobile device of the embodiment of the present application.
In another alternative embodiment of the application, the interface of above-mentioned mobile device may include multiple interfaces windows, Then different interfaces windows can correspond to same or different background image.Wherein, above-mentioned multiple interfaces windows can on to Under set gradually, interfaces windows above can be covered on following interfaces windows, and interfaces windows above can be according to It is hidden according to the operation of user.In the case where different interfaces windows correspond to different background images, the layer at interface can be enhanced Secondary sense.
In a kind of application example of the application, it is assumed that the interface of above-mentioned mobile device includes: the first interfaces windows and Second interface window, wherein the first interfaces windows are covered on second contact surface window;First interfaces windows state for rendering The system informations such as column, navigation bar, notice, second contact surface window can be used for presenting the content of application, such as system setting, desktop, lead The information of the applications such as boat, music, desktop are the applications of first starting after system is got up, and are mainly used for carrying by card and apply Icon, the information such as illustrate, by clicking card, corresponding application interface can be jumped to.In practical applications, mobile device Above-mentioned first interfaces windows and above-mentioned second contact surface window can be initialized respectively after actuation.Assuming that above-mentioned first interfaces windows and The first card and the second card are respectively arranged in above-mentioned second contact surface window, the size of usual first card is greater than the second card Size, then the background image of the first card and the second card can be same or different.
To sum up, the interface processing method of the mobile device of the embodiment of the present application, the external environment of available mobile device Corresponding image determines in the interface of the mobile device at least partly Interface Element according to the corresponding image of the external environment The background image of element, the tone of the background image and the tone of the external environment corresponding image match, and will be described Background image is set as in the interface of the mobile device at least partly background of interface element;Due at least portion in mobile device The tone of background image corresponding to the background at the interface of boundary surface element can match with the tone of external environment correspondence image, Therefore at least partly interface element can be adapted with external environment in the interface of the embodiment of the present application, in this way, it is possible to prevente effectively from The excessively bright interface for leading to mobile device of external environment is not seen and external environment secretly causes the interface of mobile device excessively to be pierced excessively The situations such as eye, therefore can be improved the clarity and readability at the interface of mobile device, that is, the embodiment of the present application can be improved Compatible degree between the interface and external environment of mobile device, and then the interface of intelligence beauty can be provided a user.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoided The unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
To make those skilled in the art more fully understand the embodiment of the present application, referring to Fig. 2, a kind of shifting of the application is shown The step flow chart of the interface processing method embodiment of dynamic equipment, in the embodiment, which can be mobile unit, should Mobile unit may include: built-in or external camera, can run multiple applications in the mobile unit, which sets The step of standby interface processing method embodiment, can be executed by multiple applications:
Step 201, driving recording apply the external environment of the mobile unit according to the second during cycle, acquired from camera First frame is extracted in corresponding video;
Step 202, driving recording apply the store path that first frame is sent to the first application;
For example, driving recording application can be to the store path of the first application broadcast first frame.
Step 203, the first application obtain external environment from the first frame according to the similarity between adjacent first frame Corresponding image;
First application can be any application of onboard operations system, can be used as driving recording and apply and the second application Perhaps the medium between third application can be used for providing the information of the background at interface to the second application or third application.
Step 204, the first application carry out Gaussian Blur processing to the corresponding image of the external environment, corresponding to obtain Gaussian Blur image;
Step 205, the first application send the store path of Gaussian Blur image to the second application;
For example, the first application can be to the store path of the second application broadcast Gaussian Blur image.
Step 206, the first application obtain the dominant hue of the corresponding image of the external environment;
Step 207, the first application send the dominant hue of the corresponding image of the external environment to third application;
The Gaussian Blur image is set in corresponding interface at least partly interface element by step 208, the second application Background;
Step 209, third apply the gradient that linear gradient is generated according to the dominant hue of the corresponding image of the external environment Image;
Step 210, third are applied using the gradient image of the linear gradient as at least partly Interface Element in correspondence interface The background of element.
According to some embodiments, the second application and third can be different interfaces windows using corresponding interface, for example, The second corresponding interface of application can be system interface, which can be used for presenting the systems such as status bar, navigation bar, notice Information, third can be desk interface using corresponding interface, which can be used for presenting the content of application.Optionally, Second application and third application can be respectively using the gradient images of Gaussian Blur image and linear gradient as the wall at corresponding interface Paper background, alternatively, second application and third application can respectively using the gradient image of Gaussian Blur image and linear gradient as The background of corresponding the included card in interface.
It should be noted that above-mentioned driving recording application, the first application, the second application and third application are intended only as this Shen Please embodiment mobile device interface processing method executing subject example, in fact, those skilled in the art can root According to practical application request, the interface processing method of the mobile device of the embodiment of the present application is executed using arbitrary executing subject, this Apply for that embodiment is without restriction for specific executing subject.
Referring to Fig. 3, a kind of step flow chart of the interface processing method embodiment of mobile device of the application is shown, is had Body may include steps of:
Step 301, the corresponding information of external environment for obtaining mobile device;
Step 302, according to the corresponding information of the external environment, determine in the interface of the mobile device at least partly boundary The background image of surface element, the tone phase that the tone of the background image is characterized with information corresponding to the external environment Match;
The background image is set in the interface of the mobile device at least partly back of interface element by step 303 Scape.
In practical applications, the corresponding information of the external environment be may include: image, and/or be obtained based on phonetic order The corresponding characteristic information of the external environment arrived.Wherein, image can shoot to obtain by camera;Phonetic order can be user Voice messaging, can be used for characterizing the corresponding characteristic information of external environment of mobile device.
In practical applications, above-mentioned phonetic order can be received by microphone or other voice collecting devices, alternatively, base The above-mentioned phonetic order of communications reception between equipment.And it is possible to by speech recognition technology, phonetic order is converted to pair The corresponding characteristic information of the external environment of the text answered, the text namely mobile device.
If phonetic order is denoted as S, corresponding phonetic feature sequence O is obtained after carrying out a series of processing to S, It is denoted as O={ O1, O2..., Oi..., OT, wherein OiIt is i-th of phonetic feature, T is phonetic feature total number.S pairs of phonetic order The sentence answered is considered as a word string being made of many words, is denoted as W={ w1, w2..., wn}.The process of speech recognition is exactly According to known phonetic feature sequence O, most probable word string W is found out.
Specifically, speech recognition is the process of a Model Matching, in this process, can be first according to the language of people Sound feature establishes speech model, by the analysis of the voice signal to input, extracts required feature, Lai Jianli speech recognition institute The template needed;The process that voice inputted to user is identified is by the feature of the inputted voice of user and the template ratio Compared with process, the finally determining optimal Template with the inputted voice match of the user, to obtain the result of speech recognition.Tool The speech recognition algorithm of body can be used the training and recognizer of the hidden Markov model based on statistics, base can also be used In the training of neural network and recognizer, based on the matched recognizer of dynamic time consolidation etc. other algorithms, the present invention Embodiment is without restriction for specific speech recognition process.
The embodiment of the present application can provide interactive voice ability, and user can be supported to set by voice command control movement The processing at standby interface.Specifically, user can obtain the corresponding characteristic information of external environment of mobile device by naked eyes, and Generate corresponding phonetic order.
Optionally, the corresponding characteristic information of the external environment of mobile device may include: the corresponding color letter of external environment Breath, corresponding phonetic order can be " external environment is green ", " outside is green " etc..
Optionally, the corresponding characteristic information of the external environment of mobile device may include: the corresponding object letter of external environment Breath, corresponding phonetic order can be " external environment is forest ", " front is a black car ", " the right and left is high Poplar " or " the right and left is high buildings and large mansions " etc..
It is above-mentioned according to the corresponding information of the external environment in a kind of embodiment of the application, determine that the movement is set At least partly process of the background image of interface element in standby interface, may include: according to the corresponding spy of the external environment Reference breath, determines the first tone;According to first tone, at least partly interface element is generated in the interface of the mobile device Background image.Specifically, the first tone can be extracted from the corresponding colouring information of the external environment, for example, from " external Environment is green " in the first tone for extracting be " green " etc..
It is above-mentioned according to the corresponding information of the external environment in another embodiment of the application, determine the movement At least partly process of the background image of interface element in the interface of equipment may include: to determine object corresponding with external environment The second tone that body information matches;According to first tone, at least partly interface is generated in the interface of the mobile device The background image of element.For example, determining the second matched color for objects such as forest, car, high buildings and large mansions, poplars Adjust etc..
It is above-mentioned according to the corresponding information of the external environment in the another embodiment of the application, determine the movement At least partly process of the background image of interface element in the interface of equipment may include: to determine object corresponding with external environment The first image that body information matches;According to the first image, at least partly interface is determined in the interface of the mobile device The background image of element.Wherein it is possible to obtain the first image that object information corresponding with external environment matches in picture library, such as Corresponding first image of the objects such as forest, car, high buildings and large mansions, poplar etc..
For according to the first image, determining in the interface of the mobile device at least partly Background of interface element For the process of picture, due to its with aforementioned step 102 according to the corresponding image of the external environment, determine the mobile device Interface in at least partly background image of interface element process it is similar, and therefore not to repeat here, cross-referenced.
To sum up, the interface processing method of the mobile device of the embodiment of the present application, can provide interactive voice ability, and can be with User is supported to pass through the processing at the interface of voice command control mobile device;Specifically, it can be obtained according to based on phonetic order The corresponding characteristic information of external environment, determine in the interface of the mobile device at least partly background image of interface element, And at least partly background of interface element is set in the interface of the mobile device by the background image.
The tone of the background image as corresponding at least partly background at the interface of interface element in mobile device and outside The tone of environment correspondence image can match, therefore at least partly interface element can be with outside in the interface of the embodiment of the present application Environment is adapted, in this way, it is possible to prevente effectively from the excessively bright interface for leading to mobile device of external environment is not seen and external environment Crossing secretly leads to excessively dazzling etc. the situations in the interface of mobile device, therefore can be improved the clarity at the interface of mobile device and readable Property, that is, the embodiment of the present application can be improved the compatible degree between the interface of mobile device and external environment, and then can to Family provides intelligence beautiful interface.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoided The unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method It closes, but those skilled in the art should understand that, the embodiment of the present application is not limited by the described action sequence, because according to According to the embodiment of the present application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should Know, the embodiments described in the specification are all preferred embodiments, and related movement not necessarily the application is implemented Necessary to example.
The embodiment of the present application also provides a kind of interface processor units of mobile device.
Referring to Fig. 4, a kind of structural block diagram of the interface processor unit embodiment of mobile device of the application is shown, specifically May include following module:
Image collection module 401, the corresponding image of external environment for obtaining mobile device;
Background image determining module 402, for determining the mobile device according to the corresponding image of the external environment At least partly background image of interface element in interface, the tone of the background image and the external environment corresponding image Tone matches;And
Background setup module 403, for setting the background image in the interface of the mobile device at least partly The background of interface element.
Optionally, the background image determining module 402 may include:
Tone acquisition submodule, for obtaining the tone of the corresponding image of the external environment;And
Background image generates submodule, for generating in the interface of the mobile device at least partly according to the tone The background image of interface element.
Optionally, the background image determining module 402 may include:
Gaussian Blur handles submodule, for carrying out Gaussian Blur processing to the corresponding image of the external environment, with To corresponding Gaussian Blur image, as at least partly background image of interface element in the interface of the mobile device.
Optionally, the interface of the mobile device can be card form interface, and the card form interface includes at least one Card, then the background setup module 403 may include:
Submodule is arranged in first background, for setting the background image to the back of card in the card form interface Scape;And/or
Submodule is arranged in second background, for setting the background image to the wallpaper background at the card form interface.
Optionally, the interface of the mobile device includes multiple interfaces windows, different interfaces windows can correspond to it is identical or The different background image of person.
Optionally, described image acquisition module 401 may include:
First image acquisition submodule, for according to the first during cycle, the external environment for obtaining camera acquisition to be corresponding Image, as the corresponding image of external environment;And/or
Second image acquisition submodule, the corresponding video of external environment of the mobile device for obtaining camera acquisition, According to the similarity between two frame adjacent in the video, the corresponding figure of external environment of mobile device is obtained from the video Picture;And/or
Third image acquisition submodule, the outside for the mobile device for being used to, according to the second during cycle, acquire from camera First frame is extracted in the corresponding video of environment, according to the similarity between adjacent first frame, movement is obtained from the first frame The corresponding image of the external environment of equipment.
Optionally, the tone may include: dominant hue and/or auxiliary tone.
Optionally, the mobile device may include: mobile unit.
To sum up, the interface processor unit of the mobile device of the embodiment of the present application, the external environment of available mobile device Corresponding image determines in the interface of the mobile device at least partly Interface Element according to the corresponding image of the external environment The background image of element, the tone of the background image and the tone of the external environment corresponding image match, and will be described Background image is set as in the interface of the mobile device at least partly background of interface element;Due at least portion in mobile device The tone of background image corresponding to the background at the interface of boundary surface element can match with the tone of external environment correspondence image, Therefore at least partly interface element can be adapted with external environment in the interface of the embodiment of the present application, in this way, it is possible to prevente effectively from The excessively bright interface for leading to mobile device of external environment is not seen and external environment secretly causes the interface of mobile device excessively to be pierced excessively The situations such as eye, therefore can be improved the clarity and readability at the interface of mobile device, that is, the embodiment of the present application can be improved Compatible degree between the interface and external environment of mobile device, and then the interface of intelligence beauty can be provided a user.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoided The unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
Referring to Fig. 5, a kind of structural block diagram of the interface processor unit embodiment of mobile device of the application is shown, specifically May include following module:
Data obtaining module 501, the corresponding information of external environment for obtaining mobile device;
Background image determining module 502, for determining the mobile device according to the corresponding information of the external environment Information institute corresponding at least partly background image of interface element in interface, the tone of the background image and the external environment The tone of characterization matches;
Background image setup module 503, for setting the background image in the interface of the mobile device at least The background of part interface element.
Optionally, the corresponding information of the external environment be may include: image, and/or be obtained based on phonetic order outer The corresponding characteristic information of portion's environment.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.
The embodiment of the present application also provides a kind of equipment, which may include: one or more processors;It deposits thereon The one or more machine readable medias for containing instruction, when being executed by one or more of processors, so that the equipment Execute method described in Fig. 1 to Fig. 3.In practical applications, which can be used as terminal device, can also be used as server, The example of terminal device may include: smart phone, tablet computer, E-book reader, (dynamic image expert compresses mark to MP3 Quasi- audio level 3, Moving Picture Experts Group Audio Layer III) player, MP4 (dynamic image Expert's compression standard audio level 4, Moving Picture Experts Group Audio Layer IV) it is player, above-knee Type portable computer, vehicle-mounted computer, set-top box, intelligent TV set, wearable device etc., the embodiment of the present application is for specific Equipment is without restriction.
The embodiment of the present application also provides a kind of non-volatile readable storage medium, be stored in the storage medium one or Multiple modules (programs) when the one or more module is used in mobile device, can make the mobile device execute The instruction (instructions) of the included step of the interface processing method of mobile device in the embodiment of the present application.
Fig. 6 is the hardware structural diagram for the mobile device that one embodiment of the application provides.As shown in fig. 6, the movement is set Standby may include: input equipment 1100, processor 1101, output equipment 1102, memory 1103 and at least one communication bus 1104.Communication bus 1104 is for realizing the communication connection between element.Memory 1103 may include high speed RAM memory, It may also further include non-volatile memories NVM, a for example, at least magnetic disk storage can store various journeys in memory 1103 Sequence, for completing various processing functions and realizing the method and step of the present embodiment.
Optionally, above-mentioned processor 1101 can be for example central processing unit (Central Processing Unit, letter Claim CPU), application specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), can compile Journey logical device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components It realizes, which is coupled to above-mentioned input equipment 1100 and output equipment 1102 by wired or wireless connection.
Optionally, above-mentioned input equipment 1100 may include a variety of input equipments, such as may include user oriented use At least one of family interface, device oriented equipment interface, the programmable interface of software, camera, sensor.Optionally, should Device oriented equipment interface can be wireline interface for carrying out data transmission between equipment and equipment, can also be and is used for Hardware insertion interface (such as USB interface, serial ports etc.) carried out data transmission between equipment and equipment;Optionally, should towards with The user interface at family for example can be user oriented control button, voice-input device and use for receiving voice input The touch awareness apparatus (such as touch screen, Trackpad with touch sensing function etc.) of family reception user's touch input;It is optional , the programmable interface of above-mentioned software for example can be the entrance for editing or modifying program for user, such as the input of chip Pin interface or input interface etc.;Optionally, above-mentioned transceiver can be rf chip, base with communication function Tape handling chip and dual-mode antenna etc..The audio input device such as microphone can receive voice data.Output equipment 1102 can To include the output equipments such as display, sound equipment.
In the present embodiment, the processor of the mobile device includes for executing each module of data processing equipment in each equipment Function, concrete function and technical effect are referring to above-described embodiment, and details are not described herein again.
Fig. 7 is the hardware structural diagram for the mobile device that one embodiment of the application provides.Fig. 7 is to Fig. 6 in reality A specific embodiment during now.As shown in fig. 7, the mobile device of the present embodiment may include processor 1201 and Memory 1202.
Processor 1201 executes the computer program code that memory 1202 is stored, and realizes Fig. 1 in above-described embodiment, figure 2 or mobile device shown in Fig. 3 interface processing method.
Memory 1202 is configured as storing various types of data to support the operation in mobile device.These data Example includes the instruction of any application or method for operating on the mobile apparatus, such as message, picture, video etc.. Memory 1202 may include random access memory (random access memory, abbreviation RAM), it is also possible to further include non- Volatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Optionally, processor 1201 is arranged in processing component 1200.The mobile device can also include: communication component 1203, power supply module 1204, multimedia component 1205, audio component 1206, input/output interface 1207 and/or sensor group Part 1208.Processing component 1200, communication component 1203, it is power supply module 1204, multimedia component 1205, audio component 1206, defeated Enter/can be connected by bus between output interface 1207 and/or sensor module 1208.The group that mobile device is specifically included Part etc. is set according to actual demand, and the embodiment of the present application is not construed as limiting this.
The integrated operation of the usually control mobile device of processing component 1200.Processing component 1200 may include one or more Processor 1201 executes instruction, to complete all or part of the steps of method shown in above-mentioned Fig. 1, Fig. 2 or Fig. 3.In addition, processing Component 1200 may include one or more modules, convenient for the interaction between processing component 1200 and other assemblies.For example, processing Component 1200 may include multi-media module, to facilitate the interaction between multimedia component 1205 and processing component 1200.
Power supply module 1204 provides electric power for the various assemblies of mobile device.Power supply module 1204 may include power management System, one or more power supplys and other with for mobile device generate, manage, and distribute the associated component of electric power.
Multimedia component 1205 includes the display screen of one output interface of offer between mobile device and user.One In a little embodiments, display screen may include liquid crystal display (LCD) and touch panel (TP).If display screen includes touch surface Plate, display screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or more touchings Sensor is touched to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or cunning The boundary of movement, but also detect duration and pressure associated with the touch or slide operation.
Audio component 1206 is configured as output and/or input audio signal.For example, audio component 1206 includes a wheat Gram wind (MIC), when mobile device is in operation mode, when such as speech recognition mode, microphone is configured as receiving external audio Signal.The received audio signal can be further stored in memory 1202 or send via communication component 1203.One In a little embodiments, audio component 1206 further includes a loudspeaker, is used for output audio signal.
Input/output interface 1207 provides interface between processing component 1200 and peripheral interface module, and above-mentioned periphery connects Mouth mold block can be click wheel, button etc..These buttons may include, but are not limited to: volume button, start button and locking press button.
Sensor module 1208 includes one or more sensors, and the state for providing various aspects for mobile device is commented Estimate.For example, sensor module 1208 can detecte the state that opens/closes of mobile device, the relative positioning of component, Yong Huyu The existence or non-existence of mobile device contact.Sensor module 1208 may include proximity sensor, be configured to do not having Detected the presence of nearby objects when any physical contact, including detection user between mobile device at a distance from.In some implementations In example, which can also be including camera etc..
Communication component 1203 is configured to facilitate the communication of wired or wireless way between mobile device and other equipment.It moves Dynamic equipment can access the wireless network based on communication standard, such as WiFi, 2G or 3G or their combination.In one embodiment In, it may include SIM card slot in the mobile device, which step on mobile device for being inserted into SIM card GPRS network is recorded, is communicated by internet with server foundation.
From the foregoing, it will be observed that communication component 1203, audio component 1206 involved in Fig. 7 embodiment and input/output Interface 1207, sensor module 1208 can be used as the implementation of the input equipment in Fig. 6 embodiment.
The embodiment of the present application also provides a kind of operating systems for equipment, as shown in figure 8, this is used for the operation of equipment System may include:
Image acquisition unit 801, the corresponding image of external environment for obtaining mobile device;
Background image determination unit 802, for determining the mobile device according to the corresponding image of the external environment At least partly background image of interface element in interface, the tone of the background image and the external environment corresponding image Tone is consistent;And
Background setting unit 803, for setting the background image in the interface of the mobile device at least partly The background of interface element.
Optionally, the background image determination unit 802 may include:
Tone obtains subelement, for obtaining the tone of the corresponding image of the external environment;And
Background image generates subelement, for generating in the interface of the mobile device at least partly according to the tone The background image of interface element.
Optionally, the background image determination unit 802 may include:
Gaussian Blur handles subelement, for carrying out Gaussian Blur processing to the corresponding image of the external environment, with To corresponding Gaussian Blur image, as at least partly background image of interface element in the interface of the mobile device.
Optionally, the interface of the mobile device can be card form interface, and the card form interface includes at least one Card, then the background setting unit 803 may include:
Subelement is arranged in first background, for setting the background image to the back of card in the card form interface Scape;And/or
Subelement is arranged in second background, for setting the background image to the wallpaper background at the card form interface.
Optionally, the interface of the mobile device includes multiple interfaces windows, different interfaces windows can correspond to it is identical or The different background image of person.
Optionally, described image acquiring unit 801 may include:
First image obtains subelement, for according to the first during cycle, the external environment for obtaining camera acquisition to be corresponding Image, as the corresponding image of external environment;And/or
Second image obtains subelement, the corresponding video of external environment of the mobile device for obtaining camera acquisition, According to the similarity between two frame adjacent in the video, the corresponding figure of external environment of mobile device is obtained from the video Picture;And/or
Third image obtains subelement, the outside for the mobile device for being used to, according to the second during cycle, acquire from camera First frame is extracted in the corresponding video of environment, according to the similarity between adjacent first frame, movement is obtained from the first frame The corresponding image of the external environment of equipment.
Optionally, the tone may include: dominant hue and/or auxiliary tone.
Optionally, the mobile device may include: mobile unit.
The embodiment of the present application also provides a kind of operating systems for equipment, as shown in figure 9, this is used for the operation of equipment System may include:
Information acquisition unit 901, the corresponding information of external environment for obtaining mobile device;
Background image determination unit 902, for determining the mobile device according to the corresponding information of the external environment Information institute corresponding at least partly background image of interface element in interface, the tone of the background image and the external environment The tone of characterization matches;
Background image setting unit 903, for setting the background image in the interface of the mobile device at least The background of part interface element.
Optionally, the corresponding information of the external environment be may include: image, and/or be obtained based on phonetic order outer The corresponding characteristic information of portion's environment.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiments of the present application may be provided as method, apparatus or calculating Machine program product.Therefore, the embodiment of the present application can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present application can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.
In a typical configuration, the computer equipment includes one or more processors (CPU), input/output Interface, network interface and memory.Memory may include the non-volatile memory in computer-readable medium, random access memory The forms such as device (RAM) and/or Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is to calculate The example of machine readable medium.Computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be with Realize that information is stored by any method or technique.Information can be computer readable instructions, data structure, the module of program or Other data.The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, CD-ROM are read-only Memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or Other magnetic storage devices or any other non-transmission medium can be used for storing the information that can be accessed with mobile device.According to Herein defines, and computer-readable medium does not include non-persistent computer readable media (transitory media), such as The data-signal and carrier wave of modulation.
The embodiment of the present application is referring to the method, mobile device (system) and computer program according to the embodiment of the present application The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these Computer program instructions are set to the processing movement of general purpose computer, special purpose computer, Embedded Processor or other programmable datas Standby processor is to generate a machine, so that being held by the processor that computer or other programmable datas handle mobile device Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable datas processing mobile device In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable datas processing mobile device, so that Series of operation steps are executed on computer or other programmable movement equipment to generate computer implemented processing, thus The instruction executed on computer or other programmable movement equipment is provided for realizing in one or more flows of the flowchart And/or in one or more blocks of the block diagram specify function the step of.
Although preferred embodiments of the embodiments of the present application have been described, once a person skilled in the art knows bases This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as Including preferred embodiment and all change and modification within the scope of the embodiments of the present application.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or mobile device including a series of elements are not only wrapped Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article Or the element that mobile device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited Element, it is not excluded that there is also other identical elements in process, method, article or the mobile device for including the element.
Above to a kind of interface processing method of mobile device provided herein, a kind of interface processing of mobile device Device, a kind of equipment, a kind of machine readable media and a kind of operating system for equipment, are described in detail, herein Applying specific case, the principle and implementation of this application are described, and the explanation of above example is only intended to help Understand the present processes and its core concept;At the same time, for those skilled in the art, according to the thought of the application, There will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not be construed as to this The limitation of application.

Claims (23)

1. a kind of interface processing method of mobile device characterized by comprising
Obtain the corresponding image of external environment of mobile device;
According to the corresponding image of the external environment, at least partly background of interface element is determined in the interface of the mobile device Image, the tone of the background image and the tone of the external environment corresponding image match;
At least partly background of interface element is set in the interface of the mobile device by the background image.
2. the method according to claim 1, wherein described according to the corresponding image of the external environment, determination At least partly background image of interface element in the interface of the mobile device, comprising:
Obtain the tone of the corresponding image of the external environment;
According to the tone, at least partly background image of interface element is generated in the interface of the mobile device.
3. the method according to claim 1, wherein described according to the corresponding image of the external environment, determination At least partly background image of interface element in the interface of the mobile device, comprising:
Gaussian Blur processing is carried out to the corresponding image of the external environment, to obtain corresponding Gaussian Blur image, as institute State in the interface of mobile device at least partly background image of interface element.
4. method according to any one of claims 1 to 3, which is characterized in that the interface of the mobile device is card form Interface, the card form interface include at least one card, then described to set the mobile device for the background image At least partly background of interface element in interface, comprising:
Set the background image to the background of card in the card form interface;And/or
Set the background image to the wallpaper background at the card form interface.
5. method according to any one of claims 1 to 3, which is characterized in that the interface of the mobile device includes multiple Interfaces windows, different interfaces windows correspond to same or different background image.
6. method according to any one of claims 1 to 3, which is characterized in that the external environment for obtaining mobile device Corresponding image, comprising:
According to the first during cycle, the corresponding image of external environment of the mobile device of camera acquisition is obtained;And/or
The corresponding video of external environment for obtaining the mobile device of camera acquisition, according between two frame adjacent in the video Similarity obtains the corresponding image of external environment of mobile device from the video;And/or
According to the second during cycle, first frame is extracted in the corresponding video of external environment of the mobile device acquired from camera, According to the similarity between adjacent first frame, the corresponding image of external environment of mobile device is obtained from the first frame.
7. method according to any one of claims 1 to 3, which is characterized in that the tone includes: dominant hue and/or auxiliary Tone.
8. method according to any one of claims 1 to 3, which is characterized in that the mobile device includes: mobile unit.
9. a kind of interface processor unit of mobile device characterized by comprising
Image collection module, the corresponding image of external environment for obtaining mobile device;
Background image determining module is used for according to the corresponding image of the external environment, in the interface for determining the mobile device At least partly background image of interface element, the tone phase of the tone of the background image and the external environment corresponding image Matching;And
Background setup module, for setting the background image in the interface of the mobile device at least partly interface element Background.
10. device according to claim 9, which is characterized in that the background image determining module includes:
Tone acquisition submodule, for obtaining the tone of the corresponding image of the external environment;And
Background image generates submodule, for according to the tone, generates in the interface of the mobile device at least partly interface The background image of element.
11. device according to claim 9, which is characterized in that the background image determining module includes:
Gaussian Blur handles submodule, for carrying out Gaussian Blur processing to the corresponding image of the external environment, to obtain pair The Gaussian Blur image answered, as at least partly background image of interface element in the interface of the mobile device.
12. according to the device any in claim 9 to 11, which is characterized in that the interface of the mobile device is card Formula interface, the card form interface include at least one card, then the background setup module includes:
Submodule is arranged in first background, for setting the background image to the background of card in the card form interface;With/ Or
Submodule is arranged in second background, for setting the background image to the wallpaper background at the card form interface.
13. according to the device any in claim 9 to 11, which is characterized in that the interface of the mobile device includes more A interfaces windows, different interfaces windows correspond to same or different background image.
14. a kind of equipment characterized by comprising
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, when being executed by one or more of processors, are made Obtain method of the equipment execution as described in one or more in claim 1-8.
15. one or more machine readable medias, are stored thereon with instruction, when executed by one or more processors, so that Equipment executes the method as described in one or more in claim 1-8.
16. a kind of operating system for equipment characterized by comprising
Image acquisition unit, the corresponding image of external environment for obtaining mobile device;
Background image determination unit is used for according to the corresponding image of the external environment, in the interface for determining the mobile device At least partly background image of interface element, the tone one of the tone of the background image and the external environment corresponding image It causes;And
Background setting unit, for setting the background image in the interface of the mobile device at least partly interface element Background.
17. a kind of interface processing method of mobile device characterized by comprising
Obtain the corresponding information of external environment of mobile device;
According to the corresponding information of the external environment, at least partly background of interface element is determined in the interface of the mobile device Image, the tone that the tone of the background image is characterized with information corresponding to the external environment match;
At least partly background of interface element is set in the interface of the mobile device by the background image.
18. according to the method for claim 17, which is characterized in that the corresponding information of the external environment include: image, And/or based on the corresponding characteristic information of external environment that phonetic order obtains.
19. a kind of interface processor unit of mobile device characterized by comprising
Data obtaining module, the corresponding information of external environment for obtaining mobile device;
Background image determining module is used for according to the corresponding information of the external environment, in the interface for determining the mobile device What information corresponding at least partly background image of interface element, the tone of the background image and the external environment was characterized Tone matches;
Background image setup module, for setting the background image in the interface of the mobile device at least partly interface The background of element.
20. device according to claim 19, which is characterized in that the corresponding information of the external environment include: image, And/or based on the corresponding characteristic information of external environment that phonetic order obtains.
21. a kind of equipment characterized by comprising
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, when being executed by one or more of processors, are made Obtain method of the equipment execution as described in one or more in claim 17-18.
22. one or more machine readable medias, are stored thereon with instruction, when executed by one or more processors, so that Equipment executes the method as described in one or more in claim 17-18.
23. a kind of operating system for equipment characterized by comprising
Information acquisition unit, the corresponding information of external environment for obtaining mobile device;
Background image determination unit is used for according to the corresponding information of the external environment, in the interface for determining the mobile device What information corresponding at least partly background image of interface element, the tone of the background image and the external environment was characterized Tone matches;
Background image setting unit, for setting the background image in the interface of the mobile device at least partly interface The background of element.
CN201710726005.6A 2017-08-22 2017-08-22 Interface processing method, device, equipment, medium and the operating system of mobile device Pending CN109426522A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710726005.6A CN109426522A (en) 2017-08-22 2017-08-22 Interface processing method, device, equipment, medium and the operating system of mobile device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710726005.6A CN109426522A (en) 2017-08-22 2017-08-22 Interface processing method, device, equipment, medium and the operating system of mobile device

Publications (1)

Publication Number Publication Date
CN109426522A true CN109426522A (en) 2019-03-05

Family

ID=65498159

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710726005.6A Pending CN109426522A (en) 2017-08-22 2017-08-22 Interface processing method, device, equipment, medium and the operating system of mobile device

Country Status (1)

Country Link
CN (1) CN109426522A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111158567A (en) * 2019-12-30 2020-05-15 联想(北京)有限公司 Processing method and electronic equipment
CN111679877A (en) * 2020-05-27 2020-09-18 浙江大华技术股份有限公司 Method and device for changing background of terminal equipment and electronic equipment
CN112330477A (en) * 2019-08-01 2021-02-05 脸谱公司 Generating customized personalized responses for social media content

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100037203A1 (en) * 2008-08-11 2010-02-11 International Business Machines Corporation Dynamic Highlighting of Related Artifacts in a UML Diagram
CN101957712A (en) * 2010-05-26 2011-01-26 宇龙计算机通信科技(深圳)有限公司 Display control method, system and mobile terminal for displaying interface background picture
CN102420896A (en) * 2010-09-27 2012-04-18 上海三旗通信科技有限公司 Operation method for switching thematic colour schemes of mobile terminal
CN103258520A (en) * 2012-02-17 2013-08-21 联想(北京)有限公司 Information processing method and system and electronic equipment
CN103856823A (en) * 2012-12-06 2014-06-11 腾讯科技(深圳)有限公司 Interface adjustment method, device and terminal
CN104360796A (en) * 2014-12-08 2015-02-18 三星电子(中国)研发中心 Method and device for applying colors onto electronic equipment and electronic equipment
CN104615450A (en) * 2013-11-01 2015-05-13 现代自动车株式会社 Apparatus, method and system for managing avn
CN104639748A (en) * 2015-01-30 2015-05-20 深圳市中兴移动通信有限公司 Method and device for displaying desktop background based on borderless mobile phone
US20170109029A1 (en) * 2015-10-16 2017-04-20 Sap Se Dynamically-themed display utilizing physical ambient conditions

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100037203A1 (en) * 2008-08-11 2010-02-11 International Business Machines Corporation Dynamic Highlighting of Related Artifacts in a UML Diagram
CN101957712A (en) * 2010-05-26 2011-01-26 宇龙计算机通信科技(深圳)有限公司 Display control method, system and mobile terminal for displaying interface background picture
CN102420896A (en) * 2010-09-27 2012-04-18 上海三旗通信科技有限公司 Operation method for switching thematic colour schemes of mobile terminal
CN103258520A (en) * 2012-02-17 2013-08-21 联想(北京)有限公司 Information processing method and system and electronic equipment
CN103856823A (en) * 2012-12-06 2014-06-11 腾讯科技(深圳)有限公司 Interface adjustment method, device and terminal
CN104615450A (en) * 2013-11-01 2015-05-13 现代自动车株式会社 Apparatus, method and system for managing avn
CN104360796A (en) * 2014-12-08 2015-02-18 三星电子(中国)研发中心 Method and device for applying colors onto electronic equipment and electronic equipment
CN104639748A (en) * 2015-01-30 2015-05-20 深圳市中兴移动通信有限公司 Method and device for displaying desktop background based on borderless mobile phone
US20170109029A1 (en) * 2015-10-16 2017-04-20 Sap Se Dynamically-themed display utilizing physical ambient conditions

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112330477A (en) * 2019-08-01 2021-02-05 脸谱公司 Generating customized personalized responses for social media content
CN111158567A (en) * 2019-12-30 2020-05-15 联想(北京)有限公司 Processing method and electronic equipment
CN111679877A (en) * 2020-05-27 2020-09-18 浙江大华技术股份有限公司 Method and device for changing background of terminal equipment and electronic equipment
CN111679877B (en) * 2020-05-27 2023-08-29 浙江大华技术股份有限公司 Method and device for changing background of terminal equipment and electronic equipment

Similar Documents

Publication Publication Date Title
CN109618222B (en) A kind of splicing video generation method, device, terminal device and storage medium
CN108632530B (en) Data processing method, device and equipment for vehicle damage assessment, client and electronic equipment
CN110706310B (en) Image-text fusion method and device and electronic equipment
US11195261B2 (en) Image processing apparatus and image processing method
CN107958449A (en) A kind of image combining method and device
CN109961747A (en) Electronic ink screen display methods, device and electronic equipment
WO2016197469A1 (en) Method and apparatus for generating unlocking interface, and electronic device
US20170132822A1 (en) Artificial intelligence in virtualized framing using image metadata
CN110084204B (en) Image processing method and device based on target object posture and electronic equipment
CN109426522A (en) Interface processing method, device, equipment, medium and the operating system of mobile device
WO2023197648A1 (en) Screenshot processing method and apparatus, electronic device, and computer readable medium
CN111340848A (en) Object tracking method, system, device and medium for target area
CN112560540B (en) Cosmetic wearing recommendation method and device
CN113986407A (en) Cover generation method and device and computer storage medium
CN107767838B (en) Color gamut mapping method and device
CN108040280A (en) Content item display methods and device, storage medium
CN104902318B (en) Control method for playing back and terminal device
CN114138215B (en) Display method and related equipment
KR20180111242A (en) Electronic device and method for providing colorable content
KR102179431B1 (en) Audio output apparatus and control method thereof
CN114003319B (en) Method for off-screen display and electronic equipment
CN112509152A (en) Car watching method, system, equipment and readable medium based on AR technology
CN116681765A (en) Method for determining identification position in image, method for training model, device and equipment
CN107943546A (en) A kind of method to set up of background, device, intelligent terminal and operating system
CN111107264A (en) Image processing method, image processing device, storage medium and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20201217

Address after: Room 603, 6 / F, Roche Plaza, 788 Cheung Sha Wan Road, Kowloon, China

Applicant after: Zebra smart travel network (Hong Kong) Ltd.

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190305