Summary of the invention
In order to solve problem of the prior art, embodiments provide a kind of method and dress showing and controlling menu
Put.Described technical scheme is as follows:
First aspect, it is provided that a kind of method showing control menu, described method includes:
When the viewfinder image that terminal is current comprises target device, determine that described target device is in described viewfinder image
The first shared image scaled;
Image scaled according to the described target device prestored and the corresponding relation controlling menu, determine described first
The first control menu that image scaled is corresponding, wherein, in described corresponding relation, image scaled is the least, corresponding control menu
Content complexity the lowest;
According to described target device size in described viewfinder image, target device described in described viewfinder image
Position, shows that described first controls menu.
Optionally, the image scaled of described target device and the image that corresponding relation is described target device controlling menu
Proportion and the corresponding relation controlling menu;
The image scaled of the described target device that described basis prestores and the corresponding relation controlling menu, determine described
The first control menu that first image scaled is corresponding, including:
Image scaled scope according to the described target device prestored and the corresponding relation controlling menu, determine described
The first control menu that image scaled scope belonging to first image scaled is corresponding.
Optionally, the described size according to described target device in described viewfinder image, institute in described viewfinder image
State the position of target device, show that described first controls menu, including:
According to described target device size in described viewfinder image, target device described in described viewfinder image
Position, by translucent display mode, shows that described first controls menu.
As such, it is possible to make user can identify target device.
Optionally, described the first image scaled determining that described target device is shared in described viewfinder image, including:
Determine the number of pixel corresponding to the region shared in described viewfinder image of described target device, and described
The total number of the pixel in viewfinder image;
The number of pixel corresponding for the region that described target device is shared in described viewfinder image is found a view with described
The ratio of the total number of the pixel in image, is defined as the first image that described target device is shared in described viewfinder image
Ratio.
As such, it is possible to quickly determine the ratio that target device is shared in viewfinder image.
Optionally, described first control menu includes that at least one controls button;
Described method also includes:
When the triggering command that described first controls the first control button in menu being detected, send to described target device
Described first controls the control request that button is corresponding.
As such, it is possible to control target device accurately.
Second aspect, it is provided that a kind of device showing control menu, described device includes:
First determines module, for when comprising target device in the viewfinder image that terminal is current, determines that described target sets
Standby the first image scaled shared in described viewfinder image;
Second determines module, corresponding with control menu for the image scaled according to the described target device prestored
Relation, determines the first control menu that described first image scaled is corresponding, and wherein, in described corresponding relation, image scaled is more
Little, the corresponding content complexity controlling menu is the lowest;
Display module, for according to described target device size in described viewfinder image, in described viewfinder image
The position of described target device, shows that described first controls menu.
Optionally, the image scaled of described target device and the image that corresponding relation is described target device controlling menu
Proportion and the corresponding relation controlling menu;
Described second determines module, is used for:
Image scaled scope according to the described target device prestored and the corresponding relation controlling menu, determine described
The first control menu that image scaled scope belonging to first image scaled is corresponding.
Optionally, described display module, it is used for:
According to described target device size in described viewfinder image, target device described in described viewfinder image
Position, by translucent display mode, shows that described first controls menu.
Optionally, described second determines module, is used for:
Determine the number of pixel corresponding to the region shared in described viewfinder image of described target device, and described
The total number of the pixel in viewfinder image;
The number of pixel corresponding for the region that described target device is shared in described viewfinder image is found a view with described
The ratio of the total number of the pixel in image, is defined as the first image that described target device is shared in described viewfinder image
Ratio.
Optionally, described first control menu includes that at least one controls button;
Described device also includes:
Sending module, for when detecting the triggering command that described first controls the first control button in menu, to institute
State target device and send the control request that described first control button is corresponding.
The technical scheme that the embodiment of the present invention provides has the benefit that
In the embodiment of the present invention, when comprising target device in the viewfinder image that terminal is current, terminal may determine that target
The first image scaled that equipment is shared in viewfinder image, then according to image scaled and the control of the target device prestored
The corresponding relation of menu, it may be determined that the first control menu that the first image scaled is corresponding, wherein, in corresponding relation, image
Ratio is the least, and the corresponding content complexity controlling menu is the lowest, according to target device size in viewfinder image, is finding a view
The position of target device in image, display the first control menu.So, control the display size of menu, be to set according to intelligence
Standby size in viewfinder image determines, even if comprising multiple at a distance of closer smart machine, each intelligence in viewfinder image
The control menu that energy equipment is corresponding also will not be overlapping, and controls the content complexity of menu, is also to exist according to smart machine
Image scaled shared in viewfinder image determines, such that it is able to clearly show that control menu.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention
Formula is described in further detail.
Embodiments providing a kind of method showing and controlling menu, the executive agent of the method can be terminal.
Example, terminal can be smart mobile phone, panel computer etc., can be provided with AR application program in terminal.Wherein, example,
Terminal can be provided with processor, memorizer, transceiver etc..Processor is displayed for controlling at the process of menu
Reason, memorizer may be used for being stored in the data needing storage during display controls menu, and transceiver may be used for sending and receiving
Message.Can also include screen in terminal, screen is displayed for viewfinder image and control menu corresponding to smart machine
Deng, can be the screen of touch.In the present embodiment, as a example by terminal is as mobile phone, carry out the detailed description of scheme, other situation
Being similar to therewith, the present embodiment is not repeated.
As it is shown in figure 1, the handling process of the method can comprise the following steps that
Step 101, when comprising target device in the viewfinder image that terminal is current, determines that target device is in viewfinder image
The first shared image scaled.
Wherein, target device is any one smart machine, such as intelligent television, intelligent air condition, intelligent lamp, intelligent washing machine
Deng.
In force, user can install AR application program in the terminal, then triggers and opens AR application program, and AR applies
Program can call the photographic head opening terminal, and the photographic head of terminal can be directed at smart machine (follow-up referred to as target by user
Equipment), now the display interface of terminal shows viewfinder image, terminal can be calculated according to the neural metwork training pre-set
Method, Sift (Scale Invariant Feature Transform, scale invariant feature transfer algorithm), Surf (Speeded
Up Robust Feature, accelerates robust feature transfer algorithm), whether detection image includes target device.If terminal
Determine in current viewfinder image and comprise target device, then can be by target device size in viewfinder image, divided by finding a view
The size (can be the size of the screen of terminal) of image, the numerical value obtained, it is defined as target device shared in viewfinder image
The first image scaled.Such as, the display interface of terminal shows viewfinder image, viewfinder image comprises an intelligent lamp,
Then terminal includes target device in may determine that current viewfinder image, and then may determine that smart machine is in viewfinder image
The first shared image scaled.
Optionally, terminal can determine target device according to target device pixel number of correspondence in viewfinder image
Image scaled shared in viewfinder image, the process of corresponding step 101 can be such that
Determine the number of pixel corresponding to the region shared in viewfinder image of target device, and in viewfinder image
The total number of pixel;By the number of pixel corresponding for the region that target device is shared in viewfinder image with in viewfinder image
The ratio of total number of pixel, be defined as the first image scaled that target device is shared in viewfinder image.
In force, after terminal comprises target device in determining current viewfinder image, it may be determined that target device is taking
Region (such as rectangular area, delta-shaped region, border circular areas etc.) shared in scape image, this region can be energy in viewfinder image
Enough comprise the minimum rectangular area (or smallest triangle region, smallest circular region etc.) of target device, then may determine that this
The number of all pixels comprised in region, the pixel that namely target device region shared by viewfinder image is corresponding
Number.Such as, determining that the region shared by target device is in viewfinder image is rectangular area, this rectangular area is to set with target
The standby length that height and the width are rectangle in viewfinder image and the wide rectangular area formed, the pixel in this rectangular area
Number, is the number of pixel corresponding to target device region shared in viewfinder image.And may determine that figure of finding a view
The total number of the pixel in Xiang, the total number of the pixel in viewfinder image can be that the resolution of the screen of terminal is (such as end
The resolution of the screen of end is 1920*1080, then may determine that the total number of the pixel in viewfinder image is 1920*1080).
Terminal can be by pixel number corresponding for region that target device is shared in viewfinder image divided by the pixel in viewfinder image
The total number of point, the value obtained, it is defined as the first image scaled that target device is shared in viewfinder image.
Step 102, according to image scaled and the corresponding relation of control menu of the target device prestored, determines first
The first control menu that image scaled is corresponding, wherein, in corresponding relation, image scaled is the least, and corresponding controls the interior of menu
Hold complexity the lowest.
Wherein, controlling menu and include that at least one controls button, each smart machine is to having control menu, Yong Huke
To click on the control button controlled in menu, control corresponding smart machine.At image scaled and the corresponding relation controlling menu
In, image scaled is the least, and the content complexity controlling menu is the lowest, such as, for target device, image scaled is 1/5, right
Only comprising one in the control menu answered and control button, image scaled is 1/2, corresponding control menu comprises three control by
Key etc..
In force, as shown in Table 1, technical staff can arrange the image scaled of target device and the right of control menu
Should be related to, and store to the installation kit of AR application program, or background server (the follow-up referred to as service of AR application program
Device) in, such as, target device is intelligent lamp, and to having control menu 1, control menu 2, control menu 3 etc., target device is
Intelligent television, to having control menu 4, control menu 5, control menu 6 etc., the control dish that smart machine is corresponding with smart machine
List can store to server, or the installation kit of AR application program.
Table one
The installation kit of AR application program has the image scaled of target device and controls the corresponding relation of menu, terminal is pacified
Fill AR application program, terminal has stored the image scaled of target device and the corresponding relation controlling menu.Terminal determines mesh
After the first image scaled that marking device is shared in viewfinder image, the image ratio of the target device that can prestore from terminal
Example, with the corresponding relation controlling menu, searches the control menu that target device is corresponding, then at the target device pair found
In the control menu answered, determine the first control menu that the first image scaled is corresponding.
Or, after terminal determines the first image scaled that target device is shared in viewfinder image, can send out to server
Sending the acquisition request controlling menu, carry the mark of target device in this acquisition request, server receives what terminal sent
After controlling the acquisition request of menu, image scaled and the control menu of target device according to the mark of target device, can be searched
Corresponding relation, then by the image scaled of target device with control menu corresponding relation send to terminal.Terminal receives
The image scaled of the target device that server sends and control menu corresponding relation after, can therefrom search the of target device
Control menu corresponding to one image scaled is the first control menu.
During it addition, the viewfinder image of terminal comprises multiple smart machine, due to the actual size not phase of each smart machine
With, each smart machine is also possible to differ with the distance of terminal, the image that each smart machine is shared in viewfinder image
Ratio is the most different, and terminal is according to the image scaled of the target device prestored and the corresponding relation controlling menu, really
The control menu content complexity that each smart machine of making is corresponding is different.Such as, as in figure 2 it is shown, the figure of finding a view of terminal
Comprising two smart machines (intelligent television and intelligent lamp) in Xiang, terminal determines the image ratio that intelligent lamp is shared in viewfinder image
Example is 1/4, and intelligent television image scaled shared by viewfinder image is 1/2, and terminal determines that the image scaled 1/4 of intelligent lamp is right
The control menu answered comprises one and controls button (switch key), the control menu of image scaled 1/2 correspondence of intelligent television
In comprise three control button (switch key, frequency channel volume button, mute button).
Optionally, the image scaled of target device and the image scaled scope that corresponding relation is target device controlling menu
With the corresponding relation controlling menu;Accordingly, the step of step 102 can be such that
Image scaled scope according to the target device prestored and the corresponding relation controlling menu, determine the first image
The first control menu that image scaled scope belonging to ratio is corresponding.
In force, the image scaled of the target device that technical staff presets and the corresponding relation controlling menu, for target
The image scaled scope of equipment and the corresponding relation controlling menu, such as, as shown in Table 2, the image scaled scope of intelligent lamp is
0~1/4, corresponding control menu, for controlling menu 1, controls that the content in menu 1 is fairly simple (as controlled the number of button is
1), the image scaled scope of intelligent lamp is 1/4~1/2, and corresponding control menu is for controlling menu 2, and control in menu 2 is interior
Hold more complicated than the content controlled in menu 1 (number controlling button is more than the control number of keys controlled in menu 1), intelligent lamp
Image scaled scope be 1/2~1, corresponding control menu, for controlling menu 3, controls the content in menu 3 than controlling menu 2
In content complicated (number controlling button is more than the control number of keys in control menu 2).
Table two
The installation kit of AR application program has the image scaled scope of target device and controls the corresponding relation of menu, terminal
In be mounted with AR application program, terminal stores the image scaled scope of target device and the corresponding relation controlling menu.Eventually
After end determines the first image scaled that target device is shared in viewfinder image, the target device that can prestore from terminal
Image scaled scope with the corresponding relation controlling menu, search control menu corresponding to target device, then finding
Control menu corresponding to target device in, determine the first control dish that the image scaled scope belonging to the first image scaled is corresponding
Single.
Or, after terminal determines the first image scaled that target device is shared in viewfinder image, can send out to server
Sending the acquisition request controlling menu, carry the mark of target device in this acquisition request, server receives what terminal sent
After controlling the acquisition request of menu, image scaled scope and the control of target device according to the mark of target device, can be searched
The corresponding relation of menu, then sends the image scaled scope of target device and the corresponding relation controlling menu to terminal.Eventually
After termination receives the image scaled scope of the target device that server sends and the corresponding relation of control menu, can therefrom search
The image scaled scope belonging to first image scaled of target device, it is then determined that the control menu that this image scaled scope is corresponding
It it is the first control menu.
Optionally, in the embodiment of the present invention, control menu corresponding to different images ratio can be any based on actual demand
Arrange, shown below is a feasible example:
If the first image scaled is less than the first predetermined threshold value, first to control the control button in menu be to use frequency
High control button;If the first image scaled is more than the first predetermined threshold value, and less than the second predetermined threshold value, first controls menu
In control button be to use the highest control button of frequency, and use frequency to press more than the control of the first predeterminated frequency threshold value
Key;If the first image scaled is more than the second predetermined threshold value, the control button in the first control menu is to use frequency the highest
Controlling button, and use the frequency control button more than the second predeterminated frequency threshold value, wherein, the first predeterminated frequency threshold value is more than
Second predeterminated frequency threshold value.
In force, if the first image scaled is less than the first predetermined threshold value, it is determined that the first control menu in control
Button processed can be the control button using frequency the highest.So, target device ratio shared by viewfinder image is smaller,
The number controlling button is fewer, and user can also be clearly seen that the control button controlled in menu.Such as, as it is shown on figure 3,
First image scaled of intelligent lamp is equal to 1/6, and less than the first predetermined threshold value 1/4, the first control button controlled in menu is to make
With the highest switch key of frequency.
If it addition, the first image scaled is less than the first predetermined threshold value, it is determined that the first control menu in control press
Key can be main menu control button, user can click on main menu control button, terminal then can receive main menu control by
The click commands of key, then terminal can show that corresponding whole of target device control button.
If the first image scaled is more than the first predetermined threshold value, and less than the second predetermined threshold value, it is determined that the first control
The button that controls in menu can be the control button using frequency the highest, and uses frequency more than the first predeterminated frequency threshold value
Control button.So, the ratio that target device is shared in viewfinder image is bigger than the first predetermined threshold value, even if arranging the most
The control button of a bit, user can also be clearly seen that the control button controlled in menu.Such as, as shown in Figure 4, intelligent lamp
The first image scaled equal to 1/3, more than the first predetermined threshold value 1/4, less than the second predetermined threshold value 1/2, first controls in menu
Control button can be switch key, brightness button (the use frequency of brightness button be more than the first predeterminated frequency threshold value).
If it addition, the first image scaled is more than the first predetermined threshold value, and less than the second predetermined threshold value, it is determined that first
The button that controls controlled in menu can be the control button using frequency the highest, and main menu controls button, and user is permissible
Clicking on main menu and control button, terminal then can receive main menu and control the click commands of button, and then terminal can show target
Equipment control button in addition to using the control button that frequency is the highest.
If the first image scaled is more than the second predetermined threshold value, the control button in the first control menu can be to use frequency
The control button that rate is the highest, and use the frequency control button more than the second predeterminated frequency threshold value.So, target device is taking
Ratio shared in scape image is more than the second predetermined threshold value, even if arranging the control button that comparison is many, user can also be clearly
See the control button controlled in menu.Such as, as it is shown in figure 5, the first image scaled of intelligent lamp is equal to 2/3, more than second
Predetermined threshold value 1/2, the control button in the first control menu can be switch key, brightness button (the use frequency of brightness button
Rate is more than the first predeterminated frequency threshold value), color button (the use frequency of color button be more than the second predeterminated frequency threshold value).
If it addition, the first image scaled more than the second predetermined threshold value, the first control button controlled in menu can be
Corresponding whole of target device control button.So, the ratio that target device is shared in viewfinder image presets threshold more than second
Value, even if controlling to be provided with, in menu, whole buttons that control that target device is corresponding, user can also be clearly seen that control dish
Each control button in list.
For the control menu that different images ratio is corresponding, the embodiment of the present invention also has a lot of set-up mode, the most no longer
Enumerate.
Step 103, according to target device size in viewfinder image, the position of target device in viewfinder image,
Display the first control menu.
In force, terminal after determining the first control menu, can in viewfinder image the position of target device, with
Target device size in viewfinder image (namely with target device in viewfinder image, shared minimum rectangular area
Size), display the first control menu, i.e. during display the first control menu, first controls menu can coverage goal equipment just.
Such as, target device is intelligent lamp, and intelligent lamp is in viewfinder image, and the shared size in minimum rectangular area is 2 inches of (squares
The catercorner length in shape region), then the first size controlling menu is 2 inches (catercorner lengths of the first control menu).
Optionally, terminal can show the first control menu, accordingly, the process of step 103 with translucent display mode
Can be such that
According to target device size in viewfinder image, the position of target device in viewfinder image, by semi-transparent
Bright display mode, display the first control menu.
In force, terminal after determining the first control menu, can in viewfinder image the position of target device, with
Target device size in viewfinder image, is shown as translucent by the background that first controls menu.So, user can be true
The smart machine that this control menu fixed is corresponding.Such as, as shown in Figure 6, target device is intelligent lamp, and first controls the background of menu
Transparency be 50%.
Or, the background that first controls menu, with target device size in viewfinder image, is shown as full impregnated by terminal
Bright, first controls menu can coverage goal equipment just.
Or, the background that first controls menu, with target device size in viewfinder image, is shown as full impregnated by terminal
Bright, the first control button controlled in menu is shown as translucent, and first controls menu can coverage goal equipment just.
The embodiment of the present invention, additionally provides user and uses the method controlling menu control smart machine, and corresponding process can
With as follows:
First controls menu includes that at least one controls button;When the first control button in the first control menu being detected
Triggering command time, to target device send first control button corresponding control request.
In force, first controls to control button including at least one in menu, and user can click on the first control menu
In the first control button, terminal then can detect the triggering command of the first control button, then terminal determine the first control by
The control request that key is corresponding, and this control request is sent to target device.After target device receives this control request, permissible
Perform the operation that this control request is corresponding.Such as, target device is intelligent lamp, and the first control button is switch key, Yong Hudian
Hitting switch key, terminal determines that the control request that the first control button is corresponding is the request of opening, and then sends to intelligent lamp and opens
Request, after intelligent lamp receives unlatching request, can be luminous.Or, the first control button is color button, and user can click on
Color button, triggering terminal shows the multiple color that can choose, and user can select certain color, then clicks on and determines button,
Triggering terminal sends to target device and controls request, carries, in this control request, the color that user chooses, and intended recipient is to control
After system request, the glow color of intelligent lamp can be changed.
It addition, the embodiment of the present invention additionally provides technical staff's use frequency according to control button, set different figures
As the method controlling button controlled in menu that ratio is corresponding, corresponding process can be such that
Technical staff can be arranged in the AR application program of terminal, as long as the click commands controlling button being detected, eventually
End then reports the use to controlling button to operate to server.The use that server receives controlling button operates
After, the use frequency of this control button of storage can be increased by 1 time.Technical staff can be from whois lookup to preset duration
In, each of corresponding target device controls the use frequency of button, then controls the use frequency of button according to each, from height to
Low it is ranked up.When image scaled is less than the first predetermined threshold value, then explanation target device size in viewfinder image is smaller,
The content controlling menu should be fairly simple, and the control button controlled in menu being correspondingly arranged is the control using frequency the highest
Button, image scaled is more than the first predetermined threshold value, and during less than the second predetermined threshold value, then explanation target device is in viewfinder image
Shared ratio is moderate, and the first content controlled in menu should be slightly more complicated, the control controlled in menu being correspondingly arranged
Button processed is the control button using frequency the highest, and uses the frequency control button more than the first predeterminated frequency threshold value, figure
During as ratio more than the second predetermined threshold value, then the ratio that explanation target device is shared in viewfinder image is bigger, controls menu
In content should be the most complicated, the control button controlled in menu being correspondingly arranged is the control button using frequency the highest, with
And use the frequency control button more than the second predeterminated frequency threshold value, wherein, the first predeterminated frequency threshold value presets frequency more than second
Rate threshold value.
It addition, technical staff can arrange main menu button in controlling menu, user can click on main menu button, touches
Sending out all control buttons that terminal demonstration target device is corresponding, user can click on arbitrary control button, and triggering terminal is to target
Equipment sends the control request that this control button is corresponding, and target device can perform the operation that this control request is corresponding.
In the embodiment of the present invention, when comprising target device in the viewfinder image that terminal is current, terminal may determine that target
The first image scaled that equipment is shared in viewfinder image, then according to image scaled and the control of the target device prestored
The corresponding relation of menu, it may be determined that the first control menu that the first image scaled is corresponding, wherein, in corresponding relation, image
Ratio is the least, and the corresponding content complexity controlling menu is the lowest, according to target device size in viewfinder image, is finding a view
The position of target device in image, display the first control menu.So, control the display size of menu, be to set according to intelligence
Standby size in viewfinder image determines, even if comprising multiple at a distance of closer smart machine, each intelligence in viewfinder image
The control menu that energy equipment is corresponding also will not be overlapping, and controls the content complexity of menu, is also to exist according to smart machine
Image scaled shared in viewfinder image determines, such that it is able to clearly show that control menu.
Based on identical technology design, the embodiment of the present invention additionally provides a kind of device showing and controlling menu, such as Fig. 7 institute
Showing, this device includes:
First determines module 710, for when comprising target device in the viewfinder image that terminal is current, determines described target
The first image scaled that equipment is shared in described viewfinder image;
Second determines module 720, for the image scaled according to the described target device prestored and control menu
Corresponding relation, determines the first control menu that described first image scaled is corresponding, wherein, in described corresponding relation, image ratio
Example is the least, and the corresponding content complexity controlling menu is the lowest;
Display module 730, for according to described target device size in described viewfinder image, in described viewfinder image
Described in the position of target device, show that described first controls menu.
Optionally, the image scaled of described target device and the image that corresponding relation is described target device controlling menu
Proportion and the corresponding relation controlling menu;
Described second determines module 720, is used for:
Image scaled scope according to the described target device prestored and the corresponding relation controlling menu, determine described
The first control menu that image scaled scope belonging to first image scaled is corresponding.
Optionally, described display module 730, it is used for:
According to described target device size in described viewfinder image, target device described in described viewfinder image
Position, by translucent display mode, shows that described first controls menu.
Optionally, described first determines module 710, is used for:
Determine the number of pixel corresponding to the region shared in described viewfinder image of described target device, and described
The total number of the pixel in viewfinder image;
The number of pixel corresponding for the region that described target device is shared in described viewfinder image is found a view with described
The ratio of the total number of the pixel in image, is defined as the first image that described target device is shared in described viewfinder image
Ratio.
Optionally, described first control menu includes that at least one controls button;
As shown in Figure 8, described device also includes:
Sending module 740, is used for when the triggering command that described first controls the first control button in menu being detected, to
Described target device sends described first and controls the control request that button is corresponding.
In the embodiment of the present invention, when comprising target device in the viewfinder image that terminal is current, terminal may determine that target
The first image scaled that equipment is shared in viewfinder image, then according to image scaled and the control of the target device prestored
The corresponding relation of menu, it may be determined that the first control menu that the first image scaled is corresponding, wherein, in corresponding relation, image
Ratio is the least, and the corresponding content complexity controlling menu is the lowest, according to target device size in viewfinder image, is finding a view
The position of target device in image, display the first control menu.So, control the display size of menu, be to set according to intelligence
Standby size in viewfinder image determines, even if comprising multiple at a distance of closer smart machine, each intelligence in viewfinder image
The control menu that energy equipment is corresponding also will not be overlapping, and controls the content complexity of menu, is also to exist according to smart machine
Image scaled shared in viewfinder image determines, such that it is able to clearly show that control menu.
It should be understood that above-described embodiment provide display control menu device display control menu time, only with
The division of above-mentioned each functional module is illustrated, and in actual application, can distribute above-mentioned functions by not as desired
With functional module complete, the internal structure of device will be divided into different functional modules, with complete described above all
Or partial function.It addition, the device that the display that above-described embodiment provides controls menu is implemented with the method that display controls menu
Example belongs to same design, and it implements process and refers to embodiment of the method, repeats no more here.
Refer to Fig. 9, it illustrates the structural representation of terminal involved by the embodiment of the present invention, this terminal may be used for
The method that the display implementing to provide in above-described embodiment controls menu.Specifically:
Terminal 900 can include RF (Radio Frequency, radio frequency) circuit 110, include one or more meters
The memorizer 120 of calculation machine readable storage medium storing program for executing, input block 130, display unit 140, sensor 150, voicefrequency circuit 160,
WiFi (wireless fidelity, Wireless Fidelity) module 170, include one or more than one process core process
The parts such as device 180 and power supply 190.It will be understood by those skilled in the art that the terminal structure shown in Fig. 9 is not intended that right
The restriction of terminal, can include that ratio illustrates more or less of parts, or combine some parts, or different parts cloth
Put.Wherein:
RF circuit 110 can be used for receiving and sending messages or in communication process, the reception of signal and transmission, especially, by base station
After downlink information receives, transfer to one or more than one processor 180 processes;It addition, be sent to relating to up data
Base station.Generally, RF circuit 110 includes but not limited to antenna, at least one amplifier, tuner, one or more agitator, use
Family identity module (SIM) card, transceiver, bonder, LNA (Low Noise Amplifier, low-noise amplifier), duplex
Device etc..Additionally, RF circuit 110 can also be communicated with network and other equipment by radio communication.Described radio communication can make
By arbitrary communication standard or agreement, include but not limited to GSM (Global System of Mobile communication, entirely
Ball mobile communcations system), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code
Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple
Access, WCDMA), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short
Messaging Service, Short Message Service) etc..
Memorizer 120 can be used for storing software program and module, and processor 180 is stored in memorizer 120 by operation
Software program and module, thus perform various function application and data process.Memorizer 120 can mainly include storing journey
Sequence district and storage data field, wherein, storage program area can store the application program (ratio needed for operating system, at least one function
Such as sound-playing function, image player function etc.) etc.;Storage data field can store the number that the use according to terminal 900 is created
According to (such as voice data, phone directory etc.) etc..Additionally, memorizer 120 can include high-speed random access memory, it is also possible to bag
Include nonvolatile memory, for example, at least one disk memory, flush memory device or other volatile solid-state parts.
Correspondingly, memorizer 120 can also include Memory Controller, to provide processor 180 and input block 130 to memorizer
The access of 120.
Input block 130 can be used for receiving numeral or the character information of input, and produces and user setup and function
Control relevant keyboard, mouse, action bars, optics or the input of trace ball signal.Specifically, input block 130 can include touching
Sensitive surfaces 131 and other input equipments 132.Touch sensitive surface 131, also referred to as touches display screen or Trackpad, can collect use
Family thereon or neighbouring touch operation (such as user uses any applicable object such as finger, stylus or adnexa at touch-sensitive table
Operation on face 131 or near Touch sensitive surface 131), and drive corresponding attachment means according to formula set in advance.Optional
, Touch sensitive surface 131 can include touch detecting apparatus and two parts of touch controller.Wherein, touch detecting apparatus detection is used
The touch orientation at family, and detect the signal that touch operation brings, transmit a signal to touch controller;Touch controller is from touch
Receive touch information on detection device, and be converted into contact coordinate, then give processor 180, and processor 180 can be received
The order sent also is performed.Furthermore, it is possible to use the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave
Realize Touch sensitive surface 131.Except Touch sensitive surface 131, input block 130 can also include other input equipments 132.Specifically,
Other input equipments 132 can include but not limited to physical keyboard, function key (such as volume control button, switch key etc.),
One or more in trace ball, mouse, action bars etc..
Display unit 140 can be used for the information that inputted by user of display or the information being supplied to user and terminal 900
Various graphical user interface, these graphical user interface can be made up of figure, text, icon, video and its combination in any.
Display unit 140 can include display floater 141, optionally, can use LCD (Liquid Crystal Display, liquid crystal
Show device), the form such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) configure display floater
141.Further, Touch sensitive surface 131 can cover display floater 141, when Touch sensitive surface 131 detects thereon or neighbouring touching
After touching operation, send processor 180 to determine the type of touch event, with preprocessor 180 according to the type of touch event
Display floater 141 provides corresponding visual output.Although in fig .9, Touch sensitive surface 131 and display floater 141 are conducts
Two independent parts realize input and input function, but in some embodiments it is possible to by Touch sensitive surface 131 and display
Panel 141 is integrated and realizes input and output function.
Terminal 900 may also include at least one sensor 150, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor can include ambient light sensor and proximity transducer, and wherein, ambient light sensor can be according to environment
The light and shade of light regulates the brightness of display floater 141, and proximity transducer can cut out display when terminal 900 moves in one's ear
Panel 141 and/or backlight.As the one of motion sensor, Gravity accelerometer can detect in all directions (generally
Three axles) size of acceleration, can detect that size and the direction of gravity time static, can be used for identifying the application (ratio of mobile phone attitude
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.;Extremely
Other sensors such as the gyroscope that can also configure in terminal 900, barometer, drimeter, thermometer, infrared ray sensor, at this
Repeat no more.
Voicefrequency circuit 160, speaker 161, microphone 162 can provide the audio interface between user and terminal 900.Audio frequency
The signal of telecommunication after the voice data conversion that circuit 160 can will receive, is transferred to speaker 161, speaker 161 is converted to sound
Tone signal exports;On the other hand, the acoustical signal of collection is converted to the signal of telecommunication by microphone 162, voicefrequency circuit 160 after receiving
Being converted to voice data, then after being processed by voice data output processor 180, through RF circuit 110, to be sent to such as, another is eventually
End, or voice data is exported to memorizer 120 to process further.Voicefrequency circuit 160 is also possible that earphone jack,
To provide the communication of peripheral hardware earphone and terminal 900.
WiFi belongs to short range wireless transmission technology, and terminal 900 can help user's transceiver electronics by WiFi module 170
Mail, browsing webpage and access streaming video etc., it has provided the user wireless broadband internet and has accessed.Although Fig. 9 illustrates
WiFi module 170, but it is understood that, it is also not belonging to must be configured into of terminal 900, can exist as required completely
Omit in the scope of the essence not changing invention.
Processor 180 is the control centre of terminal 900, utilizes various interface and each portion of the whole mobile phone of connection
Point, it is stored in the software program in memorizer 120 and/or module by running or performing, and calls and be stored in memorizer 120
Interior data, perform the various functions of terminal 900 and process data, thus mobile phone is carried out integral monitoring.Optionally, processor
180 can include one or more process core;Preferably, processor 180 can integrated application processor and modem processor,
Wherein, application processor mainly processes operating system, user interface and application program etc., and modem processor mainly processes nothing
Line communicates.It is understood that above-mentioned modem processor can not also be integrated in processor 180.
Terminal 900 also includes the power supply 190 (such as battery) powered to all parts, it is preferred that power supply can be by electricity
Management system is logically contiguous with processor 180, thus realizes management charging, electric discharge and power consumption by power-supply management system
The functions such as management.Power supply 190 can also include one or more direct current or alternating current power supply, recharging system, power supply event
Barrier testing circuit, power supply changeover device or the random component such as inverter, power supply status indicator.
Although not shown, terminal 900 can also include photographic head, bluetooth module etc., does not repeats them here.Specifically in this reality
Executing in example, the display unit of terminal 900 is touch-screen display, and terminal 900 also includes memorizer, and one or one
Above program, one of them or more than one program is stored in memorizer, and be configured to by one or one with
Upper processor performs to state one or more than one program comprises the instruction for carrying out following operation:
When the viewfinder image that terminal is current comprises target device, determine that described target device is in described viewfinder image
The first shared image scaled;
Image scaled according to the described target device prestored and the corresponding relation controlling menu, determine described first
The first control menu that image scaled is corresponding, wherein, in described corresponding relation, image scaled is the least, corresponding control menu
Content complexity the lowest;
According to described target device size in described viewfinder image, target device described in described viewfinder image
Position, shows that described first controls menu.
Optionally, the image scaled of described target device and the image that corresponding relation is described target device controlling menu
Proportion and the corresponding relation controlling menu;
The image scaled of the described target device that described basis prestores and the corresponding relation controlling menu, determine described
The first control menu that first image scaled is corresponding, including:
Image scaled scope according to the described target device prestored and the corresponding relation controlling menu, determine described
The first control menu that image scaled scope belonging to first image scaled is corresponding.
Optionally, the described size according to described target device in described viewfinder image, institute in described viewfinder image
State the position of target device, show that described first controls menu, including:
According to described target device size in described viewfinder image, target device described in described viewfinder image
Position, by translucent display mode, shows that described first controls menu.
Optionally, described the first image scaled determining that described target device is shared in described viewfinder image, including:
Determine the number of pixel corresponding to the region shared in described viewfinder image of described target device, and described
The total number of the pixel in viewfinder image;
The number of pixel corresponding for the region that described target device is shared in described viewfinder image is found a view with described
The ratio of the total number of the pixel in image, is defined as the first image that described target device is shared in described viewfinder image
Ratio.
Optionally, described first control menu includes that at least one controls button;
Described method also includes:
When the triggering command that described first controls the first control button in menu being detected, send to described target device
Described first controls the control request that button is corresponding.
In the embodiment of the present invention, when comprising target device in the viewfinder image that terminal is current, terminal may determine that target
The first image scaled that equipment is shared in viewfinder image, then according to image scaled and the control of the target device prestored
The corresponding relation of menu, it may be determined that the first control menu that the first image scaled is corresponding, wherein, in corresponding relation, image
Ratio is the least, and the corresponding content complexity controlling menu is the lowest, according to target device size in viewfinder image, is finding a view
The position of target device in image, display the first control menu.So, control the display size of menu, be to set according to intelligence
Standby size in viewfinder image determines, even if comprising multiple at a distance of closer smart machine, each intelligence in viewfinder image
The control menu that energy equipment is corresponding also will not be overlapping, and controls the content complexity of menu, is also to exist according to smart machine
Image scaled shared in viewfinder image determines, such that it is able to clearly show that control menu.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can pass through hardware
Complete, it is also possible to instruct relevant hardware by program and complete, program can be stored in the storage of a kind of computer-readable
In medium, storage medium mentioned above can be read only memory, disk or CD etc..
These are only presently preferred embodiments of the present invention, not in order to limit the present invention, all in the spirit and principles in the present invention
Within, any modification, equivalent substitution and improvement etc. made, should be included within the scope of the present invention.