CN106954089A - The mobile phone of multimedia interactive can be realized with external equipment - Google Patents
The mobile phone of multimedia interactive can be realized with external equipment Download PDFInfo
- Publication number
- CN106954089A CN106954089A CN201710149420.XA CN201710149420A CN106954089A CN 106954089 A CN106954089 A CN 106954089A CN 201710149420 A CN201710149420 A CN 201710149420A CN 106954089 A CN106954089 A CN 106954089A
- Authority
- CN
- China
- Prior art keywords
- display unit
- interactive
- control
- display
- mobile phone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42208—Display device provided on the remote control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42224—Touch pad or touch panel provided on the remote control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4781—Games
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Selective Calling Equipment (AREA)
Abstract
The mobile phone of multimedia interactive can be realized with external equipment.The mobile phone that multimedia interactive can be realized with external equipment includes one first display unit, also includes：Redraw unit, in the second display unit suitable for only receiving an electronic installation in current display frame can interactive controls control information, and according to the control information to first display unit provide control coordinate, with first display unit draw can interactive controls；And command unit, generation operational order is operated according to the user for acting on first display unit.On the one hand technical solution of the present invention, greatly reduces volume of transmitted data, saves the network bandwidth and takes；On the other hand, user can also arbitrarily adjust shown in the mobile phone that multimedia interactive can be realized with external equipment can interactive controls size, without in electronic installation display picture produce influence, enhance Consumer's Experience.
Description
The application is that on November 30th, 2015, application number are that 201510854499.7, denomination of invention is " remote control for the applying date
The divisional application of the application for a patent for invention of device and method, electronic installation ".
Technical field
Field is interacted the present invention relates to smart machine, it is more particularly to a kind of to realize multimedia interactive with external equipment
Mobile phone.
Background technology
The electronic installation of computer, intelligent television, mobile phone etc generally includes the display screen built in one, the display screen
For showing the content for being produced or being stored on electronic installation by electronic installation.In certain circumstances, it may be necessary to pass through an electricity
Another electronic installation of sub-device remote control.For example, user may want to mobile phone as remote control, played and swum by intelligent television
Play.
Refering to Fig. 1, Fig. 1 is the first electronic installation and second electronic device interaction schematic diagram.First electronic installation 100 has
One first display screen 110, second electronic device 200 has a second display screen 210.User is wished on the first display screen 110
Part or all of content push to second display screen 210 on, with pass through the first electronic installation 100 control second electronic device
The content shown on 200.As shown in figure 1, the first electronic installation can be mobile phone, the second display device can be intelligent television.
Due to the current rare application program developed specifically designed for intelligent television, generally by the application program applied to other intelligent terminals
It is directly applied in intelligent television.Therefore, a game application is shown in intelligent television, the game application has one
A bit can interactive controls.
To meet above-mentioned needs, the IOS of Apple Inc. provides Airplay technologies, can realize that two show
The content mirrors of display screen.Airplay technologies are the wireless communication techniques that Apple Inc. releases, can be by the sound played without bundle of lines
The even whole picture of happy, video is sent to receiving device and played back again.But, using Airplay technologies in two display screens
The content of display is pushed between (for example, display screen of mobile telephone and tv display screen), there is following defect：
On the one hand, because AirPlay technologies are to push between two display screens whole display picture, its number transmitted
According to very big, the network bandwidth is seriously taken.So that display resolution is 1920 × 1080 mobile phone as an example, if display picture
Frame per second (due to the special physiological structure of human eye, when seeing that the frame per second of picture is higher than 24, company will be considered for 24fps
Pass through), then a width of ÷ 1024 of 1920 × 1080 × 32 ÷ 8 of band needed for transmitting the display picture2× 24=189.8M.Some
In the case of higher to network bandwidth requirement, such as mobile phone as remote control, is played and swum by foregoing user by intelligent television
In the scene of play, transmission display picture takes the response speed that more bandwidth may influence smart television display to operate user
Degree, reduces Consumer's Experience.
On the other hand, display picture is pushed between the first display screen and second display screen using Airplay technologies, when
Picture in picture amplification in one display screen, second display screen also can correspondingly amplify.For foregoing user by mobile phone
As remote control, in the scene that game is played by intelligent television, if the part of the display screen of mobile telephone as remote control is shown
Show picture (region that typically operation is concentrated by part) amplification, then the game picture shown in intelligent television can also amplify.This will
Game picture is caused to show incomplete so that game can not be carried out.Therefore, in the prior art user can not adjust mobile phone show
The display size of content in display screen.This is when needing to operate some less buttons, it appears especially inconvenient.
The content of the invention
Technical solution of the present invention to be solved is that existing one electronic equipment with display screen pushes display picture content
During to another electronic equipment with display screen, the problem of transmitting picture serious occupied bandwidth.
In order to solve the above technical problems, technical solution of the present invention proposes that one kind can realize multimedia interactive with external equipment
Mobile phone, including one first display unit, the mobile phone that multimedia interactive can be realized with external equipment has a flux scale
Know, the mobile phone that multimedia interactive can be realized with external equipment also includes：Unit is redrawn, suitable for only receiving an electronic installation
The second display unit in current display frame can interactive controls control information, and according to the control information to described first
Display unit provide control coordinate, with first display unit draw can interactive controls；And command unit, according to work
User's operation generation operational order for first display unit.
Based on above-mentioned, the push of whole picture, the energy of technical solution of the present invention during different from screen mirror image in the prior art
Enough and external equipment realizes the mobile phone of multimedia interactive, by extract in electronic installation can interactive controls, only by the control
Information is sent in can realize the mobile phone of multimedia interactive with external equipment, so that, allow to realize multimedia with external equipment
Interactive mobile phone is only redrawn on its first display unit can interactive controls.On the one hand, volume of transmitted data is greatly reduced, is saved
The network bandwidth takes；On the other hand, user can also arbitrarily be adjusted can realize the mobile phone of multimedia interactive with external equipment
Middle display can interactive controls size, without in electronic installation display picture produce influence, enhance Consumer's Experience.
Brief description of the drawings
Fig. 1 is the first electronic installation and second electronic device interaction schematic diagram；
Fig. 2 is the remote control and electronic installation schematic diagram of one embodiment of the invention；
Fig. 3 is the conversion formula schematic diagram that a control redraws when the first display unit in the second display unit of the invention；
Fig. 4 is that the remote control of one embodiment of the invention and an electronic installation interaction with the second display unit are shown
It is intended to；
Fig. 5 be one embodiment of the invention the first display unit in can interactive controls scaling schematic diagram；
Fig. 6 be by the first display unit shown in Fig. 5 after amplification can interactive controls with one have the second display unit
Electronic installation interaction schematic diagram；
Fig. 7 is the remote control and electronic installation schematic diagram of another embodiment of the present invention；
Fig. 8 is the flow chart of the remote control thereof of one embodiment of the invention；
Fig. 9 is the flow chart of the remote control thereof of another embodiment of the present invention.
Embodiment
For the features described above and advantage of the present invention can be become apparent, special embodiment below, and coordinate institute's accompanying drawings
It is described in detail below.
As stated in the Background Art, it is existing during progress content push, on the one hand to need push whole between two electronic installations
Individual picture, the data of transmission are very big, seriously take the network bandwidth；On the other hand the display screen that electronic installation can not be adjusted is shown
The size of control, it is inconvenient for use.
Based on this, technical solution of the present invention provides a kind of remote control, and electronics dress can be only redrawn on its display screen
Put in display screen can interactive controls, user is by operating the remote control, it is possible to achieve to electronic installation display content
Control.Technical solution of the present invention also provides a kind of electronic installation, and user can be realized to this by operating above-mentioned remote control
The control of electronic installation display content.
Refering to Fig. 2, Fig. 2 is the remote control and electronic installation schematic diagram of one embodiment of the invention.Remote control 100 includes
One first display unit 110, one redraws the command unit 130 of unit 150 and one.Electronic installation 200 includes one second display unit
210th, a control unit 230, a filter element 250 and one second information acquisition unit 220.
For remote control 100, the first display unit 110 is touch-screen, specifically, can be resistive touch screen,
Capacitive touch screen, infrared type touch-screen or surface acoustic wave touch screen, it can operate according to user and provide different electricity
Signal.The shape or type of first display unit 110 can be otherwise varied according to different remote controls, and the present invention is not limited this
It is fixed.
Command unit 130 is used for basis and acts on user's operation S42 generation operations that the first display unit 110 is received
Instruct S10 or store instruction S46.The user operation S42 can be click on operation, drag operation, choose operate or other make
User operates.User is played exemplified by playing by mobile phone as remote control by intelligent television using in background technology, remote control dress
It can be mobile phone to put 100, and the first display unit 110 can be the display screen of mobile phone.User is in mobile phone
Performed on display screen click, pull, choose or other operation when, command unit 130 will according to aforesaid operations generate operational order
S10 or store instruction S46, operational order S10 include triggering command S52, control response instruction S51, will hereafter make further
It is described in detail.
With reference to Fig. 4, have one to open control 102 in one embodiment, on the first display unit 110, when user's point
When hitting the unlatching control 102, command unit 130 generates an operational order S10 according to the clicking operation of the user, and the operation refers to
Make and be supplied to the acquisition of information of filter element 250 and second via a control unit 230 for triggering command S52, triggering command S52
Unit 220, corresponding information is sent in remote control 100 to trigger it.
For electronic installation 200, the second display unit 210 can be touch-screen or non-touch screen.User can
To run some application programs by electronic installation 200, corresponding picture is presented in the application program on the second display unit 210
Face.Such as the example that user is played by intelligent television object for appreciation in background technology, electronic installation 200 can be an intelligent television, the
Two display units 210 can be the display screen of the intelligent television, such as LCDs.Game display picture passes through intelligent electricity
Depending on display screen be presented in user.
The filter element 250 of electronic installation 200 is after a triggering command S52 is received, from second display unit
Current display frame extract can interactive controls control information S55, and control information S55 is provided in remote control 100.Refering to figure
4, Fig. 4 be that the remote control of one embodiment of the invention and one have the electronic installation interaction schematic diagram of the second display unit.
In the second display unit 210 of electronic installation 200, a games interface, the first half at the games interface are presented
Show that a people navigates within multiple barriers, and can be by being jumped at the top of a barrier at the top of another barrier.The games
The lower half at interface show five can interactive controls, indicate respectively game in people's motion mode：Upward U, downward D, to the left
L, to the right R and acceleration Enter.When filter element 250 receives triggering command S52, then from current display frame (going game journey
Sequence interface) extract can interactive controls 101 (upward U, downward D, to the left L, to the right R and accelerate Enter) control information S55, and
Unit 150 is redrawn by what control information S55 was supplied to remote control 100.The control information includes：Application name, should
With program version number, frame number, control numbering, control coordinate and control property.Control information can hereafter be done further in detail
Explanation.
Second information acquisition unit 220 of electronic installation 200 refers to after a triggering command S52 is received according to the triggering
Make S52 obtain the second display information S30 by the second display unit 210, and the second display information S30 is provided in remote control
100 redraw unit 150.Second display information S30 can in resolution ratio and current display frame including the second display unit 210
The upward U of interactive controls, such as aforementioned controls, downward D, to the left L, to the right R and accelerate Enter control coordinate.
As it was previously stated, the unit 150 that redraws of remote control 100 receives the control that the filter element 250 of electronic installation 200 is sent
The second display information S30 that part information S55 and the second display information acquiring unit 220 are sent.Unit 150 is redrawn according to above-mentioned control
Part information S55 and the second display information S30, generates control coordinate S43, is shown with being drawn on the first display unit 110 with second
Showing in unit 210 that current display frame is corresponding can interactive controls.It is detailed to redrawing the course of work of unit 150 in the present embodiment below
Thin description.
In the present embodiment, remote control 100 includes one first display information acquiring unit 120, and first display information is obtained
Unit 120 is taken to couple the first display unit 110, for obtaining the first display information S41.First display information S41 includes first
The resolution ratio of display unit 110.So that foregoing remote control is the situation of mobile phone as an example, point of the display screen of the mobile phone
Resolution is Wrs*Hrs, then the first display information is then including resolution ratio Wrs*Hrs。
Redrawing unit 150 includes a converting unit 152, couples the first display information acquiring unit 110.The converting unit
152 according to a conversion formula, and by control information S55, the first display information S41 and the second display information S30, calculating can interact control
Part is shown in the control coordinate S43 of the first display unit 110, and the control coordinate S43 is sent in into the first display list
Member 110, to be drawn on first display unit 110 and current display frame is corresponding in the second display unit 210 interacts control
Part.Refering to Fig. 3, Fig. 3 is the conversion formula signal that a control redraws when the first display unit in the second display unit of the invention
Figure.In Fig. 3 in the second display unit 210 have one can interactive controls, this can interactive controls coordinate as illustrated, control information
S55 be this can interactive controls control coordinate (that is, Xtc、Ytc、Xbc、Ybc)；The resolution ratio of first display unit 110 is
One display information S41 (that is, Wrs*Hrs)；The resolution ratio of second display unit 210 is the second display information S30 (that is, Wcs*
Hcs).In the present embodiment, conversion formula can be used as using equation below：
Wherein, xtcFor in the second display information one can interactive controls left upper apex X-coordinate；
ytcFor in the second display information one can interactive controls left upper apex Y coordinate；
xbcFor in the second display information one can interactive controls bottom right vertex X-coordinate；
ybcFor in the second display information one can interactive controls bottom right vertex Y coordinate；
x1cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls a left side
The X-coordinate on upper summit；
y1cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls a left side
The Y coordinate on upper summit；
x2cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls the right side
The X-coordinate on lower summit；
y2cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls the right side
The Y coordinate on lower summit；
The resolution ratio of first display unit is Wrs*Hrs；
The resolution ratio of second display unit is Wcs*Hcs。
So far, redraw unit 150 by its converting unit 152 can obtain being drawn in the first display unit 110 can
Left upper apex coordinate (the x of interactive controls1c, y1c) and bottom right vertex coordinate (x2c, y2c).Similarly, on the first display unit 110
Can draw out it is corresponding with the second display unit 210 it is all can interactive controls.User is can be in the aobvious of mobile phone
Only be presented current display frame in games in display screen can interactive controls, the upward U of such as aforementioned controls, to the left downward D, L, to the right
R and acceleration Enter, without personage, barrier or the control (such as prompt column) that can not be interacted in game is presented.
Then, user can in the first display unit 110 (display screen of mobile telephone) can interactive controls 101 carry out
Operation, such as can carry out clicking operation, drag operation, choose operation.Command unit 130 is according to first display unit
In 110 can interactive controls 101 receive user operation S42, generation operational order S10 be supplied to the electronic installation
200, so that the electronic installation 200 performs a corresponding task of the operational order S10.For example, such as Fig. 4 institutes
Show, user can click in the first display unit 110 of remote control 100 can interactive controls 101 upwards " U ", first show
Show that unit 110 sends user's operation S42 to command unit 130.Command unit 130 operates S42 generations according to the user
Operational order S10.Judge via the control unit 230 of electronic installation 200, operational order S10 is control response instruction S51,
Therefore instruction is responded based on the control, performing in the second display unit 210 can corresponding one of interactive controls (i.e. upwards " U ")
Business, the display picture of the second display unit 210 is that corresponding effect is presented, and the people in such as playing rebounds.
Electronic installation 200 also includes a updating block 240.Updating block 240 is monitoring second display unit 210
Current display frame when updating, the information S53 of the current display frame is sent in updating block 240 by control unit 230, and to
The filter element 250 provides a triggering command S54.As it was previously stated, the filter element 250 of electronic installation 200 is receiving one
After triggering command S54, by from the current display frame of second display unit 210 extract can interactive controls control information S55,
And control information S55 is provided in remote control 100.
The course of work to filter element 250 is described in detail below.Filter element 250 includes a controls filter unit 251
With a notification unit 252.Controls filter unit 251, for according to a triggering command S54 from the current of the second display unit 210
Show frame extract can interactive controls 101 control information.Notification unit 252, for providing control information to remote control 100
S55.Control information includes：Application name, application version number, frame number, control numbering, control coordinate and control category
Property.Table 1 below is a control information example：
The control information table of the display unit current display frame of table 1 second
Control on second display unit 210 is different according to the property value of its widget interaction association attributes, is divided into two classes：Can
Interactive controls and can not interactive controls.Some controls, such as pointing out user the application journey that the electronic installation 200 is run
The control of the essential information of sequence, for notifying whether successful control of user's prior operation etc., its do not need relative users behaviour
Make, being can not interactive controls.Can not be in the control property of interactive controls, the intercorrelation such as clickable, longclickble category
The property value of property is False, or the control by disable.Can not interactive controls control information just need not be supplied to it is distant
Device 100 is controlled, transmission bandwidth on the one hand can be so reduced, on the other hand also cause the display interface of the first display unit 110
Compare clean and tidy.Separately there are some controls, indicate control Botton_U upwards as shown in table 1, indicate control Botton_D, to the left downwards
Indicate control Botton_L, control Botton_R is indicated to the right or accelerate control Botton_E, its need response user operation with
A task of certain application program (such as games) is performed, being can interactive controls., can interactive controls in intelligent operating system
Control property in, the property value of at least one is in the intercorrelation attribute such as longClickable or Clickable
TRUE.Can the control informations of interactive controls be provided to remote control 100, so that user passes through the first display unit 100
Application program straighforward operation to being shown in the second display unit 210.
In one embodiment, one also preserves control on the first display unit.Refering to Fig. 5, Fig. 6 and Fig. 2 is combined, schemed
5 be one embodiment of the invention the first display unit 110 in can interactive controls scaling schematic diagram；Fig. 6 is by Fig. 5 after amplification
Can interactive controls and an electronic installation interaction schematic diagram with the second display unit in shown first display unit 110.
After user zooms in and out operation to the first display unit 110 of remote control 100, click on and preserve control 103, the first display
The user operation S42 that the preservation control 103 of unit 110 is received, command unit 130 operates S42 to generate according to the user
Store instruction S46, and store instruction S46 is supplied to a memory cell 140 of remote control 100.Memory cell 140 preserves the
The current display frame of one display unit 110.Memory cell 140 can be a nonvolatile memory, such as flash memory.With reference to Fig. 5, lift
For example, if operator think in current display frame (Frame_008) on the first display unit 110 can interactive controls 101 compared with
It is small, it is difficult accurate touch-control, you can slided with two fingers on the first display unit 110 according to direction shown in arrow, and then amplify
Can interactive controls 101 to desired size, can interactive controls as shown in the first display unit 110 in Fig. 6.Now, operator
The preservation control 103 on the first display unit 110 in Fig. 6 is selected, that is, generates user operation S42.The basis of command unit 130
User operation S42 generates a store instruction S46, and the current display frame of the first display unit 110 (can record as Frame_
008) 01) it is stored in memory cell 140.
In the present embodiment, remote control 100 also includes a loading unit 151.Notification unit 252 sends out control information S55
The loading unit 151 of remote control 100 is delivered to, control information S55 is application name, application version number, frame number.
Loading unit 151 is searched the frame S45 corresponding to control information S55 by memory cell 140, and is provided to the first display unit 110
Control coordinate S44 in frame S45, with the first display unit 110 draw can interactive controls 101.For example, control is believed
Breath S55 is application name Marie, application version number 1.01, frame number Frame_008, and loading unit 151 is according to control
Part information S55 by found in memory cell 140 frame Frame_008_01 in control information S55 correspondence, then loading unit 151 to
First display unit 110 provides the control coordinate in frame Frame_008_01.It can be redrawn such as Fig. 6 in first display unit 110
Shown larger control.
In another embodiment, remote control 100 includes a loading unit 151, and remote control 100 is connected to high in the clouds clothes
Business device.Refering to Fig. 7, Fig. 7 is the remote control and electronic installation schematic diagram of another embodiment of the present invention.Cloud server 300 is deposited
Contain multiple application programs.Notification unit 252 sends control information S55 to the loading unit 151 of remote control 100, control
Information S55 is application name, application version number, frame number, control numbering, control coordinate and control property.Loading
Unit 151 is searched the application program and the application program corresponding to control information S55 by internet by cloud server 300
Corresponding frame.Cloud server 300 can be extracted by the frame of above-mentioned corresponding application programs and corresponding with control information S55 interact control
Part.Loading unit 151 via internet load this can interactive controls control information, and according to the control information to first display
Unit 110 provides control coordinate S44.Can be drawn in cloud server 300 on first display unit 110 in respective frame can
Interactive controls.Cloud server can also store the application program or application program in addition to storing aforesaid plurality of application program
The other information of middle frame, for example, train control coordinate (control of certain frame of acquisition most through using by different user use habit
Part size) etc..
Refering to Fig. 8, Fig. 8 is the flow chart of the remote control thereof of one embodiment of the invention.Technical solution of the present invention also provides one
Plant remote control thereof.The remote control thereof includes：
Perform step S100：From an electronic installation receive can interactive controls control information.
Perform step S200：Control can be interacted by only being redrawn in the first display unit of a remote control based on the control information
Part.
Perform step S300：User according to first display unit is acted on operates generation operational order.
Perform step S400：Perform the corresponding task of the operational order.
Describe the remote control thereof of technical solution of the present invention in detail below in conjunction with a specific embodiment.Refering to Fig. 9, Fig. 9 is this
Invent the flow chart of the remote control thereof of another embodiment.
Still by taking the games in foregoing remote control of mobile phone intelligent television as an example.As shown in step S101 in Fig. 9, when one
When user wishes to operate the game of display in intelligent television (electronic installation) by its mobile phone (remote control), touch first
The unlatching control of the display unit of remote control first is sent out, remote control is that can send a triggering command to electronic installation.Triggering electricity
Sub-device make its filter element extract on the second display unit of the electronic installation can interactive controls, and can interactive controls by this
Control information be sent in remote control.
Then, continue step S102, remote control from electronic installation receive it is above-mentioned can interactive controls control information.
If loading unit (step S201) is not present in redrawing for remote control in unit unit, the remote control receives electricity
Second display information (step S206) of the display unit of sub-device second.According to above-mentioned second display information and can interactive controls
Control information, according to a conversion formula, on the first display unit of remote control, the i.e. display screen of mobile phone, only draws
Can interactive controls (step S207).The form of conversion formula may refer to previous embodiment, and this is not repeated.
If redrawing for remote control has a loading unit (step S201) in unit, and the remote control is without memory cell
(step S202), then the remote control be stored with from one the cloud server of multiple application programs, search and correspond to the control
The frame of information, only being redrawn in first display unit according to the frame can interactive controls (step S203).
If redrawing for remote control has a loading unit (step S201) in unit, and the remote control has a storage
Unit (step S202), then judge in memory cell whether there is correspond to the display unit of electronic installation second in can interactive controls
Control information frame (step S204).Correspond to the control if so, being searched from a memory cell of the remote control
The frame of information, being redrawn according to the frame in first display unit can interactive controls (step S205).If in the memory unit not
Corresponding frame is found, the remote control is stored with the cloud servers of multiple application programs from one, searches and corresponds to the control
The frame of information, only being redrawn in first display unit according to the frame can interactive controls (step S203).
So far, only redrawn out on the first display unit of remote control corresponding to the second display unit of electronic installation
Can interactive controls, user can by the first display unit can interactive controls operation (step S300), make electronics
Application program in device performs corresponding task (step S400).
If user thinks that control size is not suitable in remote control, it can be shown by scaling current display interface and preserving this
Show the mode of the corresponding frame in interface, the current display frame with the control size oneself being accustomed to is stored in the storage of remote control
In unit.When opening the remote control next time, you can the display frame preserved in the memory cell is directly mapped in into first and shown
Show on unit.
The push of whole picture when in summary, different from screen mirror image in the prior art, technical solution of the present invention it is distant
Control device and method, electronic installation, by extract in electronic installation can interactive controls, only the information of the control is sent in distant
Device is controlled, so that, remote control is only redrawn on its first display unit can interactive controls.On the one hand, number is greatly reduced
According to transmission quantity, save the network bandwidth and take；On the other hand, what user arbitrarily can also be shown in adjusting remote device interacts
The size of control, without producing influence to the display picture in electronic installation, enhances Consumer's Experience.
Present pre-ferred embodiments are the foregoing is only, so it is not limited to the scope of the present invention, any to be familiar with sheet
The personnel of item technology, without departing from the spirit and scope of the present invention, further can be improved and be changed on this basis, because
This protection scope of the present invention is defined when the scope defined by following claims.
Claims (9)
1. a kind of can realize the mobile phone of multimedia interactive, including one first display unit with external equipment, it is characterised in that institute
Stating can realize that the mobile phone of multimedia interactive has a flow identifier with external equipment, described that many matchmakers can be realized with external equipment
The mobile phone of body interaction also includes：
Redraw unit, in the second display unit suitable for only receiving an electronic installation in current display frame can interactive controls control
Information, and control coordinate is provided to first display unit according to the control information, with first display unit
Drafting can interactive controls；And
Command unit, generation operational order is operated according to the user for acting on first display unit.
2. according to claim 1 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that described heavy
Unit is painted including a converting unit, suitable for according to a conversion formula by the control information, corresponding to first display unit
The first display information and the second display information corresponding to second display unit, calculate it is described can interactive controls show
The control coordinate of first display unit is shown in, and the control coordinate is sent in first display unit.
3. according to claim 2 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that the energy
It is enough to realize that the mobile phone of multimedia interactive also includes first display information for coupling first display unit and obtained with external equipment
Unit is taken, for providing first display information to the converting unit.
4. according to claim 2 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that described turn
Changing formula is：
Wherein, xtcFor in the second display information one can interactive controls left upper apex X-coordinate；
ytcFor in the second display information one can interactive controls left upper apex Y coordinate；
xbcFor in the second display information one can interactive controls bottom right vertex X-coordinate；
ybcFor in the second display information one can interactive controls bottom right vertex Y coordinate；
x1cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls upper left push up
The X-coordinate of point；
y1cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls upper left push up
The Y coordinate of point；
x2cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls bottom right push up
The X-coordinate of point；
y2cFor in the first display information with second display information can interactive controls it is corresponding can interactive controls bottom right push up
The Y coordinate of point；
The resolution ratio of first display unit is Wrs*Hrs；
The resolution ratio of second display unit is Wcs*Hcs。
5. according to claim 1 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that described
Have one to open control on one display unit,
User's operation generation operational order that the basis acts on first display unit includes：
The user's operation received according to the unlatching control, generation triggering command is supplied to the electronic installation, so that institute
The mobile phone that multimedia interactive can be realized to described with external equipment by stating electronic installation provide it is described can the controls of interactive controls believe
Breath.
6. according to claim 5 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that described
Also have one to preserve control on one display unit,
User's operation generation operational order that the basis acts on first display unit also includes：
The user's operation received according to the preservation control, generation store instruction be supplied to it is described can be real with external equipment
One memory cell of the mobile phone of existing multimedia interactive, so that the memory cell preserves the currently displaying of first display unit
Frame.
7. according to claim 6 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that described heavy
Painting unit also includes a loading unit, and many matchmakers can be realized with external equipment corresponding to described for being searched by the memory cell
The frame of control information that the mobile phone of body interaction is received, and the control coordinate in the frame is provided to first display unit, with
Can interactive controls in being drawn on first display unit.
8. according to claim 7 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that the energy
Enough to realize that the mobile phone of multimedia interactive is connected to a cloud server with external equipment, the cloud server is stored with multiple answer
Use program；
The loading unit, multimedia can be realized corresponding to described with external equipment by being additionally operable to be searched by the cloud server
The frame for the control information that interactive mobile phone is received, and the control coordinate in the frame is provided to first display unit, with
Being drawn on first display unit can interactive controls.
9. according to claim 1 can realize the mobile phone of multimedia interactive with external equipment, it is characterised in that the control
Part information includes：Application name, application version number, frame number, control numbering, control coordinate or control property.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710149420.XA CN106954089A (en) | 2015-11-30 | 2015-11-30 | The mobile phone of multimedia interactive can be realized with external equipment |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510854499.7A CN105491418A (en) | 2015-11-30 | 2015-11-30 | Remote control device and method, and electronic device |
| CN201710149420.XA CN106954089A (en) | 2015-11-30 | 2015-11-30 | The mobile phone of multimedia interactive can be realized with external equipment |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510854499.7A Division CN105491418A (en) | 2015-11-30 | 2015-11-30 | Remote control device and method, and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106954089A true CN106954089A (en) | 2017-07-14 |
Family
ID=55678081
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510854499.7A Pending CN105491418A (en) | 2015-11-30 | 2015-11-30 | Remote control device and method, and electronic device |
| CN201710149420.XA Pending CN106954089A (en) | 2015-11-30 | 2015-11-30 | The mobile phone of multimedia interactive can be realized with external equipment |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510854499.7A Pending CN105491418A (en) | 2015-11-30 | 2015-11-30 | Remote control device and method, and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN105491418A (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331800B (en) * | 2016-08-25 | 2019-12-03 | 深圳Tcl数字技术有限公司 | The amplification display method and system of control |
| CN113791834B (en) * | 2021-09-17 | 2023-11-03 | 北京百度网讯科技有限公司 | Information display apparatus |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102638716A (en) * | 2012-03-21 | 2012-08-15 | 华为技术有限公司 | Method, device and system for television remote control by mobile terminal |
| CN102892038A (en) * | 2012-09-28 | 2013-01-23 | 歌尔声学股份有限公司 | Auxiliary television multimedia interaction system and television interaction method |
| CN103064597A (en) * | 2012-12-28 | 2013-04-24 | 鸿富锦精密工业（深圳）有限公司 | Display control system and display control method |
| CN103617165A (en) * | 2013-10-22 | 2014-03-05 | 小米科技有限责任公司 | Picture loading method, device and terminal |
| CN103838479A (en) * | 2012-11-21 | 2014-06-04 | 宏碁股份有限公司 | Electronic device and application software interface adjustment method |
| CN203933872U (en) * | 2014-06-17 | 2014-11-05 | 上海昌谷实业有限公司 | There is the multi-medium information spreading system of interactive device |
| CN104298443A (en) * | 2014-09-19 | 2015-01-21 | 百度在线网络技术（北京）有限公司 | Method, device and system used for presenting display interface |
| WO2015079330A1 (en) * | 2013-11-28 | 2015-06-04 | Sony Corporation | Multimedia reading control device, graph acquisition device, electronic equipment, graph supply device and methods thereof |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5720661B2 (en) * | 2012-11-30 | 2015-05-20 | コニカミノルタ株式会社 | Mobile terminal device, image processing cooperation system, screen data display method and display program |
| US20140368537A1 (en) * | 2013-06-18 | 2014-12-18 | Tom G. Salter | Shared and private holographic objects |
| CN103369049B (en) * | 2013-07-22 | 2016-05-04 | 王雁林 | Mobile terminal and server exchange method and system thereof |
| CN105068467B (en) * | 2015-07-13 | 2018-02-02 | 小米科技有限责任公司 | Control the method and device of smart machine |
-
2015
- 2015-11-30 CN CN201510854499.7A patent/CN105491418A/en active Pending
- 2015-11-30 CN CN201710149420.XA patent/CN106954089A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102638716A (en) * | 2012-03-21 | 2012-08-15 | 华为技术有限公司 | Method, device and system for television remote control by mobile terminal |
| CN102892038A (en) * | 2012-09-28 | 2013-01-23 | 歌尔声学股份有限公司 | Auxiliary television multimedia interaction system and television interaction method |
| CN103838479A (en) * | 2012-11-21 | 2014-06-04 | 宏碁股份有限公司 | Electronic device and application software interface adjustment method |
| CN103064597A (en) * | 2012-12-28 | 2013-04-24 | 鸿富锦精密工业（深圳）有限公司 | Display control system and display control method |
| CN103617165A (en) * | 2013-10-22 | 2014-03-05 | 小米科技有限责任公司 | Picture loading method, device and terminal |
| WO2015079330A1 (en) * | 2013-11-28 | 2015-06-04 | Sony Corporation | Multimedia reading control device, graph acquisition device, electronic equipment, graph supply device and methods thereof |
| CN203933872U (en) * | 2014-06-17 | 2014-11-05 | 上海昌谷实业有限公司 | There is the multi-medium information spreading system of interactive device |
| CN104298443A (en) * | 2014-09-19 | 2015-01-21 | 百度在线网络技术（北京）有限公司 | Method, device and system used for presenting display interface |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105491418A (en) | 2016-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106502638B (en) | For providing the equipment, method and graphic user interface of audiovisual feedback | |
| CN105144071B (en) | Method and electronic equipment for managing user interface | |
| CN105187930B (en) | Interactive approach and device based on net cast | |
| CN104461318B (en) | Reading method based on augmented reality and system | |
| CN106537326A (en) | Mobile device input controller for secondary display | |
| CN108369455A (en) | Equipment, method and graphic user interface for providing touch feedback | |
| CN107896279A (en) | Screenshotss processing method, device and the mobile terminal of a kind of mobile terminal | |
| DE202016002906U1 (en) | Devices for navigating between user interfaces | |
| CN109219796A (en) | Digital touch on real-time video | |
| CN111782130A (en) | Column interface for navigating in a user interface | |
| US11706485B2 (en) | Display device and content recommendation method | |
| CN103827924B (en) | Information processor, information processing method | |
| CN107683470A (en) | Audio frequency control for web browser | |
| CN108984087A (en) | Social interaction method and device based on three-dimensional avatars | |
| CN109643214A (en) | Equipment, method and the graphic user interface of power sensitive gesture on equipment rear portion | |
| CN111464430B (en) | Dynamic expression display method, dynamic expression creation method and device | |
| CN110456949A (en) | For the equipment, method and graphic user interface of taskbar to be navigated and shown between user interface | |
| WO2023030010A1 (en) | Interaction method, and electronic device and storage medium | |
| CN109739418A (en) | The exchange method and terminal of multimedia application program | |
| CN110058754A (en) | A kind of option display method and terminal device | |
| CN107952242A (en) | A kind of terminal software experiential method, terminal and computer-readable recording medium | |
| CN110471588A (en) | Application icon method for sorting, device and mobile terminal | |
| CN110109604A (en) | A kind of application interface display methods and mobile terminal | |
| CN110221759A (en) | A kind of element dragging method, device, storage medium and interactive intelligent tablet computer | |
| CN109460170A (en) | Screen extension and exchange method, terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170714 |