CN103329087A - GUI generator, integrated circuit, GUI generating method, and GUI generating program - Google Patents

GUI generator, integrated circuit, GUI generating method, and GUI generating program Download PDF

Info

Publication number
CN103329087A
CN103329087A CN201280006438XA CN201280006438A CN103329087A CN 103329087 A CN103329087 A CN 103329087A CN 201280006438X A CN201280006438X A CN 201280006438XA CN 201280006438 A CN201280006438 A CN 201280006438A CN 103329087 A CN103329087 A CN 103329087A
Authority
CN
China
Prior art keywords
equipment
gui
parts
function
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201280006438XA
Other languages
Chinese (zh)
Inventor
阿曾光洋
秦秀彦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Corp of America
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Publication of CN103329087A publication Critical patent/CN103329087A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/52—Program synchronisation; Mutual exclusion, e.g. by means of semaphores
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/01—Social networking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40—Network security protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/568—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M7/00—Arrangements for interconnection between switching centres
    • H04M7/006—Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4108—Peripherals receiving signals from specially adapted client devices characterised by an identification number or address, e.g. local network address
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42684—Client identification by a unique number or address, e.g. serial number, MAC address, socket ID
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/2849—Audio/video appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/567—Multimedia conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • Human Resources & Organizations (AREA)
  • Power Engineering (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Security & Cryptography (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Computing Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An information terminal (1t) is provided with: a device information management unit (101) that acquires device information specifying first and second devices that are connected to a network; a device coordination service information management unit (103) that acquires coordination information specifying coordination behavior to be achieved by a first function of the first device and a second function of the second device; and a GUI generating and drawing unit (105) that makes a connection between first and second GUI components representing the first and second devices specified by the device information, and a third GUI component representing the coordination behavior specified by the coordination information.

Description

GUI generating apparatus, integrated circuit, GUI generation method, GUI generator program
Technical field
The present invention relates to the GUI generating apparatus, this GUI generating apparatus has: the facility information obtaining section, obtain for the facility information of determining equipment; And the GUI drawing section, describe GUI(Graphical UserInterface: graphic user interface) parts.
Background technology
There is GUI generating apparatus (for example, with reference to patent documentation 1) such as panel computer terminal, smart phone in past, and this GUI generating apparatus has: the facility information obtaining section, obtain for the facility information of determining equipment; And the GUI drawing section, describe GUI(Graphical User Interface) parts.
The prior art document
Patent documentation
Patent documentation 1: TOHKEMY 2008-305103 communique
Brief summary of the invention
The problem that invention will solve
But, can not realize easily utilizing needed the describing of cooperative action of being undertaken by the 1st and the 2nd equipment, estimate to be difficult to utilize cooperative action.
Summary of the invention
The object of the invention is to, a kind of information terminal that can easily utilize cooperative action is provided.
For the means of dealing with problems
In order to achieve the above object, the GUI generating apparatus of a mode of the present invention has: the facility information obtaining section, obtain the facility information be used to the 1st and the 2nd equipment of determining to be connected to network; The cooperative information obtaining section obtains the cooperative information of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And the GUI drawing section, expression being utilized the 1st and 2GUI(Graphical User Interface of the described the 1st and the 2nd equipment that described facility information determines) parts and expression utilize the 3GUI part relation of the described cooperative action that described cooperative information determines to get up to describe.
In addition, overall or concrete mode of the present invention also can realize in the mode of system, method, integrated circuit, computer program or storage medium, can also realize in the combination in any mode of system, method, integrated circuit, computer program and storage medium.
The invention effect
The present invention can provide the information terminal that easily utilizes cooperative action.
Description of drawings
Fig. 1 is the structural drawing of information terminal with equipment collaboration services display device of embodiments of the present invention.
Fig. 2 is the figure of an example of the facility information table of expression embodiments of the present invention.
Fig. 3 A is the figure of an example of the equipment collaboration services information table of expression embodiments of the present invention.
Fig. 3 B is the figure of an example of the execution action defined file of expression photo browsing service.
Fig. 3 C is the figure of an example of the execution action defined file of expression power management services.
Fig. 4 is the figure of an example of the GUI of expression embodiments of the present invention, and this GUI is used for the relation of the equipment of display device collaboration services and actuating equipment collaboration services.
Fig. 5 is the process flow diagram of the GUI of equipment collaboration services display device of the expression embodiments of the present invention example describing to process.
Fig. 6 is the process flow diagram of an example of expression user processing when operating the GUI of embodiments of the present invention, the GUI control part.
Fig. 7 A is the figure of an example of the GUI of expression embodiments of the present invention, and this GUI is used for showing the relation of service and equipment.
Fig. 7 B is the figure of an example of the GUI of expression embodiments of the present invention, and this GUI is used for showing the relation of service and equipment.
Fig. 8 A is the figure of another example of the GUI of expression embodiments of the present invention, and this GUI is used for showing the relation of service and equipment.
Fig. 8 B is the figure of another example of the GUI of expression embodiments of the present invention, and this GUI is used for showing the relation of service and equipment.
Fig. 9 A is the figure of expression GUI.
Fig. 9 B is the figure of expression GUI.
Figure 10 is the figure of expression record information storage part etc.
Figure 11 is the figure of expression GUI.
Figure 12 is the figure of expression user profile storage part etc.
Figure 13 A is the figure of expression GUI.
Figure 13 B is the figure of expression GUI.
Figure 13 C is the figure of expression GUI.
Figure 14 is the figure in expression room the 1st, the 2nd.
Figure 15 is the figure of expression native system.
Figure 16 is the figure of expression GUI.
Figure 17 is the figure of expression GUI.
Figure 18 is the figure of expression information terminal.
Embodiment
(as the opinion on basis of the present invention)
In present technique, the various device collaboration services that provides the function of the various device by will being connected in network to combine and realize to the user to hold intelligible mode.Thus, provide the user can easily select also graphic user interface (the GUI:Graphical User Interface) technology of the function of actuating equipment.
Inventors are in the process of the research and development of carrying out the information terminals such as panel computer terminal, and discovery might produce problem as described below.
That is, in recent years with AV(Audio Visual such as televisor or recording arrangements: audio frequency and video) the various digital devices such as the portable data assistances such as equipment, panel computer or smart phone, PC or printer carry out network connection mutually.And, the equipment collaboration services that mutually cooperates and realize by the function that makes these various devices has been proposed.
For example, at the DLNA(Digital Living Network Alliance of the mode that interconnects of specified devices: DLNA) in the standard, utilize the portable data assistance of network connection to be chosen in the dynamic image content of preserving in the recording arrangement.And, can utilize the TV by network connection to reproduce selected dynamic image content.
But, be that the multiple devices cooperation is moved in this equipment collaboration services.Therefore, the relation between these multiple devices complicates, and the function that the equipment collaboration services provides increases.Therefore, for the user, sometimes be difficult to easily understand the function that to utilize.
Therefore, expectation realizes and can provide equipment collaboration services and user can easily utilize the novel GUI of equipment collaboration services to the user to hold intelligible mode.
Relative therewith, the situation as prior art has: content display region is used for the information of the content that display device preserves; The operation display area territory is used for showing the information to the operation of content execution; And device display area, for the information of the object that shows executable operations.And, use the operating portion of Facility Control Terminal to be chosen in the information that each viewing area shows.When carrying out this selection, the service that is provided by the equipment that connects by wide area network is shown in device display area as candidate target.The prior art (for example, with reference to patent documentation 1) of existence take foregoing as feature.
But, in aforesaid prior art, only limit in the situation that three equipment cooperate, the user is provided for the equipment collaboration services of the content that operating equipment has to hold intelligible mode.Therefore, be difficult to tackle be not only content is operated and is equipment collaboration services when utilizing the function of certain equipment or four above equipment to carry out cooperative action from miscellaneous equipment.
For example, can consider not only AV equipment future, and the white domestic appliances products such as novel air conditioner or refrigerator are also wanted interconnection network.Therefore, can expect the cooperation of equipment room will be more complicated, the type of equipment collaboration services increases.But in the GUI of prior art, being difficult to provides the following this equipment collaboration services that increases to hold intelligible mode to the user, and is difficult to easy utilization.
In order to address this is that, the GUI generating apparatus of a mode of the present invention (with reference to information terminal 1t shown in Figure 1 described later) has: facility information obtaining section (equipment information management section 101), obtain the facility information (the facility information table 200 of Fig. 2) be used to the 1st and the 2nd equipment of determining to be connected to network; Cooperative information obtaining section (equipment collaboration services Information Management Department 103) obtains the cooperative information (the equipment collaboration services information table 300 of Fig. 3 A) of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And GUI drawing section (GUI generates drawing section 105), expression being utilized the 1st and 2GUI(Graphical User Interface of the described the 1st and the 2nd equipment that described facility information determines) parts (the node type GUI parts 402,403 of Fig. 4) and expression utilize the 3GUI parts (packet node type GUI parts 401) of the described cooperative action that described cooperative information determines to associate and describe.
Thus, comprise by interrelated 1GUI parts～3GUI parts in each GUI parts of describing and showing.Thus, can make cooperative action easily be utilized needed demonstration, and make and easily utilize cooperative action.
In addition, for example described cooperative information (equipment collaboration services information table 300) is identified for realizing the described the 1st and the 2nd function of described cooperative action, and the described the 1st and the 2nd equipment refers to the equipment (for example recording arrangement of Fig. 2) that utilizes described facility information to represent to have determined described the 1st function and utilizes described facility information to represent to have the equipment (televisor) of determined described the 2nd function.
Thus, even when having two equipment of a side with the 1st and the 2nd function and the opposing party's with the 1st and the 2nd identical function two equipment, also can carry out appropriate action.That is, for any two equipment, can both depict the 1st equipment in these two equipment 1GUI parts, the 2nd equipment the 2GUI parts and with these the 1st and the 3GUI parts that are associated of 2GUI parts.Therefore, can both carry out appropriate describing for any two equipment, and carry out reliably appropriate describing.
For example, also can be, the GUI generating apparatus has: display device (display device 106) shows to comprise the GUI(of described the 1st～the 3GUI parts of being depicted by described GUI drawing section with reference to GUI4001); Input media (input media 107), the operation that accepted user carries out the GUI parts that are contained among the described GUI; And GUI control part (GUI control part 108), according to the described operation of accepting by described input media, carry out the GUI action that is associated with the described GUI parts of described user selection.
Thus, by operating, carry out the GUI action of carrying out above-mentioned cooperative action for making, and carry out cooperative action.Therefore, the operation by this simple GUI generating apparatus can realize carrying out the needed operation of cooperative action, and needed operation is finished by shirtsleeve operation.
For example, also can be, described GUI drawing section describe with described 1GUI parts be connected the line (with reference to the line 16043 of line 8L, Figure 16 of Fig. 4 etc.) of straight line that the 2GUI parts connect or curve.
Therefore, by describing and showing above-mentioned line, can express corresponding relation, and the corresponding relation ratio is easier to understand.
For example, also can be, described GUI drawing section describes to have represented to be implemented the information of the described GUI parts of the described operation that described input media accepts, after accepting, with from accept before describe the different mode of the mode of this information and describe this information.
For example, also can be, described GUI drawing section describes to represent the described the 1st and 2GUI parts of the described the 1st and the 2nd equipment, and with expression comprise these the described the 1st and the packet node type GUI parts of the group of 2GUI parts, be depicted as the described 3GUI parts of the described cooperative action of expression.
For example, also can be, accepting the described 3GUI parts (the packet node type GUI parts 701 of Fig. 7 A) of user to describing by described input media, and in the situation of the drag-and-drop operation that the 4GUI parts (node type GUI parts 702) that represent an equipment are carried out (operation 702m), the described GUI control part described equipment (illumination in parlor) that described 4GUI parts are represented is registered as, an equipment that moves during the represented described cooperative action (power management services) of the described 3GUI parts before execution has been implemented described drag-and-drop operation.
Therefore, can easily register.
For example, also can be, described GUI generating apparatus has resume storage part (record information storage part 109b), storage is used for determining the data (the data 109x of Figure 10) of the effective number of times of described cooperative action, in the situation of described number of times more than threshold value that the described data that utilization is stored are determined, described GUI drawing section is described with the many forms of the number of times that is suitable for operating (with reference to the button-type GUI parts 703m of Figure 11), in the situation that described number of times is less than threshold value, described GUI drawing section is described with the fewer form of the number of times that is suitable for operating (with reference to button-type GUI parts 703n).
Thus, under any circumstance can both describe with suitable form, can realize reliably describing of suitable form.
In addition, above-mentioned threshold value is such as being threshold value of the proper value that is determined by experiment etc.
For example, also can be, described GUI generating apparatus has storage part (user profile storage part 109b), store the data (the data 109x of Figure 12) of the equipment of holding for the user who determines this GUI generating apparatus, in the situation of the function that the described equipment of holding that use utilizes described data to determine when carrying out described cooperative action has, described GUI drawing section is described with the many forms of the number of times that is suitable for operating, in the situation that do not use described function, described GUI drawing section is described with the fewer form of the number of times that is suitable for operating.
Thus, under any circumstance can both describe with suitable form, can realize reliably describing of suitable form.
For example, also can be, the a plurality of described data of described storage portion stores (information 109n), the equipment that each described data are held for the described user who determines a plurality of these data of user, described GUI generating apparatus has determination portion (user's determination portion 109a), determine the suggested user of described GUI from described a plurality of users, described GUI drawing section is according to determined described user's described data, and switching is suitable for the more form of described number of times and is suitable for the less described form of described number of times.
For example, also can be, described facility information obtaining section with radio communication and the near zone (the 1st room 1H1a of Figure 14) that is positioned at this GUI generating apparatus comprise the described the 1st and two above equipment of the 2nd equipment communicate, described facility information is used for these two the above equipment in definite described near zone, but the uncertain equipment that is positioned at other zone (the 2nd room 1H1b), described GUI drawing section only describes to represent the plural GUI parts of described two the above equipment in the described near zone, does not describe the GUI parts of the described equipment in described other zone.
For example, also can be, the system (system 1s) that comprises this GUI generating apparatus comprises the described the 1st and the 2nd equipment, with the 3rd equipment, the the described the 1st and the 2nd equipment is located in the 1st (the 1st 1H1 of Figure 15), described the 3rd equipment is located in the 2nd (the 2nd 1H2), described cooperative action is the described the 1st and the 2nd function of utilizing described the 1st described the 1st equipment and described the 2nd equipment to have, i.e. the 3rd function realization of the function identical with described the 2nd function that the 2nd described the 3rd equipment has, described GUI drawing section also describes to represent the GUI parts of the 3rd equipment, described GUI control part makes the described the 1st and the 2nd equipment carry out respectively the described the 1st and the 2nd action, and make described the 3rd equipment carry out described the 3rd action, as the described GUI action of when having accepted described operation, having carried out.
In addition, for example also can be the 1st network in the 1st of the 1st the 1st and the 2nd equipment connection, the 2nd network that the 2nd the 3rd equipment connection is other.
In addition, also can be, the 1st the 1st and the 2nd equipment be at the remote location away from this GUI generating apparatus, and the 2nd the 3rd equipment is positioned at remote location.
For example, also can be that in the situation that this GUI generating apparatus has described the 2nd function, this GUI generating apparatus is carried out the action based on described the 2nd function when carrying out described cooperative action as described the 2nd equipment.
For example, also can be, described 3GUI parts (with reference to packet node type GUI parts 401 of Fig. 4 etc.) with described 1GUI parts (node type GUI parts 402) be connected the described line (line 8L) that 2GUI parts (node type GUI parts 402) are connected and be associated.
For example, also can be that described 3GUI parts (for example the GUI parts 1603) are depicted on the described line (line 1604).
Also can be that described line (line 1604) is to be illustrated in to utilize represented described the 1st equipment of described 1GUI parts (GUI parts 1601) and utilize arrow line (line 1604) when carrying out described cooperative action between represented described the 2nd equipment of described 2GUI parts (GUI parts 1602), the data transfer direction.
Thus, show the data transfer direction in the cooperative action, can realize than the demonstration that is easier to understand cooperative action.
Also can be that described 3GUI parts are depicted between described 1GUI parts (GUI parts 1601) and the described 2GUI parts (GUI parts 1602).
Like this, present technique is the technology that solves aforesaid prior art problem.Namely, can provide so novel GUI according to present technique: in the equipment collaboration services that the multiple devices cooperation realizes, to hold intelligible mode to the relation between user's prompt facility collaboration services, these equipment, the user can easily utilize the equipment collaboration services.
In addition, in order to solve aforesaid existing issue, the GUI generating apparatus of a mode of the present invention has: the facility information obtaining section, obtain and the device-dependent facility information that is connected to network; The cooperative information obtaining section obtains the cooperative information for definite function, and this function is for each action of a plurality of actions that realize carrying out when carrying out the cooperative action that is used for the realization collaboration services; And GUI generates drawing section, to comprise the described facility information that utilizes this obtained equipment the described equipment more than two that has the described described equipment of determined each function and consist of will be shown, relation with described collaboration services, be depicted as GUI(Graphical User Interface), and describe to comprise the node type GUI parts that represent described collaboration services, and the node type GUI parts that comprise the described individual device in described two the above equipment of expression consist of, represent that the plural described node type GUI parts that are connected of described equipment are at interior described GUI.
That is the GUI that, describes comprises the node type GUI parts that represent collaboration services and the plural node type GUI parts (GUI parts) of indication equipment.And, for example in the plural node type GUI parts that are connected of indication equipment, in two the situation in the number of the node type GUI parts that comprise, these two GUI parts are connected, in the situation that number is n and n＞=3, at least one GUI parts and remaining GUI parts in the n-1 that connects node type GUI parts are connected.
According to this structure, the multiple devices of actuating equipment collaboration services and the GUI that concerns of equipment collaboration services can be shown as the graph of a relation between the node type GUI parts.Therefore, utilize the user of equipment collaboration services can be according to the relation of holding intelligible GUI and show to confirm equipment collaboration services and the multiple devices that are associated.Thus, can be easily operation by node type GUI parts come the actuating equipment collaboration services.
According to the equipment collaboration services display device of present technique, the user can be visually confirms as graph of a relation between the node type GUI parts with the relation of the multiple devices of actuating equipment collaboration services and equipment collaboration services.On the basis of having carried out this affirmation, by running node type GUI parts, easily actuating equipment collaboration services.
In addition, these overall or concrete modes also can realize in the mode of system, method, integrated circuit, computer program or storage medium, can also realize in the combination in any mode of system, method, integrated circuit, computer program or storage medium.
Below, the embodiment that present invention will be described in detail with reference to the accompanying.
In addition, the embodiment that the following describes is all be used to a concrete example of the present invention is shown.The sequential scheduling of the allocation position of the numerical value shown in the embodiment below, shape, material, inscape, inscape and connected mode, step, step only is an example, and its purport is not to limit the present invention.Therefore, the inscape of in the inscape about following embodiment, not putting down in writing in the independent claims of expression upper concept only describes as inscape arbitrarily.
This GUI generating apparatus (information terminal 1t) has: equipment information management section 101, obtain facility information 200s(Fig. 1 relevant with the equipment 1e that is connected to network (for example network 1n of Figure 15)); Equipment collaboration services Information Management Department 103, obtain for cooperative information 300s(Fig. 3 A, Fig. 1 of determining function (the picture data management function of the 2nd row of Fig. 3 A, photo Presentation Function etc.)), each action in a plurality of actions (for example, action 1e1p, the 1e2p of Figure 15) that this function is used for realizing carrying out when carrying out the cooperative action that is used for the realization collaboration services; And GUI generates drawing section 105, to comprise the facility information 200s that utilizes this obtained equipment the equipment (equipment of Figure 15 (recording arrangement) 1e1 with determined each described function (function 300F) will be shown, equipment (televisor) 1e2) two above equipment (the equipment 1e1 that consists of, 1e2), relation (relation of the GUI8x of Fig. 4) with collaboration services (photo browsing service), be depicted as GUI(Graphical User Interface) (GUI8x, 106s), and describe to comprise the node type GUI parts (the packet node type GUI parts 8M of Fig. 4) that represent this collaboration services the GUI(picture), and comprise the expression described two above equipment (equipment 1e1, the node type GUI parts of the individual device 1e2) (GUI parts 8N) and two above node type GUI parts 8N that connect with line 8L of consisting of are at interior GUI(GUI8x, the GUI(picture) 106s).
That is in the plural node type GUI parts 8N that is connected of indication equipment, be that these two GUI parts are connected in two the situation in the number of the node type GUI parts that comprise.And in the situation that number is n and n＞=3, at least one GUI parts and remaining GUI parts in the n-1 that connects node type GUI parts are connected.
In addition, for example also can be to comprise system 1s(Figure 15 of this information terminal 1t) comprise respectively the 1st, the 2nd and the 3rd equipment (equipment 1e1, the 1e2 of Figure 15,1e3) as equipment 1e.
Also can be to be located at respectively among the 1st 1H1 (Figure 15) as the 1st equipment 1e1 of recording arrangement etc. with as the 2nd equipment 1e2 of televisor etc.
Also can arrange according to as described below about the 3rd equipment 1e3 as televisor etc.
That is, also can be located among the 2nd 1H2.
In addition, also can be, when the 1st equipment 1e1 of the 1st 1H1 and the 2nd equipment 1e2 carry out respectively the 1st action 1e1p and the 2nd action 1e2p, the 3rd equipment 1e3 carries out with the 2nd action 1e2p(for example by the demonstration of the image of the 1st equipment 1e1 output) demonstration of the identical action image that namely the 3rd action 1e3p(is identical), realize thus the cooperative action of these the 1st～the 3rd equipment 1e1～1e3.
Also can be to represent node type GUI parts 8N(Fig. 4 of the 3rd equipment 1e3) depicted by GUI generation drawing section 105, and show by display device 106.
In addition, also can be, GUI control part 108 makes the 1st and the 2nd equipment 1e1,1e2 carry out respectively the 1st and the 2nd action 1e1p, 1e2p and makes the 3rd equipment 1e3 carry out aforesaid the 3rd action 1e3p, as the operation 404M(Fig. 4 such as touch operation that accepting the user and carry out) time performed GUI action.
Thus, even in 2 1H2 of father and mother family's grade in an imperial examination, also can show identical image, no matter in which family (the 1st, the 2nd 1H1,1H2), can both carry out appropriate action.Thus, can carry out more reliably appropriate action.
And the operation that does not need father and mother to wait in the 2nd 1H2 to carry out etc. only utilize information terminal 1t to carry out above-mentioned processing in 1 1H1 of children family's grade in an imperial examination and get final product, can avoid carrying out difficult operation, and needed operation can be finished by shirtsleeve operation.
(embodiment)
Fig. 1 is the structural drawing of the equipment collaboration services display device (information terminal) of embodiments of the present invention.
In Fig. 1, the facility information (data 200s) of equipment information management section 101 management definition (storage) in facility information table 102, the equipment collaboration services information (data 300s) of equipment collaboration services Information Management Department 103 management definition (storage) in equipment collaboration services information management table 104.
Fig. 2 is that expression is as the figure of the facility information table 200 of an example of facility information table 102.
Identifier), the IP(Internet Protocol of equipment in facility information table 200, defined device id (Identifier:: Internet protocol) address, device name, functions of the equipments (the 2nd row～the 5 row of the table of Fig. 2) as facility information.
That is, also can be for example to store the 2nd row of the table of the plural data 200s(Fig. 2～data 200s of the 5th row, data 200s of the 6th row～eighth row by facility information table 200 ...).
In addition, also can be that each data 200s comprises the content more than in device id (the 1st data) 200a, IP address (the 2nd data) 200b, device name (the 3rd data) 200c, the functions of the equipments (the 4th data 200d) of the equipment (for example with reference to Figure 15 described later equipment 1e) of these data 200s.
In addition, also can be that the number of the 4th data 200d that comprises for example is more than two shown in the 2nd row of Fig. 2～data 200s of the 5th row, data 200s of the 6th row～eighth row.
In these device ids that are contained in each data 200s etc., device id is the unique identifier be used to the equipment of determining to be connected to network (with reference to the equipment 1e of Figure 15).
Near-field communication) etc. in addition, part or all of above-mentioned network is such as being WLAN (Local AreaNetwork: LAN (Local Area Network)), bluetooth(bluetooth), NFC(Near Field Communication: based on the network of radio communication.
In addition, about device id (table of Fig. 2 the 1st row), such as the MAC(Media Access Control of the equipment that can use this device id: medium access control) address, this equipment to interconnect standard according to network be UPnP(Universal Plug and Play: universal plug and play) the identifier UUID(Universal Unique Identifier of standard code: universal unique identifier) etc.
In addition, device name (the 3rd row) refers to the name of this equipment (equipment 1e).
In addition, for example utilizing the device name of the equipment of device id " 2001 " expression in the 2nd of Fig. 2～the 5th row is " recording arrangement in parlor ".
In addition, functions of the equipments (the 4th row) refer to the data for the function of determining equipment that can be by network facility information (data 200s) that use, that comprise these functions of the equipments.
For example, utilize in the function of the recording arrangement (recording arrangement in parlor) that device id " 2001 " illustrates at the 2nd row of Fig. 2～the 5th row, defined " recording function " (the 2nd row), " dynamic image data management function " (the 3rd row), " picture data management function " (the 4th row), " power control function " (the 5th row) etc.
In addition, this information terminal (equipment collaboration services display device) 1t for example is that the equipment of the data 200s in the 9th row is " panel computer ".
Fig. 3 A is that expression is as the figure of the equipment collaboration services information table 300 of an example of equipment collaboration services information table 104.
In this equipment collaboration services information table 300, service ID, service name, cooperation relation, service URI(Uniform Resource Identifier have been defined as equipment collaboration services information (data 300s): Uniform Resource Identifier) (the 1st row the～the 4 row).
That is, also can be to store the 2nd row, the 3rd row of the table of more than one data 300s(Fig. 3 A by equipment collaboration services information table 300 ...).
Also can be that each data 300s comprises service ID (the 1st data) 300a, service name (the 2nd data) 300b, cooperation relation (the 3rd data) 300c, service URI(the 4th data in the service (collaboration services, cooperative action) of these data 300s) 300d.
The service ID of equipment collaboration services information table 300 (for example " 3001 " of the 2nd row) is the equipment collaboration services (photo browsing service) that comprises these data of data 300s(300s of this service ID for management) identifier.
Service name (the 2nd row) is to hold the title that intelligibly the equipment collaboration services is described.
In addition, cooperation relation (the 3rd row) for example represents the annexation between the function of two above equipment of needs for the equipment collaboration services of carrying out the data 300s that comprises this cooperation relation.
For example, utilizing the cooperation relation of " the photo browsing service " of service ID " 3001 " (the 2nd row) definition is " service execution function-(picture data management function, photo Presentation Function) " (" photo Presentation Function-picture data management function ").
Wherein, symbol "-" represents that the equipment that has in each function shown in the both sides of this symbol "-" is connected to each other.
In addition, exist to use " service execution function-(picture data management function, photo Presentation Function) " form that symbol " () " records and narrates, i.e. " function A-(function B, function C) " form.The equipment that this form represents to have function A with have function B and be connected equipment with function C and be connected respectively.
In addition, the annexation of the function of equipment has been described about cooperation relation, but the data of cooperation relation except the annexation of the function of indication equipment, the two or more function that can also be interpreted as indication equipment and annexation based on the equipment collaboration services of these functions.
For example, the data of cooperation relation also can be expressed as " service execution function-(picture data management service, photo Presentation Function) " (the 2nd row).In addition, above-mentioned " picture data management service " represents " picture data management function " in Fig. 3.In this case, the service execution function refers to mutually cooperate a kind of function in the equipment collaboration services of carrying out of multiple devices, represents the meaning that is connected with " the picture data management service " of the function with management picture data etc.
In addition, service URI(the 4th row of equipment collaboration services information management table 300) allocation position of expression execution action defined file (http: // 192.168.1.11/photoService), this execution action defined file has been recorded and narrated the concrete execution action of equipment collaboration services (for example " photo browsing service ") that definition has the data 300s of this service URI.
At this, the execution action defined file is that the form that can explain of equipment (for example panel computer of the device id of Fig. 2 " 2003 " (the 9th row)) with the service execution function in the functions of the equipments shown in Figure 2 is recorded and narrated.
HTML (Hypertext Markup Language)) extend markup language), HTML(HyperText Markup Language for example, the execution action defined file is to use XML(Extensible Markup Language:: markup language or the Java(registered trademark such as) Script supervisor language etc. records and narrates.
In addition, the allocation position of file is with URI(Uniform Resource Identifier) the form record.
In addition, also can be that the execution action defined file for example is the file 1xF that stores in 9 server 1x shown in Figure 15.
Fig. 3 B, Fig. 3 C are respectively that expression is as execution action defined file 301,302(file 1xF an example, photo browsing service and power management services) figure.
In execution action defined file 301,302, definition service ID and service name in Service (service) label.And definition is used for function name (function attribute) and the function title (name attribute) of regulation execution action in action (action) label.And the filename etc. of program of the function of this function name has been installed in definition in Script (script) label.
Above use Fig. 2 and Fig. 3 A～Fig. 3 C describe facility information table 102 and equipment collaboration services information management table 104 in detail.Below, turn back to the explanation of structure shown in Figure 1.
In Fig. 1, GUI generates drawing section 105 and obtains equipment collaboration services information (data 300s) from equipment collaboration services Information Management Department 103.
And GUI generates 105 pairs of each obtained equipment collaboration services information (data 300s) of drawing section and carries out following processing.That is, there is plural facility information (data 200s) determined according to the cooperation relation definition (the 3rd data 300c of Fig. 3 A) of this equipment collaboration services information, that need for the equipment collaboration services of carrying out this equipment collaboration services information.In this is processed, obtain this plural facility information from equipment information management section 101.
Then, GUI generates drawing section 105 with obtained equipment collaboration services information (data 300s) and facility information (data 200s), is depicted as node type GUI parts (with reference to node type GUI parts 8N, the packet node type GUI parts 8M of Fig. 4 described later).
In addition, more particularly, GUI generates drawing section 105, for the equipment collaboration services of this equipment collaboration services information with carry out relation between two above equipment of this equipment collaboration services, utilize straight line or curve etc. to couple together between a plurality of node type GUI parts and to describe (with reference to line 8L of Fig. 4 etc.).
Fig. 4 is that expression GUI generates the GUI(GUI4001 that equipment collaboration services information (the data 300s of the 2nd row) that drawing section 105 illustrates according to the service ID of utilizing Fig. 3 A " 3001 " is described) the figure of an example.
In Fig. 4, the device name that the equipment of photo browsing service (the 2nd row of Fig. 3 A) is carried out in expression is the 6th～8 row of the TV(Fig. 2 in parlor) node type GUI parts 402 and the node type GUI parts 403 of the recording arrangement (the 2nd row of Fig. 2～the 5th row) in expression parlor between, (line 8L) is connected and describes by curve, explains the annexation between these two equipment.
In addition, the node (packet node type GUI parts 401) of expression photo browsing service is grouped into a group with node type GUI parts 402 and node type GUI parts 403.That is, utilize this packet node type GUI parts 401 to represent to comprise in addition the group of two node type GUI parts 402 and node type GUI parts 403.
In addition, later on like this node type GUI parts of node type GUI parts packetizing being called packet node type GUI parts.
In addition, the button-type GUI parts 404 of the function that the photo browsing service provides in packet node type GUI parts 401, have been described to be used for to carry out.
At this, the character string that button-type GUI parts 404 are described " is appreciated photo with TV ", be to obtain and set from the name attribute of the Action label of the execution action defined file 301 of Fig. 3 B.
In addition, the function of having carried out when user (with reference to the user 1u1A of Figure 15) has selected button-type GUI parts 404 is that the function name that utilization obtains from the function attribute of the Action label of the execution action defined file 301 of Fig. 3 B defines.
As mentioned above, GUI generates drawing section 105 can be depicted as the relation of an above equipment of equipment collaboration services and actuating equipment collaboration services node type GUI parts (with reference to packet node type GUI parts 401 etc.), and the button-type GUI parts (button-type GUI parts 404) also carried out of the function of describing user selection equipment collaboration services is provided.
Then, in Fig. 1, display device 106 shows the image of this GUI of GUI(that is described by GUI generation drawing section 105 at the picture of liquid crystal display or touch plate type display etc.).
Input media 107 is the input medias such as finger mouse, touch pad or keyboard, will be for user's operation (the operation 404M of Fig. 4 etc.) notice GUI control part 108 that operates the GUI that is described by GUI generation drawing section 105.
Will be for user's operational notification GUI control part 108 of the GUI that is described by GUI generation drawing section 105 from input media 107.GUI control part 108 has determined to be implemented the GUI parts (node type GUI parts or button-type GUI parts) of the operation of notifying after receiving this notice, and carries out the function that determined GUI is distributed.
The structure of the equipment collaboration services display device of present embodiment more than has been described.Below, use Fig. 5 and Fig. 6 that the treatment scheme of the equipment collaboration services display device of present embodiment is described.
Fig. 5 is the process flow diagram of the GUI of equipment collaboration services display device of the expression embodiments of the present invention example describing to process.
Equipment collaboration services display device describe process beginning after, at the step S501 of Fig. 5, GUI generates drawing section 105 and obtains equipment collaboration services information (with reference to the data 300s of Fig. 3 A) from equipment collaboration services Information Management Department 103.
Below, an example of usefulness as an illustration is to describing from the situation that is obtained the information on services of service ID " 3001 ", service name " photo browsing service " by the equipment collaboration services information table 300 of Fig. 3 A of equipment collaboration services Information Management Department 103 management.
Then at step S502, the GUI of information on services (the data 300s of the 2nd row) that has obtained the service ID " 3001 " of Fig. 3 A generates drawing section 105, obtains the facility information (with reference to the data 200s of Fig. 2) relevant with service ID " 3001 " from equipment information management section 101.
At this moment, equipment information management section 101 is according to " collaboration feature " to service ID " 3001 " definition, from the facility information table 200 of Fig. 2, extract the equipment (information of this equipment) relevant with the service ID " 3001 " that is generated drawing section 105 notices by GUI, and notice GUI generates drawing section 105.
Specifically, " collaboration feature " owing to as service ID " 3001 " shows service execution function, picture data management function, picture data Presentation Function, thereby carries out following extraction and process from the facility information table 200 of Fig. 2.In this extracts, extract the equipment (the data 200s of equipment) of device id " 2003 " (the 9th row) that each function in these functions is defined as " functions of the equipments " (the 4th row of Fig. 2), device id " 2001 " (the 2nd row～the 5th row), device id " 2002 " (the 6th row～eighth row).And, each data 200s notice GUI that extracts is generated drawing section 105.
Then at step S503, GUI generates drawing section 105 according to obtained equipment collaboration services information (data 300s) and facility information (data 200s), describes aforesaid GUI shown in Figure 4.
In addition, in Fig. 4, for the restricted number of the equipment that will once describe is minimum necessary amount, equipment (equipment of user's direct control) for the equipment collaboration services display device with present embodiment, " panel computer " with device id " 2003 " is not shown as node type GUI parts, but can be shown as node type GUI parts yet.
Above, use Fig. 5 to illustrate that the GUI of the equipment collaboration services display device of embodiments of the present invention describes treatment scheme.
Fig. 6 is the process flow diagram of user's processing when having operated the GUI of Fig. 4, GUI control part 108.
In Fig. 6, after the user had operated the GUI that is shown in display device 106 by input media 107, at step S601, GUI control part 108 had determined to be implemented the GUI parts of this operation.
In addition, in this example of usefulness as an illustration, suppose that display device 106 is to comprise contact panel display as the touch pad of input media 107 etc.
Behind this contact panel display of user's touch operation, coordinate (X, Y) the notice GUI control part 108 on the touch pad that input media 107 touched the user.GUI control part 108 is determined to generate among the GUI that drawing section 105 describes the GUI parts (node type GUI parts or button-type GUI parts) that overlap with notified coordinate (X, Y) by GUI.In addition, as the information of coincidence needing describing coordinate position or describing the information of scope (wide or high) of GUI parts carrying out being used to judge when this is determined, suppose to generate at GUI and preserved this information when drawing section 105 is described GUI.
Behind the GUI parts of determining user's operation, at step S602, GUI control part 108 is carried out the GUI action that is associated with determined GUI parts.For example, in Fig. 4, as when the user has carried out selecting operation to button-type GUI parts 404, as the GUI action that is associated with button-type GUI parts 404, carry out service URI(the 2nd row the 4th row that utilize service ID " 3001 " (the 2nd row of Fig. 3 A)) specified equipment collaboration services.
Specifically, utilizing the equipment collaboration services of the service URI appointment of service ID " 3001 ", is to utilize the execution action defined file 301 of Fig. 3 B to define.Therefore, the function attribute of the Action label of the execution action defined file 301 of Fig. 3 B is the action of the function of " showPhotoOnTV " when selecting action button type GUI parts 404, and action is performed as GUI.
In addition, about the relevance of GUI action with the GUI parts, suppose to generate the relations of distribution of preserving this relevance when drawing section 105 is described GUI at GUI.
In addition, as the GUI action that is associated with the GUI parts of user selection, be not only the execution action of equipment collaboration services.For example, also can be to indicate, so that only describe the information relevant with selected GUI parts, or emphasize to describe (change color or lines overstriking, the change line style of type etc. is described).At step S602,108 pairs of GUI generations of GUI control part drawing section 105 is carried out the action of this indication etc.
In addition, the user not only selects operation to node type GUI parts or packet node type GUI parts, also can carry out drag-and-drop operation (with reference to operation 702m) to packet node type GUI parts (with reference to the packet node type GUI parts 701 of Fig. 7 A).
At this moment, also can be that at step S601, GUI control part 108 determines respectively to be pulled the GUI parts (node type GUI parts 702) of (drag) and (the packet node type GUI parts 701) of conduct placement (drop) destination.Thus, GUI control part 108 can be carried out the GUI action to distributing as the GUI parts (packet node type GUI parts 701) of placing the destination.
At this, can pre-defined GUI action to distributing as the GUI parts of placing the destination.In addition, the for example GUI of performed packet node type GUI parts 701 action refers to such as in each node type GUI parts that append in the group that is contained in this packet node type GUI parts 701, by the action of the node type GUI parts 702 that pull to this packet node type GUI parts 701 etc.
For example, the function attribute of the Action label of the execution action defined file 302 of Fig. 3 C can be processed the GUI action that is assigned as when being placed for the function of " addDevice ".And the GUI action in the time of node type GUI parts can being dragged and dropped to the region exterior of packet node type GUI parts, the function attribute that is assigned as the Action label are processed for the function of " removeDevice ".
With Fig. 7 concrete example is described.
Fig. 7 A is the figure of expression GUI7001.
Fig. 7 B is the figure of expression GUI7002.
In Fig. 7 A, Fig. 7 B, show respectively GUI and generate the state that drawing section 105 has been described to utilize the power management services shown in the facility information table 200 (with reference to the service ID " 3003 " in the 4th row of Fig. 3 A) and had the equipment (with reference to the device id among Fig. 2 " 2001 ", " 2002 ", " 2004 ") of power control function.
In addition, in the GUI7001 of Fig. 7 A, in the packet node type GUI parts 701 of expression " power management services ", do not comprise the node type GUI parts 702 of expression " illumination in parlor ".Therefore, " illumination in parlor " be not based on the object to " power supply is connected in the lump " or " power supply disconnects in the lump " of the user of button-type GUI parts (703,704) operation.
The user pulls node type GUI parts 702 and is placed on the position of packet node type GUI parts 701 (operation 702m) from this not involved position.Then, GUI control part 108 is carried out the GUI action as the packet node type GUI parts 701 of placing the destination, makes the state of the GUI7002 that becomes Fig. 7 B.At this moment, " illumination in parlor " become " power management services " " power supply is connected in the lump " or " power supply disconnects in the lump " operation object.
That is, as the switching that the connection of power supply disconnects, the switching that disconnects to power supply is arranged in button-type GUI parts 703 and in button-type GUI parts 704 to the switching of power connection.
And, when the GUI7002 of depiction 7A, carry out " TV in parlor " and " recording arrangement in parlor " these two equipment switchings separately.On the other hand, after having carried out above-mentioned operation 702m, when the GUI7002 of depiction 7B, carry out these three equipment switchings separately of " illumination in parlor " equipment of these two equipment and the node type GUI parts 702 that quilt is pulled in operation 702m.
According to aforesaid drag-and-drop operation, also can carry out user's operation as shown in Figure 8.
Fig. 8 A is the figure of expression GUI8001.
Fig. 8 B is the figure of expression GUI8002.
In each GUI of the GUI8001 of Fig. 8 A, Fig. 8 B and GUI8002, show i.e. " photo browsing service " (packet node type GUI parts 401) of service of the demonstration of the photo that " TV in parlor " equipment (with reference to equipment 1e2) of utilizing node type GUI parts 702 expressions that are positioned at oneself dwelling house (with reference to the 1st 1H1 of Figure 15) carries out browsing.In addition, in each GUI, show the equipment that is connected with information terminal 1t by the Internet (for example network 1n of Figure 15) (with reference to the equipment 1e(equipment 1e3 of the 2nd 1H2)) the node type GUI parts 801 of " equipment of father and mother family ".Shown these packet node types GUI parts 401 and node type GUI parts 801 are depicted in respectively in the packet node type GUI parts (401,802).
At this, in the GUI8001 of Fig. 8 A, the user is residing from " equipment of father and mother family " (node type GUI parts 801), drag-and-drop operation is carried out in the packet node type GUI parts 802 residing positions of the 2nd 1H2.In this drag-and-drop operation, will utilize demonstration thing (icon etc.) drag-and-drop operation of TV of this node type GUI parts 801 expression to the position (with reference to the operation 702m of Fig. 7 A) of " photo browsing service " (packet node type GUI parts 401) of oneself dwelling house.In addition, shown GUI106S(is with reference to the GUI106s of Fig. 8 A, Fig. 8 B(Fig. 1)) become the GUI8002 of Fig. 8 B.Thus, can make the TV(equipment 1e3 of father and mother family (the 2nd 1H2)) identify oneself with in the individual device of in the photo browsing service, utilizing.That is, the TV of father and mother family is included in the equipment more than one that shows photo.
Namely, the user is after having carried out this participation operation, only action button type GUI parts 404(" appreciates photo with TV "), can in " TV " of father and mother family (equipment 1e3), be presented at " recording arrangement in parlor " (with reference to the equipment 1e1(Figure 15 among the 1st 1H1), the node type GUI parts 403 of oneself dwelling house) in the photo preserved.
That is, the father and mother such as no matter as the children of the user 1u1A of the 1st 1H1 wait the operation of whether being accustomed to equipment 1e3, and the user 1u2 of the 2nd 1H2 all can be as follows.That is, only by utilizing the information terminal 1t as the 1st 1H1 of children's user 1u1A to carry out above-mentioned processing, can utilize the equipment 1e3 of the 2nd 1H2 to show the photo identical with the photo that in the 1st 1H1, shows.Thus, the appropriate action of photo can be in more family, shown, appropriate action can be carried out more reliably.
According to this structure, the multiple devices of actuating equipment collaboration services and the GUI that concerns between this equipment collaboration services can be shown as the graph of a relation between packet node type GUI parts or node type GUI parts.
Therefore, utilize the user of equipment collaboration services can show to confirm by holding intelligible GUI the relation of equipment collaboration services and multiple devices relevant with this equipment collaboration services.And, can be easily operation by button-type GUI parts come the actuating equipment collaboration services.
In addition, as packet node type GUI parts or the property value that represents with node type GUI parts, equipment or equipment collaboration services are illustrated as an example.On the other hand, shown property value can be " setting position " of equipment in the diagram of Fig. 8 A, Fig. 8 B, for example is expressed as " equipment of father and mother family ", also can be " people " of holding equipment or service etc.
For example, if with setting position as the represented property value of packet node type GUI parts, then only by with the equipment drag-and-drop operation of undefined setting position in this packet node type GUI parts, the user is the definable setting position.
In addition, if will hold the people of equipment or service as the represented property value of node type GUI parts, then by to the selection of this node type GUI parts operation, can only select equipment or the service that " people " that utilize node type GUI parts to represent hold and show.
In addition, as the property value of " setting position " or " people " etc., can be in the equipment collaboration services information table of the facility information table of Fig. 2 or Fig. 3 the predetermined property value of definition, also can dynamically append property value according to user's operation.
In addition, the equipment collaboration services information of equipment collaboration services Information Management Department 103 management or the facility information of equipment information management section 101 management have been described in the present embodiment, by the situation of pre-save in equipment collaboration services information management table 104 or facility information table 102.On the other hand, also can be by retrieval facility collaboration services information or facility information from the equipment that is connected in network, dynamically to append management.
Fig. 9 A is the figure of expression GUI7001a.
The GUI that describes for example also can be the GUI7001a shown in Fig. 9 A.
This GUI7001a comprises the plural node type GUI parts (node type GUI parts 701a, 701b) of indication equipment (" TV in parlor ", " recording arrangement in parlor ").
Also can carry out respectively touch operation (operation 7t1,7t2) to these plural node type GUI parts.
Also can be after carrying out each operation, to describe to comprise the packet node type GUI parts 701 of the plural node type GUI parts (node type GUI parts 701a, 701b) that have been implemented these operations.
In addition, also can be, for example judge whether the equipment of these plural node type GUI parts carries out the equipment more than two of cooperative action, to carry out in the situation of the equipment more than two of cooperative action being judged to be only, carry out describing of packet node type GUI parts 701, in the situation that is judged to be the equipment more than two that is not to carry out cooperative action, do not carry out describing of packet node type GUI parts 701.
Fig. 9 B is the figure of expression GUI7001a.
Also can carry out the operation 7m for definite area 7mR, this zone 7mR comprises the position of plural node type GUI parts (node type GUI parts 701a, 701b).
Also can be after carrying out this operation 7m, in the regional 7mR definite by this operation 7m, to describe to comprise packet node type GUI parts 701 this position and that comprise these plural node type GUI parts.
In addition, also can be shown in Fig. 9 B, to be to make operation that the position of the finger of user 1u1A moves in the periphery of this zone 7mR etc. such as operation 7m.
In addition, also can be that the describing of above-mentioned packet node type GUI parts 701 only carried out when following situation.
That is, exist comprise the plural node type GUI parts (node type GUI parts 701a, 701b) that comprise in this packet node type GUI parts 701 separately equipment and the combination of the equipment that consists of.Above-mentioned describing can be to comprise to utilize cooperative information 300a(Fig. 3 A in this combination only also) the combination of equipment of the determined various functions of the 3rd data 300c the time carry out.
Figure 10 is the figure of expression record information storage part 109b etc.
Information terminal 1t can also have record information storage part 109b.
Also can be to be used for the data 109x of the information 109n(inclusion information 109n of definite cooperative action (for example the 1st cooperative action of Figure 10) by this record information storage part 109b storage).
Also can be to be estimated as the GUI(that is prompted to describe with reference to the GUI8x of Fig. 4 etc.) user (the user 1u1A of Figure 15) carry out the probability of certain cooperative action, be higher than the probability of carrying out other cooperative action (for example the 4th cooperative action among Figure 10).Also can be that determined cooperative action is higher certain the above-mentioned cooperative action of probability.
That is the cooperative action that, the determined probability that is performed is higher is such as being the cooperative action carried out of this user etc. in the past.
Also can be to describe GUI8x(Fig. 4 of determined cooperative action), do not describe the GUI8x of other cooperative action.
In addition, specifically, as previously described, information terminal 1t for example is panel computer.
That is, can consider that information terminal 1t is utilized the 1st 1H1(Figure 15 of information terminal 1t) the kinsfolk in a plurality of user 1u1(Figure 15) use.
In other words, information terminal 1t is such as also being that only used by a people user, that be not the information terminal such as portable phone, information terminal.
Also can be user's determination portion 109a(Figure 10) current user 1u1A(Figure 15 that is using this information terminal 1t of being prompted of the GUI8x that from these a plurality of user 1u1, determines to describe).
Also can be to store relevant each user 1u1(with reference to the 1st, the 2nd user of Figure 10 by record information storage part 109b) data 109x.
Also can be, by selection portion 109c(Figure 10) from a plurality of data 109x, determine the data 109x of determined user 1u1A.
In addition, also can be as shown in figure 10, be the aforesaid GUI part that generates drawing section 105 etc. such as this selection portion 109c.
Also can be that determined data 109x is used as only describing the above-mentioned GUI8x that utilizes the cooperative action that these data 109x determines, does not describe the data 109x of the GUI8x of other cooperative action.
In addition, two places in Figure 10 illustrate respectively GUI and generate drawing section 105.This two place for example be expression GUI generate a place of the part 1 that comprises in the drawing section 105 and expression part 2 another locate this two place.
Figure 11 is the figure of expression GUI8xj and GUI8xk etc.
The outward appearance of the button-type GUI parts 703m of GUI8xj is the 1st outward appearance, and the outward appearance of the button-type GUI parts 703n of GUI8xk is 2nd outward appearance different from the 1st outward appearance.
The suitable outward appearance that the button-type GUI parts that the 1st outward appearance is for example more operated (button-type GUI parts 703m) are had.
That is, the 1st outward appearance is such as being that outward appearance, character with more eye-catching color (such as the redness more eye-catching than black, the yellow etc.) outward appearance being emphasized to show, character etc. are not translucent outward appearances etc.
On the other hand, the suitable outward appearance that had of the button-type GUI parts (button-type GUI parts 703n) that less operated of the 2nd outward appearance.
That is, the 2nd outward appearance is such as being that to have outward appearance that the outward appearance, the character that are difficult for eye-catching color (such as black) emphasized to show, character etc. be translucent outward appearance etc.
Also can be that the GUI8x that utilizes the cooperative action shown in the information 109n comprises the GUI8xj that is fit to by than the button-type GUI parts 703m of multioperation.
On the other hand, also can be that the GUI8x of other cooperative action comprises being fit to by the GUI8xk of the button-type GUI parts 703n of less operation.
Figure 12 is the figure of expression user profile storage part 109b etc.
In addition, also can be that the information 109n of utilization determines in equipment (such as the 1st equipment) that the user (such as the 1st user of Figure 12) of this information 109n holds etc., by the equipment of the more use of this user.
In addition, so-called by more use, refer to that number of times (number of times in specified time limit etc.) that this equipment is used is more than threshold value etc.Threshold value is such as referring to number of times that miscellaneous equipment (such as the 4th equipment) is used etc.
That is, also can be, utilize this information 109n indirectly to determine the cooperative action of being moved by the equipment that utilizes this information 109n to determine, indirectly determine thus cooperative action (with reference to Figure 10).
Also can be that the cooperative action of aforesaid GUI8xj for example is the cooperative action of utilizing this data 109x indirectly to determine.
Figure 13 A is the figure of expression GUI9R1.
Also can be, as shown in the figure, describe to comprise the packet node type GUI parts 9b of node type GUI parts 9a, expression cooperative action (collaboration services) of indication equipment and the GUI9R1 of line that these node types GUI parts 9a is connected with packet node type GUI parts 9b.
Figure 13 B is the figure of expression GUI9R2.
Also can be as shown in the figure, to describe to comprise that the node type GUI parts of indication equipment are the GUI9R2 of node type GUI parts 9c, 9d, 9e respectively.
And, also can be that as shown in the figure, this GUI9R2 that describes also comprises the line that will connect between node type GUI parts 9c and the node type GUI parts 9d and with the line that connects between node type GUI parts 9c and the node type GUI parts 9e.
That is, also can be to utilize the GUI9R2 that describes to represent that node type GUI parts 9c is " root ", two node type GUI parts 9d, 9e are respectively the charts of the tree of " leaf " in addition.
Figure 13 C is the figure of expression GUI9R3.
That is, also can be to describe to comprise the GUI9R3 of packet node type GUI parts 9h and node type GUI parts 9i.
Also can be that above-mentioned packet node type GUI parts 9h comprises that the node type GUI parts of indication equipment are node type GUI parts 9g, 9H respectively.
Like this, can depict various GUI(GUI9R1, GUI9R2, GUI9R3).
Figure 14 is the 1st room 1H1a, the figure of the 2nd room 1H1b in the expression residing family of information terminal 1t (the 1st 1H1 of Figure 15).
Also can be to have the 2nd zone in the 1st zone in zone etc. of the 1st room 1H1a and zone of the 2nd room 1H1b etc.
In addition, also can be, the 1st zone be the zone of principal rooms, and the 2nd zone is the zone of the other parts beyond the principal rooms etc.
Equipment 1ea is the equipment 1e that is arranged in the 1st zone (zone of the 1st room 1H1a).
Equipment 1eb is the equipment 1e that is arranged in the 2nd zone (zone of the 2nd room 1H1b).
That is, communicating by letter between information terminal 1t and the equipment 1e for example is radio communication as previously described.
Also can be that information terminal 1t only communicates with the equipment 1ea that is positioned at the 1st zone in the situation that be positioned at the 1st zone (with reference to being positioned at the information terminal 1ta in the 1st zone), does not communicate with the equipment 1eb that is positioned at the 2nd zone.
For example, also can be, the equipment information management section 101 of information terminal 1t be in the situation that information terminal 1t is positioned at the 1st zone, and only the equipment 1ea from the 1st zone obtains facility information (data) 200s, and the equipment 1eb from the 2nd zone does not obtain facility information 200s.
And, also can be in the situation that information terminal 1t is positioned at the 1st zone, the GUI(picture of describing) and 106s(GUI106sa) only comprise the node type GUI parts of the equipment 1ea that is positioned at the 1st zone.
That is, also can be, in this case, according to being contained in GUI106s(GUI106sa) in packet-type node type GUI parts cooperative action and the individual device of moving only comprises the equipment 1ea that is positioned at the 1st zone.
Figure 15 is the figure of expression the 1st, the 2nd 1H1,1H2 etc.
The 1st 1H1 is such as being the children Mr. and Mrs family of living etc.That is, in the 1st 1H1, user 1u1 is youth etc., can carry out with comparalive ease the operation of equipment 1e.
The 2nd 1H2 is such as being the parents family of living etc., and in the 2nd 1H2, user 1u2 is old man etc., can not carry out with comparalive ease the operation of equipment 1e.
Also can be that the processing of above-mentioned information terminal 1t is carried out in this system 1s.
Specifically, also can be, in cooperative action, utilize i.e. the 1st equipment 1e1 such as the 1st recording arrangement among the 1H1, read out in the images such as the photo that records in the recording medium that the 1st equipment 1e1 has, dynamic image.
And, also can be to utilize as the 2nd equipment 1e2 that is in the 1st televisor among the 1H1 etc. and obtain the image of reading, and show.
And, also can be when in the 1st 1H1, showing like this, to utilize the 3rd equipment 1e3 among the 2nd 1H2 to show the image identical with the image that in the 1st 1H1, shows.
In addition, also can be, be after user 1u1A etc. utilizes phone etc. to notify the user 1u2 of the 2nd 1H2 will begin to show simultaneously such as the user 1u1 of the 1st 1H1, carries out thisly showing simultaneously.
Also can be, when carrying out like this cooperative action of the 1st～the 3rd equipment 1e1～1e3, according to the processing of carrying out by information terminal 1t execution noted earlier.
In addition, also can be that the 3rd equipment 1e3 generates the equipment 1e with setting function that drawing section 105 grades determine from the multiple devices 1eA that is arranged in the 2nd 1H2 etc. by GUI.
For example, determined equipment 1e is that utilization is the equipment of the function of afore mentioned rules from the facility information 200s function that determine, this equipment 1e that this equipment 1e obtains.
In addition, also can be to obtain facility information 200s such as being undertaken by network 1n such as the Internets from the 2nd 1H2 like this.
In addition, the function of afore mentioned rules for example is the function that comprises in the various functions (with reference to the 3rd data 300c of Fig. 3 A) of utilizing obtained cooperative information 300s to determine.
In addition, also can be to have storing device information 200s(facility information table 102) the 1st storage part 102s(with reference to Fig. 1).
The 1st storage part 102s can be the part of information terminal 1t as shown in Figure 1, also can be positioned at the outside of information terminal 1t etc.
Also can be, the facility information 200s that is obtained by equipment information management section 101 be stored among the 1st storage part 102s, and the facility information 200s that obtains from the 1st storage part 102s.
In addition, also can be, utilize the 1st storage part 102s as the part of information terminal 1t, the facility information 200s that storage is obtained from the outside of information terminal 1t by equipment information management section 101.
In addition, also can be same the 2nd storage part 104s that has storage cooperative information 300s.
And the 2nd storage part 104s and above-mentioned the 1st storage part 102s can be the part of information terminal 1t in the same manner, also can be positioned at the outside of information terminal 1t.
Also can be that the cooperative information 300s that is obtained by equipment collaboration services Information Management Department 103 is the cooperative information 300s that stores in the 2nd storage part 104s.
In addition, also can be when obtaining the information of equipment, to utilize aforesaid DLNA technology to obtain.
Figure 16 is the figure of expression GUI1600.
In Figure 16, GUI generates the plural node type GUI parts (node type GUI parts 1601,1602) that drawing section 105 describes to represent to be connected to two above equipment of network.And GUI generates drawing section 105 and also describes the line as straight line or curve (line 1604) that will connect between these plural node type GUI parts.
And, GUI generates drawing section 105 and describes this plural node type GUI parts and line, and describes to represent node type GUI parts (node type GUI parts 1603) based on the collaboration services (cooperative action) of above-mentioned two above equipment at above-mentioned line.
In addition, also can be, GUI generates drawing section 105 and describes outside the above-mentioned line, the arrow (arrow 1604a) of also describing to represent the data stream of above-mentioned two the above equipment in the collaboration services or controlling the direction of stream.
In addition, also can be by delineation lines, also to depict the above-mentioned arrow (arrow 1604a) as the part of this line.This line for example also can be the arrow line that comprises above-mentioned arrow.
Produce thus following effect.That is, has relation between two the above equipment (with reference to node type GUI parts 1601,1602) that cooperate and the function (with reference to node type GUI parts 1603) that can realize by the cooperative action of carrying out according to the two or more function of these two above equipment.This Relationship Comparison can be held and be prompted to intelligibly the user.And, depict the arrow of direction action direction of the effect of communications etc. that when above-mentioned two above equipment carry out cooperative action, produce, the expression data.In addition, this effect is such as the effect that is data stream or control stream etc.By carrying out this describing, can the cooperative action of above-mentioned two above equipment be prompted to the user to hold intelligible mode, and the prompting of carrying out is more appropriate prompting.
In addition, the position of describing like this node type GUI parts 1603 for example is the position in the environs of above-mentioned line 1604.
Figure 17 is the figure of the GUI1600 of expression when having three above equipment.
In Figure 17, also show the node type GUI parts 1605 of indication equipment.In addition, this equipment is such as being digital camera etc.And, in Figure 17, also show this node type GUI parts 1605 are connected the line 1606 that connects and this node type GUI parts 1605 are connected the line 1607 that connects with node type GUI parts with node type GUI parts.
Shown in the example of this Figure 17, about equipment, also can there be the equipment (with reference to three node type GUI parts 1601,1602,1605) more than three.In these three above equipment, comprise two the above equipment (with reference to two node type GUI parts 1601,1602) that carry out cooperative action (in the cooperative action of the example middle finger of Figure 17 service of " appreciating photo with TV ").In the example of Figure 17, these two above equipment refer to the recording arrangement in parlor and the TV in parlor.
And, have above-mentioned line 1604 in the position of the node type GUI parts 1603 that represent cooperative information (" appreciating photo with TV ").Node type GUI parts 1603 also can with represented two the above equipment (recording arrangement and TV) of plural node type GUI parts (node type GUI parts 1601,1602) that coupled together by this line 1604 that is positioned at this position, be expressed as two above equipment that carry out cooperative action.
That is, there is the equipment more than two that coupled together by other line (line 1606,1607) beyond the above-mentioned line 1606 (two equipment of two node type GUI parts 1601,1605 that for example, coupled together by line 1606).Also can be this equipment more than two to be defined as not carrying out the equipment more than two of cooperative action (" appreciating photo with TV ").
Thus, even when having equipment more than three, two above equipment that carry out cooperative action also can hold intelligible appropriate demonstration, can carry out reliably appropriate demonstration.
In addition, also can be that the position of node type GUI parts 1603 is near with the location comparison of the plural node type GUI parts (node type GUI parts 1601,1602) of above-mentioned two the above equipment that carry out cooperative action.And, also can be that it is far away that the location comparison of node type GUI parts (for example node type GUI parts 1605) of the miscellaneous equipment beyond above-mentioned two above equipment of cooperative action is carried out in the position of node type GUI parts 1603 and expression.Thus, two represented above equipment lists of plural node type GUI parts (node type GUI parts 1601,1602) that also can location comparison is near are shown two above equipment that carry out cooperative action.And, also can be will be positioned at apart from the equipment list of the node type GUI parts (node type GUI parts 1605) of the location comparison of node type GUI parts 1603 position far away and be shown miscellaneous equipment.
Like this, node type GUI parts 1603 can be corresponding with line 1604.
In addition, as in the explanation of above-mentioned arrow 1604a, narrate like that, in cooperative action, also can comprise the streams such as communication stream.Also can be that the action of this stream of communication by carrying out this stream in cooperative action etc. realizes.
In addition, be the terminals such as portable panel computer terminal, smart phone such as information terminal 1.
Figure 18 is the figure of expression information terminal 1t.
For example, also can be that information terminal 1t comprises CPU1tA and the memory storage 1tB such as stored program RAM, ROM, HDD.
Also can be in memory storage 1tB, to store the program for the part of functions of the above-mentioned functions that realizes information terminal 1t etc.Also can be by carried out the program of storing by CPU1tA, to make this information terminal 1t realize above-mentioned part of functions etc.
For example, also can be, these part of functions etc. comprise the function of equipment collaboration services Information Management Department 103 shown in Figure 1.And, also can comprise the function of equipment information management section 101.And, can comprise that also GUI generates the function of drawing section 105.
In addition, above-mentioned part of functions etc. for example also can comprise the function of GUI control part 108, also can comprise other function.
On the other hand, for example the input media 107 of Fig. 1 also can be sensor for example, the operations such as touch operation that the touch pad that this sensor accepted user has this information terminal 1t etc. carries out, and obtain input based on this operation.
On the other hand, such as the display device 106 of Fig. 1 also can be the display part of the GUI such as GUI1600 of aforesaid Figure 17 of demonstration of the part etc. as above-mentioned touch pad.
In addition, the equipment collaboration services information management table 104 of Fig. 1 also can be information by the memory device stores such as above-mentioned memory storage 1tB shown in Figure 180 etc.And same facility information table 102 also can be by the information of this memory device stores etc.
In addition, the information terminal 1t of Fig. 1 is an example of " GUI generating apparatus " in claims.Equally, equipment information management section 101, equipment collaboration services Information Management Department 103, GUI to generate drawing section 105, display device 106, input media 107, GUI control part 108 be respectively " facility information obtaining section ", " cooperative information obtaining section ", " GUI drawing section ", " display device ", " input media " in claims, an example of " GUI control part ".
In addition, also can be, generation have for example determined to describe the data of the GUI of GUI parts like this, and demonstration utilizes the determined GUI of these data.
In addition, the various treatment steps that carry out of the equipment collaboration services display device of above-mentioned embodiments of the present invention also can be realized by by CPU the regulated procedure data that can carry out above-mentioned treatment step of storage in memory storage (ROM, RAM, hard disk etc.) being made an explanation and carry out.In this case, routine data also can be imported in the memory storage by storage medium, can also directly carry out from storage medium.In addition, storage medium refers to the optical disc memorys such as the magnetic disk memory such as the semiconductor memories such as ROM or RAM or flash memory, floppy disk or hard disk, CD-ROM or DVD or BD and storage card etc.And storage medium refers to comprise the concept of the communication medias such as telephone line or transmission path.
In addition, each inscape of describing performance specification (profile) display device of above-mentioned embodiments of the present invention can be that the mode of LSI realizes with integrated circuit respectively.These inscapes can form independently monolithic, also can form the monolithic that comprises part or all in each inscape.Be to form LSI at this, but according to the difference of integrated level, be also sometimes referred to as IC, system LSI, super (super) LSI, superfine (ultra) LSI.
In addition, the method for integrated circuit is not limited to LSI, also can utilize special circuit or general processor to realize.Also can adopt make the field programmable gate array (FPGA:Field Programmable Gate Array) that can programme behind the LSI, can reconstruct frame LSI inside the connection of circuit unit and the reconfigurable processor (reconfigurable processor) of setting.In addition, if the technology of following the development of semiconductor technology or utilizing the other technologies that derive to replace the integrated circuit of LSI is come out, can certainly use this technology to carry out the integrated of functional unit.The possibility that also has applicable biotechnology etc.
In addition, also can adopt program as described below.
This program is GUI generator program etc., and be used for making computing machine to carry out following each step of the GUI generation method that comprises the steps: facility information is obtained step, obtains the facility information be used to the 1st and the 2nd equipment of determining to be connected to network; Cooperative information is obtained step, obtains the cooperative information of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And GUI describes step, expression utilized the 1st and 2GUI(Graphical User Interface of the described the 1st and the 2nd equipment that described facility information determines) parts and expression utilize the 3GUI part relation of the described cooperative action that described cooperative information determines to get up to describe.
Utilizability on the industry
The relation that the equipment collaboration services that equipment collaboration services display device of the present invention can be carried out multiple devices cooperations is depicted as between the node type GUI parts is prompted to the user, thereby can hold the relation of pointing out intelligibly between for the user elusive equipment collaboration services or the equipment.Therefore, to can be used as the GUI that can allow the user utilize simply the equipment collaboration services be useful to the GUI of present technique.
Label declaration
The 1t information terminal; 101 equipment information management sections; 102 facility information tables; 103 equipment collaboration services Information Management Departments; 104 equipment collaboration services information tables; 105GUI generates drawing section; 106 display device; 107 input medias; The 108GUI control part; 200 facility information tables; 300 equipment collaboration services information tables; 301 execution action defined files; 302 execution action defined files; 401 packet node type GUI parts; 402 node type GUI parts; 403 node type GUI parts; 404 button-type GUI parts; 701 packet node type GUI parts; 702 node type GUI parts; 703 button-type GUI parts; 704 button-type GUI parts; 801 node type GUI parts; 802 packet node type GUI parts; 1600,7001,7002,8001,8002GUI; 1601,1602,1603,1605 node type GUI parts; 1604,1606,1607 lines; The 1604a arrow.

Claims (20)

1. GUI generating apparatus,
Have:
The facility information obtaining section obtains the facility information be used to the 1st and the 2nd equipment of determining to be connected to network;
The cooperative information obtaining section obtains the cooperative information of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And
The GUI drawing section utilizes the 1st and 2GUI parts of described facility information definite the described the 1st and the 2nd equipment and expression to utilize the 3GUI part relation of the definite described cooperative action of described cooperative information to get up to describe expression.
2. GUI generating apparatus according to claim 1,
Described cooperative information is identified for realizing the described the 1st and the 2nd function of described cooperative action,
The the described the 1st and the 2nd equipment is to represent to have the equipment of determined described the 1st function and the equipment that represents to have determined described the 2nd function by described facility information by described facility information.
3. GUI generating apparatus according to claim 1,
Described GUI generating apparatus has:
Display device shows the GUI that comprises described the 1st～the 3GUI parts of being depicted by described GUI drawing section;
Input media, the operation that accepted user carries out the GUI parts that are contained among the described GUI; And
The GUI control part by the described operation of being accepted by described input media, is carried out the GUI action that is associated with the described GUI parts of described user selection.
4. GUI generating apparatus according to claim 1,
Described GUI drawing section delineation lines, this line be with described 1GUI parts be connected straight line or the curve that the 2GUI parts connect.
5. GUI generating apparatus according to claim 3,
Described GUI drawing section describes to have represented to be implemented the information of the described GUI parts of the described operation that described input media accepts, after accepting, with from accept before describe the different mode of the mode of this information and describe this information.
6. GUI generating apparatus according to claim 1,
Described GUI drawing section describes to represent the described the 1st and 2GUI parts of the described the 1st and the 2nd equipment, and with expression comprise these the described the 1st and the 2GUI parts in the packet node type GUI parts of group of each GUI parts, be depicted as the described 3GUI parts of the described cooperative action of expression.
7. according to claim 3 or 5 described GUI generating apparatus,
Accepted by described input media that the user carries out the 4GUI parts that represent an equipment in the situation of the drag-and-drop operation of the described 3GUI parts of describing, the described equipment that described GUI control part is represented with described 4GUI parts is registered as one of equipment that moves when carrying out the described cooperative action that represents as the described 3GUI parts that are implemented the destination of described drag-and-drop operation.
8. GUI generating apparatus according to claim 1,
Described GUI generating apparatus has the resume storage part, and this resume storage portion stores is used for determining the data of the effective number of times of described cooperative action,
In the situation of described number of times more than threshold value that the described data that utilization is stored are determined, described GUI drawing section is described with the form of the many situations of the number of times that is suitable for operating, in the situation that described number of times is less than threshold value, described GUI drawing section is described with the form of the fewer situation of the number of times that is suitable for operating.
9. GUI generating apparatus according to claim 1,
Described GUI generating apparatus has storage part, and this storage portion stores be used for to be determined the data of the equipment that the user of this GUI generating apparatus holds,
When carrying out described cooperative action, use in the situation of the function that is had by the definite described equipment of holding of described data, described GUI drawing section is described with the form of the many situations of the number of times that is suitable for operating, in the situation that do not use this function when carrying out described cooperative action, described GUI drawing section is described with the form of the fewer situation of the number of times that is suitable for operating.
10. GUI generating apparatus according to claim 9,
The a plurality of described data of described storage portion stores,
The equipment that each described data are held for the described user who determines a plurality of these data of user,
Described GUI generating apparatus has determination portion, and this determination portion determines to be prompted the user of described GUI from described a plurality of users,
Described GUI drawing section, is described with a kind of form in the form that is suitable for the more situation of described number of times and the described form that is suitable for the less situation of described number of times according to determined described user's described data.
11. GUI generating apparatus according to claim 1,
Described facility information obtaining section is by radio communication, communicates with two above equipment of comprising of the near zone that is positioned at this GUI generating apparatus the described the 1st and the 2nd equipment,
Described facility information is used for this equipment more than two in definite described near zone, is not used in equipment of determining to be positioned at other zone,
Described GUI drawing section only describes to represent the plural GUI parts of described two the above equipment in the described near zone, does not describe the GUI parts of the described equipment in described other zone.
12. GUI generating apparatus according to claim 3,
The system that comprises this GUI generating apparatus comprises the described the 1st and the 2nd equipment and the 3rd equipment,
The the described the 1st and the 2nd equipment is located in the 1st,
Described the 3rd equipment is located in the 2nd,
Described cooperative action is that the 3rd function of the conduct that has of the described the 1st and the 2nd function of utilizing described the 1st described the 1st equipment and described the 2nd equipment to have, the 2nd described the 3rd equipment function identical with described the 2nd function realizes,
Described GUI drawing section also describes to represent the GUI parts of the 3rd equipment,
Described GUI control part makes the described the 1st and the 2nd equipment utilize respectively the described the 1st and the action of the 2nd function and make described the 3rd equipment utilize the action of described the 3rd function, as the described GUI action of having carried out when having accepted described operation.
13. GUI generating apparatus according to claim 1,
In the situation that this GUI generating apparatus has described the 2nd function, this GUI generating apparatus carries out the action based on described the 2nd function when carrying out described cooperative action as described the 2nd equipment.
14. GUI generating apparatus according to claim 4,
Described 3GUI parts with described 1GUI parts be connected the described line that the 2GUI parts are connected and be associated.
15. GUI generating apparatus according to claim 14,
Described 3GUI parts are depicted on the described line.
16. according to claim 3, the described GUI generating apparatus of any one in 14,15,
Described line is arrow line, is illustrated in the direction of utilizing represented described the 1st equipment of described 1GUI parts and utilizing the data stream when carrying out described cooperative action between represented described the 2nd equipment of described 2GUI parts.
17. the described GUI generating apparatus of any one according to claim 1～16,
Described 3GUI parts are depicted between described 1GUI parts and the described 2GUI parts.
18. an integrated circuit,
Have:
The facility information obtaining section obtains the facility information be used to the 1st and the 2nd equipment of determining to be connected to network;
The cooperative information obtaining section obtains the cooperative information of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And
The GUI drawing section utilizes the 1st and 2GUI parts of described facility information definite the described the 1st and the 2nd equipment and expression to utilize the 3GUI part relation of the definite described cooperative action of described cooperative information to get up to describe expression.
19. a GUI generation method,
Comprise:
Facility information is obtained step, obtains the facility information be used to the 1st and the 2nd equipment of determining to be connected to network;
Cooperative information is obtained step, obtains the cooperative information of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And
GUI describes step, utilizes the 1st and 2GUI parts of described facility information definite the described the 1st and the 2nd equipment and expression to utilize the 3GUI part relation of the definite described cooperative action of described cooperative information to get up to describe expression.
20. a GUI generator program, this GUI generator program make computing machine carry out following steps:
Facility information is obtained step, obtains the facility information be used to the 1st and the 2nd equipment of determining to be connected to network;
Cooperative information is obtained step, obtains the cooperative information of the cooperative action that the 2nd function that has be used to the 1st function of determining to utilize described the 1st equipment to have and described the 2nd equipment realizes; And
GUI describes step, utilizes the 1st and 2GUI parts of described facility information definite the described the 1st and the 2nd equipment and expression to utilize the 3GUI part relation of the definite described cooperative action of described cooperative information to get up to describe expression.
CN201280006438XA 2011-07-28 2012-07-12 GUI generator, integrated circuit, GUI generating method, and GUI generating program Pending CN103329087A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2011166062 2011-07-28
JP2011-166062 2011-07-28
PCT/JP2012/004506 WO2013014874A1 (en) 2011-07-28 2012-07-12 Gui generator, integrated circuit, gui generating method, and gui generating program

Publications (1)

Publication Number Publication Date
CN103329087A true CN103329087A (en) 2013-09-25

Family

ID=47600751

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280006438XA Pending CN103329087A (en) 2011-07-28 2012-07-12 GUI generator, integrated circuit, GUI generating method, and GUI generating program

Country Status (4)

Country Link
US (1) US20130311912A1 (en)
JP (1) JPWO2013014874A1 (en)
CN (1) CN103329087A (en)
WO (1) WO2013014874A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107005750A (en) * 2014-12-26 2017-08-01 索尼公司 Information processor, information processing method and program
CN108885592A (en) * 2016-03-28 2018-11-23 株式会社索思未来 Communication device, communication means and signal procedure
CN110581930A (en) * 2018-06-07 2019-12-17 富士施乐株式会社 Information processing apparatus, non-transitory computer-readable medium, and information processing method

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5474238B1 (en) * 2013-06-05 2014-04-16 三菱電機株式会社 Layout generation system, energy management system, terminal device, layout creation method, and program
US10303324B2 (en) * 2014-02-10 2019-05-28 Samsung Electronics Co., Ltd. Electronic device configured to display three dimensional (3D) virtual space and method of controlling the electronic device
US11113022B2 (en) * 2015-05-12 2021-09-07 D&M Holdings, Inc. Method, system and interface for controlling a subwoofer in a networked audio system
US11209972B2 (en) 2015-09-02 2021-12-28 D&M Holdings, Inc. Combined tablet screen drag-and-drop interface
JP6611550B2 (en) * 2015-10-09 2019-11-27 キヤノン株式会社 COMMUNICATION DEVICE, COMMUNICATION DEVICE CONTROL METHOD, AND PROGRAM
WO2017149710A1 (en) * 2016-03-02 2017-09-08 三菱電機株式会社 Air conditioning system and link confirmation method
US10921974B2 (en) * 2016-03-30 2021-02-16 Microsoft Technology Licensing, Llc Using drag and drop to apply metadata
JP6327387B2 (en) * 2017-06-07 2018-05-23 富士ゼロックス株式会社 Information processing apparatus and program
WO2019064616A1 (en) * 2017-09-29 2019-04-04 シャープ株式会社 Network system
JP7099092B2 (en) * 2018-07-03 2022-07-12 富士フイルムビジネスイノベーション株式会社 Information processing equipment and programs
EP3932092A1 (en) 2019-02-28 2022-01-05 Sonos, Inc. Playback transitions between audio devices
US11188294B2 (en) 2019-02-28 2021-11-30 Sonos, Inc. Detecting the nearest playback device
CN115004141A (en) * 2020-10-01 2022-09-02 松下知识产权经营株式会社 Information processing method, information processing apparatus, and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1848772A (en) * 2005-04-14 2006-10-18 三洋电机株式会社 Local server
US20090066534A1 (en) * 2007-09-07 2009-03-12 Verizon Data Services Inc. Network-based access and control of home automation systems
US20090089353A1 (en) * 2007-09-28 2009-04-02 Fujitsu Limited Computer-readable medium storing relay program, relay device, and relay method
CN101741663A (en) * 2008-11-10 2010-06-16 索尼株式会社 Information processing apparatus, information processing system, information processing method, and program
US20100175010A1 (en) * 2009-01-06 2010-07-08 Mckesson Financial Holdings Limited Graphical Configuration and Management of Interfaces

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4058845B2 (en) * 1999-06-24 2008-03-12 松下電器産業株式会社 Gateway device
JP3927800B2 (en) * 2001-12-04 2007-06-13 キヤノン株式会社 Voice recognition apparatus and method, program, and storage medium
JP2005339174A (en) * 2004-05-26 2005-12-08 Sony Corp Information processing system, information processing method, and computer program therefor
JP5172156B2 (en) * 2007-01-15 2013-03-27 富士通株式会社 Information processing apparatus, display method, and display program
US8880695B2 (en) * 2007-11-22 2014-11-04 Sony Corporation Information processing apparatus and information processing method
US20100077355A1 (en) * 2008-09-24 2010-03-25 Eran Belinsky Browsing of Elements in a Display
US9055077B2 (en) * 2009-08-24 2015-06-09 Apple Inc. Device identity matching
US9396090B2 (en) * 2010-12-28 2016-07-19 Sap Se System overview diagram generator

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1848772A (en) * 2005-04-14 2006-10-18 三洋电机株式会社 Local server
US20090066534A1 (en) * 2007-09-07 2009-03-12 Verizon Data Services Inc. Network-based access and control of home automation systems
US20090089353A1 (en) * 2007-09-28 2009-04-02 Fujitsu Limited Computer-readable medium storing relay program, relay device, and relay method
CN101741663A (en) * 2008-11-10 2010-06-16 索尼株式会社 Information processing apparatus, information processing system, information processing method, and program
US20100175010A1 (en) * 2009-01-06 2010-07-08 Mckesson Financial Holdings Limited Graphical Configuration and Management of Interfaces

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107005750A (en) * 2014-12-26 2017-08-01 索尼公司 Information processor, information processing method and program
US10809903B2 (en) 2014-12-26 2020-10-20 Sony Corporation Information processing apparatus, information processing method, and program for device group management
CN113467670A (en) * 2014-12-26 2021-10-01 索尼公司 Information processing apparatus, information processing method, and program
CN108885592A (en) * 2016-03-28 2018-11-23 株式会社索思未来 Communication device, communication means and signal procedure
CN110581930A (en) * 2018-06-07 2019-12-17 富士施乐株式会社 Information processing apparatus, non-transitory computer-readable medium, and information processing method
CN110581930B (en) * 2018-06-07 2023-09-26 富士胶片商业创新有限公司 Information processing apparatus, non-transitory computer readable medium, and information processing method

Also Published As

Publication number Publication date
WO2013014874A1 (en) 2013-01-31
US20130311912A1 (en) 2013-11-21
JPWO2013014874A1 (en) 2015-02-23

Similar Documents

Publication Publication Date Title
CN103329087A (en) GUI generator, integrated circuit, GUI generating method, and GUI generating program
JP5881847B2 (en) Real-time mapping and navigation of multiple media types with a metadata-based infrastructure
US10892955B1 (en) Management of a network via a GUI of user relationships
Hess et al. Jumping between devices and services: towards an integrated concept for social TV
JP5799512B2 (en) Information processing apparatus, information processing method, and program
US8825668B2 (en) Method and apparatus for updating song playlists based on received user ratings
CN105247874A (en) Apparatus and method for displaying program guide
JP7407928B2 (en) File comments, comment viewing methods, devices, computer equipment and computer programs
US11115261B2 (en) System and method of sharing content by using plurality of storages
CN103608790A (en) Information processing device, program, information processing method, and information processing system
Hess et al. Understanding and supporting cross-platform usage in the living room
JP5624056B2 (en) Method, apparatus and computer program for generating a query
Pfeil et al. Opensensemap-a citizen science platform for publishing and exploring sensor data as open data
CN104978372A (en) Multimedia information processing method, multimedia device and multimedia network system
CN102916999B (en) Server unit and information processing unit
Wang et al. A new territory of multi-user variable remote control for interactive TV
Obrist et al. Connecting TV & PC: an in-situ field evaluation of an unified electronic program guide concept
CN102110133B (en) Use the system and method for universal plug and play display document content
JP2015197553A (en) Communication terminal device, server device, program, data providing method, and karaoke system
TWI528804B (en) Real-time mapping and navigation of multiple media types through a metadata-based infrastructure
JP5133398B2 (en) Paper book / digital content correspondence generation apparatus and method
Ding et al. Seamless integration of output devices in intelligent environments: Infrastructure, strategies and implementation
JP2008146672A (en) Information retrieval system and information retrieval program
JP2018110312A (en) Information processing device, control method for information processing device, and control program
Hess et al. Entertainment Computing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: MATSUSHITA ELECTRIC (AMERICA) INTELLECTUAL PROPERT

Free format text: FORMER OWNER: MATSUSHITA ELECTRIC INDUSTRIAL CO, LTD.

Effective date: 20140926

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20140926

Address after: Seaman Avenue Torrance in the United States of California No. 2000 room 200

Applicant after: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA

Address before: Osaka Japan

Applicant before: Matsushita Electric Industrial Co.,Ltd.

C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130925