CN101681460B - Control system - Google Patents

Control system Download PDF

Info

Publication number
CN101681460B
CN101681460B CN200880020404XA CN200880020404A CN101681460B CN 101681460 B CN101681460 B CN 101681460B CN 200880020404X A CN200880020404X A CN 200880020404XA CN 200880020404 A CN200880020404 A CN 200880020404A CN 101681460 B CN101681460 B CN 101681460B
Authority
CN
China
Prior art keywords
sensor
user
information
subsystem
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200880020404XA
Other languages
Chinese (zh)
Other versions
CN101681460A (en
Inventor
龙田成示
井场阳一
杉原良平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Publication of CN101681460A publication Critical patent/CN101681460A/en
Application granted granted Critical
Publication of CN101681460B publication Critical patent/CN101681460B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q2209/00—Arrangements in telecontrol or telemetry systems
    • H04Q2209/40—Arrangements in telecontrol or telemetry systems using a wireless architecture
    • H04Q2209/43—Arrangements in telecontrol or telemetry systems using a wireless architecture using wireless personal area networks [WPAN], e.g. 802.15, 802.15.1, 802.15.4, Bluetooth or ZigBee
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q2209/00—Arrangements in telecontrol or telemetry systems
    • H04Q2209/80—Arrangements in the sub-station, i.e. sensing device
    • H04Q2209/84—Measuring functions
    • H04Q2209/845—Measuring functions where the measuring is synchronized between sensing devices

Abstract

A control system (25) includes: a history information storage unit (262) which stores user history information as history information on at least a user behavior, a user state, and a user environment acquired by at least one of sensors, i.e., a behavior sensor which measures a user behavior, a state sensor which measures a user state, and an environment sensor which measures a user environment; an event judgment unit (250) which judges whether a use-enabled event has occurred indicating that the user who has used the first subsystem can use the second subsystem; and a history information update unit (248) which updates the user history information updated according to the sensor information from the first sensor as the first subsystem further according to the sensor information from the second sensor of the second subsystem when a use-enabled event has occurred.

Description

Control system
Technical field
The present invention relates to control system.
Background technology
As existing information providing system, in TOHKEMY 2000-215211 communique following system is disclosed for example, the route that arrives before the place that the user thinks can also be introduced and neatly through the place by this system except the information of place, facility etc.
But, have following problem in the system of this TOHKEMY 2000-215211 communique: the information that can not realize so-called information pushing (push information) mode provides, and does not carry out obtaining action and also can provide the user required information initiatively even information pushing refers to the user.
As the system that solves above-mentioned problem, known have a disclosed information providing system of TOHKEMY 2006-293535 communique.In this system, utilize the Wearable sensor to identify user's active state, carry out the information corresponding with active state and show, can realize that thus the information of information pushing mode provides.
But, in this TOHKEMY 2006-293535 communique, although disclose effective information providing system in mobile environment, openly be not applicable to the control system of the aggregation system of a plurality of subsystems.
Summary of the invention
According to several modes of the present invention, can provide control system, program and the information storage medium of the aggregation system that is applicable to a plurality of subsystems.
A mode of the present invention relates to a kind of control system of the aggregation system for a plurality of subsystems, the subsystems of this aggregation system has sensor at least, it is characterized in that, this control system comprises: the historical information storage part, it stores user history information, and this user history information is by at least one historical information at least one sensor action, state and the environment that obtain, about the user in the environmental sensor of the action sensor of measuring user's action, the state sensor of measuring User Status and mensuration user environment; Event detection unit, its judgement can use case generation, this can represent to use the user of the first subsystem newly to become the state that can use the second subsystem by use case; And historical information renewal section, described can use case the time when having occured, this historical information renewal section is according to the sensor information from the second sensor, to further upgrading according to the user history information after upgrading from the sensor information of first sensor, wherein, described first sensor is the sensor of described the first subsystem, and described the second sensor is the sensor of described the second subsystem.In addition, other modes of the present invention relate to the program of the function that makes computing machine performance each part mentioned above or store the computer-readable information storage medium of this program.
According to a mode of the present invention, in the historical information storage part, store following information as user history information: according to from least one historical information in sensor information action, state and the environment that obtain, about the user of at least one sensor in action sensor, state sensor and the environmental sensor.And, when occured the second subsystem can use case the time, according to the sensor information from the second sensor of the second subsystem, user history information is upgraded.According to this mode, can continue to be updated in the user history information of upgrading in the first subsystem according to the sensor information from the second sensor of the second subsystem, the control system of the aggregation system that is suitable for a plurality of subsystems can be provided.
In addition, in a mode of the present invention, can comprise the information transport unit, this information transport unit is carried out the transmission of user history information and is processed between as the first historical information storage part of the historical information storage part of described the first subsystem and the second historical information storage part as the historical information storage part of described the second subsystem.According to this mode, the user history information that is stored in the first historical information storage part can be sent to the second historical information storage part, continue user history information is upgraded in seamless (seamless) mode.
In addition, in a mode of the present invention, described information transport unit can be carried out information synchronization and processed, and this information synchronization is processed the user history information that is stored in described the first historical information storage part and the information that is stored in user history information in described the second historical information storage part and remains identical content of making.According to this mode, even carried out the switching of subsystem, also can make user history information remain identical content.
In addition, in a mode of the present invention, described can use case the time when having occured, described historical information renewal section can be to being sent to the user history information of described the second historical information storage part from described the first historical information storage part, carry out processing based on the renewal from the sensor information of described second sensor of described the second subsystem.According to this mode, can realize based on the seamless renewal from the user history information of the sensor information of the second sensor.
In addition, in a mode of the present invention, can comprise the control handling part, described can use case the time when having occured, this control handling part begins the control action as the second control object equipment of the control object equipment of described the second subsystem, described control handling part begin described the second control object equipment, use the control action be stored in the user history information in described the second historical information storage part.According to this mode, can realize control action the second control object equipment, that reflect the user history information of in the first subsystem, upgrading.
In addition, in a mode of the present invention, can occur described can use case before, described information transport unit transmits user history information from described the first historical information storage part to described the second historical information storage part in advance, described can use case the time when having occured, described control handling part begin described the second control object equipment, use the control action that is sent in advance the user history information in described the second historical information storage part.According to this mode, when having occured can use case the time, can begin immediately the control action based on user history information of the second control object equipment, make the control high efficiency.
In addition, in a mode of the present invention, as user during near the place of described the second subsystem, be arranged on described event detection unit in the home server of described the second subsystem can be judged to be occured described can use case.According to this mode, can distribute to the high home server of processing power with processing the large event determination processing of load etc., therefore can alleviate the processing load etc. of the equipment of the first subsystem.
In addition, in a mode of the present invention, described event detection unit can be by detecting the wireless strengths of communicating by letter of carrying out between described the first subsystem and described the second subsystem, judges described generation that can use case.According to this mode, during information transmits required wireless can be used for can use case judgement process.
In addition, in a mode of the present invention, when the equipment connection of described the first subsystem is to the breakout box that can use in described the second subsystem, described event detection unit can be judged to be occured described can use case.
In addition, in a mode of the present invention, can comprise the control handling part, described can use case the time when having occured, this control handling part begins the control action the second control object equipment, user's historical information as the control object equipment of described the second subsystem.
In addition, the control system that relates to a kind of aggregation system for a plurality of subsystems in another way of the present invention, the subsystems of this aggregation system has sensor at least, it is characterized in that, this control system comprises: the historical information storage part, it stores user history information, and this user history information is by at least one historical information at least one sensor action, state and the environment that obtain, about the user in the environmental sensor of the action sensor of measuring user's action, the state sensor of measuring User Status and mensuration user environment; The event detection unit, its judgement can use case generation, this can represent by use case: use the first subsystem, according to having carried out more New Consumers of user history information from the sensor information as the first sensor of the sensor of described the first subsystem, newly become the state that can use the second subsystem; And the control handling part, described can use case the time when having occured, this control handling part begins the control action the second control object equipment, user's historical information as the control object equipment of described the second subsystem.In addition, other modes of the present invention relate to the program of the function that makes computing machine performance each part mentioned above or store the computer-readable information storage medium of this program.
According to another way of the present invention, in the historical information storage part, store following information as user history information: the historical information that obtains according to the sensor information from least one sensor in action sensor, state sensor and the environmental sensor.And, when occured the second subsystem can use case the time, begin control action the second control object equipment, user's historical information.According to this mode, can realize control action the second control object equipment, that reflect the user history information of in the first subsystem, upgrading, the control system of the aggregation system that is suitable for a plurality of subsystems can be provided.
In addition, in another way of the present invention, described can use case the time when having occured, described control handling part can carry out following control: connect the power supply of described the second control object equipment or make described the second control object equipment return to normal operation mode from low-power consumption mode.According to this mode, can occured can use case during, close the power supply of the second control object equipment or be set as low-power consumption mode, therefore can realize low-power consumption.
In addition, in another way of the present invention, when occured the user no longer can use described the second control object equipment can not use case the time, described control handling part can carry out following control: close the power supply of described the second control object equipment or make described the second control object equipment transfer to low-power consumption mode from normal operation mode.According to this mode, can occured can not use case after, close the power supply of the second control object equipment or be set as low-power consumption mode, therefore can realize low-power consumption.
In addition, in another way of the present invention, can comprise the information transport unit, this information transport unit is between as the first historical information storage part of the historical information storage part of described the first subsystem and the second historical information storage part as the historical information storage part of described the second subsystem, carrying out the transmission of user history information processes, described event detection unit judge the user with respect to the place of the second subsystem near state, when near state from first near state become degree of closeness than described first near state high second during near state, the user history information that described information transport unit will be stored in described the first historical information storage part is sent to described the second historical information storage part, when the user near state from described second near state become degree of closeness than described second near state high the 3rd during near state, described control handling part begins described the second control object equipment, the control action of user's historical information.According to this mode, when becoming second during near state from first near state, transmit user history information to the second subsystem side, when becoming the 3rd during near state from second near state, begin the control action of the second control object equipment, seamlessly start information transmits and control action.
In addition, in another way of the present invention, can the user near state be described second near state during, described information transport unit is carried out information synchronization and is processed, and this information synchronization is processed the user history information that will be stored in described the first historical information storage part and the information that is stored in user history information in described the second historical information storage part and remains identical content.
In addition, in another way of the present invention, that can work as the user becomes described first during near state near state from described second near state, and described control handling part stops control action described the second control object equipment, user's historical information.According to this mode, when the user leaves, can stop the action of the second control object equipment, realize low-power consumption.
In addition, in another way of the present invention, described event detection unit utilizes accepting state to judge described first, second, third near state because of at least two kinds of different radio communications of distance.According to this mode, can utilize accepting state because of the different at least two kinds of radio communications of distance, the transmission that realizes efficiently user history information process and the control action of the second control object equipment begin process.
In addition, another way of the present invention relates to a kind of control system of the aggregation system for a plurality of subsystems, this aggregation system has mover system and family's subsystem, it is characterized in that, this control system comprises: the historical information storage part, it stores user history information, and this user history information is by at least one historical information at least one sensor action, state and the environment that obtain, about the user in the environmental sensor of the action sensor of measuring user's action, the state sensor of measuring User Status and mensuration user environment; Event detection unit, its judgement can use case generation, this can use case represents to use the user of described mover system to become the state that can use described family subsystem; And historical information renewal section, described can use case the time when having occured, this historical information renewal section is according to the sensor information from the sensor of described family subsystem, to further upgrading according to the user history information after upgrading from the sensor information of the sensor of described mover system.In addition, other modes of the present invention relate to the program of the function that makes computing machine performance each part mentioned above or store the computer-readable information storage medium of this program.
In addition, in another way of the present invention, described event detection unit and described historical information renewal section can be arranged in the home server as the home server of described family subsystem.According to this mode, even carried out the switching of subsystem, also can reflect the control of up-to-date user history information.
In addition, another way of the present invention relates to a kind of control system of the aggregation system for a plurality of subsystems, this aggregation system has at least one party and the car intra subsystem in mover system and the family's subsystem, it is characterized in that, this control system comprises: the historical information storage part, it stores user history information, and this user history information is by the action sensor of measuring user's action, at least one sensor in the environmental sensor of the state sensor of mensuration User Status and mensuration user environment obtains, action about the user, at least one historical information in state and the environment; Event detection unit, its judgement can use case generation, this can represent to use the user of described mover system or described family subsystem newly to become the state that can use described car intra subsystem by use case; And historical information renewal section, described can use case the time when having occured, this historical information renewal section is according to the sensor information from the sensor of described Che Nei system, to further upgrading according to the user history information after upgrading from the sensor information of the sensor of described mover system or described family subsystem.In addition, other modes of the present invention relate to the program of the function that makes computing machine performance each part mentioned above or store the computer-readable information storage medium of this program.
In addition, in another way of the present invention, can comprise the control handling part, described can use case the time when having occured, this control handling part begins control action control object equipment, user's historical information of described car intra subsystem.According to this mode, can realize control action control object equipment (for example guider), that reflect the user history information of in mover system or family's subsystem, upgrading of car intra subsystem.
In addition, in another way of the present invention, described historical information renewal section can according to the operation information of described control object equipment or from the sensor information of the sensor of described car intra subsystem, upgrade user history information.According to this mode, can carry out with these information the seamless renewal of user history information, can access more rationally accurately user history information.
Description of drawings
Fig. 1 is the key diagram of the aggregation system of a plurality of subsystems.
Fig. 2 is the structure example of the control system of present embodiment.
Fig. 3 is the detailed structure example of the control system of present embodiment.
Fig. 4 A, 4B are the process flow diagrams for the action of explanation present embodiment.
Fig. 5 is based on the key diagram of system of selection of sensor, the control object equipment of TPO information.
Fig. 6 A～Fig. 6 C is the application examples of the method for present embodiment.
Fig. 7 A～Fig. 7 C is the application examples of the method for present embodiment.
Fig. 8 is the process flow diagram that the renewal of user history information is processed.
Fig. 9 is the key diagram of user history information.
Figure 10 A, Figure 10 B are the key diagrams of user history information.
Figure 11 is the first system structure example of present embodiment.
Figure 12 is the second system structure example of present embodiment.
Figure 13 is the 3rd system architecture example of present embodiment.
Figure 14 is the Quaternary system system structure example of present embodiment.
Figure 15 is the 5th system architecture example of present embodiment.
Figure 16 A, Figure 16 B are the key diagrams of the system of selection of sensor, control object equipment.
Figure 17 A, Figure 17 B are the key diagrams of the system of selection of sensor, control object equipment.
Figure 18 is the key diagram of the system of selection of sensor, control object equipment.
Figure 19 is the process flow diagram for the system of selection of explanation sensor, control object equipment.
Figure 20 is that realization is based on the structure example of the system of the transfer approach of wireless user history information.
Figure 21 A, 21B are based on the key diagram of the transfer approach of wireless user history information.
Figure 22 is for the process flow diagram of explanation based on the transfer approach of wireless user history information.
Embodiment
Below, present embodiment is described.In addition, below the present embodiment of explanation is not to carry out irrational restriction for the content that claim of the present invention is put down in writing.In addition, the formation that illustrates in the present embodiment all is not necessary structure important document of the present invention.
1. aggregation system
Use Fig. 1 that the aggregation system of present embodiment is described.As shown in Figure 1, aggregation system is made of a plurality of subsystems such as mover system, family's subsystem or car intra subsystems.In addition, the subsystem of present embodiment is not limited to this, for example, can also be susceptible to the vehicles (electric car, aircraft) beyond the company's intra subsystem, shop intra subsystem, car subsystem etc., have the various subsystems of sensor and control object equipment.
As shown in Figure 1, user (user) is carrying portable electric appts 20 (mobile gateway).In addition, near the eyes of head one side, worn Wearable display 93 (mobile display), as mobile control object equipment.And, with it with the various sensors as Wearable sensor (movable sensor).Particularly, worn indoor and outdoor sensor 510, ambient temp sensor 511, periphery humidity sensor 512, periphery luminance sensor 513, wrist formula motion determination sensor 520, pulse (heart rate) sensor 521, body temperature trans 522, Subcutaneous Temperature sensor 523, perspiration sensor 524, foot pressure sensor 530, speak/chew sensor 540, (Global Position System: GPS) sensor 550 to be arranged on GPS on the portable electric appts 20, be arranged on color sensor 560 on the Wearable display 500 and pupil size sensor 561 etc.Consist of mover system (broadly being called the first subsystem) by these portable electric appts 20, mobile control object equipment and Wearable sensor.
Portable electric appts 20 (mobile computer) be PDA (Personal Digital Assistant: personal digital assistant), the portable information terminal such as notebook PC, such as having processor (CPU), storer, guidance panel, communicator or display (sub-display) etc.This portable electric appts 20 for example can have with inferior function: the function of the sensor information of the autobiography sensor of collecting; Carry out the function of calculation process according to collected sensor information; Control object equipment (Wearable display etc.) is controlled (show control etc.) or from the function of external data base reading information according to operation result; And the function that communicates with the outside.In addition, portable electric appts 20 can also be also used as mobile phone, wrist-watch or pocket audio frequency apparatus etc.
Wearable display 93 is worn near user's eyes, and it is less than pupil size to be configured to the size of its display part, as the information display section performance function of so-called perspective viewfinder (see through viewer).In addition, the information indicating for the user can carry out with earphone, Vib. etc.In addition, as mobile control object equipment, except Wearable display 93, such as being susceptible to the various devices such as wrist-watch, mobile phone or pocket audio frequency apparatus.
Indoor and outdoor sensor 510 is to detect the user to be positioned at indoor or outdoor sensor, for example radiates ultrasound wave, measures until the time that ceiling etc. are returned ultrasonic reflections.But, indoor and outdoor sensor 510 is not limited to the ultrasound wave mode, also can be the sensor of active smooth mode, passive ultraviolet mode, passive infrared mode, passive noisy mode.
Ambient temp sensor 511 is for example measured ambient temperature with thermistor, radiation thermometer, focus equity.Periphery humidity sensor 512 for example utilizes the variation of electrical resistance humidity to measure humidity on every side.Brightness around periphery luminance sensor 513 is for example measured with photovalve.
Wrist formula motion determination sensor 520 utilizes acceleration transducer and angular acceleration transducer to measure user's list action.Can be by come to measure more exactly user's everyday actions, walking state with this motion determination sensor 520 and foot pressure sensor 530.Pulse (heart rate) sensor 521 is worn on finger or ear, utilizes the variation of ultrared transmissivity and reflectivity to measure blood flow with the variation of pulsation.Body temperature trans 522, Subcutaneous Temperature sensor 523 usefulness thermistors, radiation thermometer, thermoelectric equity are measured user's body temperature and Subcutaneous Temperature.Perspiration sensor 524 is for example measured the perspiration of skin according to the variation of skin surface impedance.Foot pressure sensor 530 detects sole to the distribution of footwear applied pressure, measures and judge user's standing state, the state of sitting down, walking state etc.
Speak/chew sensor 540 and be for measuring the user and speak (dialogue) or chewing the ear type sensor of the possibility of (having a dinner), in its housing, be built-in with bone-conduction microphone and external sound microphone.Bone-conduction microphone detects speak/chews the vibration that produces and propagate in vivo in the Shi Congti, i.e. sound in the body.The external sound microphone detects because speaking to the vibration of external propagation,, comprises the external sound of voice and neighbourhood noise that is.And, compare processing etc. by the power in the unit interval of sound that bone-conduction microphone and external sound microphone are captured, measure in a minute possibility and chew possibility.
GPS sensor 550 is the sensors that detect customer location.In addition, also can replace with the positional information server of mobile phone GPS sensor 550.Color sensor 560 for example configures optical sensor near facial, to comparing by the brightness behind a plurality of optical band pass filters, measure color.Pupil size sensor 561 for example configures camera near pupil, the signal of camera is analyzed, and measures pupil size.
Family's subsystem is such as having following home control object-based device: family's displays such as TV monitor, PC monitor; The AV of the family such as audio frequency apparatus, Disc player equipment; Dog shape, cat shape, humanoid etc. robot; Regulate the air-conditioning of room temperature; The working flare of brightness adjusting etc.In addition, as the home control object-based device, such as being susceptible to following various device: the home appliance such as game machine, suction cleaner, electric cooker, refrigerator, micro-wave oven and safety feature etc.
In addition, family's subsystem is such as having following family chamber sensor: the environmental sensor of measuring temperature, humidity, brightness, noise, the user session in the family and having a dinner etc.; The robot that is built in the robot carries sensor; Each that is arranged on family within doors, the people detection sensor on the door etc.; Be arranged on the uroscopy sensor in the toilet.In addition, in addition, as family's chamber sensor, such as being susceptible to safety sensor (theft-proof sensor, heat/cigarette/gas security etc.), seismic sensor, power consumpting determining sensor, the various sensors of pollen sensor.And, consist of family's subsystem (broadly being called the second subsystem) by these home control object-based devices and family's chamber sensor.
The car intra subsystem has control object-based device in the following car: the automobile navigation instrument (guider) that carries out the road guiding; The automobile such as audio frequency apparatus, Disc player AV equipment; And the air-conditioning of adjusting vehicle interior temperature etc.In addition, in addition, as controlling object-based device in the car, such as being susceptible to safety equipment, the seat adjusting apparatus such as air bag, having adopted the various devices such as lock/unlock equipment, communication facilities and truck-mounted computer of the car door of smart entry system.
In addition, the car intra subsystem has following car inner sensor: the transport condition sensor of measuring the speed of a motor vehicle, displacement etc.; Measure user's driver behavior, the operational state sensors of equipment operating; And the environmental sensor of temperature, humidity, brightness and user session etc. in the mensuration car etc.In addition, in addition, as the car inner sensor, for example can also be susceptible to theft-proof sensor, people detection sensor, the various sensors of pollen sensor.And, consist of car intra subsystem (broadly being called the 3rd subsystem) by control object-based device and car inner sensor in these cars.
In the aggregation system of Fig. 1, in the situation that the user is in outdoor grade (situation of mobile environment), obtain (collection) from the sensor information (secondary information that comprises sensor) of the Wearable sensor (movable sensor) of mover system, upgrade user history information according to obtained sensor information.And, carry out the control of mobile control object equipment according to user history information etc.In addition, user history information is at least one the historical information (log information) in action, state and the environment about the user.
On the other hand, in the situation that the user is in (situation of home environment) in the family, obtain the sensor information from family's chamber sensor of family's subsystem, upgrade user history information according to obtained sensor information.That is, in the situation that transfer in the home environment, the user history information of upgrading in mobile environment also can (seamless) be upgraded by seamlessly.In addition, according to user history information etc. the home control object-based device is controlled.
In addition, in the situation that the user is in (situation of environment inside car) in the car, obtain the sensor information from the car inner sensor of car intra subsystem, upgrade user history information according to obtained sensor information.That is, in the situation that transfer in the environment inside car, the user history information of upgrading in mobile environment or home environment also will seamlessly be upgraded.In addition, according to user history information etc. control object-based device in the car is controlled.
For example, the user takes off Wearable sensor (indoor and outdoor sensor), mobile control object equipment (Wearable display etc.) when getting home or when moving in the car possibly.In this case, according to the aggregation system of Fig. 1, also can replace the Wearable sensor and obtain sensor information with family's chamber sensor or car inner sensor, therefore can seamlessly upgrade user history information.For example, having a dinner in the having a dinner and being in when going out, except can obtain continuously have a dinner constantly and the history of meal time etc., can also carry out according to inside and outside status of action and Heart Rate States the accumulation calculation process etc. of energy consumption and pressure.
In addition, can mobile control object equipment not controlled, but control object-based device in home control object-based device or the car is controlled, can improve thus user's convenience.For example, less Wearable display does not show in the viewing area, but larger family's display or auto navigation display show information based on user history information etc. in the viewing area, perhaps can control out of contior control object equipment (such as air-conditioning, working flare, automobile navigation instrument etc.) in the mobile environment, can improve convenience.
2. control system
Fig. 2 shows the structure example of control system 25 of the present embodiment of the aggregation system that is applicable to Fig. 1.In addition, control system 25 is not limited to the structure of Fig. 2, can realize various distortion: such as a part (such as information obtaining section, information storage medium etc.) of omitting in its textural element, perhaps append other textural elements etc.
Information obtaining section 230 obtains the sensor information from a plurality of sensors of a plurality of subsystems.For example, obtain the sensor information of the Wearable sensor 12 (broadly being called first sensor) from the mover system, from the sensor information of family's chamber sensor 14 (broadly being called the second sensor) of family's subsystem, from the sensor information of the car inner sensor 16 (broadly being called the 3rd sensor) of car intra subsystem.Particularly, obtain from the sensor information such as lower sensor: measure user's action (walking, talk with, have a dinner, trick action, emotion performance or sleep etc.) the action sensor, measure User Status (tired, nervous, on an empty stomach, the state of mind, condition or occur in user's event with it etc.) state sensor, measure the environmental sensor of user environment (place, brightness, temperature or humidity etc.).
In addition, sensor can be sensor component itself, also can be the sensor device that also comprises control part and Department of Communication Force etc. except sensor component.In addition, sensor information can be the sensor primary information that directly obtains from sensor, also can be by the sensor primary information being processed the sensor secondary information that processing (information processing) obtains.
Information obtaining section 230 is such as being realized by Department of Communication Force 232 or sensor I/F (interface) section 234 etc.For example, (Bluetooth: registered trademark) such near radio or WLAN etc. obtain in the situation of (reception) sensor information from sensor, use Department of Communication Force 232 by infrared ray or bluetooth.On the other hand, obtaining from sensor in the situation of sensor information by USB, IEEE1394, the such wired electric signal of card I/F, using sensor I/F section 234.
The sensor informations that handling part 240 is obtained according to information obtaining section 230 etc. are carried out required various processing in action of control system 25 etc.The function of this handling part 240 can or be stored in program in the information storage medium 284 etc. by hardware such as various processors (CPU etc.), ASIC (gate array etc.) and realize.
Handling part 240 can comprise historical information renewal section 248 and event detection unit 250.In addition, can omit the part in these textural elements, or append other textural elements.
Historical information renewal section 248 carries out the renewal of historical information and processes.Particularly, when occured the second subsystem can use case (sensor can use case, control object equipment can use case) time, according to from the sensor information as the second sensor of the sensor of the second subsystem, user history information is upgraded.That is, upgrade user history information according to the sensor information that is obtained by information obtaining section 230.For example, carried out more New Consumers (using the user of the first subsystem) of user's history for the sensor information that according to the sensor from the first subsystem (for example mover system) is first sensor (for example Wearable sensor), when this user can newly use the second subsystem (for example family's subsystem) (when for example transferring to the environment of the second subsystem), according to the sensor information from the second sensor of the second subsystem, further be updated in the user history information after upgrading in the first subsystem.Then, the user history information after upgrading is stored in the historical information storage part 262.
In this case, in order to save the memory size of historical information storage part 262, when storing new historical information, can delete old historical information, the new historical information of storage in the storage area that empties by deletion.Perhaps, can give priority (weight coefficient) to each historical information, when storing new historical information, the lower historical information of deletion priority.In this case, can determine according to following situation for the priority level initializing of each historical information that is: whether once based on this historical information user history information was carried out renewal, whether once based on this historical information control object equipment carried out control.That is, for the historical information of the control of the renewal that once was used for user history information or control object equipment, set higher priority.Like this, both can the conserve memory capacity, can in historical information storage part 262, keep again based on the renewal of sensor information and the effective historical information of control of control object equipment.Certainly, also can upgrade (covering) historical information by the historical information of having stored and new historical information are carried out computing.
Event detection unit 250 carries out the determination processing of variety of event.Particularly, the generation that judgement can use case, this can represent to use the user of the first subsystem newly to become the state that can use the second subsystem by use case.For example, determine whether sensor has occured can use case (can access sensors event, can obtain the sensor information event), this can use Sensor Events to refer to: according to carried out from the sensor information of the sensor of the first subsystem user history information more New Consumers become the sensor that can use the second subsystem, i.e. the second sensor.Perhaps, determine whether device events (can access means event, can opertaing device event) has occured to use, this can use device events to refer to become the control object equipment that can use the second subsystem, i.e. the second control object equipment.Perhaps, determine whether occured to become can not use the second subsystem (the second sensor, the second control object equipment) can not use case.For example, the user during near the place of (moving to) second subsystem, event detection unit 250 can be judged to be that occured can use case.Perhaps, by wireless when carrying out communication, can by detect wireless strengths judge can use case generation.Perhaps, when the equipment (for example portable electric appts) of the first subsystem and the breakout box (cradle) (being arranged on the breakout box in the place of the second subsystem) that can in the second subsystem, use when linking to each other, be judged to be that occured can use case.
Then, when having occured can use case the time, historical information renewal section 248 obtains the sensor information from the second sensor of the second subsystem, upgrades user history information according to obtained sensor information.
Storage part 260 is workspaces of handling part 240 and information obtaining section 230 etc., and its function can realize by the storeies such as RAM or HDD (hard disk drive) etc.The historical information storage part 262 storage user history information that storage part 260 comprises, this user history information is by at least one historical information at least one sensor action, state and the environment that obtain, about the user in the environmental sensor of the action sensor of measuring user's action, the state sensor of measuring User Status and mensuration user environment.
Information storage medium (computer-readable medium) 284 storage programs and data etc., its function can realize by CD (CD, DVD) etc.Handling part 240 carries out the various processing of present embodiment according to the program (data) that is stored in the information storage medium 284.That is, in information storage medium 284, store for making computing machine (device that possesses operating portion, handling part, storage part, efferent) bring into play the program of the function of present embodiment each several part (being used for making computing machine to carry out the program that each several part is processed).
Fig. 3 illustrates the detailed structure example of the control system 25 of present embodiment.In addition, control system 25 is not limited to the structure of Fig. 3, can implement various distortion.
In Fig. 3, handling part 240 also comprises sensor selection portion 242, control object equipment selection portion 244, operational part 246 and control handling part 252 except comprising historical information renewal section 248 and event detection unit 250.In addition, can omit the part in these textural elements, perhaps append other textural elements.
Sensor selection portion 242 is carried out the selection of sensor and is processed.Particularly, the subsystem (the residing subsystem of user) of selecting the user using from a plurality of sensors of a plurality of subsystems can use the sensor of (can access, can obtain information).For example, when the user moves to the place of family's subsystem (the second subsystem), family's chamber sensor 14 (the second sensor, the second sensor group) that selection can be used in family's subsystem.In addition, when the user moves to the place of car intra subsystem (the 3rd subsystem), the car inner sensor 16 that selection can be used in the car intra subsystem (the 3rd sensor, the 3rd sensor group).
More specifically, sensor selection portion 242 can according to temporal information (year, month, week, day, constantly etc.), at least one information in customer site information (position, affiliated area, distance etc.) and the user's condition information (spirit/condition, with it the user event etc.), be TPO (Time Place Occasion: put temporally occasion) information, the sensor that selection can be used from a plurality of sensors.That is, even in same subsystem, also to select different sensors according to TPO information.
In addition, TPO information can be obtained according to the sensor information from sensor, also can obtain according to subscription table data (calendar information) or the downloading data that comes automatic network etc.In addition, the selection of sensor directly (initiatively) is carried out, and also (passive) carries out indirectly.For example, can directly not select sensor itself, but by selecting resulting sensor information indirectly to select sensor.For example, when utilizing wireless sensor information when communication of carrying out, select the sensor information that to use according to label information additional in each sensor information etc., come thus indirectly to select sensor.
For example indoor, in position probing, do not adopt the GPS sensor, but adopt the inertial navigation method of having utilized acceleration transducer.Therefore, enter when indoor when obtaining representing to be positioned at indoor information (for example can not accurately obtain from the positional information of GPS sensor or by the indoor and outdoor sensor) when detect the user according to sensor information, do not select the sensor information from the GPS sensor, but select to carry out the position computing from the sensor information of acceleration transducer.At this moment, by stopping the GPS sensor, can realize economize on electricity, alleviate wireless traffic, alleviate the load that sensor information is processed.
Control object equipment selection portion 244 is carried out the selection of control object equipment and is processed.Particularly, select control object equipment from a plurality of control object equipment of a plurality of subsystems, this control object equipment is subject to the control of user's historical information.In other words, from a plurality of control object equipment of a plurality of subsystems, the subsystem (the residing subsystem of user) of selecting the user using can use the control object equipment of (can access, can control).For example, when the user moves to the place of family's subsystem (the second subsystem), the home control object-based device 94 that selection can be used in family's subsystem (broadly being called the second control object equipment).In addition, when the user moves to the place of car intra subsystem (the 3rd subsystem), control object-based device 96 (broadly being called the 3rd control object equipment) in the car that selection can be used in the car intra subsystem.
And when having occured can use case the time, control object equipment selection portion 244 is selected the second control object equipment of the second subsystem.In addition, can use case even occured, if but do not need to select control object equipment, then also can not select control object equipment.That is, not only determine whether and to use, also will determine whether and to select.
More specifically, control object equipment selection portion 244 can be selected the control object equipment that can use according to TPO information from a plurality of control object equipment.That is, even in same subsystem, also to select different control object equipment according to TPO information.
In addition, the selection of control object equipment directly (initiatively) is carried out, and also (passive) carries out indirectly.For example, can directly not select control object equipment itself, and indirectly select this control object equipment by the required information (data, signal) of output control object equipment.
For example, do not need control and the air-conditioning control of the illumination in living room/AV equipment when having a bath, and the control of water temperature and bus TV (TV) is conducive to the user, therefore selects these control object equipment.In this case, image can be sent from home server to bus TV, also the channel information of playing the program of liking can be only sent.
Operational part 246 carries out Screening Treatment (selecting to process) and the required various calculation process of analyzing and processing of the sensor information that obtained by information obtaining section 230.Particularly, operational part 246 carries out multiplication process and the addition process of sensor information.For example as shown in the formula shown in (1), carry out measured value X jWith coefficient A IjLong-pending and computing, measured value X jThe value that obtains having carried out digitizing from a plurality of sensor informations of a plurality of sensors, coefficient A IjEach coefficient storage in coefficient storage section (not shown), represent with two-dimensional matrix.Then, shown in (2), the result of long-pending and computing as multidimensional coordinate, is calculated n n dimensional vector n Y iWherein, i is the i coordinate of n-dimensional space, and j is the numbering of distributing to each sensor.
[formula 1]
Y 0 Y 1 Y 2 · · · Y i · · · Y n = A 00 · · · · · · · · · A 0 m · · · · · · · · · A ij · · · · · · · · · A n 0 · · · · · · · · · A nm X 0 X 1 X 2 · · · X j · · · X m . . . . . . ( 1 )
[formula 2]
Y i＝A 00X 0+......+A ijX j......+A nmX m ......(2)
By carrying out the calculation process of following formula (1) (2), can realize from the sensor information that obtains, removing the Screening Treatment of unwanted sensor information and identify user's action, state, analyzing and processing of environment (TPO information) etc. according to sensor information.For example, if the coefficient A that will multiply each other with the measured value X of pulse (heart rate), volume of perspiration, body temperature is set as than the large value of coefficient for the measured value of other sensor informations, the numerical value Y that then utilizes following formula (1) (2) to calculate represents " excitement levels " as User Status.In addition, by the coefficient that will multiply each other with the measured value X of the amount of speaking and with coefficient settings that the measured value X of foot pressure multiplies each other be suitable value, the action that can identify the user is the dialogue or speak while walking or silently thinking or be in sleep state etc. of being seated.Control handling part 252 carries out the various processing controlled for to control object equipment.For example, when having occured can use case and when having selected the second control object equipment, begin control action the second control object equipment, user's historical information.For example, make the control part of the second control object equipment begin control object is controlled.In this case, also can begin the second control object equipment, use from the sensor information of the second sensor of the second subsystem and the control action of user history information.Perhaps, when having occured to make the control (indication) of the power connection (recovery normal operation mode) of the second control object equipment can use case the time.Perhaps, when occured the user can't re-use the second control object equipment can not use case the time, can make the control of the power-off (transferring to low-power consumption mode) of the second control object equipment.
The output information that output information storage part 264 storages that storage part 260 comprises are transmitted to control object equipment by information transport unit 270.
Information transport unit (information output part) 270 is control object-based device 92,94, the transmission information such as 96 in mobile control object equipment, home control object-based device and the car, and its function can realize by Department of Communication Force 272 or equipment I/F section 274 etc.For example, when the communication that utilizes wireless grade transmits (transmission) information (data) to control object equipment, use Department of Communication Force 272.On the other hand, when utilizing wired electric signal to transmit (output) information (control signal) to control object equipment, use equipment I/F section 274.
Next, use Fig. 4 A, Fig. 4 B that the action of present embodiment is described.Fig. 4 A is the process flow diagram that upgrades about user history information.Here, describe as an example of following situation example, that is: using user's (be that the sensor information of first sensor carried out user profile more New Consumers according to sensor from the first subsystem) of the first subsystem to transfer to the state that can use the second subsystem (the second sensor).
At first, event detection unit 250 judges whether to use the second subsystem (the second sensor) (step S1).For example, when the user moves to the place of the second subsystem, can use the second subsystem.Then, in the situation that can use the sensor (the second sensor) (step S2) that 242 selections of sensor selection portion can be used in the second subsystem.In this case, also can select sensor according to user's TPO information.
So information obtaining section 230 obtains the sensor information (step S3) from selected sensor.Then, historical information renewal section 248 upgrades user history information according to obtained sensor information, and the user history information after upgrading is stored in (step S4) in the historical information storage part 262.In addition, when being judged as in step S1 still can not use the second subsystem the time, proceeding based on the sensor from the first subsystem is that the user history information of the sensor information of first sensor is upgraded.
Fig. 4 B is the process flow diagram of processing about the control of control object equipment.Here, describe as an example of following situation example, that is: using user's (the control object equipment that is carrying out the first subsystem is the user of the control of the first control object) of the first subsystem to transfer to the state that can use the second subsystem (the second control object equipment).
At first, event detection unit 250 judges whether to use the second subsystem (the second control object equipment) (step S11).Then, in the situation that can use the control object equipment (step S12) that 244 selections of control object equipment selection portion can be used.In this case, can select the control object equipment that can use according to user's TPO information.So, from historical information storage part 262, read user history information (step S13).Then, information transport unit 270 is selected from output information storage part 264 according to the user history information of reading will be to the output information (step S14) of selected control object equipment transmission, export selected output information to control object equipment, the control action (step S15) of beginning control object equipment.In addition, in step S11, be judged as in the time of still can not using the second subsystem, continue the control of the control object equipment (the first control object equipment) of the first subsystem.
For example in Fig. 4 A, if select the sensor corresponding with user's TPO information, then can select different sensors according to place, time, situation.Therefore, can according to being that the sensor information that obtains makes sensor information have different implications, can realize that more intelligent sensor information obtains processing under which place, time, situation.In addition, by selection and place, time, appropriate sensor that state is corresponding, can upgrade exactly user history information.
In addition, being used for obtaining the sensor selection that TPO judges the sensor information of usefulness, judge effective sensor or select the sensor that can detect the TPO variation as long as select for TPO.For example, in above-mentioned example, indoor, select for indoor location determination (TPO judgement) effective sensor, i.e. acceleration transducer.But, only depend on acceleration transducer, thereby can't detect from indoor moving to the outdoor situation that can use the GPS sensor, can not again select sensor.Therefore, in this case, the above-mentioned indoor and outdoor sensor of preferred also prior selection.
In addition, for example in family's subsystem, when the user is in the living room, select luminance sensor and temperature sensor in order to throw light on the control of control and air-conditioning.On the other hand, when the user is in the toilet, in order to generate user's health status historical information, select the uroscopy sensor.In addition, when the close robot of user, for robot being made a response to the user or upgrading user's action historical information with robot, select robot to carry sensor.In addition, in the time period by day, select temperature sensor in order to carry out air-conditioning control; In the time period at night, for measure the user in sleep body temperature and generate user health situation historical information, the selective body temperature sensor is perhaps selected theft-proof sensor for the purpose of safety.In addition, when the user is in busy situation,, the illumination that makes the user obtain loosening selects luminance sensor for controlling; When the user is in the leisure during situation, for the robot control of dismissing user time and select robot to carry sensor.
In addition, in Fig. 4 B, if selected the control object equipment corresponding with user's TPO information, then can select different control object equipment according to place, time, situation, can realize more intelligent equipment control.
For example in family's subsystem, in the situation that the user is in the living room or in the time period after the user gets up, in order to dismiss user's time, select the control object equipment such as family's display, AV equipment or robot.Perhaps, when the close family of user display, AV equipment or robot, select the close equipment of user.On the other hand, in the situation that the user is in the bedroom or in the time period at night, for the sleep that realizes that the user is comfortable, select the control object equipment such as air-conditioning and working flare.In addition, if the user is in bloodless situation, then select robot for the user is cheered up, and if the user is in busy situation, then to make the music that the user obtains loosening and select the AV of family equipment in order to play.
In Fig. 5, more specifically show in the situation that from family via car, outdoor, indoor and sensor that the company that moves to is selected according to TPO and the example of control object equipment.During driver's seat in the user moves to car, select transport condition sensor, operational state sensors, environment inside car sensor.In addition, as control object equipment, select automobile navigation instrument, automobile AV equipment, air-conditioning, Drowse-proof device etc.
In the situation that the user moves to outdoor and walking, select the Wearable sensor of GPS, acceleration, pulse etc. in car.In addition, select the control object equipment of Wearable display, mobile AV equipment, mobile phone, wrist-watch etc.On the other hand, as user during indoor stopping, select the Wearable sensor of GPS, acceleration, pulse etc. and be installed in indoor environmental sensor.In addition, as control object equipment, select the hithermost terminal of user or display.
When the user arrives company and when taking one's seat, select the Wearable sensor of pulse etc., the sensor that is installed in the environment/state sensor on indoor or the unit desk and monitors the operation history of PC.In addition, as control object equipment, the terminal/PC on the selection desk, working flare, air-conditioning etc.
According to the method for above present embodiment, when the user moves, can realize the seamless renewal of user history information between a plurality of subsystems.
For example in Fig. 6 A, the user in going back home is connected on portable electric appts 20 and charges on the breakout box 21 etc.By being connected of this and breakout box 21, can select and start the robot 300 as the control object equipment of family's subsystem, become the state that can use this robot 300.In this case, the user history information of upgrading in mobile environment is stored in the historical information storage part of portable electric appts 20, comes control 300 according to this user history information.Particularly, judge the user has got on to drink meeting and talked with the colleague on the road of coming home from work lively atmosphere according to user history information.So robot 300 for example carries out " atmosphere of the meeting of drinking today is as awfully hot strong " such speech act when the user is close.Thus, the user to robot 300 known own in robot 300 place not on the scene action and feel novel, can produce the feelings of liking to robot 300, can realize the control of unprecedented robot.In addition, for example user job is tired out or out of spirits the time, robot 300 encourages user's speech act when judging according to user history information.Thus, the user can like more just as the situation of realizing oneself and the robot 300 that gives encouragement.
In addition, like this, in the time of in the user goes back home, can using the robot 300 of family's subsystem, can also use robot to carry sensor.And, can be updated in the user history information of upgrading in the mobile environment according to the sensor information of carrying sensor from robot.
Particularly, shown in Fig. 6 B, in robot 300 such as be equipped with feeler 319, the sensor 320 of speaking, pulse transducer 321, body temperature trans 322, perspiration sensor 323 etc.And, by the reaction that the detection users such as feeler 319 of being carried by robot speak to robot 300, can judge the state of the spirit, health etc. of user when getting home.
For example, for " atmosphere of the meeting of drinking today is as awfully hot strong " this inquiry among Fig. 6 A from robot 300, shown in Fig. 6 B, when feeler 319 or the sensor 320 of speaking detect subscriber's meter sure reaction are shown, it is correct can judging " having gone the meeting of drinking after the work " this estimation result, can generate more accurately user history information.
In addition, in the present embodiment, shown in Fig. 6 A, 6B, the user after the family when taking off Wearable sensors such as speak/chewing sensor 540, pulse transducer 521, body temperature trans 522, perspiration sensor 523, use speak sensor 320, pulse transducer 321, body temperature trans 322 and the perspiration sensor 323 that carry in robot 300, replace these Wearable sensors.Then, use the sensor information of carrying sensor from these robots, in mobile environment, upgrading according to the user history information of upgrading from the sensor information of Wearable sensor.Namely, shown in the D1 of Fig. 6 C, speak amount, pulse, volume of perspiration etc. according to measure the user from the sensor information of carrying speak sensor 320, pulse transducer 321 and perspiration sensor 323 in robot 300 continue the user history information that obtains in the mobile environment is upgraded.According to this mode, even in the situation that the user takes off the Wearable sensor, also can seamlessly upgrade user history information.
In Fig. 7 A, user in riding in car is installed in portable electric appts 20 when having set up communication path on the breakout box 21 that arranges in the car or based near radios such as bluetooths, can communicate between as the guider 700 of the control object equipment of car intra subsystem and portable electric appts 20.Thus, the user history information of upgrading in mobile environment or home environment is sent to guider 700 from portable electric appts 20, can carry out according to the user history information that sends demonstration control of auto navigation display etc.
Particularly, when the amount of exercise (Relationship of Walking) of judging the user according to user history information is not enough, shown in Fig. 7 B, show the guide picture in the healthy dining room of recommendation at the auto navigation display of guider 700.Thus, the user can thing that make a response feels novel and surprised to the action of unexpectedly knowing oneself is historical, and unprecedented guider 700 can be provided.In addition, be scheduled to carry out such as inferior Navigation Control in the situation of arrangement historical for example the shifting to an earlier date in the user who determines according to reservation table that take action according to the definite user of user history information: set the road path of navigation with surplus.
In addition, also can not use the built-in GPS sensor 550 of the portable electric appts 20 that receiving sensitivity reduces in the car, but utilize the GPS sensor 720 of guider 700 or gyro sensor 721 inner sensor of waiting for bus, identify user's accurate mobile route etc., upgrade user history information.Particularly, in environment inside car, shown in the E1 of Fig. 7 C, according to upgrading user history information from the sensor information of car inner sensor (GPS).In addition, when the user gets off and when turning back to mobile environment from environment inside car, shown in E2, the E3 of Fig. 7 C, current according to upgrading user history information from the sensor information of Wearable sensor.Therefore, can realize that the seamless renewal of user history information is processed, can access more appropriately and user history information accurately.
In addition, the application examples of the method for present embodiment is not limited to Fig. 6 A～Fig. 7 C.For example, can also be: when the user went back home, takes off Wearable display and close family display, the control action of beginning family display on family's display rather than on the Wearable display, shows that user history information reaches the information based on this.In addition, can detect the user to the image that shows on family's display or the selection operation history of program by operation sensor, upgrade user history information according to detected operation history.
In addition, can also be: when the user went back home, according to the user history information relevant with temperature that is obtained by the ambient temp sensor as the Wearable sensor, the control action of air-conditioning in the beginning man carries out air-conditioning control.For example, emitting in hot the going back home in the situation that judge the user according to user history information, carrying out air-conditioning and control to reduce temperature in the family.Perhaps, user in going back home has taken off in the situation of the Wearable sensors such as ambient temp sensor and peripheral luminance sensor, ambient temp sensor and the peripheral luminance sensor that can select to be installed in family's subsystem environment replace these Wearable sensors, continue user history information is upgraded.
In addition, can also be: in the time of in the user moves to car, if judge user's mental fatigue according to the user history information in mobile environment or the home environment (state parameter), then begin the control action of automobile AV equipment, such as the control of broadcast of carrying out the therapeutic type music etc.In addition, can also be according to upgrading user history information from the operation information of the control object equipment of car intra subsystem or from the sensor information of the sensor of car intra subsystem.Particularly, according to from the sensor information of environment inside car sensor, the user operation information (information of for example bearing circle operation, auto navigation operation) for control object equipment such as car and automobile navigation instruments, continue user's the user history information such as state parameter are upgraded.
3. user history information
Next, the renewal processing of user history information and the concrete example of user history information are described.Fig. 8 is the process flow diagram that the example that the renewal of user history information processes is shown.
At first, information obtaining section 230 obtains sensor information (step S21).Then, 246 pairs of sensor informations that obtain of operational part are screened and the calculation process (step S22) of parsing etc.Then, infer user's action, state, environment etc. (TPO, emotion) (step S23) according to operation result.Then, historical information renewal section 248 is stored in the historical information storage part 262 with time on date (year, month, week, day, constantly) etc. the user of action, state etc. who infers the user who is historical relatedly, and user history information is upgraded (step S24).
The concrete example of the schematically illustrated user history information of Fig. 9.The data structure of the user history information of Fig. 9 is associated with the time period, the moment etc. for the history of user action etc.For example, 8 of users walked to station from oneself from family in 8 o'clock to 8: 20 time period, arrived the A station of leaving home nearest in 8: 20.Then, assign in time period of 8: 45 8: 20 and to take electric car, getting off from the nearest B station of company in 8: 45,9 arrival companies start working.10 o'clock to 11 o'clock time period, with corporator's meeting, in 12 o'clock to 13 o'clock time period, have lunch.
Like this, in Fig. 9, be associated with the time period and the moment etc. according to the history of inferring user's action of etc. from the information of sensor etc., construct thus user history information.
Among this external Fig. 9, the measured value of the measuring in a minute of the user who is determined by sensor, the amount of having a dinner, pulse, volume of perspiration etc. is also with the time period with constantly be associated.For example, in 8 o'clock to 8: 20 time period, the user walks to A station from family, is measured the Relationship of Walking of this moment etc. by sensor, and is associated with time period of 8 o'clock to 8: 20.In this case, the measured value of the sensor information beyond all right further related walking speed, volume of perspiration etc., the Relationship of Walking.Can grasp thus the amount of exercise of user in this time period etc.
In 10 o'clock to 11 o'clock time period, user and colleague carry out meeting, are measured the amount of speaking of this moment and are associated with time period of 10 o'clock to 11 o'clock by sensor.In this case, the further measured value of the sensor information of associated sound state, pulse etc.Thus, can grasp speak amount and the tensity etc. of user in this time period.
Assign in the time period of 21: 45 and 22 o'clock to 23 o'clock 20: 45, the user is playing games or is seeing TV, and the pulse of this moment, volume of perspiration etc. were associated with these time periods.Thus, can grasp the excitement levels etc. of user in these time periods.
In 23 o'clock 30 minutes later time periods, the user is in the sleep, and this moment, user's body temperature variation was associated with this time period.Thus, user's health status in the time of can grasping sleep.
In addition, user history information is not limited to the mode of Fig. 9.Also can implement distortion, such as in situation the about history of user action etc. and time on date etc. not being associated, constructing user history information.
For example in Figure 10 A, according to speak amount, sound status, pulse, volume of perspiration etc. as the measured value of sensor information, arithmetic expression is according to the rules come computing user's state of mind parameter.For example, if the amount of speaking is many, then state of mind parameter is high, and expression user's the state of mind is good.In addition, according to as the Relationship of Walking of the measured value of sensor information, walking speed, body temperature etc., arithmetic expression is according to the rules come the parameter (amount of exercise parameter) of computing user's condition (health status).For example, if amount of exercise is many, then the condition parameter is high, and expression user's condition is good.
Shown in Figure 10 B, utilize histogram etc. that user's the state of mind, the parameter of condition (broadly being called state parameter) is visual, above-mentioned parameter is presented on Wearable display, family's display or the auto navigation display thus.Therefore, according to present embodiment, such as can using the state of mind of in mobile environment, upgrading, the user history information such as parameter of condition, shown in Figure 10 B that parameter is visual and be presented on the family's display or the auto navigation display in the environment inside car in the home environment.Perhaps, can be according to the parameter of the state of mind of upgrading in the mobile environment, condition etc., the robot in the control home environment, the action that makes robot encourage the user or make suggestions to the user.Perhaps, can also be in environment inside car, carry out navigation or the music corresponding with the parameter of user's mental status, health.
In addition, when the user moves between a plurality of subsystems (in movement, family, the car etc.), can obtain the sensor information from the sensor that can in each subsystem, use, continue the User Status parameters such as the state of mind, condition are carried out seamless renewal.
4. system architecture
Next, the various system architecture examples of present embodiment is specifically described.In addition, hereinafter, for convenience of explanation, be that mover system etc., the second subsystem are that the situation of family's subsystem (robot) or car intra subsystem (guider) describes as example take the first subsystem mainly, but present embodiment is not limited to this.
4.1 the first system structure example
Figure 11 illustrates the first system structure example.In Figure 11, portable electric appts 20 utilizes WLAN or breakout box etc. to communicate with robot 300 to be connected.And the processing of the control system 25 of the present embodiment of explanation can realize by the handling part 340 of robot 300 among Fig. 2, Fig. 3 etc.Perhaps, can be by being realized by the handling part 40 of portable electric appts 20, the dispersion treatment that the handling part 340 of robot 300 carries out.
In Figure 11, when according to having carried out from the sensor information of the sensor of mover system that the more capable user of user history information goes back home and during near robot 300, event detection unit 350 be judged as robot 300 (the second control object equipment of the second subsystem) occured can use case.
In addition, information transport unit 370 is carried out the transmission of user history information and is processed between the historical information storage part 362 (the second historical information storage part) of the historical information storage part 62 (the first historical information storage part) of portable electric appts 20 (the first subsystem) and robot 300 (the second subsystem).Thus, the user history information of upgrading in mobile environment is transmitted and is stored in the historical information storage part 362.In addition, also can carry out information synchronization and process, that is: will be stored in user history information and the information that is stored in user history information in the historical information storage part 362 and remains identical content in the historical information storage part 62.
In addition, when occured robot 300 can use case the time, the control action of control handling part 352 beginning robots 300.Particularly, bring into use the control action that is sent to the user history information in the historical information storage part 362.That is, 386 beginnings of robot control part make robot 300 carry out the exercises such as speech act as the control of the robot motion mechanism 390 (actuator, loudspeaker, LED etc.) of control object.
In addition, historical information renewal section 348 upgrades processing according to the sensor information of carrying sensor 310 (the second sensor of the second subsystem) from robot to the user history information that is sent in the historical information storage part 362.
According to this mode, for example as shown in Figure 6A, when the user who goes back home links portable electric appts 20 on the breakout box 21 and during near robot 300, can use robot 300 and with its starting.Then, robot 300 carries out the actions such as speech act corresponding with the user history information in the mobile environment.In addition, shown in Fig. 6 B, when the user made a response to the speech act of robot 300 etc., this reaction was carried sensor 310 (319～323) by robot and is detected.Then, shown in the D1 of Fig. 6 C, according to the sensor information of carrying sensor 310 from robot, seamlessly upgrade user history information.
In addition, robot 300 can use case judgement can whether carry out near robot 300 (family's subsystem) according to the user.Particularly, by detecting the wireless strengths of communicating by letter of carrying out between portable electric appts 20 (mover system) and the robot 300 (family's subsystem), can judge can use case generation.For example, occured can use case (can access, can control event) in the situation that the user near robot 300 and wireless strengths is higher than defined threshold, is judged as.Perhaps, also can be under portable electric appts 20 (equipment of the first subsystem) be connected to situation on the breakout box 21 of Fig. 6 A in the place that is arranged in family's subsystem (the second subsystem), be judged to be robot 300 occured can use case.
In addition, in the situation that occured like this can use case, can carry out following control: the power supply of connecting robot 300 makes its starting, or makes robot 300 return to normal operation mode from low-power consumption mode.Perhaps, occured the user no longer can use robot 300 can not the situation of use case under, can carry out following control: closing machine people 300 power supply stops it, or makes robot 30 transfer to low-power consumption mode from normal operation mode.
4.2 second system structure example
Figure 12 illustrates the second system structure example.Be provided with the home server of family's subsystem in Figure 12, namely home server 120.This home server 120 carries out the required processing of control of various control object equipment (such as robot, air-conditioning or working flare etc.) in family's subsystem, carries out (information transmission) processing etc. of communicating by letter with the outside.
And in the system of Figure 12, portable electric appts 20 utilizes WLAN or breakout box etc. to communicate with home server 120 to be connected, and home server 120 utilizes WLAN etc. to communicate with robot 300 to be connected.And the processing of the control system 25 among Fig. 2, Fig. 3 etc. can realize by the handling part 140 of home server 120.Perhaps, can be by being realized by the handling part 40 of portable electric appts 20, the handling part 140 of home server 120, the dispersion treatment that the handling part 340 of robot 300 carries out.
When the user who is carrying portable electric appts 20 is positioned at when neighbouring, can utilize WLAN to carry out communicating by letter between portable electric appts 20 and the home server 120.Perhaps, by being placed on the breakout box, portable electric appts 20 communicates.
Then, when having set up communication path, the historical information storage part 162 from the historical information storage part 62 of mobile side to family's side transmits historical informations.Particularly, between historical information storage part 62 and historical information storage part 162, carry out the synchronous processing of user history information.Then, robot 300 moves under the control of home server 120.That is, according to the user history information in the historical information storage part 162 that is stored in home server 120, beginning control action and moving.Take Fig. 6 A as example, the user history information in 152 pairs of historical information storage parts 162 of the control handling part of home server 120 is analyzed, and robot 300 is indicated control, so that it carries out the speech act corresponding with user history information etc.According to this mode, in the very large situation of the size of data of user history information, can the historical information storage part be arranged in the robot 300, therefore, can realize low cost and the miniaturization of robot 300.In addition, can be in home server 120, transmission and the calculation process with the leading subscriber historical information processed on monobasic ground, therefore can realize more intelligent robot control.
In addition, system according to Figure 12, occur robot 300 can use case before (for example detect user near or when moving to the place of the second subsystem), information transport unit 170 can be in advance 162 transmits user history information from historical information storage part 62 to the historical information storage part.For example, the user to family and near before the robot 300 (particularly, at the information table from the GPS sensor of one of Wearable sensor of carrying as the user user is shown and arrives the opportunity at nearest station or the opportunity etc. that the user is being shown from the information table as the door switching sensor of one of family's chamber sensor opens the door of entry), in advance the user history information of upgrading in the mobile environment is transmitted and is written in the historical information storage part 162 of home server 120.Then, when the user has occured near robot 300 can use case the time, beginning robot 300, use the control action that is sent in advance the user history information in the historical information storage part 162.That is, starting robot 300,386 pairs of robot motion mechanisms 390 of robot control part control, and make it carry out action shown in Fig. 6 A etc.According to this mode, after robot 300 startings, can begin immediately the robot control based on user history information, make the control high efficiency.
In addition, in Figure 12, be arranged on event detection unit 150 in the home server 120 (home server) of family's subsystem (the second subsystem) carry out can use case judgement.Particularly, as user during near the place of family subsystem, be judged to be that occured can use case.Then, be arranged on the control action of the control handling part 152 beginning robots 300 in the home server 120.In addition, the historical information renewal section 148 in the home server 120 of being arranged on upgrades user history information according to the sensor information of carrying sensor 310 grades from robot.In addition, also can upgrade user history information according to the sensor information of the Wearable sensor of carrying from other family's chamber sensors or user.
If event detection unit 150, control handling part 152, historical information renewal section 148 etc. are set in family's subsystem in this wise, even then carried out the switching of subsystem, also can reflect all the time the control of up-to-date user's history.In addition, needs can be carried out poll etc., process heavy processing such as event judgement of load and distribute to the high home server of processing power 120, the processing that therefore can alleviate portable electric appts 20 (mover system) is loaded.In addition, if only make event detection unit 150 and 170 actions of information transport unit of home server 120, then other each several parts can be set as low-power consumption mode (sleep state), can realize economize on electricity.
4.3 the 3rd system architecture is routine
Figure 13 illustrates the 3rd system architecture example.In Figure 13, be provided with the external server 620 as the master server of aggregation system.This external server 620 consists of the required processing of the control of control object equipment of a plurality of subsystems of aggregation system and the communication between the subsystem (information transmission) to be processed etc.
And in the system of Figure 13, portable electric appts 20 utilizes the wireless WAN such as PHS to communicate to be connected with external server 620, and external server 620 also utilizes the wireless WAN such as PHS to communicate to be connected with robot 300.And the processing of control system 25 can realize by the handling part 640 of external server 620.Perhaps, by being realized by the handling part 40 of portable electric appts 20, the handling part 640 of external server 620, the dispersion treatment that the handling part 340 of robot 300 carries out.
Each unit such as portable electric appts 20 and robot 300 suitably communicates with external server 620, carries out the synchronous processing (transmit and process) of user history information.For example, the opportunity that stops in the unit, 620 historical information storage part 662 is uploaded user history information from these unit to external server, on the opportunity of user starting, downloads user history information historical information storage parts 662 to these unit from external server 620.These are uploaded, download process is realized by information transport unit 670 etc.In addition, in Figure 13, externally be provided with event detection unit 650 and historical information renewal section 648 in the server 620, can unify to carry out can use case determination processing and the renewal of user history information process.
In addition, in Figure 13, can not judge that whether user and family approach according to wireless strengths.Therefore, in this case, such as the position that can judge according to the position register information of the base station of PHS etc. the user, judge the user whether be positioned at family near.Perhaps, also can judge according to the GPS sensor of Wearable sensor 12.And, be in when neighbouring when being judged as the user, can utilize the control of external server 620 grades to start robot 300.
4.4 Quaternary system system structure example
Figure 14 illustrates the structure example of Quaternary system system.In Figure 14, be provided with as the external server 620 of master server with as the home server 120 of home server.
In the system of Figure 14, portable electric appts 20 utilizes the wireless WAN such as PHS to communicate to be connected with external server 620, external server 620 utilizes wired WAN such as ADSL to communicate to be connected with home server 120, home server 120 utilizes WLAN etc. to communicate with robot 300 to be connected.And the processing of the control system of present embodiment can realize by handling part 640 grades of external server 620.Perhaps can be by being realized by the handling part 40 of portable electric appts 20, the handling part 640 of external server 620, the handling part 140 of home server 120, the dispersion treatment that the handling part 340 of robot 300 carries out.
Suitably communicating by letter with external server 620 in each unit such as portable electric appts 20, home server 120, carries out the synchronous processing (transmit and process) of user history information.In addition, utilize the position register information, GPS sensor, microphone etc. of PHS judge the user whether be positioned at family near, be positioned at when neighbouring when being judged as, the user history information of the historical information storage part 662 of external server 620 is downloaded to the storage part 160 of home server 120, the control action of beginning robot 300.
According to the system of Figure 14, therefore monobasic ground leading subscriber historical information and upgrade to process in the server 620 externally can provide the control system that is suitable for the aggregation system that is made of a plurality of subsystems.
4.5 the 5th system architecture is routine
Figure 15 illustrates the 5th system architecture example.In Figure 15, portable electric appts 20 utilizes the near radios such as bluetooth or breakout box etc. to communicate to be connected with guider 700.And the processing of control system 25 can realize by the handling part 740 of guider 700.Perhaps, can be by being realized by the handling part 40 of portable electric appts 20, the dispersion treatment that the handling part 740 of guider 700 carries out.In addition, the processing of handling part 740 can also realize by the handling part of truck-mounted computer.
In Figure 15, when when having carried out user history information from the sensor information of the sensor of mover system or family's subsystem more New Consumers moved in the car, event detection unit 750 be judged as guider 700 (the second control object equipment of the second subsystem) occured can use case.
In addition, information transport unit 770 is between the historical information storage part 762 (the second historical information storage part) of the historical information storage part 62 (the first historical information storage part) of portable electric appts 20 (the first subsystem) and guider 700 (the second subsystem), carrying out the transmission of user history information processes, thus, the user history information of upgrading in mobile environment or home environment is transmitted and is stored in the historical information storage part 762.
In addition, the control action of control handling part 752 beginning auto navigation displays 790 grades is occuring can use case the time.Particularly, 786 pairs of auto navigation displays 790 as control object of control part are controlled, and carry out display action etc. with the user history information that is sent in the historical information storage part 762 thus.
In addition, historical information renewal section 748 upgrades user history information according to from the sensor information of the car inner sensor 16 (GPS sensor, gyro sensor, touch sensor etc.) of guider 700 (car intra subsystem) etc.
According to this mode, for example shown in Fig. 7 A, when the user after getting on the bus receives portable electric appts 20 on the breakout box 21 or detects the user and got on the bus by near radio, set up communication path, transmit user history information from portable electric appts 20 navigation device 700.Then, shown in Fig. 7 B, carry out the demonstration control of auto navigation display according to user history information.In addition, according to the sensor information of the inner sensor 16 of waiting for bus from GPS sensor, gyro sensor, touch sensor, the history of the action of identification user in the car intra subsystem, state etc.Then, shown in the E1 of Fig. 7 C, according to the sensor information from car inner sensor 16 (GPS sensor), seamlessly upgrade user history information.In addition, after the user got off, for example the historical information storage part from the historical information storage part 762 of guider 700 to portable electric appts 20 62 transmitted user history information.Then, shown in E2, the E3 of Fig. 7 C, walking around from environment inside car when moving on to the mobile environment, also to seamlessly upgrade user history information.
5. the selection of sensor, control object equipment
Next, the concrete example of the system of selection of sensor and control object equipment is described.
For example, in Figure 16 A, in the situation that the user is in mobile environment, when event detection unit 50 is judged to be can use Wearable sensor 12, mobile control object equipment 92 time, sensor selection portion 42 is selected Wearable sensor 12, and control object equipment selection portion 44 is selected mobile control object equipment 92.Then, historical information renewal section 48 is according to from the sensor information of Wearable sensor 12 user history information being upgraded.In addition, control handling part 52 begins the control action of mobile control object equipment 92.
On the other hand, in Figure 16 B, the user moves to the home environment from mobile environment, and event detection unit 50 determines whether and can use a chamber sensor 14, home control object-based device 94.And in the situation that can use, sensor selection portion 42 is selected family's chamber sensor 14, and control object equipment selection portion 44 is selected home control object-based device 94.In addition, historical information renewal section 48 is according to from the sensor information of family's chamber sensor 14 user history information being upgraded.And, the action control of control handling part 52 beginning home control object-based devices 94.
Like this, in Figure 16 A, 16B, no matter the user is in the mobile environment still is in the home environment, portable electric appts 20 all can carry out the renewal of historical information and the control of control object according to sensor information, has advantages of to have realized that terminal device is shared and do not need user history information synchronous.
But, in the situation that the user is in the home environment, probably take off portable electric appts 20.In addition, when portable electric appts 20 is moved all the time, the electric power of meeting unnecessary consumption portable electric appts 20.
Therefore, in Figure 17 A～Figure 18, when the user when mobile environment (the first subsystem environment) moves to the home environment (the second subsystem environment), carry out portable electric appts 20 is stopped the control to wait.
For example in Figure 17 A, because the user is in the mobile environment, therefore mobile side is in power connection state (or normal operation mode), and home control object-based device 94 is in power down state (or low-power consumption mode).In addition, the information transport unit 170 of the information transport unit 70 of mobile side and family's side is in power connection state (normal operation mode) all the time.
And the control object equipment selection portion 44 of mobile side is selected mobile control object equipment 92, and selected mobile control object equipment 92 is controlled.In addition, the sensor selection portion 42 of mobile side is selected Wearable sensor 12, and the historical information renewal section 48 of mobile side is according to upgrading user history information from the sensor information of Wearable sensor 12.
On the other hand, in Figure 17 B, the user moves to the home environment from mobile environment.In this case, determine whether and can use home control object-based device 94, in the situation that can use, home control object-based device 94 becomes power connection state (normal operation mode).Then, the information transport unit 70 of mobile side is read user history information from historical information storage part 62, is sent to family's side.So the information transport unit 170 of family's side receives this user history information and writes historical information storage part 162.Then, select family's chamber sensor 14, beginning is upgraded based on the user history information from the sensor information of family's chamber sensor 14.In addition, beginning home control object-based device control 94, user's historical information.Then, mobile side becomes power down state (low-power consumption mode).
In Figure 18, the user turns back to the mobile environment from home environment.In this case, mobile side becomes power connection state (normal operation mode).Then, the information transport unit 170 of family's side is read user history information from historical information storage part 162, is sent to mobile side.So the information transport unit 70 of mobile side receives this user history information, writes historical information storage part 62.Then, home control object-based device 94 becomes power down state (low-power consumption mode).
Method according to Figure 17 A～Figure 18, in the situation that the user is in the mobile environment, home control object-based device 94 (or family's subsystem) is in power down state (low-power consumption mode), in the situation that the user is in the home environment, mobile side becomes power down state, has therefore realized the low-power consumption of mobile side and family's side.And, in this case, such as Figure 17 B and shown in Figure 180, as long as transmitted user history information, even then the user is mobile between subsystem, also can carry out the seamless renewal of user history information.In addition, no matter the user is in mobile environment still is in the home environment, information transport unit 70,170 is in power connection state (normal operation mode) all the time, therefore can realize exactly the transmission processing of user history information and the supervision processing that user environment changes.
Figure 19 is the detailed process flow diagram of processing example that the method for Figure 17 A～Figure 18 is shown.At first, judge whether to use home control object-based device 94 (step S31).Then, in the situation that can use, select this home control object-based device 94 (step S32), connect the power supply (step S33) of selected home control object-based device 94.Perhaps, make it return to normal operation mode from low-power consumption mode.
Next, the historical information storage part from historical information storage part 62 to family's subsystem 162 transmits user history information (step S34).Then, begin to use from the user history information of the sensor information of family's chamber sensor 14 and upgrade (step S35).And, begin to carry out control action home control object-based device 94, user's historical information (step S36).
Next, close the power supply (step S37) of portable electric appts 20.Perhaps, make it transfer to low-power consumption mode.But information transport unit (Department of Communication Force) 70 remains power connection state (normal operation mode).
So, next, judge whether to use home control object-based device 94 (step S38).Can use home control object-based device 94 during, proceed to use the control action from the user history information of the sensor information of family's chamber sensor 14 is upgraded and this user history information of use of home control object-based device 94 is upgraded.Then, in out of use situation, connect the power supply (step S39) of portable electric appts 20.Perhaps, make it return to normal operation mode from low-power consumption mode.Then, the historical information storage part from the historical information storage part 162 of family's subsystem to portable electric appts 20 62 transmits user history information (step S40).Then, close the power supply (step S41) of home control object-based device 94.Perhaps make it transfer to low-power consumption mode.
6. utilize wireless user history information to transmit
Next, the transfer approach that utilizes wireless user history information is described.Figure 20 shows the structure example of the system that realizes the method.
In Figure 20, in portable electric appts 20, be provided with information transport unit 70, in robot 300, be provided with information transport unit 370, undertaken transmitting based on wireless information by their Department of Communication Force (communication module) 72,372.For example, when occured as the robot 300 of control object equipment can use case the time, information transport unit 70, information transport unit 370 are handled as follows: will be stored in the historical information storage part 362 (the second historical information storage part) that user history information in the historical information storage part 62 of mobile side is sent to family's side.
In this case, information transport unit 70, information transport unit 370 are carried out the information synchronization processing of user history information.Particularly, carrying out following information synchronization processes: make user history information and the user history information in the historical information storage part 362 that is stored in family's side in the historical information storage part 62 that is stored in mobile side remain the information of identical content.Information synchronization is processed and carried out in the following way: the historical information with the current subsystem that is using covers the historical information that newly becomes the subsystem that can use state.For example, currently use mobile side, in the time can newly using family's side, covering the historical information of family's side with the historical information of mobile side.In the situation that opposite, cover the historical information of mobile side with the historical information of family's side.According to this mode, in historical information storage part 62,362, storing all the time up-to-date user history information, even the user is mobile between a plurality of subsystems, also can realize seamless, the suitable renewal of user history information.
In addition, in Figure 20, information transmits is undertaken by wireless mode.Particularly, by WLAN, come realization information to transmit as weak wireless, the bluetooth of wireless near field communication or infrared ray etc.And, in this case, can by detect wireless strengths judge robot 300 (control object equipment) can use case generation.Particularly, when portable electric appts 20 and robot 300 near the time, wireless strengths strengthens, and can be judged as thus and can use robot 300.On the other hand, when portable electric appts 20 separated with robot 300, wireless strengths weakened, and can be judged as thus and can not use robot 300.As long as adopt this method, requiredly in information can being transmitted wirelessly be used for the judgement of can use case and can not use case and process.
In Figure 21 A, the user moves to family in order to go home.In this case, shown in Figure 21 B, set the zone 1,2,3 centered by family.
Here, zone 1 is the zone outside the effective range of WLAN etc. (in order to be different from wireless near field communication, being called below remote-wireless communication), is the zone of portable electric appts 20 single movements.Zone 2 is interior zones of effective range of remote-wireless communication, is the zone of carrying out the transmission processing (information synchronization processing) of user history information.Zone 3 is the zones in the effective range of the wireless near field communication such as bluetooth, is the zone of robot 300 (broadly being called the home control object-based device) single movement.In addition, zone 2 is the zones outside the effective range of wireless near field communication.
For example, when the user from zone 1 when entering regional 2, robot 300 startings, the historical information storage part 362 from the historical information storage part 62 of mobile side to family's side transmits (loading) user history information.In addition, when the user entered regional 3 from zone 2, portable electric appts 20 stopped, and switches to the single movement of robot 300.
On the other hand, when the user from zone 3 when entering regional 2, portable electric appts 20 startings, the historical information storage part 62 from the historical information storage part 362 of family's side to mobile side transmits user history information.In addition, when the user entered regional 1 from zone 2, robot 300 stopped, and switches to the single movement of portable electric appts 20.
That is, in Figure 21 B, the judgement users such as event detection unit 350 with respect to the place of family's subsystem (the second subsystem) near state.Then, when near state from first near state (zone 1) become degree of closeness than first near state high second during near state (regional 2), information transport unit 370 is processed, and this processing is sent to the historical information storage part 362 of family's side for the user history information that will be stored in historical information storage part 62.Then, when the user near state from second near state (zone 2) become degree of closeness than second near state high the 3rd during near state (zone 3), control handling part 352 begins robots 300 control action (the second control object equipment), user's historical information.
Then, the user near state be second near state (zone 2) during, information transport unit 370 is carried out information synchronization and is processed, and will be stored in user history information and the information that is stored in user history information in the historical information storage part 362 and remains identical content in the historical information storage part 62 that is:.Namely, become second during near state (zone 2) near state from first near state (zone 1) as the user, transmit user history information from mobile side direction family side, when becoming second during near state (zone 2) from the 3rd near state (zone 3), be displaced sideways side from family and transmit user history information.In addition, when the user become first during near state (zone 1) near state from second near state (zone 2), stop the control action of user's historical information of robot 300.
In addition, these first, second, third for example can be judged by remote-wireless communication and wireless near field communication near state (zone 1,2,3).That is, when detecting user's (handheld electronic apparatus) by near radio and remote-wireless, can be judged as the user and be in zone 3 (the 3rd near states).In addition, when detecting the user when failing to detect the user by near radio but by remote-wireless, can be judged as the user and be in zone 2 (second near states).In addition, when all failing to detect the user by near radio and remote-wireless, can be judged as the user and be in zone 1 (first near state).Like this, by utilizing accepting state because of the different at least two kinds of radio communications of distance (for example effectively arriving at least two kinds of different radio communications of distance), can realize efficiently portable electric appts 20, robot 300 starting, stop to control and the transmission of user history information is processed.
Figure 22 is the detailed process flow diagram of processing example that the method for Figure 21 A, Figure 21 B is shown.At first, judge whether change (step S61) near state, in the situation that do not change, the time is carried out poll (polling) (step S62) according to the rules.On the other hand, in the situation that occured to change, judge whether the user enters into zone 2 (step S63), in the situation that enter into zone 2, judge whether it is to enter into zone 2 (step S64) from regional 1 side.
In the situation that be to enter into zone 2 from regional 1 side, robot side starting (each several part beyond the Department of Communication Force) (step S65).Then, carry out the synchronous exchange (handshake) (step S66) between the unit, transmit user history information (step S67) from mobile side direction robot side.
On the other hand, in the situation that be not from regional 1 side but enter into zone 2 from regional 3 sides, mobile side starting (step S68).Then, carry out the synchronous exchange (step S69) between the unit, be displaced sideways side from robot and transmit user history information (step S70).
Do not enter zone 2 in the situation that be judged as the user among the step S63, judge whether to enter into zone 1 (step S71).Then, in the situation that enter into zone 1, machine side (beyond the Department of Communication Force) stops (step S72).On the other hand, in the situation that the user do not enter the zone 1, be judged to be in the zone 3 in, mobile side (beyond the Department of Communication Force) stops (step S73).
In addition, although top present embodiment is had been described in detail, those skilled in the art can easily understand, can from novel point of the present invention and effect, not break away from the various deformation of essence.Therefore, these variation all within the scope of the present invention.For example, for in instructions and the accompanying drawing at least one times from the different terms (first of broad sense or synonym more, second, the 3rd subsystem, first, second, the 3rd sensor, first, second, the 3rd control object equipment, state parameter etc.) term (the mover system that puts down in writing together, family's subsystem, the car intra subsystem, the Wearable sensor, family's chamber sensor, the car inner sensor, mobile control object equipment, the home control object-based device, control object-based device in the car, spirit/condition parameter etc.), in the optional position of instructions or accompanying drawing, all it can be replaced to its different terms.In addition, the structure of control system, subsystem, robot, guider etc., action are not limited to the illustrated content of present embodiment, can implement various distortion.For example, can implement to omit the distortion of any one party in historical information renewal section and the control handling part.

Claims (22)

1. control system that is used for aggregation system, this aggregation system is formed by a plurality of set of subsystems that consist of by each regulation space, described subsystem comprises at least one sensor in the environmental sensor that is present in action sensor in this space, that measure user's action, the state sensor of measuring User Status and measures user environment, it is characterized in that, this control system comprises:
The information obtaining section, it obtains the sensor information from the sensor of the residing described subsystem of user;
The historical information storage part, it is stored about at least one user history information in user's action, state and the environment;
Historical information renewal section, it upgrades the user history information of storage according to the sensor information that obtains; And
Event detection unit, its judgement can use case generation, this can represent to use the user of the first subsystem newly to become the state that can use the second subsystem by use case,
Described can use case the time when having occured, described historical information renewal section is according to the sensor information from the second sensor, to further upgrading according to the user history information after upgrading from the sensor information of first sensor, wherein, described first sensor is the sensor of described the first subsystem, and described the second sensor is the sensor of described the second subsystem.
2. control system according to claim 1 is characterized in that,
This control system comprises the information transport unit, this information transport unit is carried out the transmission of user history information and is processed between as the first historical information storage part of the historical information storage part of described the first subsystem and the second historical information storage part as the historical information storage part of described the second subsystem.
3. control system according to claim 2 is characterized in that,
Described information transport unit is carried out information synchronization and is processed, and this information synchronization is processed the user history information that will be stored in described the first historical information storage part and the information that is stored in user history information in described the second historical information storage part and remains identical content.
4. control system according to claim 2 is characterized in that,
Described can use case the time when having occured, described historical information renewal section is to being sent to the user history information of described the second historical information storage part from described the first historical information storage part, carry out processing based on the renewal from the sensor information of described second sensor of described the second subsystem.
5. control system according to claim 2 is characterized in that,
This control system comprises the control handling part, and described can use case the time when having occured, this control handling part begins the control action of the second control object equipment, and described the second control object equipment is as the control object equipment of described the second subsystem,
The control action of described the second control object equipment that is begun by described control handling part is to use the control action that is stored in the user history information in described the second historical information storage part.
6. control system according to claim 5 is characterized in that,
Occur described can use case before, described information transport unit transmits user history information from described the first historical information storage part to described the second historical information storage part in advance,
Described can use case the time when having occured, described control handling part begin described the second control object equipment, use the control action that is sent in advance the user history information in described the second historical information storage part.
7. control system according to claim 1 is characterized in that,
As user during near the place of described the second subsystem, be arranged on described event detection unit in the home server of described the second subsystem be judged to be occured described can use case.
8. control system according to claim 1 is characterized in that,
Described event detection unit is by detecting the wireless strengths of communicating by letter of carrying out between described the first subsystem and described the second subsystem, judges described generation that can use case.
9. control system according to claim 1 is characterized in that,
When the equipment connection of described the first subsystem is to the breakout box that can use in described the second subsystem, described event detection unit be judged to be occured described can use case.
10. control system according to claim 1 is characterized in that,
This control system comprises the control handling part, and described can use case the time when having occured, this control handling part begins the control action of the second control object equipment, and described the second control object equipment is as the control object equipment of described the second subsystem;
The control action of described the second control object equipment that is begun by described control handling part is the control action of user's historical information.
11. control system that is used for aggregation system, this aggregation system is formed by a plurality of set of subsystems that consist of by each regulation space, described subsystem comprises at least one sensor in the environmental sensor that is present in action sensor in this space, that measure user's action, the state sensor of measuring User Status and measures user environment, it is characterized in that, this control system comprises:
The information obtaining section, it obtains the sensor information from the sensor of the residing described subsystem of user;
The historical information storage part, it is stored about at least one user history information in user's action, state and the environment;
Historical information renewal section, it upgrades the user history information of storage according to the sensor information that obtains;
The event detection unit, its judgement can use case generation, this can represent by use case: use the first subsystem, according to having carried out more New Consumers of user history information from the sensor information as the first sensor of the sensor of described the first subsystem, newly become the state that can use the second subsystem; And
The control handling part, described can use case the time when having occured, this control handling part begins the control action of the second control object equipment, and described the second control object equipment is as the control object equipment of described the second subsystem;
The control action of described the second control object equipment that is begun by described control handling part is the control action of user's historical information.
12. control system according to claim 11 is characterized in that,
Described can use case the time when having occured, described control handling part carries out following control: connect the power supply of described the second control object equipment or make described the second control object equipment return to normal operation mode from low-power consumption mode.
13. control system according to claim 11 is characterized in that,
When occured the user no longer can use described the second control object equipment can not use case the time, described control handling part carries out following control: close the power supply of described the second control object equipment or make described the second control object equipment transfer to low-power consumption mode from normal operation mode.
14. control system according to claim 11 is characterized in that,
Described control system comprises the information transport unit, this information transport unit is between as the first historical information storage part of the historical information storage part of described the first subsystem and the second historical information storage part as the historical information storage part of described the second subsystem, carrying out the transmission of user history information processes
Described event detection unit judge the user with respect to the place of the second subsystem near state,
When near state from first near state become degree of closeness than described first near state high second during near state, the user history information that described information transport unit will be stored in described the first historical information storage part is sent to described the second historical information storage part
When the user near state from described second near state become degree of closeness than described second near state high the 3rd during near state, described control handling part begins control action described the second control object equipment, user's historical information.
15. control system according to claim 14 is characterized in that,
The user near state be described second near state during, described information transport unit is carried out information synchronization and is processed, and this information synchronization is processed the user history information that will be stored in described the first historical information storage part and the information that is stored in user history information in described the second historical information storage part and remains identical content.
16. control system according to claim 14 is characterized in that,
When the user become described first during near state near state from described second near state, described control handling part stops control action described the second control object equipment, user's historical information.
17. control system according to claim 14 is characterized in that,
Described event detection unit utilizes accepting state to judge described first, second, third near state because of at least two kinds of different radio communications of distance.
18. control system that is used for aggregation system, this aggregation system is formed by a plurality of set of subsystems that consist of by each regulation space, described subsystem comprises at least one sensor in the environmental sensor that is present in action sensor in this space, that measure user's action, the state sensor of measuring User Status and measures user environment, this control system is characterised in that
Described aggregation system comprises mover system and family's subsystem,
Described control system comprises:
The information obtaining section, it obtains the sensor information from the sensor of the residing described subsystem of user;
The historical information storage part, it is stored about at least one user history information in user's action, state and the environment;
Historical information renewal section, it upgrades the user history information of storage according to the sensor information that obtains; And
Event detection unit, its judgement can use case generation, this can use case represents to use the user of described mover system newly to become the state that can use described family subsystem,
Described can use case the time when having occured, described historical information renewal section is according to the sensor information from the sensor of described family subsystem, to further upgrading according to the user history information after upgrading from the sensor information of the sensor of described mover system.
19. control system according to claim 18 is characterized in that,
Described event detection unit and described historical information renewal section are arranged in the home server as the home server of described family subsystem.
20. control system that is used for aggregation system, this aggregation system is formed by a plurality of set of subsystems that consist of by each regulation space, described subsystem comprises at least one sensor in the environmental sensor that is present in action sensor in this space, that measure user's action, the state sensor of measuring User Status and measures user environment, this control system is characterised in that
Described aggregation system comprises at least one party and the car intra subsystem in mover system and the family's subsystem,
Described control system comprises:
The information obtaining section, it obtains the sensor information from the sensor of the residing described subsystem of user;
The historical information storage part, it is stored about at least one user history information in user's action, state and the environment;
Historical information renewal section, it upgrades the user history information of storage according to the sensor information that obtains; And
Event detection unit, its judgement can use case generation, this can represent to use the user of described mover system or described family subsystem newly to become the state that can use described car intra subsystem by use case,
Described can use case the time when having occured, described historical information renewal section is according to the sensor information from the sensor of described car intra subsystem, to further upgrading according to the user history information after upgrading from the sensor information of the sensor of described mover system or described family subsystem.
21. control system according to claim 20 is characterized in that,
This control system comprises the control handling part, and described can use case the time when having occured, this control handling part begins control action control object equipment, user's historical information of described car intra subsystem.
22. control system according to claim 21 is characterized in that,
Described historical information renewal section upgrades user history information according to the operation information of described control object equipment or from the sensor information of the sensor of described car intra subsystem.
CN200880020404XA 2007-06-15 2008-06-13 Control system Expired - Fee Related CN101681460B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2007159253A JP2008310680A (en) 2007-06-15 2007-06-15 Control system, program, and information storage medium
JP159253/2007 2007-06-15
PCT/JP2008/060860 WO2008153132A1 (en) 2007-06-15 2008-06-13 Control system, program, and information storage medium

Publications (2)

Publication Number Publication Date
CN101681460A CN101681460A (en) 2010-03-24
CN101681460B true CN101681460B (en) 2013-03-06

Family

ID=40129735

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200880020404XA Expired - Fee Related CN101681460B (en) 2007-06-15 2008-06-13 Control system

Country Status (3)

Country Link
JP (1) JP2008310680A (en)
CN (1) CN101681460B (en)
WO (1) WO2008153132A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012079271A (en) * 2010-10-06 2012-04-19 Nec Commun Syst Ltd Environmental load display device, calculation method for the same, and program
EP2769275B1 (en) 2011-10-21 2021-05-12 Google LLC User-friendly, network connected learning programmable device and related method
US8622314B2 (en) 2011-10-21 2014-01-07 Nest Labs, Inc. Smart-home device that self-qualifies for away-state functionality
CN102523401B (en) * 2011-12-29 2015-09-30 深圳Tcl新技术有限公司 Smart Home TV set control system and method
JP5905760B2 (en) * 2012-03-28 2016-04-20 京セラ株式会社 Control device, control system, and control method
JP6158306B2 (en) * 2013-03-25 2017-07-05 株式会社東芝 Wearable device and remote control method
JP6207417B2 (en) * 2014-02-05 2017-10-04 三菱電機株式会社 Power control system
CN104036560B (en) * 2014-06-18 2017-08-25 长城汽车股份有限公司 Environmental recorder, onboard system and environment inside car playback system
JP6170881B2 (en) * 2014-06-19 2017-07-26 日本電信電話株式会社 Communication amount measuring apparatus, method and program
KR101570430B1 (en) * 2014-08-11 2015-11-20 엘지전자 주식회사 Wearble device and operation method thereof
CN108375168B (en) * 2014-09-26 2020-11-17 海信集团有限公司 Method for adjusting air conditioning equipment
JP6767808B2 (en) * 2016-08-25 2020-10-14 日本テレビ放送網株式会社 Viewing user log storage system, viewing user log storage server, and viewing user log storage method
JP6519560B2 (en) * 2016-09-23 2019-05-29 カシオ計算機株式会社 Robot, method of operating robot and program
CN106503185A (en) * 2016-10-31 2017-03-15 广东美的制冷设备有限公司 Stress-relieving activity based on air-conditioner recommends method and system
CN106597946B (en) * 2016-12-23 2018-11-30 上海正苒智能科技有限公司 A kind of indoor occupant method for monitoring state and system
JP2022097829A (en) * 2020-12-21 2022-07-01 パナソニックＩｐマネジメント株式会社 Seat occupancy information management system and seat occupancy information management method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030098789A1 (en) * 2001-11-28 2003-05-29 Takashi Murakami Home security system
CN1598888A (en) * 2003-08-20 2005-03-23 索尼株式会社 Monitoring system,method and equipment for processing information and storage media and program

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4367736B2 (en) * 2000-01-07 2009-11-18 クラリオン株式会社 Hands-free in-vehicle telephone device, control method therefor, and mobile communication system
JP2003111157A (en) * 2001-09-28 2003-04-11 Toshiba Corp Integrated controller, apparatus controlling method, and apparatus controlling program
JP4122779B2 (en) * 2002-01-23 2008-07-23 三菱電機株式会社 Home appliance control system, home appliance control device, and home appliance
DE10322458A1 (en) * 2003-05-16 2004-12-02 Daimlerchrysler Ag Method and device for influencing the stress of a driver in a motor vehicle
JP2005084828A (en) * 2003-09-05 2005-03-31 Ntt Docomo Inc User support system and method, and user support control system
JP2005303692A (en) * 2004-04-13 2005-10-27 Hitachi Ltd Schedule management system
JP4838499B2 (en) * 2004-05-21 2011-12-14 オリンパス株式会社 User support device
JP4768242B2 (en) * 2004-07-29 2011-09-07 日本電気株式会社 Power saving device, portable terminal, and power saving method
US20070233285A1 (en) * 2004-09-14 2007-10-04 Kakuya Yamamoto Apparatus Control System and Apparatus Control Method
WO2006075513A1 (en) * 2005-01-13 2006-07-20 Matsushita Electric Industrial Co., Ltd. Device operation control device and method thereof
JP4759304B2 (en) * 2005-04-07 2011-08-31 オリンパス株式会社 Information display system
JP5020494B2 (en) * 2005-10-12 2012-09-05 キヤノン株式会社 Wireless communication apparatus and control method thereof
JP4902174B2 (en) * 2005-11-04 2012-03-21 日本電信電話株式会社 Ubiquitous service system and ubiquitous service providing method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030098789A1 (en) * 2001-11-28 2003-05-29 Takashi Murakami Home security system
CN1598888A (en) * 2003-08-20 2005-03-23 索尼株式会社 Monitoring system,method and equipment for processing information and storage media and program

Also Published As

Publication number Publication date
CN101681460A (en) 2010-03-24
JP2008310680A (en) 2008-12-25
WO2008153132A1 (en) 2008-12-18

Similar Documents

Publication Publication Date Title
CN101681460B (en) Control system
CN101681494B (en) Mobile electronic device
CN106599722B (en) Intelligent terminal and its application program authority control method, device and server
CN105723310B (en) Method and apparatus for user interactive data storage
CN105187484B (en) The method of mobile terminal and control mobile terminal
CN101795831A (en) Robot control system, robot, program, and information recording medium
CN105683904B (en) Method and apparatus for keyword figure selecting
CN103212197B (en) There is the wearable device assembly of motor function
CN105015551A (en) Driver state monitoring system, method for control the same, and vehicle
EP3507729A1 (en) Providing insights based on health-related information
CN108604432A (en) Electronic equipment and method for controlling it
KR100979516B1 (en) Service recommendation method for network-based robot, and service recommendation apparatus
CN105935289A (en) Wearable electronic device and method for controlling the same
CN106231997A (en) Intelligent watch
US20110118870A1 (en) Robot control system, robot, program, and information storage medium
CN105849675A (en) Displaying relevant use interface objects
CN106133646A (en) User's response to notice is determined based on physiological parameter
JP2009176130A (en) Information-presenting system, program, and information storage medium
CN105723311A (en) Method and apparatus for action indication selection
CN107196363A (en) Adjust method, terminal and the computer-readable recording medium of charging current
CN107408150A (en) Dynamic rule-based notice
CN107111335A (en) For the operation that controls electronic installation method and use its electronic installation
WO2021054461A1 (en) Game program, method, and information processing device
CN108073437A (en) Method and mobile terminal are recommended in a kind of application
CN109032468A (en) A kind of method and terminal of adjustment equipment parameter

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130306

Termination date: 20210613