JP5265141B2 - Portable electronic device, program and information storage medium - Google Patents

Abstract

A mobile electronic device (20) includes: an information acquisition unit (30) acquires sensor information from at least one of the sensors of subsystems, i.e., a behavior sensor which measures a user behavior, a state sensor which measures a user state, and an environment sensor which measures a user environment; a history information storage unit (48) which stores user history information on at least one of the user behavior, the user state, and the user environment which information is updated according to the sensor information; and a control object device selection unit (44) which selects a control object device to be controlled by using the user history information from the control object devices of the subsystems.

Description

  The present invention relates to a portable electronic device, a program, and an information storage medium.

  As a conventional information providing system, for example, Patent Document 1 discloses a system that can flexibly guide not only information on points and facilities, but also a route or a halfway point to a place that the user wants to guide. ing.

  However, the system disclosed in Patent Document 1 has a problem that it is impossible to provide information as so-called push information, in which information required by the user is provided without the user performing an intentional acquisition act.

  As a solution to such a problem, an information providing system disclosed in Patent Document 2 is known. In this system, it is possible to provide information as push information by identifying a user's activity state by a wearable sensor and displaying information according to the activity state.

However, this Patent Document 2 discloses an information providing system effective in a mobile environment, but does not disclose a portable electronic device suitable for an integrated system of a plurality of subsystems.
Japanese Patent Laid-Open No. 2000-215211 JP 2006-293535 A

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a portable electronic device, a program, and an information storage medium suitable for an integrated system of a plurality of subsystems. is there.

  The present invention is a portable electronic device used in an integrated system of a plurality of subsystems and possessed by a user, and a behavior sensor for measuring a user's behavior among a plurality of sensors of the plurality of subsystems, a user Information acquisition means for acquiring sensor information from at least one of a state sensor for measuring the state of the user and an environment sensor for measuring the user's environment, and history information on at least one of the user's behavior, state and environment. A history information storage means for storing user history information updated based on the sensor information acquired in this manner, and a control target device to be controlled using the user history information, a plurality of control target devices of the plurality of subsystems It is related with the portable electronic device containing the control object apparatus selection means to select from among. The present invention also relates to a program that causes a computer to function as each of the above-described means, or a computer-readable information storage medium that stores the program.

  According to the present invention, sensor information is acquired from at least one of a behavior sensor, a state sensor, and an environment sensor among a plurality of sensors of a plurality of subsystems. Then, the user history information updated based on the acquired sensor information is stored in the history information storage means. Then, a control target device to be controlled using the user history information is selected from a plurality of control target devices of a plurality of subsystems, and the control is performed. In this way, for example, it becomes possible to control devices to be controlled in the second subsystem based on the user history information updated in the first subsystem, so that an integrated system of a plurality of subsystems can be realized. A suitable portable electronic device can be provided.

  Further, the present invention includes a sensor selection unit that selects a sensor that can be used in a subsystem being used by a user from a plurality of sensors of the plurality of subsystems, and the information acquisition unit includes the sensor selection unit. Sensor information from the selected sensor may be acquired. In this way, for example, the user history information updated based on the sensor information from the sensor of the first subsystem can be seamlessly updated based on the sensor information from the sensor of the second subsystem.

  Further, in the present invention, the sensor selection means is configured so that the user can select from a plurality of sensors of the plurality of subsystems based on TPO information that is at least one of time information, user location information, and user status information. Sensors that can be used in the sub-system being used may be selected. In this way, sensor information can be acquired by selecting different sensors according to the location, time or situation.

  According to the present invention, the control target device selection means includes a plurality of control target devices of the plurality of subsystems based on TPO information that is at least one of time information, user location information, and user status information. Therefore, a control target device that can be used in the subsystem being used by the user may be selected. In this way, it becomes possible to select and control different devices to be controlled depending on the place, time or situation.

  Moreover, in this invention, you may include the log | history information update means to update user log | history information based on the acquired sensor information.

  In the present invention, when there is no control target device that can be used, the control of the control target device using the user history information is not performed, and only the user history information is updated by the history information update unit. Good. In the present invention, when there is no sensor that can be used, only the control of the control target device using the user history information may be performed without updating the user history information by the history information updating unit. In this way, even when one of the sensor and the control target device is unavailable, the user history information can be updated and the control target device can be controlled without waste.

  The present invention further includes an external control unit capable of controlling an external control target of the portable electronic device, and the external control unit is selected when the control target device is selected by the control target device selection unit. The control target of the control target device may be controlled using the user history information. In this way, the control target of the control target device can be directly controlled by the external control means.

  In the present invention, a user whose user history information is updated by sensor information from the sensor of the first subsystem can use the second control target device that is the control target device of the second subsystem. Event determining means for determining occurrence of an available event indicating that the control target device has been selected, and the control target device selecting means may select the second control target device when the available event occurs. Good. In this way, it is possible to control the second device to be controlled that is available in the second subsystem using the user history information updated in the first subsystem.

  The present invention may further include history information updating means for updating user history information based on sensor information from sensors of the second subsystem when the available event occurs. In this way, seamless update of user history information can be realized.

  According to the present invention, there is provided control processing means for starting a control operation of the second control target device using user history information when the available event occurs and the second control target device is selected. May be included.

  In the present invention, the control processing means turns on the power of the second control target device when the available event occurs, or sets the second control target device from the low power consumption mode to the normal power consumption mode. Control to return to the operation mode may be performed. In this way, the power of the second control target device can be turned off or set to the low power consumption mode until an available event occurs, so that power consumption can be reduced.

  Further, in the present invention, the control processing means controls to turn off the power of the portable electronic device or shift the portable electronic device from the normal operation mode to the low power consumption mode when the available event occurs. May be performed. In this way, the power consumption of the portable electronic device can be turned off or set to the low power consumption mode after an available event occurs, so that the power consumption can be reduced.

  The present invention further includes information transfer means for transferring information to and from the second subsystem, wherein the control processing means turns off the information transfer means when the available event occurs. It is also possible to perform control for setting to the normal operation mode. In this way, even if the power of the portable electronic device is turned off or set to the low power consumption mode, the information transfer means is not turned off or is set to the normal operation mode. Information transfer between the portable electronic device and the second subsystem can be continued.

  In the present invention, the control processing unit turns off the power of the second control target device when an unusable event occurs in which the user cannot use the second control target device. Control for shifting the second control target device from the normal operation mode to the low power consumption mode may be performed. In this way, after the unusable event occurs, the power of the second device to be controlled can be turned off or set to the low power consumption mode, so that the power consumption can be reduced.

  According to the present invention, when the portable electronic device is attached to the device to be controlled of the second subsystem, the history information storage means performs the second control of the portable electronic device and the second subsystem. The user history information of the history information storage means shared and shared with the target device may be updated based on sensor information from the sensor of the second subsystem. In this way, since it is not necessary to provide the history information storage means in the second controlled device, the cost of the second controlled device can be reduced.

  According to the present invention, there is provided information transfer means for transferring user history information stored in the history information storage means to the second history information storage means of the second subsystem when the available event occurs. May be included. In this way, when an available event occurs, the second controlled device of the second subsystem is controlled based on the user history information transferred to the second history information storage means. Is possible.

  According to the present invention, the information transfer means has the same contents as the user history information stored in the history information storage means and the user history information stored in the second history information storage means of the second subsystem. Information synchronization processing for maintaining the information may be performed. In this way, the user history information can be updated seamlessly.

  Further, the present invention includes information transfer means for wirelessly transferring information to and from the second subsystem, and the event determination means detects the occurrence of the available event by detecting the wireless strength. You may judge. In this way, the radio necessary for information transfer can also be used for the determination process of available events.

  In the present invention, the event determining means may determine that the available event has occurred when a portable electronic device is connected to a cradle that can be used in the second subsystem.

  In the present invention, the information transfer means for transferring the user history information stored in the history information storage means to the second history information storage means of the second subsystem, and the second using the user history information. Control processing means for starting the control operation of the control target device, wherein the event determining means determines the approaching state of the user to the location of the second subsystem, and the information transfer means is the approaching state, The user history information stored in the history information storage unit is stored in the history information storage means when the first approach state is changed to a second approach state having a higher degree of approach than the first approach state. The control information is transferred from the second approach state to the third approach state having a higher degree of approach than the second approach state. Become When, it may initiate the control operation of the second control target device using the user history information. In this way, when the first approach state is changed to the second approach state, the user history information is transferred to the second subsystem side, and the second approach state is changed to the third approach state. In this case, the control operation of the second device to be controlled can be started, and the information transfer and the start of the control operation can be executed seamlessly.

  Further, in the present invention, the information transfer means includes user history information stored in the history information storage means and the second subsystem of the second subsystem during a period in which the user approach state is the second approach state. Information synchronization processing may be performed in which the user history information stored in the two history information storage means is maintained as information having the same content.

  In the present invention, the control processing unit may be configured to control the second control target device using user history information when the user approach state changes from the second approach state to the first approach state. The control operation may be stopped. In this way, when the user leaves, the operation of the second control target device can be stopped, and power consumption can be reduced.

  In the present invention, the event determination unit may determine the first, second, and third approach states by using at least two types of wireless communication that have different reception states depending on distances. In this way, the transfer process of user history information and the start process of the control operation of the second device to be controlled are efficiently realized using at least two types of wireless communication having different reception states according to the distance. it can.

  The present invention is a portable electronic device used in an integrated system of a plurality of subsystems and possessed by a user, and a sensor that selects an available sensor from a plurality of sensors of the plurality of subsystems. Based on the sensor information acquired by the selection means, the information acquisition means for acquiring sensor information from the sensor selected by the sensor selection means, and the history information on at least one of the user's behavior, state and environment History information storage means for storing user history information to be updated, wherein the sensor selection means is based on TPO information that is at least one of time information, user location information, and user status information. A portable electronic device that selects a sensor that can be used in a subsystem being used by a user from among a plurality of sensors in the subsystem Related to. The present invention also relates to a program that causes a computer to function as each of the above-described means, or a computer-readable information storage medium that stores the program.

  According to the present invention, a sensor that can be used in a subsystem being used by a user is selected from a plurality of sensors in a plurality of subsystems based on TPO information. Then, the user history information updated based on the sensor information from the selected sensor is stored in the history information storage unit. Therefore, for example, the user history information updated based on the sensor information from the sensor of the first subsystem can be seamlessly updated based on the sensor information from the sensor of the second subsystem, which is suitable for the integrated system. A portable electronic device can be provided.

  Further, in the present invention, an available event indicating that a user whose user history information has been updated with sensor information from the sensor of the first subsystem has become ready to use the sensor of the second subsystem. Event determination means for determining occurrence, and the sensor selection means may select the sensor of the second subsystem as a sensor for updating user history information when the available event occurs. Good.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Integrated System The integrated system of this embodiment is demonstrated using FIG. As shown in FIG. 1, the integrated system includes a plurality of subsystems such as a mobile subsystem, a home subsystem, or an in-vehicle subsystem. In addition, the subsystem of this embodiment is not limited to these, For example, various subsystems which have a sensor and a control object apparatus, such as a subsystem in a company, a subsystem in a shop, and a subsystem of vehicles (trains, airplanes) other than a car Can think.

  As shown in FIG. 1, a user (user) has a portable electronic device 20 (mobile gateway). Further, a wearable display 93 (mobile display) is mounted as a mobile control target device in the vicinity of one eye of the head. Furthermore, various sensors are worn on the body as wearable sensors (mobile sensors). Specifically, indoor / outdoor sensor 510, ambient temperature sensor 511, ambient humidity sensor 512, ambient light intensity sensor 513, arm-mounted motion measurement sensor 520, pulse (heart rate) sensor 521, body temperature sensor 522, peripheral skin temperature sensor 523, sweat sensor 524, foot pressure sensor 530, speech / mastication sensor 540, GPS (Global Position System) sensor 550 provided in portable electronic device 20, facial color sensor 560 provided in wearable display 500, pupil size sensor 561 Etc. are attached. The mobile electronic device 20, the mobile control target device, and the wearable sensor constitute a mobile subsystem (first subsystem in a broad sense).

  The portable electronic device 20 (mobile computer) is a portable information terminal such as a PDA (Personal Digital Assistant), a notebook PC, and the like, for example, a processor (CPU), a memory, an operation panel, a communication device, or a display (sub-display). Is provided. The portable electronic device 20 has, for example, a function of collecting sensor information from sensors, a function of performing calculation processing based on the collected sensor information, and control (display control) of a control target device (such as a wearable display) based on the calculation result. Etc.), a function of retrieving information from an external database, a function of communicating with the outside, and the like. Note that the portable electronic device 20 may be a device that is also used as a mobile phone, a wristwatch, or a portable audio device.

  The wearable display 93 is mounted in the vicinity of one of the user's eyes, and the size of the display unit is set to be smaller than the size of the pupil, and functions as an information display unit of a so-called see-through viewer. Information presentation to the user may be performed using headphones, a vibrator, or the like. In addition to the wearable display 93, various devices such as a wristwatch, a mobile phone, or a portable audio can be assumed as the mobile control target device.

  The indoor / outdoor sensor 510 is a sensor that detects whether the user is indoors or outdoors. For example, the user irradiates ultrasonic waves and measures the time until the ultrasonic waves are reflected back from the ceiling or the like. However, the indoor / outdoor sensor 510 is not limited to the ultrasonic method, and may be an active light method, passive ultraviolet method, passive infrared method, or passive noise method sensor.

  The ambient temperature sensor 511 measures the ambient temperature using, for example, a thermistor, a radiation thermometer, a thermocouple, or the like. The ambient humidity sensor 512 measures the ambient humidity using, for example, the change in electrical resistance due to humidity. The ambient light intensity sensor 513 measures the ambient light intensity using, for example, a photoelectric element.

  The arm-mounted motion measurement sensor 520 measures the movement of the user's arm with an acceleration sensor or an angular acceleration sensor. By using the motion measurement sensor 520 and the foot pressure sensor 530, it is possible to more accurately measure the user's daily motion and walking state. A pulse (heart rate) sensor 521 is attached to a finger or an ear, and measures changes in blood flow due to pulsation by changes in infrared light transmittance and reflectance. The body temperature sensor 522 and the peripheral skin temperature sensor 523 measure the user's body temperature and peripheral skin temperature using a thermistor, a radiation thermometer, a thermocouple, and the like. The perspiration sensor 524 measures the perspiration of the skin based on, for example, a change in the surface resistance of the skin. The foot pressure sensor 530 detects the pressure distribution of the sole on the shoe, and measures and determines the user's standing state, sitting state, walking state, and the like.

  The utterance / mastication sensor 540 is an earphone-type sensor for measuring the possibility that the user is speaking (conversation) or mastication (meal), and a bone conduction microphone is included in the body. Built-in external sound microphone. The bone conduction microphone detects a body sound which is a vibration generated from the body during speech and mastication and propagating through the body. The external sound microphone detects sound that is vibration that is conducted outside the body in response to an utterance and external sound including environmental noise. Then, by comparing the power of the sound captured by the bone conduction microphone and the external sound microphone in unit time, etc., the utterance possibility and mastication possibility are measured.

  The GPS sensor 550 is a sensor that detects the position of the user. A location information service of a mobile phone may be used instead of the GPS sensor 550. The face color sensor 560, for example, arranges an optical sensor near the face, and measures the face color by comparing the light intensity after passing through a plurality of optical bandpass filters. The pupil size sensor 561, for example, places a camera near the pupil and analyzes the camera signal to measure the size of the pupil.

  The home subsystem is a home control target device, for example, a home display such as a TV monitor or a PC monitor, a home AV device such as an audio device or an optical disk player, a robot such as a dog, cat, or humanoid, or a room temperature. It has an air conditioner that adjusts the lighting and lighting that adjusts the brightness. In addition to this, as home control target devices, various devices such as home appliances such as game machines, vacuum cleaners, rice cookers, refrigerators, microwave ovens, and security devices can be assumed.

  In addition, the home subsystem is a home sensor, for example, an environmental sensor that measures the temperature, humidity, light intensity, noise, user conversation, meal, etc. in the home, a robot-mounted sensor built into the robot, And a human detection sensor installed in a door, a urine test sensor installed in a toilet, and the like. In addition to this, various sensors such as a security sensor (a security sensor, a heat / smoke / gas sensor, etc.), an earthquake sensor, a power consumption measuring sensor, a pollen sensor can be assumed as the home sensor. These home control target devices and home sensors constitute a home subsystem (second subsystem in a broad sense).

  The in-vehicle subsystem includes car navigation systems (navigation devices) that provide road guidance, car AV equipment such as audio equipment and optical disk players, and air conditioners that adjust the temperature inside the car as in-vehicle control target equipment. Other in-vehicle control devices include safety devices such as airbags, seat adjustment devices, car door locking / unlocking devices using smart entry systems, communication devices, in-vehicle devices, etc. Various devices such as a computer can be assumed.

  The in-vehicle subsystem is also used as an in-vehicle sensor such as a driving state sensor that measures the speed of a vehicle, a moving distance, an operation state sensor that measures a user's driving operation and device operation, an in-vehicle temperature, humidity, luminous intensity, It has an environmental sensor that measures conversation and the like. In addition to this, various sensors such as a crime prevention sensor, a human detection sensor, and a pollen sensor can be assumed as the in-vehicle sensor. An in-vehicle subsystem (third subsystem in a broad sense) is configured by these in-vehicle control target devices and in-vehicle sensors.

  In the integrated system of FIG. 1, when the user is outdoors (in a mobile environment), sensor information (including sensor secondary information) is acquired (collected) from the wearable sensor (mobile sensor) of the mobile subsystem. The user history information is updated based on the acquired sensor information. The mobile control target device is controlled based on user history information and the like. The user history information is history information (log information) about at least one of the user's behavior, state, and environment.

  On the other hand, when the user is at home (in a home environment), sensor information from the home sensor of the home subsystem is acquired, and the user history information is updated based on the acquired sensor information. That is, the user history information updated in the mobile environment is seamlessly updated even when the user environment information is shifted to the home environment. The home control target device is controlled based on the user history information and the like.

  Further, when the user is in the vehicle (in the case of an in-vehicle environment), sensor information from the in-vehicle sensor of the in-vehicle subsystem is acquired, and the user history information is updated based on the acquired sensor information. That is, the user history information updated in the mobile environment or the home environment is seamlessly updated even when the user history information is transferred to the in-vehicle environment. Further, the in-vehicle control target device is controlled based on the user history information and the like.

  For example, when a user arrives at home or moves into a vehicle, the user is likely to remove a wearable sensor (such as an indoor / outdoor sensor) or a mobile control target device (such as a wearable display). Even in such a case, according to the integrated system of FIG. 1, sensor information can be acquired using a home sensor or an in-vehicle sensor instead of a wearable sensor, so that seamless user history information can be updated. For example, for meals when going out and meals at home, it is possible to keep a history of meal times, meal times, etc., and cumulative calculation of energy consumption and stress based on internal and external behavioral status and heart rate status Processing is also possible.

  In addition, instead of the mobile control target device, the home control target device and the in-vehicle control target device can be controlled, and the convenience for the user can be improved. For example, information based on user history information, etc. is displayed on a home display or car navigation display with a large display area, not a wearable display with a small display area, or control target devices (for example, air conditioners, lighting, car navigation systems, etc.) that could not be controlled in a mobile environment Etc.) can be controlled, and convenience can be improved.

2. Portable Electronic Device FIG. 2 shows a configuration example of the portable electronic device 20 of the present embodiment suitable for the integrated system of FIG. Note that the portable electronic device 20 is not limited to the configuration shown in FIG. 2, and some of the components (for example, an information acquisition unit, an information transfer unit, an operation unit, a display control unit, and an information storage medium) are omitted. Various modifications such as adding other components are possible.

  The information acquisition unit 30 acquires sensor information from a plurality of sensors in a plurality of subsystems. For example, the wearable sensor 12 (first sensor in a broad sense) of a mobile subsystem, the home sensor 14 (second sensor in a broad sense) of the home subsystem, and the in-vehicle sensor 16 (third sensor in a broad sense) of the in-vehicle subsystem. ) To obtain sensor information. Specifically, a behavior sensor that measures a user's behavior (walking, conversation, meal, movement of limbs, emotional expression, sleep, etc.) and a user's state (fatigue, tension, hunger, mental state, physical state, or user) Sensor information is acquired from a state sensor that measures an event that has occurred) or an environment sensor that measures a user's environment (location, brightness, temperature, humidity, etc.).

  The sensor may be the sensor device itself, or may be a sensor device including a control unit, a communication unit, and the like in addition to the sensor device. The sensor information may be sensor primary information obtained directly from the sensor, or sensor secondary information obtained by processing (information processing) the sensor primary information.

  The information acquisition unit 30 can be realized by, for example, the communication unit 32 or the sensor I / F (interface) unit 34. For example, when acquiring (receiving) sensor information from a sensor by short-range wireless or wireless LAN such as infrared rays or Bluetooth (Bluetooth is a registered trademark), the communication unit 32 is used. On the other hand, when acquiring sensor information from a sensor using a wired electrical signal such as USB, IEEE 1394, or card I / F, the sensor I / F unit 34 is used.

  The processing unit 40 performs various processes necessary for the operation of the portable electronic device 20 based on operation information from the operation unit 80, sensor information acquired by the information acquisition unit 30, and the like. The function of the processing unit 40 can be realized by hardware such as various processors (CPU and the like), ASIC (gate array and the like), a program stored in the information storage medium 84, and the like.

  The processing unit 40 can include a sensor selection unit 42, a control target device selection unit 44, a calculation unit 46, a history information update unit 48, an event determination unit 50, and a control processing unit 52. Note that some of these components may be omitted, or other components may be added.

  The sensor selection unit 42 performs sensor selection processing. Specifically, a sensor that can be used (accessed and information can be acquired) in a subsystem that is being used by the user (subsystem in which the user is located) is selected from a plurality of sensors in a plurality of subsystems. For example, when the user moves to the home subsystem (second subsystem), the home sensor 14 (second sensor, second sensor group) that can be used in the home subsystem is selected. When the user moves to the location of the in-vehicle subsystem (third subsystem), the in-vehicle sensor 16 (third sensor, third sensor group) that can be used in the in-vehicle subsystem is selected.

  More specifically, the sensor selection unit 42 includes time information (year, month, week, day, time, etc.), user location information (position, affiliation area, distance, etc.) and user status information (mental / physical state, Based on TPO (Time Place Occasion) information that is at least one of events generated for the user, an available sensor is selected from a plurality of sensors. That is, even in the same subsystem, different sensors are selected according to the TPO information.

  The TPO information may be acquired based on sensor information from the sensor, or may be acquired based on schedule data (schedule information), download data from the Internet, or the like. The sensor selection may be direct (active) or indirect (passive). For example, instead of directly selecting the sensor itself, the sensor may be selected indirectly by selecting obtained sensor information. For example, when sensor information is communicated wirelessly, available sensor information may be selected based on tag information added to each sensor information, thereby indirectly selecting a sensor.

  For example, indoor navigation uses inertial navigation using an acceleration sensor instead of a GPS sensor for position detection. Therefore, when it is detected based on sensor information that the user has entered the room (for example, position information from the GPS sensor cannot be obtained correctly, or information indicating that the user is indoors has been obtained by the indoor / outdoor sensor) Time), the sensor information from the acceleration sensor is selected and the position is calculated without selecting the sensor information from the GPS sensor. At this time, by stopping the GPS sensor, it is possible to save power, reduce wireless traffic, and reduce the load of sensor information processing.

  The control target device selection unit 44 performs control target device selection processing. Specifically, a control target device to be controlled using user history information is selected from a plurality of control target devices of a plurality of subsystems. In other words, a control target device that can be used (accessed and controlled) in a subsystem that is being used by the user (subsystem where the user is located) among a plurality of control target devices of a plurality of subsystems. Select. For example, when the user moves to the home subsystem (second subsystem), the home control target device 94 (second control target device in a broad sense) that can be used in the home subsystem is selected. When the user moves to the location of the in-vehicle subsystem (third subsystem), the in-vehicle control target device 96 (third control target device in a broad sense) that can be used in the in-vehicle subsystem is selected.

  More specifically, the control target device selection unit 44 selects an available control target device from a plurality of control target devices based on the TPO information. That is, even in the same subsystem, different control target devices are selected according to the TPO information.

  The selection of the control target device may be direct (active) or indirect (passive). For example, instead of directly selecting the control target device itself, the control target device may be selected indirectly by outputting information (data, signal) necessary for the control target device.

  For example, during bathing, lighting / AV equipment control and air conditioning control in the living room are not necessary, and control of hot water temperature and bus TV (TV) is effective for the user. To do. In this case, it is possible to distribute video to the bus TV from the home server, or it is also possible to transmit only channel information that broadcasts a favorite program.

The calculation unit 46 performs various calculation processes for filtering processing (selection processing) and analysis processing of the sensor information acquired by the information acquisition unit 30. Specifically, the calculation unit 46 performs a multiplication process or an addition process of sensor information. For example, as shown in the following formula (1), digitized measurement values X _j of a plurality of sensor information from a plurality of sensors and respective coefficients are stored in a coefficient storage unit (not shown), and a two-dimensional matrix ( A product-sum operation with a coefficient A _ij represented by a matrix) is performed. Then, as shown in the following equation (2), the result of the product-sum operation is calculated as an n-dimensional vector Y _i using multidimensional coordinates. Note that i is the i coordinate in the n-dimensional space, and j is a number assigned to each sensor.

  Filtering processing that removes unnecessary sensor information from the acquired sensor information, and user behavior, state, and environment (TPO information) by performing arithmetic processing such as the above formulas (1) and (2) Analysis processing for identifying based on information can be realized. For example, if the coefficient A multiplied by the measured value X of the pulse (heart rate), the amount of sweat, and the body temperature is set to a value larger than the coefficient for the measured value of other sensor information, the above formulas (1) and (2 The numerical value Y calculated in () represents the “excitability” that is the user's state. In addition, by setting the coefficient multiplied by the measured value X of the utterance amount and the coefficient multiplied by the measured value X of the foot pressure to appropriate values, the user's behavior can sit and talk. You can identify whether you are talking, walking, talking quietly, or sleeping.

  The history information update unit 48 performs history information update processing. Specifically, the user history information is updated based on the sensor information acquired by the information acquisition unit 30. For example, when the user transitions to the second subsystem, the user history information updated in the first subsystem is updated based on the sensor information from the second sensor in the second subsystem. The updated user history information is stored in the history information storage unit 62. In this case, in order to save the memory capacity of the history information storage unit 62, when storing new history information, the old history information is deleted, and the new history information is stored in the storage area freed by the deletion. May be. Or when giving priority (weighting coefficient) to each history information and memorizing new history information, history information with low priority may be deleted. In this case, the priority setting for each piece of history information may be determined based on whether or not the device to be controlled is controlled based on the history information. That is, a high priority is set for the history information used for controlling the control target device. In this way, it is possible to leave only history information effective for controlling the control target device in the history information storage unit 62 while saving memory capacity. Of course, history information may be updated (overwritten) by calculating already stored history information and new history information.

  The event determination unit 50 performs various event determination processes. Specifically, it is determined whether a user who has used the first subsystem has an available event indicating that the user can newly use the second subsystem. For example, a user whose user history information is updated by sensor information from a sensor of a first subsystem (for example, a mobile subsystem) may use a second control target device of a second subsystem (for example, a home subsystem). The occurrence of an available event (accessible event, controllable event) indicating that a possible state has been reached is determined. Alternatively, the occurrence of an unusable event that makes the second control target device unusable is determined. For example, when information transfer between the portable electronic device 20 and the device to be controlled is performed wirelessly, occurrence of an available event can be determined by detecting wireless strength. Alternatively, even when it is determined that an available event has occurred when the portable electronic device 20 is connected to a cradle that can be used in the second subsystem (a cradle installed at the location of the second subsystem). Good.

  And the control object apparatus selection part 44 selects a 2nd control object apparatus, when an available event generate | occur | produces. Further, when an available event occurs, the history information update unit 48 acquires sensor information from the sensors of the second subsystem, and updates the user history information based on the acquired sensor information.

  Even when an available event occurs, if it is not necessary to select a control target device, the control target device may not be selected. That is, not only whether or not it is available but also whether or not selection is necessary is determined. The event determination unit 50 can also determine the occurrence of a sensor available event. In this case, the available event of the control target device and the available event of the sensor may be the same event or different events.

  The control processing unit 52 performs various processes for controlling the control target device. For example, when an available event occurs and the second control target device is selected, the control operation of the second control target device using the user history information is started. For example, control of the control target by the control unit of the second control target device is started. Alternatively, when an available event occurs, control (instruction) to turn on the power of the second device to be controlled (return to the normal operation mode) or turn off the power of the portable electronic device 20 (low power consumption mode) Control to shift). Alternatively, when an unusable event occurs in which the user cannot use the second control target device, control is performed to turn off the power of the second control target device (transition to the low power consumption mode).

  The storage unit 60 serves as a work area for the processing unit 40, the information acquisition unit 30, the information transfer unit 70, and the like, and its functions can be realized by a memory such as a RAM, an HDD (hard disk drive), or the like. The history information storage unit 62 included in the storage unit 60 stores user history information that is updated based on the acquired sensor information and is history information such as user behavior, state, or environment. The output information storage unit 64 stores output information transferred to the control target device by the information transfer unit 70.

  The information transfer unit (information output unit) 70 transfers information to mobile devices, homes, in-car controlled devices 92, 94, 96, and the like, and functions as a communication unit 72 and a device I / F unit 74. It can be realized by. For example, when information (data) is transferred (transmitted) to the control target device by wireless communication or the like, the communication unit 72 is used. On the other hand, the device I / F unit 74 is used when information (control signal) is transferred (output) to a control target device by a wired electric signal.

  The operation unit 80 is for inputting user operation information, and its function can be realized by an operation panel such as a keyboard or a touch panel display. The display control unit 82 performs display control processing for displaying information such as characters and images on a display (wearable display, sub-display), and the function can be realized by a graphic processor or the like. An information storage medium (a computer-readable medium) 84 stores programs, data, and the like, and its function can be realized by an optical disk (CD, DVD) or the like. The processing unit 40 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 84. That is, in the information storage medium 84, a program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  Next, the operation of this embodiment will be described with reference to FIGS. 3 (A) and 3 (B). FIG. 3A is a flowchart regarding sensor selection processing.

  First, information necessary for TPO determination, such as sensor information and schedule information, is acquired (step S1). Then, the user's TPO is determined based on the acquired information (step S2). Next, the sensor selection unit 42 selects an available sensor based on the user's TPO information (step S3). Then, the information acquisition unit 30 acquires sensor information from the selected sensor (step S4). Next, the history information update unit 48 updates the user history information based on the acquired sensor information, and stores the updated user history information in the history information storage unit 62 (step S5).

  In sensor selection for acquiring sensor information for TPO determination, a sensor effective for TPO determination or a sensor capable of detecting a change in TPO may be selected. For example, in the above-described example, an acceleration sensor that is an effective sensor for indoor position determination (TPO determination) is selected indoors. However, with only the acceleration sensor, it is impossible to detect that the GPS sensor can be used from the indoor to the outdoor, and the sensor cannot be reselected. Therefore, in this case, it is desirable to select the indoor / outdoor sensor described above.

  FIG. 3B is a flowchart regarding control target device selection processing. First, information necessary for TPO determination, such as sensor information and schedule information, is acquired (step S11). Then, the user's TPO is determined based on the acquired information (step S12). Next, the control target device selection unit 44 selects an available control target device based on the user's TPO information (step S13). Then, the user history information is read from the history information storage unit 62 (step S14). Next, the information transfer unit 70 selects output information to the selected control target device from the output information storage unit 64 based on the read user history information (step S15), and selects the selected output information as the control target. Output to the device (step S16).

  In FIG. 3A, since a sensor corresponding to the user's TPO information is selected, a different sensor can be selected depending on the location, time, and situation. Therefore, the meaning of the sensor information can be made different depending on the location, time, and situation of the sensor information, and more intelligent sensor information acquisition processing can be realized. In addition, the user history information can be appropriately updated by selecting an appropriate sensor according to the place, time, and situation.

  For example, in a home subsystem, when a user is in the living room, a light intensity sensor and an air temperature sensor are selected for lighting control and air conditioning control. On the other hand, when the user is in the toilet, the urinalysis sensor is selected in order to create the history information of the user's health condition. When the user approaches the robot, the robot-mounted sensor is selected in order to make the robot correspond to the user or to update the history information of the user's action using the robot. Also, during daytime hours, an air temperature sensor is selected for air-conditioning control, and during night hours, a body temperature sensor is selected to measure the user's body temperature during sleep and create user's health status history information. Or select security sensors for security. In addition, when the user is in a busy situation, the light intensity sensor is selected for lighting control to relax the user. When the user is in a spare situation, for robot control to eliminate the user's spare time, Select a robot-mounted sensor.

  In FIG. 3B, since the control target device is selected according to the user's TPO information, it becomes possible to select a different control target device according to the location, time, and situation, and more intelligent device control can be performed. realizable.

  For example, in the home subsystem, when the user is in the living room or in the time zone when the user is waking up, a control target device such as a home display, an AV device, or a robot is selected to eliminate the user's time. Alternatively, when the user approaches the home display, the AV device, or the robot, the device that the user has approached is selected. On the other hand, when the user is in the bedroom or in the night time, a control target device such as an air conditioner or lighting is selected in order to realize a comfortable sleep of the user. In a situation where the user is not energetic, a robot is selected to energize the user, and in a situation where the user is busy, a home AV device is selected to play music for relaxing the user.

  FIG. 4 shows more specifically examples of sensors and control target devices selected by the TPO when moving from a house to a company via a car, outdoors, or indoors.

  When the user moves to the driver's seat in the vehicle, a running state sensor, an operation state sensor, an in-vehicle environment sensor, and the like are selected. In addition, a car navigation system, a car AV device, an air conditioner, a dozing prevention device, or the like is selected as a control target device.

  When the user goes out of the car and walks, wearable sensors such as GPS, acceleration, and pulse are selected. In addition, a control target device such as a wearable display, a mobile AV device, a mobile phone, and a wristwatch is selected. On the other hand, when the user is stationary indoors, wearable sensors such as GPS, acceleration, and pulse, and environment sensors embedded indoors are selected. Further, a terminal or display nearest to the user is selected as the control target device.

  When the user goes to the office and sits down, a wearable sensor such as a pulse, an environment / state sensor embedded in an indoor or workplace desk, and a sensor for monitoring the operation history of the PC are selected. Further, a desk terminal / PC, lighting, air conditioning, or the like is selected as the control target device.

  According to the method of the present embodiment described above, when the user moves between a plurality of subsystems, it is possible to provide the user with appropriate and effective information according to the user history information.

  For example, in FIG. 5A, the user who has returned home connects the portable electronic device 20 to the cradle 21 and performs charging or the like. By such connection to the cradle 21, the robot 300, which is a control target device of the home subsystem, is selected and activated, and its use becomes possible. In this case, the history information storage unit 62 of the portable electronic device 20 stores user history information updated in the mobile environment, and the robot 300 is controlled based on the user history information. Specifically, it is determined based on the user history information that the user went to a drinking party on the way home from work and was excited by conversation with colleagues. Then, when the user approaches, the robot 300 performs an utterance operation such as “Looks like today's drinking party was exciting”, for example. As a result, the user can feel the freshness of what the robot 300 knows about his / her behavior in a place where the robot 300 is not present, can be attached to the robot 300, and can realize unprecedented robot control. . Further, for example, when it is determined that the user is tired or unwell based on the user history information, the robot 300 performs an utterance operation that encourages the user. As a result, the user becomes more attached to the robot 300 that encourages the user as if he knew his / her state.

  Further, when the user returns home in this way, not only the robot 300 but also the robot mounted sensor can be used, and the user history information updated in the mobile environment can be updated based on the sensor information from the robot mounted sensor. Become. Therefore, the user's mental state and the like when returning home can be determined by detecting the user's reaction to the utterance of the robot 300 by the contact sensor mounted on the robot. For example, if the user responds positively to the dialogue, “Today's drinking party seems to have risen,” it can be determined that the estimated result of “I went to a drinking party after work” is correct. It is possible to create more accurate user history information.

  Also, when the user comes home and removes wearable sensors such as ambient temperature sensor, ambient humidity sensor, ambient light intensity sensor, and body temperature sensor, the robot mounted sensor can be selected by selecting the robot mounted sensor instead of these wearable sensors. The sensor can measure ambient temperature, humidity, luminous intensity, user body temperature, and the like. Accordingly, seamless update processing of user history information is possible based on sensor information from the robot-mounted sensor, and more appropriate and accurate user history information can be obtained.

  In FIG. 5 (B), the user getting on the car connects the portable electronic device 20 to a cradle 21 provided in the car. By such connection to the cradle 21 or establishment of a short-range wireless communication path, a navigation device that is a control target device of the in-vehicle subsystem is selected. In this case, the history information storage unit 62 of the portable electronic device 20 stores the user history information updated in the mobile environment or the home environment, and the car navigation display can be controlled based on the user history information. . Specifically, when it is determined that the user's exercise amount (walking amount) is insufficient based on the user history information, a healthy store is recommended for the car navigation display as shown in FIG. A guidance screen is displayed. As a result, the user feels fresh and surprised at the navigation device that reacts as if he / she knew his / her action history, and can provide an unprecedented navigation device. In addition, when the user's action history specified by the user history information is ahead of the user's schedule specified by the schedule, for example, navigation control such as setting a route with a margin is provided. May be.

  Also, instead of using the built-in GPS sensor of the portable electronic device 20 whose reception sensitivity has dropped in the vehicle, the GPS sensor or gyro sensor of the navigation device is used to identify the accurate movement history of the user and update the user history information. become able to. Therefore, seamless update processing of user history information from a mobile environment or a home environment can be performed, and more appropriate and accurate user history information can be obtained.

  Note that application examples of the method of the present embodiment are not limited to FIGS. 5 (A) to 5 (C). For example, when the user who returns home removes the wearable display and approaches the home display, the user history information and information based thereon may be displayed on the home display instead of the wearable display. If the user history information determines that the user is mentally tired, the car AV device may be selected and control may be performed to play healing music.

3. User History Information Update and Control Target Device Control Next, a specific example of the user history information update method and the control target device control method will be described with reference to FIG.

  In FIG. 6, both the sensor and the control target device are usable in the period T1, the control target device is unavailable in the period T2, the sensor is unavailable in the period T3, and in the period T4. Both the sensor and the control target device are unavailable.

  When there is no controllable device that can be used (selectable) as in the period T2, the control of the control target device using the user history information is not performed, and the history information update unit 48 updates the user history information. Only done. On the other hand, when there is no available sensor (acquirable sensor information) during the period T3, the history information update unit 48 does not update the user history information, and the control target device using the user history information is not used. Only the control is performed. When both the control target device and the sensor can be used as in the period T1, both the history information update and the control target device control are performed. On the other hand, when neither the control target device nor the sensor is available during the period T4, neither the history information is updated nor the control target device is controlled.

  As described above, in FIG. 6, the portable electronic device 20 searches for available sensors and control target devices. If an available sensor is detected, the sensor information is acquired and the user history information is updated. At this time, if an available control target device is not detected, only updating of the user history information is continued, and the control operation of the control target device is not performed. Then, when an available control target device is detected and selected, a control operation of the control target device is started based on the updated user history information.

  Further, when an available sensor is not detected and only an available control target device is detected, only the control operation of the control target device is performed based on the last updated user history information. Then, when an available sensor is detected and selected, the update of the user history information is resumed.

  According to the above method, even when one of the sensor and the control target device is unavailable, it is possible to continuously update the user history information and control the control target device without waste.

4). Monitoring of Selected State When the portable electronic device 20 selects a sensor or a control target device, it is desirable that the sensor or control target device on the selected side can recognize that it is in the selected state. Such a selection state monitoring method will be described with reference to FIGS.

  For example, in FIG. 7A, the sensor selection unit 42 of the portable electronic device 20 makes an inquiry according to a predetermined protocol to the selection state monitoring unit 17 of the sensor (sensor device) 10. If the sensor 10 is available, the selection state monitoring unit 17 of the sensor 10 returns that fact to the sensor selection unit 42 according to a predetermined protocol.

  When the handshake is established in this way, the portable electronic device 20 determines that the sensor 10 can be used, and takes in sensor information from the sensor 10. When the handshake is established, the selection state monitoring unit 17 activates the control unit 18, and the control unit 18 controls the sensor device 19 to output sensor information to the portable electronic device 20. With such a configuration, until the sensor 10 is selected, processing based on control of the sensor 10 and sensor information becomes unnecessary, and the processing load can be reduced.

  In FIG. 7B, the control target device selection unit 44 of the portable electronic device 20 makes an inquiry according to a predetermined protocol to the selection state monitoring unit 97 of the control target device 90. If the control target device 90 is available, the selection state monitoring unit 97 returns that fact to the control target device selection unit 44 according to a predetermined protocol.

  When the handshake is established in this way, the portable electronic device 20 determines that the control target device 90 is available, and filters information necessary for the control target device 90 based on the user history information and sensor information ( To the control unit 98 of the control target device 90. When the handshake is established, the selection state monitoring unit 97 activates the control unit 98, and the control unit 98 controls the control object 99 based on information output from the portable electronic device 20. By adopting such a configuration, it is not necessary to control the control target device 90 and output information for the control target device 90 until the control target device 90 is selected, and the processing load can be reduced.

  In FIG. 7C, the control target device selection unit 44 makes an inquiry to the selection state monitoring unit 397 of the robot 300 according to a predetermined protocol. If the robot 300 is available, the selection state monitoring unit 397 returns that fact to the control target device selection unit 44 according to a predetermined protocol.

  When handshaking is established in this way, the selection state monitoring unit 397 activates the robot control unit 386, and the robot control unit 386 controls the robot-mounted sensor 310 to output sensor information to the portable electronic device 20. Let The robot control unit 386 controls the robot operation mechanism (actuator, speaker, LED, etc.) 390 based on the user history information and sensor information. When the handshake is established, the portable electronic device 20 determines that the robot 300 can be used, captures sensor information from the robot-mounted sensor 310, and requires the robot 300 based on user history information and sensor information. This information is filtered and output to the control unit 386 of the robot 300. With such a configuration, until the robot 300 is selected, each part of the robot 300 other than the selected state monitoring unit 397 can be set to a low power consumption (sleep) mode, and power saving can be achieved.

  In FIG. 8A, the information transfer unit 70 selects output information based on the user history information in the history information storage unit 62, and sends the output information to the display control unit 286 of the home display 200 and the robot control unit 386 of the robot 300. Output. Thereby, display control of the display unit 290 by the display control unit 286 and control of the robot operation mechanism 390 by the robot control unit 386 are performed. Further, in the in-vehicle environment, the information transfer unit 70 outputs information to the processing unit 440 of the car navigation 400, and thereby, the car navigation control by the processing unit 440 and the display control of the display unit 490 by the display control unit 486 are performed.

  At this time, for example, when displaying the user history information itself on the home display 200, the information transfer unit 70 selects information to be displayed from the user history information in the history information storage unit 62, and selects the selected information. The data is output to the display control unit 286. Then, the display control unit 286 controls the display unit 290 to display information such as the selected character or image.

  On the other hand, when the robot 300 performs an utterance operation based on the user history information as shown in FIG. 5A, the information transfer unit 70 instructs the utterance content from the output information of the output information storage unit 64. Information is selected, and the selected instruction information is output to the robot controller 386. Then, the robot control unit 386 determines the utterance content based on the instruction information, and controls the robot operation mechanism 390 to perform the utterance operation. In this case, the information transfer unit 70 outputs parameters such as the mental state and body state of the user, and the robot control unit 386 determines the utterance content and the robot operation based on these parameters, and the robot operation mechanism. 390 may be controlled.

  In FIG. 8B, the portable electronic device 20 includes an external control unit 71 capable of controlling an external control target. Then, when the control target device is selected by the control target device selection unit 44, the external control unit 71 controls the control target of the selected control target device using the user history information. For example, the external control unit 71 functions as a display control unit of the home display 200 and performs display control of the display unit 290. The external control unit 71 functions as a control unit of the robot 300 and controls the robot operation mechanism 390. The external control unit 71 functions as a display control unit of the car navigation system 400 and performs display control of the display unit 490. In this way, it is possible to perform display control and operation control by directly controlling the control target of the control target device by the external control unit 71 of the portable electronic device 20.

5. User History Information Next, specific examples of user history information update processing and user history information will be described. FIG. 9 is a flowchart illustrating an example of update processing of user history information.

  First, the information acquisition unit 30 acquires sensor information (step S21). Next, the calculation unit 46 performs calculation processing such as filtering and analysis of the acquired sensor information (step S22). Based on the calculation result, the user's behavior, state, environment, etc. (TPO, feeling) are estimated (step S23). Then, the history information update unit 48 stores the user history such as the estimated user behavior and state in the history information storage unit 62 in association with the date and time (year, month, week, day, time) and the like. Is updated (step S24).

  FIG. 10 schematically shows a specific example of user history information. The user history information in FIG. 10 has a data structure in which a history of user actions and the like is associated with a time zone, a time, and the like. For example, the user departs from home at 8 o'clock, walks from his home to the station in the time zone from 8 o'clock to 8:20, and arrives at the nearest station A at 8:20. And, from 8:20 to 8:45, I got on the train, got off at the nearest B station of the company at 8:45, arrived at the company at 9:00, and started work. During the time zone from 10:00 to 11:00, meetings are held with members in the company, and lunch is served from 12:00 to 13:00.

  As described above, in FIG. 10, user history information is constructed by associating a history of user behavior or the like estimated based on information from a sensor or the like with a time zone, a time, or the like.

  In FIG. 10, measurement values such as a user's utterance amount, a meal amount, a pulse rate, and a sweat amount, which are measured by a sensor or the like, are also associated with the time zone and time. For example, in the time zone from 8:00 to 8:20, the user is walking from the home to the station A, but the walking amount at this time is measured by the sensor and is associated with the time zone from 8:00 to 8:20. It is done. In this case, for example, measurement values of sensor information other than the walking amount such as walking speed and sweating amount may be further associated. By doing so, it becomes possible to grasp the user's momentum and the like in this time zone.

  In the time zone from 10 o'clock to 11 o'clock, the user is having a meeting with a colleague, and the amount of speech, etc. at this time is measured by a sensor and correlated with the time zone from 10 o'clock to 11 o'clock. In this case, for example, measurement values of sensor information such as a voice state and a pulse may be further associated. By doing so, it becomes possible to grasp the user's conversation volume, degree of tension, and the like during this time period.

  In the time zone from 20:45 to 21:45 or from 22:00 to 23:00, the user is playing a game or watching TV, but the pulse, sweating amount, etc. at this time are in these time zones. Associated. By doing so, it becomes possible to grasp the degree of excitement of the user in these time zones.

  In the time zone from 23:30, the user is sleeping, but a change in the user's body temperature at this time is associated with this time zone. By doing so, it becomes possible to grasp the health condition of the user during sleep.

  Note that the user history information is not limited to the form as shown in FIG. 10. For example, the user history information can be modified without associating the history of user behavior with the date and time.

  For example, in FIG. 11A, the mental state parameter of the user is calculated according to a predetermined calculation formula based on the utterance amount, the voice state, the pulse rate, the sweating amount, etc., which are measured values of the sensor information. For example, if the utterance amount is large, the mental state parameter also becomes high, indicating that the user's mental state is good. In addition, based on a walking amount, walking speed, body temperature, and the like, which are measurement values of sensor information, a user body condition (health state) parameter (exercise amount parameter) is calculated according to a predetermined calculation formula. For example, if the amount of walking is large, the body condition parameter also increases, indicating that the user's body condition is good.

  As shown in FIG. 11B, the mental state and body state parameters (state parameters in a broad sense) of the user can be displayed on a wearable display, a home display, or a car navigation display by using a bar graph or the like. . Therefore, according to the present embodiment, the user history information such as the mental state and body state parameters updated in the mobile environment, for example, is used for the home display in the home environment and the car navigation display in the in-car environment as shown in FIG. The parameter can be visualized and displayed as in B). Alternatively, the robot in the home environment can be controlled based on the mental state and body state parameters updated in the mobile environment to encourage the user or to allow the robot to perform an operation that advises the user. Alternatively, in the in-vehicle environment, navigation according to the parameters of the user's mental state and physical state and music can be played.

6). Selection of Sensor and Control Target Device Next, a specific example of a method for selecting a sensor and a control target device will be described. In the following, in order to simplify the description, the case where the first subsystem is a mobile subsystem and the second subsystem is a home subsystem (robot) will be mainly described as an example. The form is not limited to this.

  For example, as shown in FIG. 12A, when the user is in a mobile environment, if the event determination unit 50 determines that the wearable sensor 12 and the mobile control target device 92 can be used, the sensor selection unit 42 The wearable sensor 12 is selected, and the control target device selection unit 44 selects the mobile control target device 92. Then, the history information update unit 48 updates the user history information based on the sensor information from the wearable sensor 12. Further, the control processing unit 52 starts the control operation of the mobile control target device 92.

  On the other hand, in FIG. 12B, the user moves from the mobile environment to the home environment, and the event determination unit 50 determines whether or not the home sensor 14 and the home control target device 94 can be used. If it is available, the sensor selection unit 42 selects the home sensor 14, and the control target device selection unit 44 selects the home control target device 94. Further, the history information update unit 48 updates the user history information based on the sensor information from the home sensor 14. In addition, the control processing unit 52 starts the control operation of the home control target device 94.

  As described above, in FIGS. 12A and 12B, the portable electronic device 20 updates the history information based on the sensor information regardless of whether the user is in the mobile environment or the home environment. The controlled device is controlled.

  However, when the user is in the home environment, there is a high possibility that the portable electronic device 20 will be removed. Further, if the portable electronic device 20 is always operated even in the home environment, the power of the portable electronic device 20 is wasted.

  Therefore, in FIGS. 13A to 14, the portable electronic device 20 is stopped when the user moves from the mobile environment (first subsystem environment) to the home environment (second subsystem environment). Etc. are controlled.

  For example, in FIG. 13A, since the user is in a mobile environment, the mobile side is powered on (or normal operation mode), and the home control target device 94 is powered off (or low power consumption mode). Yes. The information transfer units 70 and 170 on the mobile side and the home side are always turned on (normal operation mode).

  Then, the mobile control target device selection unit 44 selects the mobile control target device 92, and the selected mobile control target device 92 is controlled. In addition, the mobile-side sensor selection unit 42 selects the wearable sensor 12, and the mobile-side history information update unit 48 updates the user history information based on the sensor information from the wearable sensor 12.

  On the other hand, in FIG. 13B, the user has moved from the mobile environment to the home environment. In this case, it is determined whether or not the home control target device 94 can be used. If the home control target device 94 can be used, the home control target device 94 is turned on (normal operation mode). Then, the mobile-side information transfer unit 70 reads the user history information from the history information storage unit 62 and transfers it to the home side. Then, the home-side information transfer unit 170 receives this user history information and writes it in the history information storage unit 162. Then, the home sensor 14 is selected, and updating of the user history information based on the sensor information from the home sensor 14 is started. In addition, control of the home control target device 94 using the user history information is started. The mobile side is turned off (low power consumption mode).

  In FIG. 14, the user has returned from the home environment to the mobile environment. In this case, the mobile side is turned on (normal operation mode). Then, the home-side information transfer unit 170 reads the user history information from the history information storage unit 162 and transfers it to the mobile side. Then, the mobile-side information transfer unit 70 receives this user history information and writes it in the history information storage unit 62. Then, the home control target device 94 is turned off (low power consumption mode).

  13A to 14, when the user is in a mobile environment, the home control target device 94 (or home subsystem) is turned off (low power consumption mode), and the user is at home. When in the environment, the mobile side is powered off, so the power consumption on the mobile side and the home side can be reduced. In this case, if the user history information is transferred as shown in FIGS. 13B and 14, even if the user moves between subsystems, the user history information can be updated seamlessly. Even when the user is in a mobile environment or a home environment, the information transfer units 70 and 170 are always powered on (normal operation mode). It is possible to properly implement environmental change monitoring processing.

  When the user moves from the mobile environment to the home environment, processing such as determination of occurrence of an available event, selection of the home control target device 94 or home sensor 14, or start of a control operation of the home control target device 94 is performed in the home It may be realized by a joint operation on the mobile side and the mobile side (for example, FIG. 7A to FIG. 7C), or may be realized by a single operation on the home side.

  FIG. 15 is a flowchart showing a detailed processing example of the method of FIGS. First, it is determined whether or not the home control target device 94 can be used (step S31). If it becomes available, the home control target device 94 is selected (step S32), and the power of the selected home control target device 94 is turned on (step S33). Alternatively, the low power consumption mode is returned to the normal operation mode.

  Next, the user history information is transferred from the history information storage unit 62 to the history information storage unit 162 of the home subsystem (step S34). Then, updating of the user history information using the sensor information from the home sensor 14 is started (step S35). Further, the control operation of the home control target device 94 using the user history information is started (step S36).

  Next, the portable electronic device 20 is turned off (step S37). Alternatively, the mode is shifted to the low power consumption mode. However, the information transfer unit (communication unit) 70 is always kept powered on (normal operation mode).

  Thus, next, it is determined whether or not the use of the home control target device 94 is disabled (step S38). While the home control target device 94 can be used, the updating of the user history information using the sensor information from the home sensor 14 and the control operation of the home control target device 94 using the same are continued. And when it becomes unavailable, the power source of the portable electronic device 20 is turned on (step S39). Alternatively, the low power consumption mode is returned to the normal operation mode. Then, the user history information is transferred from the history information storage unit 162 of the home subsystem to the history information storage unit 62 of the portable electronic device 20 (step S40). Then, the power source of the home control target device 94 is turned off (step S41). Alternatively, the mode is shifted to the low power consumption mode.

7). Sharing of History Information Storage Unit, etc. Next, a sharing method of the history information storage unit and the like will be described. For example, in FIG. 16A, the mouth portion of the dog-shaped robot 300 is a cradle of the portable electronic device 20. When the user attaches the portable electronic device 20 to the mouth portion of the robot 300, the control operation using the user history information of the robot 300 that is the home control target device is started.

  FIG. 16B shows a configuration example of a system that realizes the technique of FIG. When the portable electronic device 20 is not attached to the robot 300, the user history information in the history information storage unit 62 of the portable electronic device 20 is updated based on the sensor information from the wearable sensor 12. The control unit 86 of the portable electronic device 20 controls mobile control target devices such as the wearable display 93.

  On the other hand, when the portable electronic device 20 is attached to the robot 300, switching as shown in F1 and F2 is performed, and the history information storage unit 62 and the control unit 86 are shared by the mobile subsystem and the home subsystem. . That is, in this case, the robot-mounted sensor 310 and the history information storage unit 62 are electrically connected via an electric signal or the like, and the user history information in the history information storage unit 62 is not mounted on the wearable sensor 12 but is mounted on the robot. It is updated based on sensor information from the sensor 310. Further, the control unit 86 controls the robot operation mechanism 390 that is a control target instead of the wearable display 93.

  As described above, in FIGS. 16A and 16B, when the portable electronic device 20 is attached to the robot 300 (control target device) of the home subsystem (second subsystem), history information is stored. The unit 62 is shared by the portable electronic device 20 and the robot 300 of the home subsystem. Then, the user history information in the shared history information storage unit 62 is updated based on the sensor information from the robot-mounted sensor 310 that is a sensor of the home subsystem.

  According to the method of FIGS. 16A and 16B, since it is not necessary to provide a history information storage unit for the robot 300, the cost of the robot 300 can be reduced. In particular, when the history information storage unit 62 is configured with a large-capacity memory or HDD, the merit of sharing is great. In addition, the update of the user history information only needs to be performed on the history information storage unit 62 provided in the portable electronic device 20, and it is not necessary to update the history information on the robot side, so that the processing can be simplified. Furthermore, since the control unit 86 can be shared by the mobile side and the robot side, further cost reduction and simplification of processing can be achieved.

  FIG. 17 is a flowchart showing a detailed processing example of the method of FIGS. 16 (A) and 16 (B). First, it is determined whether or not the robot 300 is available (step S51). Specifically, when the portable electronic device 20 is attached to the robot 300 or the proximity of the portable electronic device 20 is detected by short-range wireless, it is determined that the robot 300 can be used. When the robot 300 becomes available, the robot 300 is activated (step S52).

  Next, the wearable display 93 and the wearable sensor 12 on the mobile side are stopped (step S53). Then, the robot operating mechanism 390 is controlled by the controller 86 of the portable electronic device 20 (step S54). Also, the user history information in the history information storage unit 62 set in the shared storage unit is updated using the sensor information from the robot-mounted sensor 310 (step S55).

  Next, it is determined whether or not the robot 300 has become unavailable (step S56). Specifically, when the portable electronic device 20 is removed from the robot 300 or when it is detected that the portable electronic device 20 has been separated by short-range wireless, it is determined that the robot 300 has become unusable. If the use becomes impossible, the wearable display 93 and the wearable sensor 12 are activated (step S57). Then, the robot 300 is stopped (step S58).

8). Transferring User History Information Using Wireless Next, a method for transferring user history information using wireless will be described. FIG. 18 shows a configuration example of a system that realizes this technique.

  In FIG. 18, information transfer units 70 and 370 are provided in the portable electronic device 20 and the robot 300, and information is transferred wirelessly by the communication units (communication modules) 72 and 372. For example, when an available event of the robot 300 that is the device to be controlled occurs, the information transfer unit 70 uses the user history information stored in the mobile history information storage unit 62 as the home history information storage unit 362 (second The history information storage unit).

  In this case, the information transfer unit 70 (information transfer unit 370) performs information synchronization processing of user history information. Specifically, an information synchronization process for maintaining the user history information stored in the mobile history information storage unit 62 and the user history information stored in the home history information storage unit 362 in the same content information is performed. Do. The information synchronization process is performed by overwriting the history information of the currently used subsystem with the history information of the subsystem that is newly available. For example, when the mobile side is currently used and the home side becomes available, the mobile side history information is overwritten on the home side history information. In the opposite case, the history information on the home side is overwritten on the history information on the mobile side. In this way, the latest user history information is maintained and stored in the history information storage units 62 and 362, and even when the user moves between a plurality of subsystems, the user history information is seamless. Appropriate updates become possible.

  In FIG. 18, information transfer is performed wirelessly. Specifically, information transfer is realized by, for example, wireless LAN, weak wireless that is short-range wireless communication, Bluetooth, infrared rays, or the like. In this case, the occurrence of an available event of the robot 300 (control target device) can be determined by detecting the wireless strength. Specifically, when the portable electronic device 20 and the robot 300 are close to each other, the wireless strength increases, and it can be determined that the robot 300 can be used. On the other hand, when the portable electronic device 20 and the robot 300 are separated from each other, the wireless strength decreases, and it can be determined that the robot 300 is not usable. If such a method is used, the radio | wireless required for information transfer can be used for the determination process of an available event or an unusable event.

  In FIG. 19A, the user is moving toward the house to go home. In this case, as shown in FIG. 19B, areas 1, 2, and 3 centered on the house are set.

  Here, area 1 is an area outside the effective range of a wireless LAN or the like (hereinafter referred to as long-distance wireless communication in order to be distinguished from short-range wireless communication), and the portable electronic device 20 operates alone. It is an area. Area 2 is an area within the effective range of long-distance wireless communication, and is an area where user history information transfer processing (information synchronization processing) is performed. Area 3 is an area within an effective range of short-range wireless communication such as Bluetooth, and is an area where the robot 300 (home control target device in a broad sense) operates independently. Area 2 is an area outside the effective range of near field communication.

  For example, when the user enters the area 2 from the area 1, the robot 300 is activated, and the user history information is transferred (loaded) from the history information storage unit 62 on the mobile side to the history information storage unit 362 on the home side. When the user enters the area 3 from the area 2, the portable electronic device 20 is stopped and switched to the single operation of the robot 300.

  On the other hand, when the user enters the area 2 from the area 3, the portable electronic device 20 is activated, and the user history information is transferred from the history information storage unit 362 on the home side to the history information storage unit 62 on the mobile side. When the user enters area 1 from area 2, the robot 300 is stopped and switched to the single operation of the portable electronic device 20.

  That is, in FIG. 19B, the event determination unit 50 and the like determine the approaching state of the user to the location of the home subsystem (second subsystem). When the approaching state changes from the first approaching state (area 1) to the second approaching state (area 2) having a higher degree of approaching than the first approaching state, the information transfer unit 70 The user history information stored in the storage unit 62 is transferred to the home history information storage unit 362. And when the user's approaching state changes from the second approaching state (area 2) to the third approaching state (area 3) having a higher degree of approach than the second approaching state, the control processing unit 52 The control operation of the robot 300 (second control target device) using the user history information is started.

  Further, the information transfer unit 70 (information transfer unit 370) is configured to store the user history information and the history information storage unit stored in the history information storage unit 62 during a period in which the user approach state is the second approach state (area 2). Information synchronization processing is performed to maintain the user history information stored in 362 as the same content information. That is, when the user approach state changes from the first approach state (area 1) to the second approach state (area 2), the user history information is transferred from the mobile side to the home side, and the third approach state When the second approach state (area 2) is entered from (area 3), the user history information is transferred from the home side to the mobile side. When the user approach state changes from the second approach state (area 2) to the first approach state (area 1), the control operation of the robot 300 using the user history information is stopped.

  In addition, these 1st, 2nd, 3rd approach states (area 1, 2, 3) can be judged by long-distance wireless communication and short-distance wireless communication, for example. That is, when a user (portable electronic device) is detected by short-range radio and long-range radio, it can be determined that the user is in area 3 (third approach state). In addition, the user cannot be detected by the short-range wireless, but if the user can be detected by the long-range wireless, it can be determined that the user is in the area 2 (second approach state). If the user cannot be detected by the short-range radio or the long-range radio, it can be determined that the user is in area 1 (first approach state). In this way, by using at least two types of wireless communications with different reception states depending on distances (for example, at least two types of wireless communications with different effective reach distances), the start and stop control of the portable electronic device 20 and the robot 300 can be performed. The user history information transfer process can be efficiently realized.

  19A and 19B show the case where two types of radio, short-range radio and long-range radio, are used, three or more types of radio may be used.

  FIG. 20 is a flowchart showing a detailed processing example of the method of FIGS. 19 (A) and 19 (B). First, it is determined whether or not the proximity state has changed (step S61). If it has not changed, polling is performed every predetermined time (step S62). On the other hand, if it has changed, it is determined whether or not the user has entered area 2 (step S63). If so, it is determined whether or not the user has entered area 2 from the area 1 side (step S64).

  When the area 2 is entered from the area 1 side, the robot side (each unit other than the communication unit) is activated (step S65). Then, handshaking between units is performed (step S66), and user history information is transferred from the mobile side to the robot side (step S67).

  On the other hand, when entering the area 2 from the area 3 side instead of the area 1 side, the mobile side is activated (step S68). Then, handshaking between units is performed (step S69), and the user history information is transferred from the robot side to the mobile side (step S70).

  If it is determined in step S63 that the user is not in area 2, it is determined whether or not the user has entered area 1 (step S71). When entering the area 1, the robot side (other than the communication unit) is stopped (step S72). On the other hand, if the user is not in area 1, it is determined that the user is in area 3, and the mobile side (other than the communication unit) is stopped (step S73).

9. System Configuration Examples FIGS. 21A, 21B, and 22 show various system configuration examples of the present embodiment. In the system of FIG. 21A, the portable electronic device 20 and the home server 120 are communicatively connected via a wireless LAN, a cradle, or the like, and the home server 120 and the robot 300 are communicatively connected via a wireless LAN or the like. And when the user who has the portable electronic device 20 approaches a house, communication between the portable electronic device 20 and the home server 120 becomes possible by wireless LAN. Alternatively, communication can be performed by placing the portable electronic device 20 in a cradle.

  When the communication path is established, user history information synchronization processing (transfer processing) is performed between the storage unit 60 of the portable electronic device 20 and the storage unit 160 of the home server 120. The robot 300 operates under the control of the home server 120. That is, the operation is controlled based on the user history information stored in the storage unit 160 of the home server 120. Taking FIG. 5A as an example, the processing unit 140 of the home server 120 analyzes the user history information in the storage unit 160 and instructs the robot 300 to perform an utterance operation corresponding to the user history information. Control.

  According to the system configuration of FIG. 21A, when a user approaches, user history information is loaded in advance into the storage unit 160 of the home server 120. Accordingly, the robot control based on the user history information can be started immediately after the robot 300 is activated, and the processing can be made efficient. Further, when the data size of the user history information is large, it is not necessary to provide a history information storage unit in the robot 300, so that the robot 300 can be reduced in cost and size.

  In the system of FIG. 21B, the portable electronic device 20 and the external server 620 are connected for communication by a wireless WAN such as PHS, and the external server 620 and the robot 300 are also connected for communication by a wireless WAN such as PHS. Each unit such as the portable electronic device 20 and the robot 300 appropriately communicates with the external server 620 to perform user history information synchronization processing. For example, user history information is uploaded from the unit to the external server 620 when the unit stops, and user history information is downloaded from the external server 620 to the unit when the unit starts.

  In FIG. 21B, it is not possible to determine the proximity of the user and the house based on the wireless strength. Therefore, in this case, the user's position may be determined based on, for example, the position registration information of the PHS base station, and it may be determined whether or not the user has approached the house. Or you may judge based on the GPS sensor of the wearable sensor 12. FIG. When it is determined that the user has approached the house, the robot 300 may be activated under the control of the external server 620 or the like.

  In the system of FIG. 22, the portable electronic device 20 and the external server 620 are communicatively connected by a wireless WAN such as PHS, the external server 620 and the home server 120 are communicatively connected by a wired WAN such as ADSL, and the home server 120 and the robot 300 are connected. Are connected by wireless LAN or the like. Each unit appropriately communicates with the external server 620 to perform synchronization processing of user history information. In addition, it is determined whether or not the user has approached the house using PHS location registration information, a GPS sensor, a microphone, and the like. If the user has approached, the user history information in the storage unit 660 of the external server 620 is stored as home information. Download to the storage unit 160 of the server 120.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or drawings, at least once, a broader or synonymous different term (first, second, third subsystem, first, second, third sensor, first, second, third The term (mobile subsystem, home subsystem, in-vehicle subsystem, wearable sensor, home sensor, in-vehicle sensor, mobile control target device, home control target device, in-vehicle control target device, etc.) The different terms can be used anywhere in the specification or drawings. In addition, the configuration and operation of the portable electronic device, subsystem, robot, and the like are not limited to those described in this embodiment, and various modifications can be made. For example, a modified embodiment in which any one of the sensor selection unit and the control target device selection unit is omitted is possible.

Illustration of an integrated system of multiple subsystems 1 is a configuration example of a portable electronic device according to an embodiment. 3A and 3B are flowcharts for explaining the operation of the present embodiment. Explanatory drawing of the selection method of the sensor based on TPO information, and a control object apparatus. 5A to 5C show application examples of the method of the present embodiment. Explanatory drawing of the update method of log | history information, and the control method of a control object apparatus. FIG. 7A to FIG. 7C are explanatory diagrams of a monitoring method of a selected state. 8A and 8B are explanatory diagrams of an information transfer method and an external control method. The flowchart of the update process of user history information. Explanatory drawing of user log | history information. FIG. 11A and FIG. 11B are explanatory diagrams of user history information. FIGS. 12A and 12B are explanatory diagrams of a method for selecting a sensor and a device to be controlled. FIG. 13A and FIG. 13B are explanatory diagrams of a method for selecting a sensor and a device to be controlled. Explanatory drawing of the selection method of a sensor and a control object apparatus. The flowchart for demonstrating the selection method of a sensor and a control object apparatus. FIGS. 16A and 16B are explanatory diagrams of a technique for sharing the history information storage unit. The flowchart for demonstrating the sharing method of a log | history information storage part. 1 is a configuration example of a system that implements a wireless method for transferring user history information. 19A and 19B are explanatory diagrams of a method for transferring user history information by wireless. The flowchart for demonstrating the transfer method of the user historical information by radio | wireless. FIG. 21A and FIG. 21A are system configuration examples of this embodiment. The system configuration example of this embodiment.

Explanation of symbols

10 sensors, 12 wearable sensors, 14 home sensors, 16 in-vehicle sensors,
17 selection state monitoring unit, 18 control unit, 19 sensor device,
20 portable electronic devices, 30 information acquisition unit, 32 communication unit, 34 sensor I / F unit,
40 processing unit, 42 sensor selection unit, 44 control target device selection unit, 46 calculation unit,
48 history information update unit, 50 event determination unit, 52 control processing unit, 60 storage unit,
62 history information storage unit, 64 output information storage unit, 70 information transfer unit, 72 communication unit,
74 device I / F unit, 80 operation unit, 82 display control unit, 84 information storage medium,
90 control target device, 92 mobile control target device, 93 wearable display,
94 home control target equipment, 96 in-car control target equipment, 97 selection state monitoring unit,
98 control unit, 99 control target, 120 home server, 140 processing unit,
160 storage unit, 200 home display, 286 display control unit, 290 display unit,
300 robot, 310 robot mounting sensor 340 processing unit,
386 robot control unit, 390 robot operation mechanism, 397 selection state monitoring unit,
400 car navigation system, 440 processing unit, 486 display control unit, 490 display unit,
620 External server, 640 processing unit 660 storage unit

Claims (26)

A behavior sensor configured to measure a user's behavior existing in the space, at least one of a state sensor that measures a user's state and an environment sensor that measures a user's environment, and a control target device A portable electronic device used by an integrated system of a plurality of subsystems, in which a plurality of subsystems are integrated, possessed by a user moving between the plurality of subsystems;
Information acquisition means for acquiring sensor information from sensors of the subsystem in which the user exists;
History information storage means for storing user history information about at least one of the user's behavior, state and environment;
History information updating means for updating the stored user history information based on the acquired sensor information;
Control target device selecting means for selecting a control target device to be controlled using user history information from among the control target devices of the subsystem in which the user exists;
The user whose user history information has been updated by the sensor information from the sensor of the first subsystem is in a state where the second control target device that is the control target device of the second subsystem can be used. Event determining means for determining occurrence of an available event to be indicated;
Control processing means for starting a control operation of the second control target device using user history information when the available event occurs and the second control target device is selected;
Only including,
The control target device selection means includes
When the available event occurs, select the second control target device,
The control processing means includes
When the available event occurs, the portable electronic device is controlled to turn off the power of the portable electronic device or shift the portable electronic device from the normal operation mode to the low power consumption mode. . In claim 1,
Sensor selection means for selecting a sensor available in the subsystem being used by the user from the plurality of sensors of the plurality of subsystems;
The information acquisition means includes
Sensor information from a sensor selected by the sensor selection means is acquired. In claim 2,
The sensor selection means includes
Based on TPO information that is at least one of time information, user location information, and user status information, a sensor that can be used in the subsystem being used by the user is selected from the plurality of sensors in the plurality of subsystems. A portable electronic device characterized by being selected. In any one of Claims 1 thru | or 3,
The control target device selection means includes
Based on TPO information that is at least one of time information, user location information, and user status information, it can be used in a subsystem being used by a user from among a plurality of control target devices of the plurality of subsystems. A portable electronic device characterized by selecting a device to be controlled. In claim 1,
When there is no control target device that can be used, the control of the control target device using the user history information is not performed, and only the user history information is updated by the history information update unit. Electronics. In any one of Claims 1 thru | or 5,
The portable electronic device is characterized in that when there is no usable sensor, the user history information is not updated by the history information updating means, and only the control target device is controlled using the user history information. . In any one of Claims 1 thru | or 6.
Including external control means capable of controlling an external control target of the portable electronic device,
The external control means includes
When a control target device is selected by the control target device selection unit, a control target of the selected control target device is controlled using user history information. In any one of Claims 1 thru | or 7 ,
A portable electronic device comprising history information update means for updating user history information based on sensor information acquired from a sensor of the second subsystem when the available event occurs. In any one of Claims 1 thru | or 8 .
The control processing means includes
When the available event occurs, the second control target device is turned on, or the second control target device is controlled to return from the low power consumption mode to the normal operation mode. A portable electronic device. In any one of Claims 1 thru | or 9 ,
Including information transfer means for transferring information to and from the second subsystem;
The control processing means includes
When the available event occurs, the information transfer means is controlled not to turn off the power or set to a normal operation mode. In any one of Claims 1 thru | or 10 .
The control processing means includes
When an unusable event occurs in which the user cannot use the second control target device, the second control target device is turned off, or the second control target device is moved from the normal operation mode. A portable electronic device characterized by performing control to shift to a low power consumption mode. In any one of Claims 1 thru | or 11 ,
When the portable electronic device is mounted on the control target device of the second subsystem, the history information storage means is shared by the portable electronic device and the second control target device of the second subsystem. And
The portable electronic device, wherein user history information in the shared history information storage means is updated based on sensor information from a sensor of the second subsystem. In any one of Claims 1 thru | or 11 ,
Characterized in that it includes information transfer means for transferring user history information stored in the history information storage means to second history information storage means of the second subsystem when the available event occurs. Portable electronic devices. In claim 13 ,
The information transfer means includes
Performing information synchronization processing for maintaining the user history information stored in the history information storage means and the user history information stored in the second history information storage means of the second subsystem in the same information. A portable electronic device characterized by In any one of Claims 1 thru | or 14 .
Including information transfer means for wirelessly transferring information to and from the second subsystem,
The event determination means includes
A portable electronic device, wherein the occurrence of the available event is determined by detecting the wireless strength. In any one of Claims 1 thru | or 14 .
The event determination means includes
A portable electronic device, wherein when the portable electronic device is connected to a cradle that can be used in the second subsystem, it is determined that the available event has occurred. In any one of Claims 1 thru | or 16 .
Including information transfer means for transferring user history information stored in the history information storage means to second history information storage means of the second subsystem;
The event determination means includes
Determining a user's proximity to the location of the second subsystem;
The information transfer means includes
When the approaching state changes from the first approaching state to the second approaching state having a higher degree of approaching than the first approaching state, the user history information stored in the history information storage means is Transfer to the second history information storage means of the two subsystems,
The control processing means includes
When the user approach state changes from the second approach state to a third approach state having a higher degree of approach than the second approach state, the second control target device using user history information A portable electronic device characterized by starting a control operation. In claim 17 ,
The information transfer means includes
The user history information stored in the history information storage means and the user stored in the second history information storage means of the second subsystem during a period when the user approach state is the second approach state A portable electronic device characterized by performing information synchronization processing for maintaining history information as information of the same content. In claim 17 or 18 ,
The control processing means includes
When the user approaching state changes from the second approaching state to the first approaching state, the control operation of the second control target device using the user history information is stopped. Type electronic equipment. In any of claims 17 to 19 ,
The event determination means includes
The portable electronic device, wherein the first, second, and third approach states are determined using at least two types of wireless communication in which reception states according to distances are different. A behavior sensor configured to measure a user's behavior existing in the space, at least one of a state sensor that measures a user's state and an environment sensor that measures a user's environment, and a control target device A portable electronic device used by an integrated system in which a plurality of subsystems are integrated and possessed by a user moving between the plurality of subsystems;
A sensor selection means for selecting a sensor available to the user from the sensors of the subsystem in which the user exists;
Information acquisition means for acquiring sensor information from the sensor selected by the sensor selection means;
History information storage means for storing user history information about at least one of the user's behavior, state and environment;
History information updating means for updating the stored user history information based on the acquired sensor information ;
An event for determining the occurrence of an available event indicating that a user whose user history information has been updated with sensor information from the sensor of the first subsystem has entered a state where the sensor of the second subsystem can be used. A determination means;
Information transfer means for transferring user history information stored in the history information storage means to second history information storage means of the second subsystem when the available event occurs;
Only including,
The sensor selection means includes
A sensor that can be used by the user is selected from sensors of the subsystem in which the user exists based on TPO information that is at least one of time information, user location information, and user status information. Portable electronic devices. In claim 21 ,
Before Symbol sensor selection means,
A portable electronic device, wherein a sensor of the second subsystem is selected as a sensor for updating user history information when the available event occurs. In claim 21 or 22,
  The information transfer means includes
  Performing information synchronization processing for maintaining the user history information stored in the history information storage means and the user history information stored in the second history information storage means of the second subsystem in the same information. A portable electronic device characterized by A behavior sensor configured to measure a user's behavior existing in the space, at least one of a state sensor that measures a user's state and an environment sensor that measures a user's environment, and a control target device A program for a portable electronic device used by an integrated system in which a plurality of subsystems are integrated and possessed by a user moving between the plurality of subsystems,
Information acquisition means for acquiring sensor information from sensors of the subsystem in which the user exists;
History information storage means for storing user history information about at least one of the user's behavior, state and environment;
History information updating means for updating the stored user history information based on the acquired sensor information;
Control target device selecting means for selecting a control target device to be controlled using user history information from among the control target devices of the subsystem in which the user exists;
The user whose user history information has been updated by the sensor information from the sensor of the first subsystem is in a state where the second control target device that is the control target device of the second subsystem can be used. Event determining means for determining occurrence of an available event to be indicated;
As the control processing means for starting the control operation of the second control target device using user history information when the available event occurs and the second control target device is selected,
Make the computer work ,
The control target device selection means includes
When the available event occurs, select the second control target device,
The control processing means includes
A program for performing a control to turn off the power of a portable electronic device or shift the portable electronic device from a normal operation mode to a low power consumption mode when the available event occurs . A behavior sensor configured to measure a user's behavior existing in the space, at least one of a state sensor that measures a user's state and an environment sensor that measures a user's environment, and a control target device A program for a portable electronic device used by an integrated system in which a plurality of subsystems are integrated and possessed by a user moving between the plurality of subsystems,
A sensor selection means for selecting a sensor available to the user from the sensors of the subsystem in which the user exists;
Information acquisition means for acquiring sensor information from the sensor selected by the sensor selection means;
History information storage means for storing user history information about at least one of the user's behavior, state and environment;
History information updating means for updating the stored user history information based on the acquired sensor information ;
An event for determining the occurrence of an available event indicating that a user whose user history information has been updated with sensor information from the sensor of the first subsystem has entered a state where the sensor of the second subsystem can be used. A determination means;
As information transfer means for transferring user history information stored in the history information storage means to second history information storage means of the second subsystem when the available event occurs,
Make the computer work,
The sensor selection means includes
A sensor that can be used by the user is selected from sensors of the subsystem in which the user exists based on TPO information that is at least one of time information, user location information, and user status information. Program to do. A computer-readable information storage medium, wherein the program according to claim 24 or 25 is stored.

Images