WO2020084837A1 - Terminal d'information et programme de support aux opérations - Google Patents

Terminal d'information et programme de support aux opérations Download PDF

Info

Publication number
WO2020084837A1
WO2020084837A1 PCT/JP2019/026381 JP2019026381W WO2020084837A1 WO 2020084837 A1 WO2020084837 A1 WO 2020084837A1 JP 2019026381 W JP2019026381 W JP 2019026381W WO 2020084837 A1 WO2020084837 A1 WO 2020084837A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
information terminal
control
user
screen
Prior art date
Application number
PCT/JP2019/026381
Other languages
English (en)
Japanese (ja)
Inventor
茉那 中川
亮太 内田
貴生 小川
かほる 居相
賢二 中北
力也 増田
今出　昌宏
明子 藤瀬
敬市郎 山縣
昌史 森光
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Priority to JP2020552519A priority Critical patent/JP7033724B2/ja
Publication of WO2020084837A1 publication Critical patent/WO2020084837A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Definitions

  • the present invention relates to an information terminal for displaying and operating the status of residential IoT (Internet of Things) equipment such as residential equipment and home appliances, and an operation support program for the information terminal.
  • residential IoT Internet of Things
  • Echonet Lite registered trademark
  • KNX registered trademark
  • the above information terminal displays and controls a plurality of household appliances and home appliances in the house, so if you try to attach an instruction manual, it will be a thick manual like a dictionary, and a general user Is not valid for immediate use.
  • an operation tutorial there are some that explain the operation, but many sentences are displayed and the operation procedure is endlessly displayed, which is not user-friendly.
  • the present invention has been made in view of the above problems, and an object thereof is to provide an information terminal that can be easily operated without causing stress to the user, and an operation support program in the information terminal. Especially.
  • An information terminal is an information terminal that is directly or indirectly connected to a control target including a plurality of home appliances or home appliances via a control device and that displays the state of each control target and controls the control target.
  • a display unit that displays a list of at least a part of the control target, an operation unit that receives a user operation, a storage unit that records information regarding the first operation of the control target, and the list display are performed.
  • the selection operation of the control target is accepted by the operation unit, when the information regarding the first operation of the control target is not stored in the storage unit with reference to the storage unit, And a control unit for displaying the tutorial as a moving image on the display unit.
  • An information terminal is an information terminal that is directly or indirectly connected to a control target including a plurality of home appliances or home appliances via a control device and that displays the state of each control target and controls the control target.
  • a display unit that displays a list of at least a part of the control target, an operation unit that receives a user operation, and an operation that the user should perform on the operation unit when the state of the control target changes.
  • a control unit for displaying a warning display on the display unit.
  • An information terminal is an information terminal that is directly or indirectly connected to a control target including a plurality of home appliances or home appliances via a control device and that displays the state of each control target and controls the control target.
  • a display unit that displays a list of at least a part of the control target, an operation unit that receives a user's operation, and detailed operation information indicating the content of the operation on the operation unit for controlling the control target, the user.
  • a control unit that outputs detailed operation link information to be acquired using the second information terminal.
  • An operation support program includes a display unit, an operation unit, a storage unit, and a control unit, which is directly or indirectly connected to a control target including a plurality of household appliances or home electric appliances via a control device.
  • the function of accepting and the control unit refers to the storage unit to perform the first operation of the control target.
  • a function of displaying a tutorial regarding the controlled object as a moving image on the display unit when the information regarding the control target is not stored in the storage unit.
  • An operation support program is an information terminal including a display unit, an operation unit, and a control unit, which is directly or indirectly connected to a control target including a plurality of home appliances or home appliances by a control device.
  • the plurality of functions include a function of displaying a list of at least a part of the control target by the display unit, and a function of the operation unit receiving a user operation.
  • the control unit includes a function of causing the display unit to display a caution display indicating an operation to be performed by the user on the operation unit when the state of the control target is changed.
  • An operation support program is an information terminal including a display unit, an operation unit, and a control unit, which is directly or indirectly connected to a control target including a plurality of home appliances or home appliances by a control device.
  • the plurality of functions include a function of displaying a list of at least a part of the control target by the display unit, and a function of the operation unit receiving a user operation.
  • a function for the control unit to output detailed operation link information, wherein the detailed link information is provided by the user as detailed operation information indicating details of an operation performed on the operation unit for controlling the control target. This is information to be acquired using the information terminal of.
  • an outline of what can be done to the controlled object and a typical operation are displayed on the display unit in a moving image of at least a part of what the user experiences with the operation unit. Since the information is displayed, the user can easily operate the information terminal without feeling stress.
  • FIG. 1 is a front view of the information terminal according to the embodiment.
  • FIG. 2 is a perspective view of the information terminal according to the embodiment.
  • FIG. 3 is a diagram showing an example of a display screen of an information terminal installed at the entrance.
  • FIG. 4 is a diagram showing an example of a display screen of the information terminal installed in the dining room.
  • FIG. 5 is a figure which shows an example of the display screen of the information terminal installed in the bedroom.
  • FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building.
  • FIG. 7 is a diagram showing an example of a display screen when the notification is given.
  • FIG. 8 is a diagram showing a first example of the notified contents.
  • FIG. 9 is a diagram showing a second example of the notified contents.
  • FIG. 10 is a diagram showing a third example of the notified contents.
  • FIG. 11 is a figure which shows the 4th example of the content notified.
  • FIG. 12 is a diagram showing an example of a display screen for performing scene control when waking up.
  • FIG. 13 is a diagram showing an example of a display screen for performing scene control when returning home.
  • FIG. 14 is a diagram showing an example of a display screen for performing scene control when working from home.
  • FIG. 15 is a diagram showing an example of a display screen for performing scene control before going to bed.
  • FIG. 16 is a diagram showing an example of an application selection screen.
  • FIG. 17 is a diagram showing an example of a screen showing the air quality of each room.
  • FIG. 18 is a diagram showing an example of a detailed air quality screen of the living room.
  • FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used.
  • FIG. 20 is a diagram showing a second example of the screen showing the amount of electricity used.
  • FIG. 21 is a diagram showing a first example of a screen on which the home messenger application is being executed.
  • FIG. 22 is a diagram showing a second example of the screen on which the home messenger application is being executed.
  • FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of image of visitor imaged by doorphone).
  • FIG. 24 is a diagram showing a second example (doorphone / camera selection screen) of the screen during execution of the doorphone application.
  • FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen on which the message application is being executed.
  • FIG. 26 is a diagram showing a second example of a screen on which a message application is being executed (a screen for selecting a plurality of messages).
  • FIG. 27 is a diagram showing a first example of a screen on which a moving picture application is being executed.
  • FIG. 28 is a diagram showing a second example of a screen on which a moving picture application is being executed.
  • FIG. 29 is a diagram showing a third example of the screen on which the moving picture application is being executed.
  • FIG. 30 is a diagram showing a first example of a screen on which a music application is being executed.
  • FIG. 31 is a diagram showing a second example of a screen on which a music application is being executed.
  • FIG. 32 is a diagram showing a third example of the screen on which the music application is being executed.
  • FIG. 33 is a diagram showing a first example of a screen on which a photograph application is being executed.
  • FIG. 34 is a diagram showing a second example of the screen on which the photograph application is being executed.
  • FIG. 35 is a diagram showing a third example of the screen on which the photo application is being executed.
  • FIG. 36 is a diagram for explaining an example of presenting information by using an operation on a remote controller of an air conditioner as a trigger.
  • FIG. 37 is a diagram for explaining an example of presenting information by using an operation on a wall switch for turning on and off a lighting device as a trigger.
  • FIG. 38 is a diagram for explaining an example of presenting information by using an operation on a water heater as a trigger.
  • FIG. 39 is a diagram showing an example of a display screen of other information.
  • FIG. 40 is a diagram showing an example of a display screen of a weather warning.
  • FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key.
  • FIG. 42 is a diagram showing an example of a display screen recommending the control of the air purifier most suitable for pollen removal.
  • FIG. 43 is a diagram illustrating an example of a display screen that proposes improvement of a sleep state.
  • FIG. 44 is a diagram showing an example of a notification screen for the laundry timing.
  • FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothes.
  • FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays.
  • FIG. 47 is a diagram showing an example of a display screen that presents programs that are likely to suit the user's preference.
  • FIG. 48 is a diagram showing a first example of a display screen for producing a Christmas effect.
  • FIG. 49 is a diagram showing a second example of the display screen for performing the Christmas effect.
  • FIG. 50 is a diagram showing a configuration of a home screen of the information terminal according to the embodiment.
  • FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the information terminal.
  • FIG. 52 is a diagram showing an example of a push layer screen including a plurality of icons.
  • FIG. 53 is a diagram showing an example of a push layer screen in the night mode.
  • FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state.
  • FIG. 55 is a diagram showing an example of a screen for moving and deleting icons of devices.
  • FIG. 56 is a diagram for explaining the change of the display mode of the push layer screen.
  • FIG. 57 is a diagram for explaining a notification performed when the application layer screen is displayed.
  • FIG. 58 is a diagram for explaining an example in which the tutorial of the control layer is displayed when the screen of the control layer is first displayed.
  • FIG. 59 is a diagram showing an example of an icon for performing air conditioning in the entire building, which is displayed on the screen of the control layer.
  • FIG. 60 is a diagram showing screen transitions when the icon for the air conditioning in the entire building is operated.
  • FIG. 61 is a diagram showing an example of a control screen for the entire building air conditioning during the automatic save operation.
  • FIG. 62 is a diagram showing an example of a control screen for the entire building air conditioning in the outing mode.
  • FIG. 63 is a diagram showing an example of an icon for controlling an air conditioner displayed on the screen of the control layer.
  • FIG. 64 is a diagram showing screen transitions when the icon of the air conditioner is long-tap operated.
  • FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter is long-tap operated.
  • FIG. 72 is a diagram showing an example of an icon for controlling the electric lock displayed on the screen of the control layer.
  • FIG. 73 is a diagram showing screen transitions when a long tap operation is performed on the electric lock icon.
  • FIG. 74 is a diagram showing an example of an icon for controlling the air purifier displayed on the screen of the control layer.
  • FIG. 75 is a figure which shows a screen transition when the icon of an air purifier is long tap-operated.
  • FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state.
  • FIG. 77 is a diagram showing an initial setting screen and screen transition from the initial setting screen.
  • FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment. 79 is a flowchart of Operation Example 1 of the information terminal according to the embodiment. FIG. 80 is a flowchart of operation example 2 of the information terminal according to the embodiment. FIG. 81 is a flowchart of Operation Example 3 of the information terminal according to the embodiment.
  • each diagram is a schematic diagram and is not necessarily an exact illustration. Further, in each drawing, the same reference numerals are given to substantially the same configurations, and overlapping description may be omitted or simplified.
  • FIG. 1 is a front view of the information terminal according to the embodiment.
  • FIG. 2 is a perspective view of the information terminal according to the embodiment.
  • the information terminal 20 is a dedicated terminal used for a system (for example, a display control system described later) that provides services related to a new lifestyle centered on people.
  • the information terminal 20 can provide the user with a beautifully integrated new form of engagement with home appliances and home appliances. Further, the information terminal 20 can provide the user with a value tailored to the person who lives in cooperation with the server device.
  • the information terminal 20 is installed inside a building such as a house (for example, a wall).
  • the information terminal 20 includes a touch screen 21 and is used as an integrated remote controller for the user to control the devices installed in the building. According to the information terminal 20, it is not necessary to install a remote controller for each device, and thus complexity can be removed from the building.
  • FIG. 3 is a diagram showing an example of the display screen of the information terminal 20 installed at the entrance
  • FIG. 4 is a diagram showing an example of the display screen of the information terminal 20 installed at the dining room
  • FIG. It is a figure which shows an example of the display screen of the information terminal 20 installed in the bedroom.
  • the user can close the entrance key or the electric shutter in the living room from the bedroom, and turn off the air conditioners and lighting devices in the house from the entrance.
  • the information terminal 20 eliminates unnecessary information from a large amount of information and provides only necessary information to the user.
  • the device control function of the information terminal 20 eliminates the complicated functions that are common in conventional remote controllers or switches.
  • the information terminal 20 intuitively provides only necessary functions in daily life.
  • FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the whole building (in other words, to control a plurality of air conditioning devices).
  • the information terminal 20 is configured to be able to access the information that the user wants and the notification that the user does not want to miss with one tap.
  • the home screen of the information terminal 20 is notified of the status or notification of the device corresponding to the information terminal 20.
  • FIG. 7 is a diagram showing an example of a display screen when the notification is given. As shown in FIG. 7, for example, the user confirms a new recording immediately after returning home from the information terminal 20 installed at the entrance, or confirms a visitor of the intercom from the information terminal 20 installed in the study. be able to.
  • FIG. 8 to 11 are diagrams showing examples of notified contents.
  • the user can check and watch the new arrival recording from the entrance or any place he / she wants, immediately after returning home.
  • FIG. 9 according to the information terminal 20, the user can respond to the intercom apparatus from anywhere in the building and can confirm the history of absence.
  • FIG. 10 according to the information terminal 20, the user can confirm the completion of hot water in the bathtub from anywhere in the building.
  • FIG. 11 according to the information terminal 20, the user can also confirm the message left by someone in the family.
  • scene control The control for switching the environment in the building to the state desired by the user with one tap or a timer is also referred to as scene control.
  • scene control as long as the device corresponds to the information terminal 20, the device installed in any space (room) in the building can be controlled at once. For example, it is possible to put all the electric shutters, lighting equipment, and air conditioning equipment installed in a building into a state suitable for comfortable awakening, or to set necessary equipment at once when returning home.
  • FIG. 12 is a diagram showing an example of a display screen for performing scene control when waking up.
  • an alarm is sounded, an electric shutter is opened, and a lighting device is turned on (on. Control) is realized by a timer.
  • the scene control when waking up provides a comfortable wake-up for the user and makes the inside of the building an environment suitable for the morning hours.
  • FIG. 13 is a diagram showing an example of a display screen for performing scene control when returning home.
  • control such as opening an electric shutter, lighting an illumination device, or turning on an air conditioner is performed. Is realized with one tap. In other words, what you need when you go home is realized with one tap.
  • scene control is prepared in multiple preset types in advance, but the user can newly create and register it according to their preferences. For example, the user can newly create and register scene control for working from home and scene control before going to bed.
  • FIG. 14 is a diagram showing an example of a display screen for performing scene control when working from home.
  • the lighting device is dimmed and the set temperature of the air conditioning device is low.
  • FIG. 15 is a diagram showing an example of a display screen for performing scene control before going to bed, and is a diagram showing an example of a display screen for performing scene control before going to bed. Lighting equipment is dimmed, the electric shutter is closed, and the temperature setting of the air conditioning equipment is set to a low level, which makes it possible to create an environment in which the building can be comfortably introduced to sleep. .
  • the user can instruct scene control before going to bed not only from the information terminal 20 installed in the bedroom but also from the information terminal 20 installed in the living room or dining room.
  • FIG. 16 is a diagram showing an example of an application selection screen. If various applications are installed, the user can confirm the state of the air in the building and the state of the amount of electricity used in the building by selecting the application to be executed. The user can also check the television programs currently being broadcast and recorded programs. The information terminal 20 can also receive provision of a new application from the server device.
  • FIG. 17 is a diagram showing an example of a screen showing the air quality of each room
  • FIG. 18 is a diagram showing an example of a detailed screen of the air quality of the living room. If the screen as shown in FIG. 17 is displayed on the touch screen 21, the user can grasp the air quality of each room at a glance. If the screen as shown in FIG. 18 is displayed on the touch screen 21, the user can confirm the daily (or monthly) change in the air quality of the specific room.
  • the information terminal 20 can manage the air quality, for example, by acquiring a signal indicating the sensing result from a sensor that measures the air quality.
  • FIG. 19 is a diagram showing a first example of the screen showing the electricity usage amount
  • FIG. 20 is a diagram showing a second example of the screen showing the electricity usage amount.
  • the information terminal 20 manages the current or past electricity usage in the building for each branch circuit by acquiring a signal indicating the electricity usage from a distribution board or the like having a communication function installed in the building, for example. However, it can be provided to the user as an image.
  • the information terminal 20 acquires information indicating the amount of electricity used by another user (may be a general amount of electricity used) from the server device, and as a result, as shown in FIG.
  • the usage amount and the power usage amount of other users can be displayed side by side.
  • FIG. 21 is a diagram showing a first example of a screen on which a home messenger application is being executed
  • FIG. 22 is a diagram showing a second example of a screen on which a home messenger application is being executed. If the home messenger application is executed, the kitchen can tell the children's room that "rice is ready", or the entrance can tell the dining room that "you're home”. In other words, the possibility of communication between rooms expands.
  • FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of image of visitor imaged by doorphone). Further, if a camera for imaging the outside of the building is connected to the information terminal 20 by communication, the user can visually recognize the outside of the building through the information terminal 20.
  • FIG. 24 is a diagram showing a second example (doorphone / camera selection screen) of the screen during execution of the doorphone application.
  • FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen on which the message application is being executed.
  • FIG. 26 is a diagram showing a second example of a screen on which a message application is being executed (a screen for selecting a plurality of messages).
  • the message can be stored (that is, recorded) as a moving image or a still image, or can be stored (that is, recorded) as a voice.
  • the user selects the “movie” icon on the selection screen of FIG. 16 to receive the television program currently being broadcast and the information received by the tuner device that is communicatively connected to the information terminal 20. It is also possible to check the recorded program provided from the moving image content storage device communicatively connected to the terminal 20.
  • 27 to 29 are diagrams showing examples of screens during execution of a moving image application. Upon returning home, the user can check new recordings using the information terminal 20 installed at the entrance, or check the morning news using the information terminal 20 installed in the bedroom while changing clothes in the bedroom. You can In other words, the range of ways to interact with information in your life will expand.
  • the user can enjoy the music provided from the music content storage device communicatively connected to the information terminal 20 by selecting the “music” icon on the selection screen of FIG. 30 to 32 are diagrams showing examples of screens during execution of the music application.
  • the user can enjoy music in any room in which the information terminal 20 is installed. Further, if a separate speaker device is communicatively connected to the information terminal 20, it is possible to output music from the speaker device.
  • the user can enjoy the photo provided from the still image content storage device communicatively connected to the information terminal 20 by selecting the “photo” icon in the selection screen of FIG. 33 to 35 are diagrams showing examples of screens during execution of the photo application.
  • the user can enjoy the photograph in any room where the information terminal 20 is installed.
  • the information terminal 20 is a user's daily life activities such as “lighting the lighting device”, “turning off the power to the air conditioner", and “heating the bath” as a trigger, which leads to a better life, Alternatively, it is possible to present an optimal experience and the like (specifically, content or function) according to the situation. That is, the information terminal 20 can present information to the user, triggered by the user's operation on the device.
  • FIG. 36 is a diagram for explaining an example of presenting information by using an operation on a remote controller of an air conditioner as a trigger.
  • the information terminal 20 uses this as a trigger to reduce the power consumption of the air conditioning equipment.
  • Displaying advice on how to use the air conditioner to reduce the power consumption for example, if the user leaves the room for about one hour, the power consumption is lower when the power is on) ((b) in FIG. 36). ).
  • FIG. 37 is a diagram for explaining an example of presenting information by using an operation on a wall switch for turning on and off the lighting device as a trigger.
  • the information terminal 20 displays the dimming setting suitable for the midnight time period using this as a trigger ( FIG. 37 (b)).
  • FIG. 38 is a diagram for explaining an example of presenting information by using an operation on the water heater as a trigger.
  • the information terminal 20 uses this as a trigger to display an image recommending bathing goods that enriches bath time. indicate.
  • the information terminal 20 can present various information triggered by the user's operation on the device.
  • 36 to 38 show examples of information presentation. Various information can be presented depending on the combination of devices connected to the information terminal 20 and various services.
  • the information terminal 20 combines a device use log, date and time data, weather information provided from a server device (cloud server), and the like to protect the safety and health of the family, advice to help housework hurt, and , It is also possible to provide recommended contents that match the tastes of the family.
  • FIG. 39 is a diagram showing an example of a display screen of such other information. Hereinafter, a specific example of information that can be presented by the information terminal 20 will be described.
  • the information terminal 20 can display that it is a stormy weather and a weather warning by being provided with weather information (in other words, weather information) from the server device, for example.
  • FIG. 40 is a diagram showing an example of a display screen of a weather warning.
  • the information terminal 20 can support the peace of mind of the family by being in stormy weather and displaying a weather warning.
  • the information terminal 20 can display a notification screen for preventing forgetting to lock the key based on the state of the electric lock and the time zone.
  • FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key.
  • the information terminal 20 can support the peace of mind of the family by giving a notification for preventing forgetting to lock the key.
  • the information terminal 20 can recommend the control of the air purifier that is most suitable for pollen removal, depending on the pollen information and the situation at home.
  • FIG. 42 is a diagram showing an example of a display screen recommending the control of the air purifier most suitable for pollen removal.
  • the information terminal 20 can support the health of the family by recommending control of the air purifier that is most suitable for pollen removal.
  • the information terminal 20 can estimate the sleep condition of the user from the usage log of the lighting device and the electric shutter, and can make a proposal regarding improvement of the sleep state.
  • FIG. 43 is a diagram illustrating an example of a display screen that proposes improvement of a sleep state.
  • the information terminal 20 can support the health of the family by making a proposal regarding improvement of the sleep state.
  • the information terminal 20 can notify the best washing timing by receiving, for example, weather information (in other words, information on a weather API (Application Programming Interface)) from the server device.
  • FIG. 44 is a diagram showing an example of a notification screen for the laundry timing.
  • the information terminal 20 can also recommend drying the room in a season when there is a lot of pollen.
  • the information terminal 20 can support the housework by notifying the laundry timing.
  • the information terminal 20 can make a proposal regarding clothes (thick or light) based on the difference between the average temperature of the week included in the weather information provided from the server device and the temperature of the day.
  • FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothes.
  • the information terminal 20 can also suggest carrying a rain gear on a rainy day.
  • the information terminal 20 can alert the user about ultraviolet rays during the day (morning to daytime) based on the ultraviolet ray index included in the weather information provided from the server device.
  • FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays.
  • the information terminal 20 can support the beauty of the user by calling attention to ultraviolet rays.
  • the information terminal 20 can record and present a program that is likely to suit the user's preference from the viewing history of the television and the recording log of the moving image content storage device.
  • FIG. 47 is a diagram showing an example of a display screen that presents programs that are likely to suit the user's preference.
  • the information terminal 20 can perform special device control on an anniversary or the like.
  • the information terminal 20 displays a display screen for performing a Christmas effect using the device at Christmas.
  • 48 and 49 are diagrams each showing an example of a display screen for performing a Christmas effect. When the user's approval is obtained through such a display screen, a Christmas presentation is performed by the speaker (music) and the lighting device (light) in the room where the information terminal 20 is installed.
  • FIG. 50 is a diagram showing the configuration of the home screen of the information terminal 20.
  • the home screen of the information terminal 20 has (a) “Apps Layer (application layer)”, (b) “Push Layer (push layer)”, and (c) “Control Layer (control layer)”.
  • Layer) has a three-story structure (three-layer structure).
  • the push layer serves as a base point and a swipe operation is performed on the touch screen 21 from the top to the bottom while the push layer screen is displayed, the screen transitions to the application layer screen.
  • the touch screen 21 is swiped in the direction from the bottom to the top while the push layer screen is displayed, the screen changes to the control layer screen.
  • the push layer is a layer of push-type interaction that is the basis of the information terminal 20 such as recommendation and notification.
  • information such as a notification or a recommendation transmitted from a device that is communicatively connected to the information terminal 20 from the device as a starting point is displayed.
  • the information terminal 20 detects the presence / absence of a user around the information terminal 20 by a human sensor or the like, and the user is in the vicinity of the information terminal 20 (that is, near the information terminal 20). ) Displays information such as notifications or recommendations on the screen. On the other hand, when the user is not around the information terminal 20 (that is, near the information terminal 20), the information terminal 20 does not display the information such as the notification or the recommendation to be displayed on the screen.
  • FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the information terminal 20.
  • FIG. 52 is a diagram showing an example of a push layer screen including a plurality of icons.
  • the plurality of icons are arranged in a line in the left-right direction in the order of the generated time, for example, the one having a newer time when the information is generated is on the left side.
  • a horizontal swipe operation in other words, scroll operation
  • the icon is scrolled.
  • the display areas of time, date, and weather are maintained (fixed).
  • the screen changes to the screen of the application layer or the screen of the control layer related to the information indicated by the icon.
  • FIG. 53 is a diagram showing an example of a push layer screen in such a night mode.
  • the control layer is a layer for individually controlling the devices grouped for each device category and place (room), such as turning off lighting devices in the kitchen and setting air conditioning in the whole building.
  • the user can turn the device on and off without screen transition by tapping the device icon included in the control layer screen. That is, the user can simply control the device. Also, the user can perform detailed control of the device by long-tap operation of the device icon.
  • Respective icons of a plurality of devices are displayed in different modes (for example, in different colors) according to the on and off states so that the on and off states of the devices can be seen at a glance.
  • the icon of the device is displayed in color
  • the icon of the device is displayed in monochrome (grayscale, washout).
  • FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state.
  • the device icon may include characters indicating the operating state of the device.
  • the device icons are arranged in a line in the left-right direction, and when a left-right swipe operation (in other words, scroll operation) is performed on the icon display area, the icon is scrolled. .
  • the icon located on the rightmost side of the touch screen 21 in the default state is displayed so that a part of the icon is interrupted so that the user can be informed that the icons of a plurality of devices scroll.
  • the icons of multiple devices are arranged in the order according to the place (room) where the devices are installed.
  • an icon for example, a scene control icon
  • a room for example, a living room
  • the icon of the device installed in is placed.
  • icons of devices installed in the room closest to the living room are arranged.
  • the icon of the device installed in a room closer to the room in which the information terminal 20 is installed is located on the left side (in other words, in the default state (initial state) where it is easily accessible). Will be placed. That is, the icons of the plurality of devices are arranged in an order based on the installation positions of the devices (in other words, an order related to the installation positions).
  • the icons on the relatively left side of the icons of the multiple devices are located on the screen in the default state, but are on the relatively right side. Is not on the screen in the default state and appears on the screen only after scrolling.
  • a jump shortcut (characters indicating a place (space) in the building such as “all rooms”, “living room”, and “kitchen”) is provided at the lower left of the screen of the control layer. By tapping the jump shortcut, the user can position the icon of the device installed at the location indicated by the tapped character on the screen (a plurality of icons automatically scroll).
  • FIG. 55 is a diagram showing an example of a screen for moving and deleting icons of devices.
  • the user can change the arrangement (left-right positional relationship) of the device icon by performing a drag-and-drop operation on the device icon on the device icon movement / deletion screen.
  • the application layer is used to check the power consumption in the building and watch a video.
  • multiple icons are categorized according to the user's desired action or experience action.
  • new applications provided by the developer and new services provided in the future are added to the application layer.
  • the application program described in FIGS. 16 to 35 can be executed from the application layer screen.
  • What can be executed from the application layer and what can be executed from the control layer are classified as follows, for example.
  • What can be executed from the application layer is equipment that is easy to add and change, such as so-called home appliances (equipment that is not fixed to the wall of the building), and equipment (lighting equipment and air conditioning equipment that is fixed to the wall of the building, etc.).
  • Device but refers to control of a device that operates by referring to information.
  • control layer what can be executed from the control layer is control of equipment. In some cases, the same control can be executed from both the application layer and the control layer.
  • the display mode of the push layer screen may be changed according to the distance between the information terminal 20 and a person standing in front of the information terminal 20. That is, the information terminal 20 may automatically switch the display according to the distance to the user.
  • FIG. 56 is a diagram for explaining the change of the display mode of the push layer screen.
  • the push layer screen is displayed when the user is located within 1 m from the information terminal 20 (for example, while the user is operating the information terminal 20 or in front of the information terminal 20).
  • Standing state is displayed in the normal state.
  • the push layer screen is displayed in an ambient state when the user is located within a range of 1 m or more and less than 3 m from the information terminal 20 (when the user is in the room where the information terminal 20 is installed).
  • the screen of the push layer is in a sleep state (for example, black when the user is located 3 m or more away from the information terminal 20 (for example, when the user is not in the room where the information terminal 20 is installed)).
  • Image for example, black when the user is located 3 m or more away from the information terminal 20 (for example, when the user is not in the room where the information terminal 20 is installed).
  • Ambient state means a state in which the presence or absence of a notification can be confirmed even from a distant position while taking care not to insist on the notification too much.
  • the push layer screen in the ambient state is realized, for example, by displaying the time and the notification icon on a white background.
  • the information that the user always wants to display may be changed by the user setting.
  • the information that the user always wants to display includes, specifically, time, weather, outdoor temperature and humidity, indoor temperature and humidity, air quality (in other words, the degree of contamination of air. Smell, and PM2. 5 concentration, etc., power consumption, power generation amount of solar power generation system, family schedule, what day is today, etc.
  • the information that the user always wants to display may be considered such that the user can visually recognize it even from a slightly distant position, for example, by enlarging the characters or the display.
  • FIG. 57 is a diagram for explaining a notification performed when the application layer screen is displayed. Although not shown, the same applies to the notification given when the screen of the control layer is displayed.
  • the content of the notification is superimposed and displayed on the upper part of the screen of the application layer. While the application is being executed, the notification is not displayed on the application execution screen (screens shown in FIGS. 17 to 35), and when the execution screen returns to the app layer screen, the notification content is superimposed on the upper part of the screen. It When the area on which the notification content is superimposed is tap-operated, for example, the notification ends and the state returns to the state of (a) of FIG.
  • a screen for controlling the device is displayed.
  • Notifications that are normally performed as push notifications include, for example, notification of the anniversary of the installation of the information terminal 20, notification of the birthday of the user or family, notification of an important message, notification of abnormal temperature and humidity, and opening of the electric shutter.
  • the notification includes a notification of the time, a notification when the electric lock is opened, and a notification regarding the delivery box.
  • the forced priority push notification is a notification that requires immediate response from the user like an incoming call, in other words, it wants to be notified immediately regardless of any operation (more important than normal push notification). It is a notification. As shown in (a) of FIG. 57 and (c) of FIG. 57, when the forced priority push notification is required, the entire screen is switched to the notification screen even during the operation.
  • Examples of the notification given as the forced priority push notification include, for example, a power failure (cooperative / non-cooperative) notification, a power overuse notification (peak alarm), a notification indicating a visitor by an intercom device ((c) in FIG. 57), Calls from other rooms (that is, other information terminals 20) are included.
  • the information terminal 20 displays a tutorial (specifically, an outline of what can be done with the application and typical operations) when the application or the like is activated for the first time.
  • FIG. 58 is for explaining an example in which the tutorial of the control layer is displayed ((c) of FIG. 58) when the screen of the control layer is first displayed ((a) and (b) of FIG. 58).
  • FIG. 58 is for explaining an example in which the tutorial of the control layer is displayed ((c) of FIG. 58) when the screen of the control layer is first displayed ((a) and (b) of FIG. 58).
  • Animation in other words, video is used to display the tutorial.
  • a balloon or a character is displayed on the screen, or an animation for predicting an operation is displayed on the screen. Accordingly, the information terminal 20 can present the operation method to the user in an easy-to-understand manner.
  • the tutorial by removing the amount of information (words and contents, etc.), it is possible to prevent users from feeling stress.
  • the tutorial is configured to advance to the next item by a user operation such as a swipe operation so that the user can quickly access a necessary portion, and this can prevent the user from feeling annoying.
  • a user operation such as a swipe operation so that the user can quickly access a necessary portion, and this can prevent the user from feeling annoying.
  • Detailed functions and operating instructions are described in the online manual, and the information terminal 20 displays a guide so that the user can smoothly reach the place where the online manual is described.
  • FIG. 59 is an example of an icon (hereinafter, also simply referred to as an entire building air conditioning icon) for performing the entire building air conditioning displayed on the screen of the control layer (specifically, an icon corresponding to the state of the entire air conditioning). It is a figure which shows an example of a change.
  • FIG. 60 is a diagram showing screen transitions when the icon for the air conditioning in the entire building is operated.
  • the entire building air conditioning icon is not grouped (in other words, associated) with the "all rooms" tab on the control layer screen, for example.
  • the entire building air conditioning is basically always on and is not suitable for single tap operation. Therefore, even if either single tap operation or long tap operation is performed on the entire building air conditioning icon, the modal shown in FIG. A window is displayed.
  • the entire building air conditioning may have a specification that cannot be turned off from the information terminal 20.
  • FIG. 61 is a diagram showing an example of the control screen for the entire building air conditioning during the automatic save operation
  • FIG. 62 is a diagram showing an example of the control screen for the whole building air conditioning in the outing mode (during outing). These control screens are displayed only when an operation is performed from the original remote controller of the air conditioning system in the whole building.
  • FIG. 63 is an example of an icon (hereinafter, also simply referred to as an icon of an air conditioner) for controlling the air conditioner displayed on the screen of the control layer (specifically, an icon corresponding to the state of the air conditioner).
  • FIG. 4 is a diagram showing an example of the change of FIG.
  • FIG. 64 is a diagram showing screen transitions when the icon of the air conditioner is long-tap operated.
  • FIG. 65 is an example of an icon (hereinafter, also simply referred to as a heat pump water heater icon) for controlling the heat pump water heater displayed on the screen of the control layer (specifically, a heat pump water heater).
  • FIG. 4 is a diagram showing an example of change of an icon according to the state of FIG.
  • FIG. 66 is a first diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater.
  • FIG. 67 is a second diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater. Similar icons are used for the gas water heater, and similar screen transitions are performed.
  • FIG. 68 is an example of an icon (specifically, also referred to as an icon of the fuel cell system, hereinafter) for controlling the water heater provided in the fuel cell system, which is displayed on the screen of the control layer (specifically, fuel). It is a figure which shows an example of a change of the icon according to the state of the water heater with which a battery system is equipped.
  • FIG. 69 is a diagram showing screen transitions when a long tap operation is performed on the icon of the fuel cell system.
  • FIG. 70 shows an example of an icon (hereinafter, also simply referred to as an electric shutter icon) for controlling the electric shutter displayed on the screen of the control layer (specifically, depending on the state of the electric shutter). It is a figure which shows an example of a change of an icon. As shown in FIG. 70, during the operation of the electric shutter, the icon is animated to present the state of the electric shutter to the user in an easy-to-understand manner. A similar icon (the title of the icon is changed from "shutter” to "blind”) is also used for the electric blind.
  • FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter (or the electric blind) is long-tap operated.
  • a long-tap operation is performed on the electric shutter icon grouped (in other words, associated) with the “all rooms” tab on the control layer screen, a plurality of electric shutters in the building are collectively controlled.
  • the icon of the electric shutter grouped in each room tab on the screen of the control layer is long-tap operated, the electric shutter installed in the room is controlled.
  • FIG. 72 shows an example of an icon (hereinafter, also simply referred to as an electric lock icon) for controlling the electric lock displayed on the screen of the control layer (specifically, depending on the state of the electric lock). It is a figure which shows an example of a change of an icon.
  • FIG. 73 is a diagram showing screen transitions when a long tap operation is performed on the electric lock icon.
  • the electric lock icon grouped in the "All rooms" tab on the control layer screen is long-tapped, a plurality of electric locks in the building are collectively controlled.
  • the electric lock icon grouped in each room tab on the screen of the control layer is long-tap operated, the electric lock installed in the room is controlled.
  • FIG. 74 shows an example of an icon for controlling the air purifier (hereinafter, also simply referred to as an air purifier icon) displayed on the screen of the control layer (specifically, the state of the air purifier).
  • FIG. 6 is a diagram showing an example of change of an icon according to FIG.
  • FIG. 75 is a figure which shows a screen transition when the icon of an air purifier is long tap-operated.
  • FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state.
  • 76 (a) is a diagram showing an example of a screen when the system is abnormal
  • FIG. 76 (b) is a diagram showing an example of a screen when offline.
  • irregular states are classified into, for example, a detached state, an indefinite state, and a failure state.
  • the detached state means a state in which the communication connection between the information terminal 20 and the device is lost
  • the indefinite state is a state in which the information terminal 20 and the device are communicatively connected but it takes time to detect a numerical value (for example, starting State).
  • the failure state means that the device itself is out of order.
  • FIG. 77 is a diagram showing such an initial setting screen and screen transition from the initial setting screen. As shown in FIG. 77, when inputting the name of the installation place on the initial setting screen ((a) of FIG. 77), the screen changes to the input screen ((b) of FIG. 77).
  • the screen ((c) in Fig. 77) notifying that the initial settings are completed is displayed.
  • a predetermined operation in the example of FIG. 77, a swipe operation in the upward direction
  • the screen changes to the push layer screen ((d) of FIG. 77).
  • the tutorial screen is automatically displayed as a modal window as described above ((e) in FIG. 77).
  • FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment.
  • the display control system 10 is a system that displays an image for controlling the control target devices (the first control target device 41 and the second control target device 42).
  • the display control system 10 includes an information terminal 20, a control device 30, a first control target device 41, a second control target device 42, a sensor 43, and a server device 50.
  • the information terminal 20, the control device 30, the first control target device 41, the second control target device 42, and the sensor 43 are installed in, for example, a building such as a house or the site of the building.
  • the information terminal 20 is a device that functions as a user interface device related to device control.
  • the information terminal 20 is directly or indirectly communicatively connected to a plurality of devices installed in a building.
  • the information terminal 20 is directly or indirectly connected to a control target device including a home appliance, a home electric appliance, or the like via a control device.
  • the information terminal 20 is installed on the wall inside the building, for example.
  • the information terminal 20 includes a touch screen 21, a control unit 22, a storage unit 23, a communication unit 24, and an imaging unit 25.
  • the touch screen 21 includes an operation unit 21a that receives a user operation and a display unit 21b that displays an image (moving image or still image).
  • the operation unit 21a is, for example, a capacitance type touch panel, but may be a resistive film type touch panel.
  • the display unit 21b is, for example, a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel.
  • the control unit 22 performs control for operating the controlled device according to the operation received by the operation unit 21a and control for displaying an image on the display unit 21b.
  • the control unit 22 is realized by, for example, a microcomputer, but may be realized by a processor.
  • the storage unit 23 is a storage device in which a control program executed by the control unit 22 is stored.
  • the storage unit 23 is realized by, for example, a semiconductor memory.
  • the communication unit 24 is a communication circuit (in other words, a communication module) for the information terminal 20 to communicate with the control device 30, the second controlled device 42, and the server device 50.
  • the communication unit 24 transmits a control request for the control target device to the control device 30 based on the control of the control unit 22, for example. Further, the communication unit 24 transmits a control signal for controlling the second control target device 42 to the second control target device 42 based on the control of the control unit 22.
  • the communication unit 24 receives, for example, a signal indicating the sensing result from the sensor.
  • the communication unit 24 performs wireless communication, for example, but may perform wired communication.
  • the communication standard of communication performed by the communication unit 24 is not particularly limited.
  • the image capturing unit 25 captures an image in front of the information terminal 20.
  • the imaging unit 25 is, for example, an example of a user recognition unit that captures an image of the face of the user located in front of the information terminal 20.
  • the imaging unit 25 is specifically a camera realized by a lens, an image sensor, and the like.
  • the control device 30 is, for example, a HEMS (Home Energy Management System) controller, and controls the first control target device 41 based on a control request transmitted by the communication unit 24.
  • the control device 30 is not limited to the HEMS controller having the energy management function, and may be another home controller having no energy management function or a gateway device.
  • the first controlled device 41 is a device controlled by the control device 30 and is indirectly connected to the information terminal 20 so as to be communicable. Specifically, the first control target device 41 operates based on a control signal transmitted from the control device 30.
  • the first control target device 41 includes, for example, a storage battery system, a fuel cell system, a solar power generation system, a lighting device, a heat pump water heater, an electric shutter, or a device such as an electric lock.
  • wireless communication based on a communication standard such as Echonet Lite (registered trademark) is performed.
  • the second controlled device 42 is a device controlled by the information terminal 20 and is directly communicably connected to the information terminal 20.
  • the second controlled device 42 specifically operates based on a control signal transmitted from the information terminal 20.
  • the second control target device 42 includes, for example, a device such as an intercom device or an air conditioning device.
  • the device described as the first control target device 41 may be included in the second control target device 42, and the device described as the second control target device 42 may be included in the first control target device 41.
  • the equipment to be controlled may include household equipment or household appliances.
  • the sensor 43 senses the environment inside the building and sends a signal indicating the sensing result to the information terminal 20. Thereby, the information terminal 20 can display the environment inside the building. The information terminal 20 can also control the control target device based on the environment inside the building.
  • the sensor 43 includes a pressure sensor, a temperature sensor, a humidity sensor, an illuminance sensor, or the like.
  • the server device 50 is a cloud server. Various services are realized by the cooperation of the server device 50 and the information terminal 20.
  • the second information terminal 60 is a mobile terminal such as a smartphone or a tablet terminal that the user possesses.
  • FIG. 79 is a flowchart of the operation example 1 of the information terminal 20.
  • the operation in FIG. 79 corresponds to the operation in FIG. 58 (or FIG. 77), and will be described below with reference to FIGS. 58 and 79.
  • the information terminal 20 includes a plurality of home appliances or home appliances as at least control targets, and is directly or indirectly connected to these via the control device 30. , And performs individual control together with the status display of each control target.
  • the display unit 21b displays, in a list, at least a part of the control targets assigned to each room among the control targets.
  • the operation unit 21a is for selecting an individual control target from the display unit 21b and operating the selected control target.
  • the storage unit 23 records at least information regarding the first operation of the control target in the operation unit 21a.
  • the information on the first operation is, for example, count information indicating the number of operations or operation history information indicating the operation history.
  • the operation unit 21a receives selection of each control target from the list display (S11).
  • the control unit 22 refers to the storage unit 23 and determines whether or not information regarding the first operation of the control target is stored (S12).
  • the control unit 22 can perform the control target. And the typical operation are displayed on the display unit 21b (S13). Further, the control unit 22 causes the display unit 21b to display at least a part of the content that the user experiences with the operation unit 21a as a moving image (S14). In other words, a tutorial about the controlled object is displayed as a video.
  • control target When the control target is an air conditioner, frequently used operations such as cooling, heating, and dehumidification, and changes in the room when each operation is performed, etc. are shown as moving images from the user's perspective.
  • control target when the control target is an intercom, operations such as calling with a visitor, confirming the situation outside the front door and absent visitor, and operations such as information obtained when each operation is performed are illustrated. To be done.
  • control unit 22 when it is determined that the information about the first operation of the control target is stored (Yes in S12), the control unit 22 does not perform the processes of step S14 and step S13.
  • a moving image showing at least a part of the outline of what can be done with the control target, typical operations, and the contents to be experienced is displayed on the display unit 21b. Is displayed, the user can easily operate the information terminal 20 without feeling stress.
  • the determination as to whether or not the first operation has been performed may be performed for each user, and information regarding the first operation may be managed for each user. That is, the determination as to whether the first operation has been performed may be performed by distinguishing the user who performed the operation.
  • the information terminal 20 includes an imaging unit 25 as a user recognition unit that recognizes each user.
  • the image capturing unit 25 captures a face image of a user who operates the information terminal 20, and the control unit 22 determines which of the user's face images the captured image is registered in advance. This determination is realized by the existing face recognition technology.
  • the control unit 22 records, in the storage unit 23, information regarding the first operation of the control target for each user.
  • FIG. 80 is a flowchart of an operation example 2 of the information terminal 20.
  • the operation of FIG. 80 corresponds to that of FIG. 58, and will be described below with reference to FIGS. 58 and 80.
  • the following operation example 2 may be performed not only at the first startup but also at the second and subsequent startups.
  • the operation unit 21a receives selection of each control target from the list display (S21).
  • the control unit 22 determines whether the state of the control target has changed and the user's operation is required (S22).
  • the control unit 22 determines that the state of the control target has changed and the user's operation is necessary (Yes in S22)
  • the control unit 22 causes the display unit 21b to display an alert display indicating the operation to be performed by the user ( S23).
  • the alert display is a display for guiding the user's operation.
  • the alert display is, for example, blinking, blinking, magnifying, moving image of the operation icon, a balloon character for the operation icon, or the like.
  • the state of the controlled intercom changes from the standby state to the calling state. Since the resident needs to respond to the visitor, the blinking of the response button is illustrated as an alert display.
  • control unit 22 does not determine that the state of the control target has changed and the user's operation is required (No in S22), the control unit 22 does not perform the process of Step S22.
  • the attention display indicating the operation to be performed by the user is displayed on the display unit 21b, the user can easily operate the information terminal 20 without feeling stress. Become.
  • FIG. 81 is a flowchart of Operation Example 3 of the information terminal 20.
  • the operation of FIG. 81 corresponds to the operation of FIG. 58, and will be described below with reference to FIGS. 58 and 81.
  • the following operation example 3 may be performed not only at the first startup but also at the second and subsequent startups.
  • the operation unit 21a receives the selection of each control target from the list display (S31).
  • the control unit 22 adjusts the state of the selected control target, detailed operation for acquiring detailed operation information necessary for the user to operate the control target from the second information terminal 60.
  • the link information is output (S32).
  • the detailed operation information is information indicating the content of the operation on the operation unit 21a for controlling the control target.
  • Detailed operation information is, for example, an online manual.
  • the control unit 22 causes the display unit 21b to display the detailed operation link information as a barcode or a two-dimensional code.
  • An example of the two-dimensional code is a QR code (registered trademark).
  • the user can easily access the detailed operation information by operating the second information terminal 60 and reading the barcode or the two-dimensional code displayed on the display unit 21b.
  • control unit 22 may output the detailed operation link information to the second information terminal 60 via the communication unit 24.
  • the communication unit 24 in this case is an example of a wireless communication unit. Thereby, the user can easily access the detailed operation information using the second information terminal 60.
  • the user can smoothly reach detailed operation information in which detailed functions and operation explanations are described, so that the user can easily operate the information terminal 20 without feeling stress. It becomes possible to do.
  • the processing executed by a specific processing unit may be executed by another processing unit.
  • part or all of the processing performed by the information terminal may be performed by the control device or the server device.
  • the communication method between the devices in the above embodiment is not particularly limited. Wireless communication may be performed between devices, or wired communication may be performed. In addition, wireless communication and wired communication may be combined between the devices. Further, in the above embodiment, when two devices communicate with each other, a relay device (not shown) may be interposed between the two devices.
  • each component may be realized by executing a software program suitable for each component.
  • Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.
  • each component may be realized by hardware.
  • each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole or may be separate circuits. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.
  • a recording medium such as a system, a device, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM.
  • the system, the device, the method, the integrated circuit, the computer program, and the recording medium may be implemented in any combination.
  • the present invention may be realized as a display control method executed by a computer such as a display control system, or may be realized as a program for causing a computer to execute such a display control method.
  • the present invention may be realized as an operation support program for causing an information terminal to realize the functions described in the above operation examples 1 to 3.
  • the present invention may be realized as a computer-readable non-transitory recording medium in which such a program is recorded.
  • the display control system is realized by a plurality of devices, but it may be realized as a single device.
  • the display control system may be realized as, for example, a single device corresponding to an information terminal, a single device corresponding to a control device, or a single device corresponding to a server device. May be realized as.
  • the components included in the display control system may be distributed to the plurality of devices in any way.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Lorsqu'une opération de sélection d'un objet à contrôler est reçue par une unité d'exploitation (21a) pendant l'affichage d'une liste et qu'il est déterminé par référence à une unité de stockage (23) que les informations relatives à une opération initiale de l'objet à contrôler n'ont pas été stockées dans l'unité de stockage (23), ce terminal d'information (20) fait afficher par une unité d'affichage (21b) un tutoriel relatif à l'objet à contrôler sous la forme d'une image animée.
PCT/JP2019/026381 2018-10-25 2019-07-02 Terminal d'information et programme de support aux opérations WO2020084837A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2020552519A JP7033724B2 (ja) 2018-10-25 2019-07-02 情報端末、及び、操作支援プログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862750530P 2018-10-25 2018-10-25
US62/750,530 2018-10-25

Publications (1)

Publication Number Publication Date
WO2020084837A1 true WO2020084837A1 (fr) 2020-04-30

Family

ID=70330705

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/026381 WO2020084837A1 (fr) 2018-10-25 2019-07-02 Terminal d'information et programme de support aux opérations

Country Status (2)

Country Link
JP (1) JP7033724B2 (fr)
WO (1) WO2020084837A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003259465A (ja) * 2002-03-04 2003-09-12 National Institute Of Advanced Industrial & Technology ネットワーク制御システム
WO2014024428A1 (fr) * 2012-08-07 2014-02-13 パナソニック株式会社 Procédé de commande de dispositif, système de commande de dispositif et dispositif de serveur
JP2016111674A (ja) * 2014-11-28 2016-06-20 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 遠隔操作方法、及び遠隔操作システム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003259465A (ja) * 2002-03-04 2003-09-12 National Institute Of Advanced Industrial & Technology ネットワーク制御システム
WO2014024428A1 (fr) * 2012-08-07 2014-02-13 パナソニック株式会社 Procédé de commande de dispositif, système de commande de dispositif et dispositif de serveur
JP2016111674A (ja) * 2014-11-28 2016-06-20 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 遠隔操作方法、及び遠隔操作システム

Also Published As

Publication number Publication date
JP7033724B2 (ja) 2022-03-11
JPWO2020084837A1 (ja) 2021-09-16

Similar Documents

Publication Publication Date Title
US11372433B2 (en) Thermostat user interface
US9952573B2 (en) Systems and methods for a graphical user interface of a controller for an energy-consuming system having spatially related discrete display elements
US10778461B2 (en) Appliance control system, home controller, remote control method, and recording medium
US10637679B2 (en) Smart home scene switching method and system
US10591877B2 (en) Building automation remote control device with an in-application tour
US11372530B2 (en) Using a wireless mobile device and photographic image of a building space to commission and operate devices servicing the building space
JP5882391B2 (ja) エネルギーマネジメントコントローラ、エネルギーマネジメントシステム、エネルギーマネジメント方法、及び、プログラム
JP7122615B2 (ja) 表示制御方法、及び、表示制御システム
JP7042454B2 (ja) 情報端末、及び、情報端末の操作プログラム
WO2020084836A1 (fr) Procédé de commande d'affichage et système de commande d'affichage
JP7033724B2 (ja) 情報端末、及び、操作支援プログラム
WO2020084835A1 (fr) Procédé de commande d'affichage et système de commande d'affichage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19876506

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020552519

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19876506

Country of ref document: EP

Kind code of ref document: A1