WO2020084836A1 - Display control method and display control system - Google Patents

Display control method and display control system Download PDF

Info

Publication number
WO2020084836A1
WO2020084836A1 PCT/JP2019/026380 JP2019026380W WO2020084836A1 WO 2020084836 A1 WO2020084836 A1 WO 2020084836A1 JP 2019026380 W JP2019026380 W JP 2019026380W WO 2020084836 A1 WO2020084836 A1 WO 2020084836A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
display
control
layer
diagram showing
Prior art date
Application number
PCT/JP2019/026380
Other languages
French (fr)
Japanese (ja)
Inventor
茉那 中川
亮太 内田
貴生 小川
かほる 居相
賢二 中北
力也 増田
今出　昌宏
明子 藤瀬
敬市郎 山縣
昌史 森光
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Priority to JP2020552518A priority Critical patent/JPWO2020084836A1/en
Publication of WO2020084836A1 publication Critical patent/WO2020084836A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present invention relates to a display control method and a display control system for displaying the status of residential IoT (Internet of Things) equipment such as residential equipment and home appliances.
  • residential IoT Internet of Things
  • Echonet Lite registered trademark
  • KNX registered trademark
  • the present invention provides a display control method and a display control system capable of notifying a user of the status of a device.
  • a display control method is a display control method executed by a computer, the first display layer having a display object of a first category, which is a user interface for notifying a state of a device. Acquiring information about a first touch on the touch screen performed while is displayed on the touch screen, and the information about the first touch includes movement of the touch position in the first direction.
  • a program according to one aspect of the present invention is a program for causing a computer to execute the display control method.
  • a display control system is performed while a first display layer having display objects of a first category, which is a user interface for notifying a state of a device, is displayed on a touch screen.
  • the acquisition unit that acquires information regarding the first contact with respect to the touch screen and the information regarding the first contact include movement of the contact position in the first direction, from the first display layer
  • a control unit that shifts to a second display layer having a display object of a second category different from the first category, the control unit acquires the state of the device, and the second display layer is When the state of the device changes while being displayed on the touch screen, a display object that notifies the change in the second display layer. -Objects to display.
  • the display control method and display control system of the present invention can notify the user of the status of the device.
  • FIG. 1 is a front view of a display device according to an embodiment.
  • FIG. 2 is a perspective view of the display device according to the embodiment.
  • FIG. 3 is a diagram showing an example of a display screen of a display device installed at the entrance.
  • FIG. 4 is a diagram showing an example of a display screen of a display device installed in a dining room.
  • FIG. 5 is a diagram showing an example of a display screen of a display device installed in the bedroom.
  • FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building.
  • FIG. 7 is a diagram showing an example of a display screen when the notification is given.
  • FIG. 8 is a diagram showing a first example of the notified contents.
  • FIG. 9 is a diagram showing a second example of the notified contents.
  • FIG. 10 is a diagram showing a third example of the notified contents.
  • FIG. 11 is a figure which shows the 4th example of the content notified.
  • FIG. 12 is a diagram showing an example of a display screen for performing scene control when waking up.
  • FIG. 13 is a diagram showing an example of a display screen for performing scene control when returning home.
  • FIG. 14 is a diagram showing an example of a display screen for performing scene control when working from home.
  • FIG. 15 is a diagram showing an example of a display screen for performing scene control before going to bed.
  • FIG. 16 is a diagram showing an example of an application selection screen.
  • FIG. 17 is a diagram showing an example of a screen showing the air quality of each room.
  • FIG. 18 is a diagram showing an example of a detailed air quality screen of the living room.
  • FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used.
  • FIG. 20 is a diagram showing a second example of the screen showing the amount of electricity used.
  • FIG. 21 is a diagram showing a first example of a screen on which the home messenger application is being executed.
  • FIG. 22 is a diagram showing a second example of the screen on which the home messenger application is being executed.
  • FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of image of visitor imaged by doorphone).
  • FIG. 24 is a diagram showing a second example (doorphone / camera selection screen) of the screen during execution of the doorphone application.
  • FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen on which the message application is being executed.
  • FIG. 26 is a diagram showing a second example of a screen on which a message application is being executed (a screen for selecting a plurality of messages).
  • FIG. 27 is a diagram showing a first example of a screen on which a moving picture application is being executed.
  • FIG. 28 is a diagram showing a second example of a screen on which a moving picture application is being executed.
  • FIG. 29 is a diagram showing a third example of the screen on which the moving picture application is being executed.
  • FIG. 30 is a diagram showing a first example of a screen on which a music application is being executed.
  • FIG. 31 is a diagram showing a second example of a screen on which a music application is being executed.
  • FIG. 32 is a diagram showing a third example of the screen on which the music application is being executed.
  • FIG. 33 is a diagram showing a first example of a screen on which a photograph application is being executed.
  • FIG. 34 is a diagram showing a second example of the screen on which the photograph application is being executed.
  • FIG. 35 is a diagram showing a third example of the screen on which the photo application is being executed.
  • FIG. 36 is a diagram for explaining an example of presenting information by using an operation on a remote controller of an air conditioner as a trigger.
  • FIG. 37 is a diagram for explaining an example of presenting information by using an operation on a wall switch for turning on and off a lighting device as a trigger.
  • FIG. 38 is a diagram for explaining an example of presenting information by using an operation on a water heater as a trigger.
  • FIG. 39 is a diagram showing an example of a display screen of other information.
  • FIG. 40 is a diagram showing an example of a display screen of a weather warning.
  • FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key.
  • FIG. 42 is a diagram showing an example of a display screen recommending the control of the air purifier most suitable for pollen removal.
  • FIG. 43 is a diagram illustrating an example of a display screen that proposes improvement of a sleep state.
  • FIG. 44 is a diagram showing an example of a notification screen for the laundry timing.
  • FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothes.
  • FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays.
  • FIG. 47 is a diagram showing an example of a display screen that presents programs that are likely to suit the user's preference.
  • FIG. 48 is a diagram showing a first example of a display screen for producing a Christmas effect.
  • FIG. 49 is a diagram showing a second example of the display screen for performing the Christmas effect.
  • FIG. 50 is a diagram showing a configuration of a home screen of the display device according to the embodiment.
  • FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device.
  • FIG. 52 is a diagram showing an example of a push layer screen including a plurality of icons.
  • FIG. 53 is a diagram showing an example of a push layer screen in the night mode.
  • FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state.
  • FIG. 55 is a diagram showing an example of a screen for moving and deleting icons of devices.
  • FIG. 56 is a diagram for explaining the change of the display mode of the push layer screen.
  • FIG. 57 is a diagram for explaining a notification performed when the application layer screen is displayed.
  • FIG. 58 is a diagram for explaining an example in which the tutorial of the control layer is displayed when the screen of the control layer is first displayed.
  • FIG. 59 is a diagram showing an example of an icon for performing air conditioning in the entire building, which is displayed on the screen of the control layer.
  • FIG. 60 is a diagram showing screen transitions when the icon for the air conditioning in the entire building is operated.
  • FIG. 61 is a diagram showing an example of a control screen for the entire building air conditioning during the automatic save operation.
  • FIG. 62 is a diagram showing an example of a control screen for the entire building air conditioning in the outing mode.
  • FIG. 63 is a diagram showing an example of an icon for controlling an air conditioner displayed on the screen of the control layer.
  • FIG. 64 is a diagram showing screen transitions when the icon of the air conditioner is long-tap operated.
  • FIG. 65 is a figure which shows an example of the icon for controlling the heat pump type water heater displayed on the screen of a control layer.
  • FIG. 66 is a first diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater.
  • FIG. 67 is a second diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater.
  • FIG. 68 is a diagram showing an example of icons displayed on the screen of the control layer for controlling the water heater provided in the fuel cell system.
  • FIG. 69 is a diagram showing screen transitions when a long tap operation is performed on the icon of the fuel cell system.
  • FIG. 70 is a diagram showing an example of an icon for controlling the electric shutter, which is displayed on the screen of the control layer.
  • FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter is long-tap operated.
  • FIG. 72 is a diagram showing an example of an icon for controlling the electric lock displayed on the screen of the control layer.
  • FIG. 73 is a diagram showing screen transitions when a long tap operation is performed on the electric lock icon.
  • FIG. 74 is a diagram showing an example of an icon for controlling the air purifier displayed on the screen of the control layer.
  • FIG. 75 is a figure which shows a screen transition when the icon of an air purifier is long tap-operated.
  • FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state.
  • FIG. 77 is a diagram showing an initial setting screen and screen transition from the initial setting screen.
  • FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment.
  • FIG. 79 is a flowchart of Operation Example 1 of the display control system according to the embodiment.
  • FIG. 80 is a flowchart of Operation Example 2 of the display control system according to the embodiment.
  • each diagram is a schematic diagram and is not necessarily an exact illustration. Further, in each drawing, the same reference numerals are given to substantially the same configurations, and overlapping description may be omitted or simplified.
  • FIG. 1 is a front view of a display device according to an embodiment.
  • FIG. 2 is a perspective view of the display device according to the embodiment.
  • the display device 20 is a dedicated terminal used for a system (for example, a display control system described later) that provides services related to a new lifestyle centered on people.
  • the display device 20 can provide the user with a beautifully integrated, new form of engagement with home appliances and appliances. Further, the display device 20 can provide the user with a value tailored to the person who lives in cooperation with the server device.
  • the display device 20 is installed inside a building such as a house (for example, a wall).
  • the display device 20 includes a touch screen 21 and is used as an integrated remote controller for the user to control the devices installed in the building. According to the display device 20, since it is not necessary to install a remote controller for each device, it is possible to remove complexity from the building.
  • the user can confirm the activity of living or the setting of devices in the building. It can be done from anywhere inside.
  • 3 is a diagram showing an example of a display screen of the display device 20 installed at the entrance
  • FIG. 4 is a diagram showing an example of the display screen of the display device 20 installed at the dining room
  • FIG. It is a figure which shows an example of the display screen of the display apparatus 20 installed in the bedroom.
  • the user can close the entrance key or the electric shutter in the living room from the bedroom, and turn off the air conditioners and lighting devices in the house from the entrance.
  • the display device 20 eliminates unnecessary information from a large amount of information and provides only necessary information to the user.
  • the device control function of the display device 20 eliminates the complicated function that is often present in the conventional remote controller or switch.
  • the display device 20 intuitively provides only necessary functions in daily life.
  • FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the whole building (in other words, to control a plurality of air conditioning devices).
  • the display device 20 is configured so that the information desired by the user and the notification the user does not want to miss can be accessed with one tap.
  • the home screen of the display device 20 is notified of the status or notification of the device corresponding to the display device 20.
  • FIG. 7 is a diagram showing an example of a display screen when the notification is given. As shown in FIG. 7, for example, the user confirms a new recording from the display device 20 installed at the entrance immediately after returning home, or confirms a visitor of the intercom from the display device 20 installed in the study. be able to.
  • FIG. 8 to 11 are diagrams showing examples of notified contents.
  • the user can check the homecoming recording and watch the new arrival recording from the entrance or any place immediately after returning home.
  • the display device 20 enables the user to respond to the intercom device and confirm the history of absence from anywhere in the building.
  • the user can confirm completion of hot water in the bathtub from anywhere in the building.
  • the user can also check the message left by someone in the family.
  • Display function scene control
  • the user can freely switch the environment in the building by operating a plurality of devices through the display device 20.
  • the control for switching the environment in the building to the state desired by the user with one tap or a timer is also referred to as scene control.
  • scene control as long as the device is compatible with the display device 20, any device installed in any space (room) in the building can be controlled at once. For example, it is possible to put all the electric shutters, lighting equipment, and air conditioning equipment installed in a building into a state suitable for comfortable awakening, or to set necessary equipment at once when returning home.
  • FIG. 12 is a diagram showing an example of a display screen for performing scene control when waking up.
  • an alarm is sounded, an electric shutter is opened, and a lighting device is turned on (on. Control) is realized by a timer.
  • the scene control when waking up provides a comfortable wake-up for the user and makes the inside of the building an environment suitable for the morning hours.
  • FIG. 13 is a diagram showing an example of a display screen for performing scene control when returning home.
  • control such as opening an electric shutter, lighting an illumination device, or turning on an air conditioner is performed. Is realized with one tap. In other words, what you need when you go home is realized with one tap.
  • scene control is prepared in multiple preset types in advance, but the user can newly create and register it according to their preferences. For example, the user can newly create and register scene control for working from home and scene control before going to bed.
  • FIG. 14 is a diagram showing an example of a display screen for performing scene control when working from home.
  • the lighting device is dimmed and the set temperature of the air conditioning device is low.
  • FIG. 15 is a diagram showing an example of a display screen for performing scene control before going to bed, and is a diagram showing an example of a display screen for performing scene control before going to bed. Lighting equipment is dimmed, the electric shutter is closed, and the temperature setting of the air conditioning equipment is set to a low level, which makes it possible to create an environment in which the building can be comfortably introduced to sleep. .
  • the user can instruct scene control before going to bed not only from the display device 20 installed in the bedroom but also from the display device 20 installed in the living room or dining room.
  • FIG. 16 is a diagram showing an example of an application selection screen. If various applications are installed, the user can confirm the state of the air in the building and the state of the amount of electricity used in the building by selecting the application to be executed. The user can also check the television programs currently being broadcast and recorded programs. The display device 20 can also receive a new application provided from the server device.
  • FIG. 17 is a diagram showing an example of a screen showing the air quality of each room
  • FIG. 18 is a diagram showing an example of a detailed screen of the air quality of the living room. If the screen as shown in FIG. 17 is displayed on the touch screen 21, the user can grasp the air quality of each room at a glance. If the screen as shown in FIG. 18 is displayed on the touch screen 21, the user can confirm the daily (or monthly) change in the air quality of the specific room.
  • the display device 20 can manage the air quality, for example, by acquiring a signal indicating the sensing result from a sensor that measures the air quality.
  • FIG. 19 is a diagram showing a first example of the screen showing the electricity usage amount
  • FIG. 20 is a diagram showing a second example of the screen showing the electricity usage amount.
  • the display device 20 manages the current or past amount of electricity used in the building for each branch circuit, for example, by acquiring a signal indicating the amount of electricity used from a distribution board or the like having a communication function installed in the building. However, it can be provided to the user as an image.
  • the display device 20 acquires the information indicating the electricity usage amount of another user (may be a general electricity usage amount) from the server device, and thus, as shown in FIG.
  • the usage amount and the power usage amount of other users can be displayed side by side.
  • FIG. 21 is a diagram showing a first example of a screen on which a home messenger application is being executed
  • FIG. 22 is a diagram showing a second example of a screen on which a home messenger application is being executed. If the home messenger application is executed, the kitchen can tell the children's room that "rice is ready", or the entrance can tell the dining room that "you're home”. In other words, the possibility of communication between rooms expands.
  • FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of image of visitor imaged by doorphone). Further, if a camera for imaging the outside of the building is communicatively connected to the display device 20, the user can visually recognize the outside of the building through the display device 20.
  • FIG. 24 is a diagram showing a second example (doorphone / camera selection screen) of the screen during execution of the doorphone application.
  • FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen on which the message application is being executed.
  • FIG. 26 is a diagram showing a second example of a screen on which a message application is being executed (a screen for selecting a plurality of messages).
  • the message can be stored (that is, recorded) as a moving image or a still image, or can be stored (that is, recorded) as a voice.
  • the user selects the “movie” icon in the selection screen of FIG. 16 to display the currently broadcast television program and display which are received by the tuner device that is communicatively connected to the display device 20. It is also possible to check the recorded program provided from the moving image content storage device communicatively connected to the device 20.
  • 27 to 29 are diagrams showing examples of screens during execution of a moving image application. The user checks the new recordings using the display device 20 installed at the entrance immediately after returning home, or checks the morning news using the display device 20 installed in the bedroom while changing clothes in the bedroom. You can In other words, the range of ways to interact with information in your life will expand.
  • the user can enjoy the music provided from the music content storage device communicatively connected to the display device 20 by selecting the “music” icon on the selection screen of FIG. 16.
  • 30 to 32 are diagrams showing examples of screens during execution of the music application. The user can enjoy music in any room where the display device 20 is installed. Also, if a separate speaker device is communicatively connected to the display device 20, it is possible to output music from the speaker device.
  • the user can enjoy the photo provided from the still image content storage device communicatively connected to the display device 20 by selecting the “photo” icon in the selection screen of FIG. 33 to 35 are diagrams showing examples of screens during execution of the photo application.
  • the user can enjoy the photograph in any room where the display device 20 is installed.
  • the display device 20 is an action that leads to a better life, triggered by everyday actions performed by the user in daily life, such as "turning on the lighting device”, “turning off the power of the air conditioning device”, and “heating the bath”. Alternatively, it is possible to present an optimal experience and the like (specifically, content or function) according to the situation. That is, the display device 20 can present information to the user, triggered by the user's operation on the device.
  • FIG. 36 is a diagram for explaining an example of presenting information by using an operation on a remote controller of an air conditioner as a trigger.
  • the display device 20 uses this as a trigger to reduce the power consumption of the air conditioner. 36. Displaying advice on how to use the air conditioner to reduce the power consumption (for example, if the user leaves the room for about one hour, the power consumption is lower when the power is on) ((b) in FIG. 36). ).
  • FIG. 37 is a diagram for explaining an example of presenting information by using an operation on a wall switch for turning on and off the lighting device as a trigger.
  • the display device 20 displays the light control setting suitable for the midnight time zone by using this as a trigger ( FIG. 37 (b)).
  • FIG. 38 is a diagram for explaining an example of presenting information by using an operation on the water heater as a trigger.
  • the display device 20 uses this as a trigger to display an image recommending bathing goods that enriches the bath time. indicate.
  • the display device 20 can present various information triggered by the user's operation on the device.
  • 36 to 38 show examples of information presentation.
  • Various information can be presented by combining the devices connected to the display device 20 and various services.
  • the display device 20 combines a device use log, date and time data, weather information provided from a server device (cloud server), and the like to protect the safety and health of a family, advice for helping housework hurt, and , It is also possible to provide recommended contents that match the tastes of the family.
  • FIG. 39 is a diagram showing an example of a display screen of such other information. Hereinafter, a specific example of information that the display device 20 can present will be described.
  • the display device 20 can display that it is a stormy weather and a weather warning by being provided with weather information (in other words, weather information) from the server device, for example.
  • FIG. 40 is a diagram showing an example of a display screen of a weather warning.
  • the display device 20 can support the peace of mind of the family by displaying stormy weather and displaying a weather warning.
  • the display device 20 can display a notification screen for preventing forgetting to lock the key, based on the state of the electric lock and the time zone.
  • FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key.
  • the display device 20 can support the peace of mind of the family by giving a notification for preventing forgetting to lock the lock.
  • the display device 20 can recommend the control of the air purifier that is most suitable for pollen removal, depending on the pollen information and the home-based situation.
  • FIG. 42 is a diagram showing an example of a display screen recommending the control of the air purifier most suitable for pollen removal.
  • the display device 20 can support the health of the family by recommending control of the air purifier that is most suitable for pollen removal.
  • the display device 20 can estimate the sleep condition of the user from the usage log of the lighting device and the electric shutter, and can make a proposal regarding improvement of the sleep state.
  • FIG. 43 is a diagram illustrating an example of a display screen that proposes improvement of a sleep state.
  • the display device 20 can support the health of the family by making a proposal regarding improvement of the sleep state.
  • the display device 20 can notify the best washing timing, for example, by receiving weather information (in other words, information of weather API (Application Programming Interface)) from the server device.
  • FIG. 44 is a diagram showing an example of a notification screen for the laundry timing.
  • the display device 20 can also recommend drying the room in the season when pollen is abundant.
  • the display device 20 can support housework by notifying the laundry timing.
  • the display device 20 can make a proposal regarding clothes (thick or light clothing) based on the difference between the average temperature of the week included in the weather information provided by the server device and the temperature of the day.
  • FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothes.
  • the display device 20 can also suggest carrying a rain gear on a rainy day.
  • the display device 20 can alert the user about ultraviolet rays during the day (morning to daytime) based on the ultraviolet ray index included in the weather information provided from the server device.
  • FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays.
  • the display device 20 can support the beauty of the user by calling attention to ultraviolet rays.
  • the display device 20 can record and present a program that is likely to suit the user's preference from the viewing history of the television and the recording log of the moving image content storage device.
  • FIG. 47 is a diagram showing an example of a display screen that presents programs that are likely to suit the user's preference.
  • the display device 20 can perform special device control on an anniversary or the like.
  • the display device 20 displays a display screen for performing a Christmas effect using the device at Christmas.
  • 48 and 49 are diagrams each showing an example of a display screen for performing a Christmas effect. When the user's approval is obtained through such a display screen, a Christmas effect is performed by the speaker (music) and the lighting device (light) in the room where the display device 20 is installed.
  • FIG. 50 is a diagram showing the configuration of the home screen of the display device 20.
  • the home screen of the display device 20 has (a) "Apps Layer (application layer)", (b) “Push Layer (push layer)”, and (c) "Control Layer (control layer)”.
  • Layer) has a three-story structure (three-layer structure).
  • the push layer serves as a base point and a swipe operation is performed on the touch screen 21 from the top to the bottom while the push layer screen is displayed, the screen transitions to the application layer screen.
  • the touch screen 21 is swiped in the direction from the bottom to the top while the push layer screen is displayed, the screen changes to the control layer screen.
  • the push layer is a push-type interaction layer that is the basis of the display device 20 such as recommendations and notifications.
  • information such as a notification or a recommendation transmitted from a device that is communicatively connected to the display device 20 as a starting point is displayed.
  • the display device 20 detects the presence or absence of the user around the display device 20 by a human sensor or the like, and the user detects the presence of the user around the display device 20 (that is, near the display device 20). ) Displays information such as notifications or recommendations on the screen. On the other hand, when the user is not around the display device 20 (that is, near the display device 20), the display device 20 does not display the information such as the notification or the recommendation to be displayed on the screen.
  • FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device 20.
  • FIG. 52 is a diagram showing an example of a push layer screen including a plurality of icons.
  • the plurality of icons are arranged in a line in the left-right direction in the order of the generated time, for example, the one having a newer time when the information is generated is on the left side.
  • a horizontal swipe operation in other words, scroll operation
  • the icon is scrolled.
  • the display areas of time, date, and weather are maintained (fixed).
  • the screen changes to the screen of the application layer or the screen of the control layer related to the information indicated by the icon.
  • FIG. 53 is a diagram showing an example of a push layer screen in such a night mode.
  • the control layer is a layer for individually controlling the devices grouped for each device category and place (room), such as turning off lighting devices in the kitchen and setting air conditioning in the whole building.
  • the user can turn the device on and off without screen transition by tapping the device icon included in the control layer screen. That is, the user can simply control the device. Also, the user can perform detailed control of the device by long-tap operation of the device icon.
  • Respective icons of a plurality of devices are displayed in different modes (for example, in different colors) according to the on and off states so that the on and off states of the devices can be seen at a glance.
  • the icon of the device is displayed in color
  • the icon of the device is displayed in monochrome (grayscale, washout).
  • FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state.
  • the device icon may include characters indicating the operating state of the device.
  • the device icons are arranged in a line in the left-right direction, and when a left-right swipe operation (in other words, scroll operation) is performed on the icon display area, the icon is scrolled. .
  • the icon located on the rightmost side of the touch screen 21 in the default state is displayed so that a part of the icon is interrupted so that the user can be informed that the icons of a plurality of devices scroll.
  • the icons of multiple devices are arranged in the order according to the place (room) where the devices are installed.
  • an icon for example, a scene control icon
  • a room for example, a living room
  • the icon of the device installed in is placed.
  • icons of devices installed in the room closest to the living room are arranged.
  • the icon of the device installed in the room closer to the room in which the display device 20 is installed is on the left side (in other words, the position that is easily accessible in the default state (initial state)). Will be placed. That is, the icons of the plurality of devices are arranged in an order based on the installation positions of the devices (in other words, an order related to the installation positions).
  • the icons on the relatively left side of the icons of the multiple devices are located on the screen in the default state, but are on the relatively right side. Is not on the screen in the default state and appears on the screen only after scrolling.
  • a jump shortcut (characters indicating a place (space) in the building such as “all rooms”, “living room”, and “kitchen”) is provided at the lower left of the screen of the control layer. By tapping the jump shortcut, the user can position the icon of the device installed at the location indicated by the tapped character on the screen (a plurality of icons automatically scroll).
  • FIG. 55 is a diagram showing an example of a screen for moving and deleting icons of devices.
  • the user can change the arrangement (left-right positional relationship) of the device icon by performing a drag-and-drop operation on the device icon on the device icon movement / deletion screen.
  • the application layer is used to check the power consumption in the building and watch a video.
  • multiple icons are categorized according to the user's desired action or experience action.
  • new applications provided by the developer and new services provided in the future are added to the application layer.
  • the application program described in FIGS. 16 to 35 can be executed from the application layer screen.
  • What can be executed from the application layer and what can be executed from the control layer are classified as follows, for example.
  • What can be executed from the application layer is equipment that is easy to add and change, such as so-called home appliances (equipment that is not fixed to the wall of the building), and equipment (lighting equipment and air conditioning equipment that is fixed to the wall of the building, etc.).
  • Device but refers to control of a device that operates by referring to information.
  • control layer what can be executed from the control layer is control of equipment. In some cases, the same control can be executed from both the application layer and the control layer.
  • the display mode of the push layer screen may be changed according to the distance between the display device 20 and a person standing in front of the display device 20. That is, the display device 20 may automatically switch the display according to the distance to the user.
  • FIG. 56 is a diagram for explaining the change of the display mode of the push layer screen.
  • the screen of the push layer is when the user is located within a range of 1 m from the display device 20 (for example, while the user is operating the display device 20 or in front of the display device 20).
  • Standing state is displayed in the normal state.
  • the screen of the push layer is displayed in the ambient state when the user is located within the range of 1 m or more and less than 3 m from the display device 20 (when the user is in the room where the display device 20 is installed).
  • the push layer screen is in a sleep state (for example, black when the user is located 3 m or more away from the display device 20 (for example, when the user is not in the room where the display device 20 is installed)).
  • Image for example, black when the user is located 3 m or more away from the display device 20 (for example, when the user is not in the room where the display device 20 is installed).
  • Ambient state means a state in which the presence or absence of a notification can be confirmed even from a distant position while taking care not to insist on the notification too much.
  • the push layer screen in the ambient state is realized, for example, by displaying the time and the notification icon on a white background.
  • the information that the user always wants to display may be changed by the user setting.
  • the information that the user always wants to display includes, specifically, time, weather, outdoor temperature and humidity, indoor temperature and humidity, air quality (in other words, the degree of contamination of air. Smell, and PM2. 5 concentration, etc., power consumption, power generation amount of solar power generation system, family schedule, what day is today, etc.
  • the information that the user always wants to display may be considered such that the user can visually recognize it even from a slightly distant position, for example, by enlarging the characters or the display.
  • FIG. 57 is a diagram for explaining a notification performed when the application layer screen is displayed. Although not shown, the same applies to the notification given when the screen of the control layer is displayed.
  • the content of the notification is superimposed and displayed on the upper part of the screen of the application layer. While the application is being executed, the notification is not displayed on the application execution screen (screens shown in FIGS. 17 to 35), and when the execution screen returns to the app layer screen, the notification content is superimposed on the upper part of the screen. It When the area on which the notification content is superimposed is tap-operated, for example, the notification ends and the state returns to the state of (a) of FIG.
  • a screen for controlling the device is displayed.
  • Notifications that are normally performed as push notifications include, for example, notification of the anniversary of the installation of the display device 20, notification of the birthday of the user or family, notification of an important message, notification of abnormal temperature and humidity, and opening of the electric shutter.
  • the notification includes a notification of the time, a notification when the electric lock is opened, and a notification regarding the delivery box.
  • the forced priority push notification is a notification that requires immediate response from the user like an incoming call, in other words, it wants to be notified immediately regardless of any operation (more important than normal push notification). It is a notification. As shown in (a) of FIG. 57 and (c) of FIG. 57, when the forced priority push notification is required, the entire screen is switched to the notification screen even during the operation.
  • the notification performed as the forced priority push notification includes, for example, a power outage (cooperation / non-cooperation) notification, a power overuse notification (peak alarm), a notification indicating a visitor by an intercom device ((c) in FIG. 57), Calls from other rooms (that is, other display devices 20) are included.
  • the display device 20 displays a tutorial (specifically, an outline of what can be done by the application and typical operations) when the application or the like is activated for the first time.
  • FIG. 58 is for explaining an example in which the tutorial of the control layer is displayed ((c) of FIG. 58) when the screen of the control layer is first displayed ((a) and (b) of FIG. 58).
  • FIG. 58 is for explaining an example in which the tutorial of the control layer is displayed ((c) of FIG. 58) when the screen of the control layer is first displayed ((a) and (b) of FIG. 58).
  • Animation in other words, video is used to display the tutorial.
  • a balloon or a character is displayed on the screen, or an animation for predicting an operation is displayed on the screen. Accordingly, the display device 20 can present the operation method to the user in an easy-to-understand manner.
  • the tutorial by removing the amount of information (words and contents, etc.), it is possible to prevent users from feeling stress.
  • the tutorial is configured to advance to the next item by a user operation such as a swipe operation so that the user can quickly access a necessary portion, and this can prevent the user from feeling annoying.
  • a user operation such as a swipe operation so that the user can quickly access a necessary portion, and this can prevent the user from feeling annoying.
  • Detailed functions and operating instructions are described in the online manual, and the display device 20 displays guidance so that the user can smoothly reach the place where the online manual is described.
  • FIG. 59 is an example of an icon (hereinafter, also simply referred to as an entire building air conditioning icon) for performing the entire building air conditioning displayed on the screen of the control layer (specifically, an icon corresponding to the state of the entire air conditioning). It is a figure which shows an example of a change.
  • FIG. 60 is a diagram showing screen transitions when the icon for the air conditioning in the entire building is operated.
  • the entire building air conditioning icon is not grouped (in other words, associated) with the "all rooms" tab on the control layer screen, for example.
  • the entire building air conditioning is basically always on and is not suitable for single tap operation. Therefore, even if either single tap operation or long tap operation is performed on the entire building air conditioning icon, the modal shown in FIG. A window is displayed.
  • the entire building air conditioning may have a specification that cannot be turned off from the display device 20.
  • FIG. 61 is a diagram showing an example of the control screen for the entire building air conditioning during the automatic save operation
  • FIG. 62 is a diagram showing an example of the control screen for the whole building air conditioning in the outing mode (during outing). These control screens are displayed only when an operation is performed from the original remote controller of the air conditioning system in the whole building.
  • FIG. 63 is an example of an icon (hereinafter, also simply referred to as an icon of an air conditioner) for controlling the air conditioner displayed on the screen of the control layer (specifically, an icon corresponding to the state of the air conditioner).
  • FIG. 4 is a diagram showing an example of the change of FIG.
  • FIG. 64 is a diagram showing screen transitions when the icon of the air conditioner is long-tap operated.
  • FIG. 65 is an example of an icon (hereinafter, also simply referred to as a heat pump water heater icon) for controlling the heat pump water heater displayed on the screen of the control layer (specifically, a heat pump water heater).
  • FIG. 4 is a diagram showing an example of change of an icon according to the state of FIG.
  • FIG. 66 is a first diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater.
  • FIG. 67 is a second diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater. Similar icons are used for the gas water heater, and similar screen transitions are performed.
  • FIG. 68 is an example of an icon (specifically, also referred to as an icon of the fuel cell system, hereinafter) for controlling the water heater provided in the fuel cell system, which is displayed on the screen of the control layer (specifically, fuel). It is a figure which shows an example of a change of the icon according to the state of the water heater with which a battery system is equipped.
  • FIG. 69 is a diagram showing screen transitions when a long tap operation is performed on the icon of the fuel cell system.
  • FIG. 70 shows an example of an icon (hereinafter, also simply referred to as an electric shutter icon) for controlling the electric shutter displayed on the screen of the control layer (specifically, depending on the state of the electric shutter). It is a figure which shows an example of a change of an icon. As shown in FIG. 70, during the operation of the electric shutter, the icon is animated to present the state of the electric shutter to the user in an easy-to-understand manner. A similar icon (the title of the icon is changed from "shutter” to "blind”) is also used for the electric blind.
  • FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter (or the electric blind) is long-tap operated.
  • a long-tap operation is performed on the electric shutter icon grouped (in other words, associated) with the “all rooms” tab on the control layer screen, a plurality of electric shutters in the building are collectively controlled.
  • the icon of the electric shutter grouped in each room tab on the screen of the control layer is long-tap operated, the electric shutter installed in the room is controlled.
  • FIG. 72 shows an example of an icon (hereinafter, also simply referred to as an electric lock icon) for controlling the electric lock displayed on the screen of the control layer (specifically, depending on the state of the electric lock). It is a figure which shows an example of a change of an icon.
  • FIG. 73 is a diagram showing screen transitions when a long tap operation is performed on the electric lock icon.
  • the electric lock icon grouped in the "All rooms" tab on the control layer screen is long-tapped, a plurality of electric locks in the building are collectively controlled.
  • the electric lock icon grouped in each room tab on the screen of the control layer is long-tap operated, the electric lock installed in the room is controlled.
  • FIG. 74 shows an example of an icon for controlling the air purifier (hereinafter, also simply referred to as an air purifier icon) displayed on the screen of the control layer (specifically, the state of the air purifier).
  • FIG. 6 is a diagram showing an example of change of an icon according to FIG.
  • FIG. 75 is a figure which shows a screen transition when the icon of an air purifier is long tap-operated.
  • FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state.
  • 76 (a) is a diagram showing an example of a screen when the system is abnormal
  • FIG. 76 (b) is a diagram showing an example of a screen when offline.
  • irregular states are classified into, for example, a detached state, an indefinite state, and a failure state.
  • the detached state means a state in which the communication connection between the display device 20 and the device is lost
  • the indefinite state is a state in which the display device 20 and the device are connected by communication but it takes time to detect a numerical value (for example, starting State).
  • the failure state means that the device itself is out of order.
  • FIG. 77 is a diagram showing such an initial setting screen and screen transition from the initial setting screen. As shown in FIG. 77, when inputting the name of the installation place on the initial setting screen ((a) of FIG. 77), the screen changes to the input screen ((b) of FIG. 77).
  • the screen ((c) in Fig. 77) notifying that the initial settings are completed is displayed.
  • a predetermined operation in the example of FIG. 77, a swipe operation in the upward direction
  • the screen changes to the push layer screen ((d) of FIG. 77).
  • the tutorial screen is automatically displayed as a modal window as described above ((e) in FIG. 77).
  • FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment.
  • the display control system 10 is a system that displays an image for controlling the control target devices (the first control target device 41 and the second control target device 42).
  • the display control system 10 includes a display device 20, a control device 30, a first control target device 41, a second control target device 42, a sensor 43, and a server device 50.
  • the display device 20, the control device 30, the first control target device 41, the second control target device 42, and the sensor 43 are installed in, for example, a building such as a house or the site of the building.
  • the display device 20 is a device that functions as a user interface device related to device control.
  • the display device 20 is directly or indirectly communicatively connected to a plurality of devices installed in a building.
  • the display device 20 is directly or indirectly connected to a control target device including a home appliance, a home electric appliance, or the like via the control device.
  • the display device 20 is installed, for example, on a wall inside a building.
  • the display device 20 includes a touch screen 21, a control unit 22, a storage unit 23, and a communication unit 24.
  • the touch screen 21 includes a touch panel 21a that receives a user operation and a display unit 21b that displays an image (moving image or still image).
  • the touch panel 21a is an example of an acquisition unit.
  • the touch panel 21a is, for example, a capacitance type touch panel, but may be a resistive film type touch panel.
  • the display unit 21b is, for example, a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel.
  • the control unit 22 performs control for operating the control target device according to the operation received by the touch panel 21a and control for displaying an image on the display unit 21b.
  • the control unit 22 is realized by, for example, a microcomputer, but may be realized by a processor.
  • the storage unit 23 is a storage device in which a control program executed by the control unit 22 is stored.
  • the storage unit 23 is realized by, for example, a semiconductor memory.
  • the communication unit 24 is a communication circuit (in other words, a communication module) for the display device 20 to communicate with the control device 30, the second controlled device 42, and the server device 50.
  • the communication unit 24 transmits a control request for the control target device to the control device 30 based on the control of the control unit 22, for example. Further, the communication unit 24 transmits a control signal for controlling the second control target device 42 to the second control target device 42 based on the control of the control unit 22.
  • the communication unit 24 receives, for example, a signal indicating the sensing result from the sensor.
  • the communication unit 24 performs wireless communication, for example, but may perform wired communication.
  • the communication standard of communication performed by the communication unit 24 is not particularly limited.
  • the control device 30 is, for example, a HEMS (Home Energy Management System) controller, and controls the first control target device 41 based on a control request transmitted by the communication unit 24.
  • the control device 30 is not limited to the HEMS controller having the energy management function, and may be another home controller having no energy management function or a gateway device.
  • the first controlled device 41 is a device controlled by the control device 30 and is indirectly connected to the display device 20 so as to be communicable. Specifically, the first control target device 41 operates based on a control signal transmitted from the control device 30.
  • the first control target device 41 includes, for example, a storage battery system, a fuel cell system, a solar power generation system, a lighting device, a heat pump water heater, an electric shutter, or a device such as an electric lock.
  • wireless communication based on a communication standard such as Echonet Lite (registered trademark) is performed.
  • the second control target device 42 is a device controlled by the display device 20, and is directly communicably connected to the display device 20.
  • the second controlled device 42 specifically operates based on a control signal transmitted from the display device 20.
  • the second control target device 42 includes, for example, a device such as an intercom device or an air conditioning device.
  • the device described as the first control target device 41 may be included in the second control target device 42, and the device described as the second control target device 42 may be included in the first control target device 41.
  • the equipment to be controlled may include household equipment or household appliances.
  • the sensor 43 senses the environment inside the building and transmits a signal indicating the sensing result to the display device 20. Accordingly, the display device 20 can display the environment inside the building. In addition, the display device 20 can also control the control target device based on the environment in the building.
  • the sensor 43 includes a pressure sensor, a temperature sensor, a humidity sensor, an illuminance sensor, or the like.
  • the server device 50 is a cloud server. Various services are realized by the cooperation of the server device 50 and the display device 20.
  • FIG. 79 is a flowchart of the operation example 1 of the display control system 10.
  • the operation of FIG. 79 is an operation corresponding to the case of the normal push notification of FIG. 57 based on FIG. 50, and will be described below with reference to FIGS. 50, 57, and 79.
  • the control unit 22 of the display device 20 displays the first display layer on the touch screen 21 (more specifically, the display unit 21b) (S11).
  • the first display layer corresponds to, for example, the push layer in (b) of FIG.
  • the first display layer has display objects belonging to the first category.
  • the display object belonging to the first category is a rectangular icon displayed on the push layer screen in FIG. 50 (b).
  • the first category is, for example, a user interface for notifying the state of each device to be controlled (in other words, a plurality of devices).
  • the touch panel 21a acquires information regarding the first touch on the touch screen 21 performed while the first display layer is displayed on the touch screen 21 (S12).
  • control unit 22 determines whether the information on the first contact includes the movement of the contact position in the first direction (S13).
  • the movement of the contact position in the first direction is, for example, movement of the contact position based on an upward swipe operation.
  • the control unit 22 determines that the information regarding the first contact includes the movement of the contact position in the first direction (Yes in S13), the image displayed on the display unit 21b is displayed in the first display layer.
  • the second display layer corresponds to the control layer in (c) of FIG. 50, for example.
  • the second display layer has display objects that belong to a second category different from the first category. Specifically, the display object belonging to the second category is a rectangular icon displayed on the screen of the control layer in (c) of FIG.
  • the second category is a user interface for controlling each state of the control target device (a plurality of devices).
  • the control unit 22 acquires the state of the control target device via the communication unit 24 (S15), and determines whether the state of the control target device has changed (S16).
  • the control unit 22 determines that the state of the control target device has changed (Yes in S16)
  • the control unit 22 notifies the change of the state of the device (S17).
  • the display unit 21b superimposes a display object that notifies the change of the state of the device on a part of the second display layer being displayed. That is, when the state of the control target device changes while the second display layer is displayed on the touch screen 21, the control unit 22 displays a display object that notifies the change in the second display layer. indicate.
  • step S13 If it is determined in step S13 that the information regarding the first contact does not include the movement of the contact position in the first direction (No in S13), the processes in step S14 and thereafter are not performed. If it is determined in step S16 that the state of the control target device has not changed (No in S16), the process of step S17 is not performed.
  • the display control method as described above can notify the user of the device status.
  • control unit 22 controls the second display layer to change the state of the control target device when the state of the control target device changes while the second display layer is displayed on the touch screen 21. You may move to the device usage screen.
  • FIG. 80 is a flowchart of an operation example 2 of such a display control system 10.
  • the operation example 2 is an operation corresponding to the case of the forced priority push notification in FIG.
  • the control unit 22 determines that the state of the control target device has changed (Yes in S16)
  • the control unit 22 shifts to the use screen of the control target device having the state change (S18).
  • the control unit 22 shifts to the intercom use screen when, for example, the state of the intercom changes.
  • the use screen of the intercom is displayed on the full screen, for example.
  • the display control method described above can display a usage screen and prompt the user for an immediate response when the user needs an immediate response such as an incoming call.
  • the operation example 1 and the operation example 2 may be switched according to what kind of device the control target device having the state change is (or what kind of state change).
  • “while the second display layer is displayed on the touch screen 21” includes the time when the second display layer is actually displayed on the touch screen 21 in a manner that can be visually recognized by the user.
  • the sleep state black image
  • the sleep state is set when the second display layer is displayed on the touch screen 21. The case (that is, while the second display layer is displayed on the touch screen 21 in a manner invisible to the user) is also included.
  • the touch screen 21 enters a sleep state.
  • the display object notifying the change of the state of the intercom is superimposed on a part of the second display layer.
  • the display object that notifies the change of the intercom state may be superimposed on the screen in the sleep state, or may be actually displayed when the user returns home and performs an operation such as canceling the sleep state.
  • a display object for notifying the change of the state of the intercom may be superimposed on the second display layer.
  • the processing executed by a specific processing unit may be executed by another processing unit.
  • part or all of the processing performed by the display device may be performed by the control device or the server device.
  • the communication method between the devices in the above embodiment is not particularly limited. Wireless communication may be performed between devices, or wired communication may be performed. In addition, wireless communication and wired communication may be combined between the devices. Further, in the above embodiment, when two devices communicate with each other, a relay device (not shown) may be interposed between the two devices.
  • each component may be realized by executing a software program suitable for each component.
  • Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.
  • each component may be realized by hardware.
  • each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole or may be separate circuits. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.
  • a recording medium such as a system, a device, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM.
  • the system, the device, the method, the integrated circuit, the computer program, and the recording medium may be implemented in any combination.
  • the present invention may be realized as a display control method executed by a computer such as a display control system, or may be realized as a program for causing a computer to execute such a display control method. Further, the present invention may be realized as a computer-readable non-transitory recording medium in which such a program is recorded.
  • the display control system is realized by a plurality of devices, but it may be realized as a single device.
  • the display control system may be realized, for example, as a single device corresponding to a display device, a single device corresponding to a control device, or a single device corresponding to a server device. May be realized as.
  • the components included in the display control system may be distributed to the plurality of devices in any way.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This display control method involves a step (S12) for acquiring information relating to a first contact on a touch screen made while a first display layer is displayed on the touch screen, a step (S14) for shifting from the first display layer to a second display layer if the information relating to the first contact includes movement of the contact position in a first direction, a step (S15) for acquiring the state of a device, and a step (S17) in which, if while the second display layer is displayed on the touch screen there was a change in the state of the device, a display object notifying of said change is displayed in the second display layer.

Description

表示制御方法、及び、表示制御システムDisplay control method and display control system
　本発明は、住設機器、家電機器などの住宅ＩｏＴ（Ｉｎｔｅｒｎｅｔ　ｏｆ　Ｔｈｉｎｇｓ）機器の状態を表示するための表示制御方法、及び、表示制御システムに関する。 The present invention relates to a display control method and a display control system for displaying the status of residential IoT (Internet of Things) equipment such as residential equipment and home appliances.
　近年、住宅内に設置された２４時間換気システム、エコキュート（登録商標）・ガス給湯器、インターホン・電気錠、電動シャッター、床暖房などの住設機器、エアコン、空気清浄機、照明器具、テレビ、ＤＶＤレコーダーなどの家電機器を、一括、協調して制御する住宅ＩｏＴ（Ｉｎｔｅｒｎｅｔ　ｏｆ　Ｔｈｉｎｇｓ）システムが注目を浴びている。 In recent years, 24-hour ventilation systems installed in houses, EcoCute (registered trademark) gas water heaters, intercoms, electric locks, electric shutters, floor heating and other housing equipment, air conditioners, air purifiers, lighting equipment, TVs, House IoT (Internet of Things) systems that collectively control home appliances such as DVD recorders in a collective manner are drawing attention.
　当該住宅ＩｏＴシステムでは、各機器を制御するためのプロトコルとして、例えば、Ｅｃｈｏｎｅｔ　Ｌｉｔｅ（登録商標）、または、ＫＮＸ（登録商標）などを通じて、情報端末であるアンビエントパネルに各機器の状態を表示し、同パネルでユーザが所望の設定をすることで、各機器が単独のみならず、協調して制御できるようになっている。 In the house IoT system, as a protocol for controlling each device, for example, Echonet Lite (registered trademark) or KNX (registered trademark) is used to display the state of each device on an ambient panel which is an information terminal. By the user making desired settings on the panel, each device can be controlled not only independently but also cooperatively.
　本発明は、機器の状態をユーザに通知することができる表示制御方法、及び、表示制御システムを提供する。 The present invention provides a display control method and a display control system capable of notifying a user of the status of a device.
　本発明の一態様に係る表示制御方法は、コンピュータによって実行される表示制御方法であって、機器の状態を通知するためのユーザーインターフェースである第１のカテゴリの表示オブジェクトを有する第１の表示レイヤがタッチスクリーンに表示されている間に行われた当該タッチスクリーンに対する第１の接触に関する情報を取得するステップと、前記第１の接触に関する情報が、第１の方向への接触位置の移動を含む場合に、前記第１の表示レイヤから、前記第１のカテゴリと異なる第２のカテゴリの表示オブジェクトを有する第２の表示レイヤに移行するステップと、前記機器の状態を取得するステップと、前記第２の表示レイヤが前記タッチスクリーンに表示されている間に前記機器の状態に変化があった場合に、前記第２の表示レイヤにおいて当該変化を通知する表示オブジェクトを表示するステップと、を含む。 A display control method according to one aspect of the present invention is a display control method executed by a computer, the first display layer having a display object of a first category, which is a user interface for notifying a state of a device. Acquiring information about a first touch on the touch screen performed while is displayed on the touch screen, and the information about the first touch includes movement of the touch position in the first direction. In this case, a step of shifting from the first display layer to a second display layer having a display object of a second category different from the first category; a step of acquiring the state of the device; If there is a change in the state of the device while the second display layer is being displayed on the touch screen, the second Shows and displaying the display object to notify the change in the layer.
　本発明の一態様に係るプログラムは、前記表示制御方法をコンピュータに実行させるためのプログラムである。 A program according to one aspect of the present invention is a program for causing a computer to execute the display control method.
　本発明の一態様に係る表示制御システムは、機器の状態を通知するためのユーザーインターフェースである第１のカテゴリの表示オブジェクトを有する第１の表示レイヤがタッチスクリーンに表示されている間に行われた当該タッチスクリーンに対する第１の接触に関する情報を取得する取得部と、前記第１の接触に関する情報が、第１の方向への接触位置の移動を含む場合に、前記第１の表示レイヤから、前記第１のカテゴリと異なる第２のカテゴリの表示オブジェクトを有する第２の表示レイヤに移行する制御部とを備え、前記制御部は、前記機器の状態を取得し、前記第２の表示レイヤが前記タッチスクリーンに表示されている間に前記機器の状態に変化があった場合に、前記第２の表示レイヤにおいて当該変化を通知する表示オブジェクトを表示する。 A display control system according to one aspect of the present invention is performed while a first display layer having display objects of a first category, which is a user interface for notifying a state of a device, is displayed on a touch screen. When the acquisition unit that acquires information regarding the first contact with respect to the touch screen and the information regarding the first contact include movement of the contact position in the first direction, from the first display layer, A control unit that shifts to a second display layer having a display object of a second category different from the first category, the control unit acquires the state of the device, and the second display layer is When the state of the device changes while being displayed on the touch screen, a display object that notifies the change in the second display layer. -Objects to display.
　本発明の表示制御方法及び表示制御システムは、機器の状態をユーザに通知することができる。 The display control method and display control system of the present invention can notify the user of the status of the device.
図１は、実施の形態に係る表示装置の正面図である。FIG. 1 is a front view of a display device according to an embodiment. 図２は、実施の形態に係る表示装置の斜視図である。FIG. 2 is a perspective view of the display device according to the embodiment. 図３は、玄関に設置された表示装置の表示画面の一例を示す図である。FIG. 3 is a diagram showing an example of a display screen of a display device installed at the entrance. 図４は、ダイニングに設置された表示装置の表示画面の一例を示す図である。FIG. 4 is a diagram showing an example of a display screen of a display device installed in a dining room. 図５は、寝室に設置された表示装置の表示画面の一例を示す図である。FIG. 5 is a diagram showing an example of a display screen of a display device installed in the bedroom. 図６は、ユーザが直感的に全館空調の制御を行うための表示画面の一例を示す図である。FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building. 図７は、通知が行われているときの表示画面の一例を示す図である。FIG. 7 is a diagram showing an example of a display screen when the notification is given. 図８は、通知される内容の第一の例を示す図である。FIG. 8 is a diagram showing a first example of the notified contents. 図９は、通知される内容の第二の例を示す図である。FIG. 9 is a diagram showing a second example of the notified contents. 図１０は、通知される内容の第三の例を示す図である。FIG. 10 is a diagram showing a third example of the notified contents. 図１１は、通知される内容の第四の例を示す図である。FIG. 11: is a figure which shows the 4th example of the content notified. 図１２は、起床時のシーン制御を行うための表示画面の一例を示す図である。FIG. 12 is a diagram showing an example of a display screen for performing scene control when waking up. 図１３は、帰宅時のシーン制御を行うための表示画面の一例を示す図である。FIG. 13 is a diagram showing an example of a display screen for performing scene control when returning home. 図１４は、在宅勤務時のシーン制御を行うための表示画面の一例を示す図である。FIG. 14 is a diagram showing an example of a display screen for performing scene control when working from home. 図１５は、就寝前のシーン制御を行うための表示画面の一例を示す図である。FIG. 15 is a diagram showing an example of a display screen for performing scene control before going to bed. 図１６は、アプリケーションの選択画面の一例を示す図である。FIG. 16 is a diagram showing an example of an application selection screen. 図１７は、各部屋の空気質を示す画面の一例を示す図である。FIG. 17 is a diagram showing an example of a screen showing the air quality of each room. 図１８は、リビングの空気質の詳細画面の一例を示す図である。FIG. 18 is a diagram showing an example of a detailed air quality screen of the living room. 図１９は、電気使用量を示す画面の第一の例を示す図である。FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used. 図２０は、電気使用量を示す画面の第二の例を示す図である。FIG. 20 is a diagram showing a second example of the screen showing the amount of electricity used. 図２１は、ホームメッセンジャーのアプリケーションを実行中の画面の第一の例を示す図である。FIG. 21 is a diagram showing a first example of a screen on which the home messenger application is being executed. 図２２は、ホームメッセンジャーのアプリケーションを実行中の画面の第二の例を示す図である。FIG. 22 is a diagram showing a second example of the screen on which the home messenger application is being executed. 図２３は、ドアホンのアプリケーションを実行中の画面の第一の例（ドアホンが撮影している訪問者の画像の表示画面）を示す図である。FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of image of visitor imaged by doorphone). 図２４は、ドアホンのアプリケーションを実行中の画面の第二の例（ドアホン及びカメラの選択画面）を示す図である。FIG. 24 is a diagram showing a second example (doorphone / camera selection screen) of the screen during execution of the doorphone application. 図２５は、伝言のアプリケーションを実行中の画面の第一の例（手書き入力画面）を示す図である。FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen on which the message application is being executed. 図２６は、伝言のアプリケーションを実行中の画面の第二の例（複数の伝言の選択画面）を示す図である。FIG. 26 is a diagram showing a second example of a screen on which a message application is being executed (a screen for selecting a plurality of messages). 図２７は、動画のアプリケーションを実行中の画面の第一の例を示す図である。FIG. 27 is a diagram showing a first example of a screen on which a moving picture application is being executed. 図２８は、動画のアプリケーションを実行中の画面の第二の例を示す図である。FIG. 28 is a diagram showing a second example of a screen on which a moving picture application is being executed. 図２９は、動画のアプリケーションを実行中の画面の第三の例を示す図である。FIG. 29 is a diagram showing a third example of the screen on which the moving picture application is being executed. 図３０は、音楽のアプリケーションを実行中の画面の第一の例を示す図である。FIG. 30 is a diagram showing a first example of a screen on which a music application is being executed. 図３１は、音楽のアプリケーションを実行中の画面の第二の例を示す図である。FIG. 31 is a diagram showing a second example of a screen on which a music application is being executed. 図３２は、音楽のアプリケーションを実行中の画面の第三の例を示す図である。FIG. 32 is a diagram showing a third example of the screen on which the music application is being executed. 図３３は、写真のアプリケーションを実行中の画面の第一の例を示す図である。FIG. 33 is a diagram showing a first example of a screen on which a photograph application is being executed. 図３４は、写真のアプリケーションを実行中の画面の第二の例を示す図である。FIG. 34 is a diagram showing a second example of the screen on which the photograph application is being executed. 図３５は、写真のアプリケーションを実行中の画面の第三の例を示す図である。FIG. 35 is a diagram showing a third example of the screen on which the photo application is being executed. 図３６は、空調機器のリモートコントローラへの操作をトリガとして情報を提示する例を説明するための図である。FIG. 36 is a diagram for explaining an example of presenting information by using an operation on a remote controller of an air conditioner as a trigger. 図３７は、照明機器を点灯及び消灯するための壁スイッチへの操作をトリガとして情報を提示する例を説明するための図である。FIG. 37 is a diagram for explaining an example of presenting information by using an operation on a wall switch for turning on and off a lighting device as a trigger. 図３８は、給湯器への操作をトリガとして情報を提示する例を説明するための図である。FIG. 38 is a diagram for explaining an example of presenting information by using an operation on a water heater as a trigger. 図３９は、その他の情報の表示画面の一例を示す図である。FIG. 39 is a diagram showing an example of a display screen of other information. 図４０は、気象警報の表示画面の一例を示す図である。FIG. 40 is a diagram showing an example of a display screen of a weather warning. 図４１は、鍵のかけ忘れを防止するための通知画面の一例を示す図である。FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key. 図４２は、花粉除去に最適な空気清浄機の制御をリコメンドする表示画面の一例を示す図である。FIG. 42 is a diagram showing an example of a display screen recommending the control of the air purifier most suitable for pollen removal. 図４３は、睡眠状態の改善を提案する表示画面の一例を示す図である。FIG. 43 is a diagram illustrating an example of a display screen that proposes improvement of a sleep state. 図４４は、洗濯のタイミングの通知画面の一例を示す図である。FIG. 44 is a diagram showing an example of a notification screen for the laundry timing. 図４５は、服装に関する提案を行う表示画面の一例を示す図である。FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothes. 図４６は、紫外線に関する注意喚起を行う表示画面の一例を示す図である。FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays. 図４７は、ユーザの好みに合いそうな番組を提示する表示画面の一例を示す図である。FIG. 47 is a diagram showing an example of a display screen that presents programs that are likely to suit the user's preference. 図４８は、クリスマス用の演出を行うための表示画面の第一の例を示す図である。FIG. 48 is a diagram showing a first example of a display screen for producing a Christmas effect. 図４９は、クリスマス用の演出を行うための表示画面の第二の例を示す図である。FIG. 49 is a diagram showing a second example of the display screen for performing the Christmas effect. 図５０は、実施の形態に係る表示装置のホーム画面の構成を示す図である。FIG. 50 is a diagram showing a configuration of a home screen of the display device according to the embodiment. 図５１は、ユーザが表示装置の近くにいないときのプッシュレイヤの画面の一例を示す図である。FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device. 図５２は、複数のアイコンを含むプッシュレイヤの画面の一例を示す図である。FIG. 52 is a diagram showing an example of a push layer screen including a plurality of icons. 図５３は、ナイトモードにおけるプッシュレイヤの画面の一例を示す図である。FIG. 53 is a diagram showing an example of a push layer screen in the night mode. 図５４は、機器がオフ状態である場合のコントロールレイヤの画面の一例を示す図である。FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state. 図５５は、機器のアイコンの移動及び削除画面の一例を示す図である。FIG. 55 is a diagram showing an example of a screen for moving and deleting icons of devices. 図５６は、プッシュレイヤの画面の表示態様の変更を説明するための図である。FIG. 56 is a diagram for explaining the change of the display mode of the push layer screen. 図５７は、アプリレイヤの画面が表示されているときに行われる通知を説明するための図である。FIG. 57 is a diagram for explaining a notification performed when the application layer screen is displayed. 図５８は、最初にコントロールレイヤの画面が表示されたときに、コントロールレイヤのチュートリアルが表示される例を説明するための図である。FIG. 58 is a diagram for explaining an example in which the tutorial of the control layer is displayed when the screen of the control layer is first displayed. 図５９は、コントロールレイヤの画面に表示される全館空調を行うためのアイコンの一例を示す図である。FIG. 59 is a diagram showing an example of an icon for performing air conditioning in the entire building, which is displayed on the screen of the control layer. 図６０は、全館空調のアイコンが操作されたときの画面遷移を示す図である。FIG. 60 is a diagram showing screen transitions when the icon for the air conditioning in the entire building is operated. 図６１は、自動セーブ運転時の全館空調の制御画面の一例を示す図である。FIG. 61 is a diagram showing an example of a control screen for the entire building air conditioning during the automatic save operation. 図６２は、お出かけモードにおける全館空調の制御画面の一例を示す図である。FIG. 62 is a diagram showing an example of a control screen for the entire building air conditioning in the outing mode. 図６３は、コントロールレイヤの画面に表示される空調機器を制御するためのアイコンの一例を示す図である。FIG. 63 is a diagram showing an example of an icon for controlling an air conditioner displayed on the screen of the control layer. 図６４は、空調機器のアイコンがロングタップ操作されたときの画面遷移を示す図である。FIG. 64 is a diagram showing screen transitions when the icon of the air conditioner is long-tap operated. 図６５は、コントロールレイヤの画面に表示されるヒートポンプ式給湯器を制御するためのアイコンの一例を示す図である。FIG. 65: is a figure which shows an example of the icon for controlling the heat pump type water heater displayed on the screen of a control layer. 図６６は、ヒートポンプ式給湯器のアイコンがロングタップ操作されたときの画面遷移を示す第一の図である。FIG. 66 is a first diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater. 図６７は、ヒートポンプ式給湯器のアイコンがロングタップ操作されたときの画面遷移を示す第二の図である。FIG. 67 is a second diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater. 図６８は、コントロールレイヤの画面に表示される、燃料電池システムが備える給湯器を制御するためのアイコンの一例を示す図である。FIG. 68 is a diagram showing an example of icons displayed on the screen of the control layer for controlling the water heater provided in the fuel cell system. 図６９は、燃料電池システムのアイコンがロングタップ操作されたときの画面遷移を示す図である。FIG. 69 is a diagram showing screen transitions when a long tap operation is performed on the icon of the fuel cell system. 図７０は、コントロールレイヤの画面に表示される、電動シャッターを制御するためのアイコンの一例を示す図である。FIG. 70 is a diagram showing an example of an icon for controlling the electric shutter, which is displayed on the screen of the control layer. 図７１は、電動シャッターのアイコンがロングタップ操作されたときの画面遷移を示す図である。FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter is long-tap operated. 図７２は、コントロールレイヤの画面に表示される、電気錠を制御するためのアイコンの一例を示す図である。FIG. 72 is a diagram showing an example of an icon for controlling the electric lock displayed on the screen of the control layer. 図７３は、電気錠のアイコンがロングタップ操作されたときの画面遷移を示す図である。FIG. 73 is a diagram showing screen transitions when a long tap operation is performed on the electric lock icon. 図７４は、コントロールレイヤの画面に表示される、空気清浄機を制御するためのアイコンの一例を示す図である。FIG. 74 is a diagram showing an example of an icon for controlling the air purifier displayed on the screen of the control layer. 図７５は、空気清浄機のアイコンがロングタップ操作されたときの画面遷移を示す図である。FIG. 75: is a figure which shows a screen transition when the icon of an air purifier is long tap-operated. 図７６は、機器がイレギュラーな状態に陥った場合の画面遷移を示す図である。FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state. 図７７は、初期設定画面、及び、初期設定画面からの画面遷移を示す図である。FIG. 77 is a diagram showing an initial setting screen and screen transition from the initial setting screen. 図７８は、実施の形態に係る表示制御システムの機能構成を示すブロック図である。FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment. 図７９は、実施の形態に係る表示制御システムの動作例１のフローチャートである。FIG. 79 is a flowchart of Operation Example 1 of the display control system according to the embodiment. 図８０は、実施の形態に係る表示制御システムの動作例２のフローチャートである。FIG. 80 is a flowchart of Operation Example 2 of the display control system according to the embodiment.
　以下、実施の形態について、図面を参照しながら具体的に説明する。なお、以下で説明する実施の形態は、いずれも包括的または具体的な例を示すものである。以下の実施の形態で示される数値、形状、材料、構成要素、構成要素の配置位置及び接続形態、ステップ、ステップの順序などは、一例であり、本発明を限定する主旨ではない。また、以下の実施の形態における構成要素のうち、独立請求項に記載されていない構成要素については、任意の構成要素として説明される。 Hereinafter, embodiments will be specifically described with reference to the drawings. It should be noted that each of the embodiments described below shows a comprehensive or specific example. Numerical values, shapes, materials, constituent elements, arrangement positions and connection forms of constituent elements, steps, order of steps, and the like shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the constituent elements in the following embodiments, constituent elements not described in independent claims are described as arbitrary constituent elements.
　なお、各図は模式図であり、必ずしも厳密に図示されたものではない。また、各図において、実質的に同一の構成に対しては同一の符号を付し、重複する説明は省略または簡略化される場合がある。 Note that each diagram is a schematic diagram and is not necessarily an exact illustration. Further, in each drawing, the same reference numerals are given to substantially the same configurations, and overlapping description may be omitted or simplified.
　（実施の形態）
　［表示装置の概要］
　まず、実施の形態に係る表示装置の概要について説明する。図１は、実施の形態に係る表示装置の正面図である。図２は、実施の形態に係る表示装置の斜視図である。 (Embodiment)
[Overview of display device]
First, an outline of the display device according to the embodiment will be described. FIG. 1 is a front view of a display device according to an embodiment. FIG. 2 is a perspective view of the display device according to the embodiment.
　表示装置２０は、人を中心に考えた新しいくらしに関するサービスを提供するシステム（例えば、後述の表示制御システム）に用いられる専用端末である。表示装置２０は、美しく統合された、新しい形の住宅設備及び家電との関わりをユーザに提供することができる。また、表示装置２０は、サーバ装置との連携で住む人に合わせた価値をユーザに提供することができる。 The display device 20 is a dedicated terminal used for a system (for example, a display control system described later) that provides services related to a new lifestyle centered on people. The display device 20 can provide the user with a beautifully integrated, new form of engagement with home appliances and appliances. Further, the display device 20 can provide the user with a value tailored to the person who lives in cooperation with the server device.
　表示装置２０は、住宅などの建物の内部（例えば、壁）に設置される。また、表示装置２０は、タッチスクリーン２１を備え、ユーザが上記建物に設置された機器を制御するための統合リモートコントローラとして使用される。表示装置２０によれば、機器ごとにリモートコントローラを設置することが不要となるため、建物から複雑性を取り除くことができる。 The display device 20 is installed inside a building such as a house (for example, a wall). In addition, the display device 20 includes a touch screen 21 and is used as an integrated remote controller for the user to control the devices installed in the building. According to the display device 20, since it is not necessary to install a remote controller for each device, it is possible to remove complexity from the building.
　また、表示装置２０が建物内の複数の空間（玄関、ダイニング、及び、ベッドルームなど）のそれぞれに設置されれば、ユーザは、暮らしの行為の確認、または、機器の設定の確認を建物の中のあらゆる場所から行うことができる。図３は、玄関に設置された表示装置２０の表示画面の一例を示す図であり、図４は、ダイニングに設置された表示装置２０の表示画面の一例を示す図であり、図５は、寝室に設置された表示装置２０の表示画面の一例を示す図である。例えば、ユーザは、寝室から玄関の鍵またはリビングの電動シャッターを閉じたり、玄関から家中の空調機器及び照明機器を消したりすることが可能となる。 Further, if the display device 20 is installed in each of a plurality of spaces (entrance, dining room, bedroom, etc.) in the building, the user can confirm the activity of living or the setting of devices in the building. It can be done from anywhere inside. 3 is a diagram showing an example of a display screen of the display device 20 installed at the entrance, FIG. 4 is a diagram showing an example of the display screen of the display device 20 installed at the dining room, and FIG. It is a figure which shows an example of the display screen of the display apparatus 20 installed in the bedroom. For example, the user can close the entrance key or the electric shutter in the living room from the bedroom, and turn off the air conditioners and lighting devices in the house from the entrance.
　また、表示装置２０は、大量の情報から不要なものをなくし、必要なものだけをユーザに提供する。例えば、表示装置２０の機器制御機能からは、従来のリモートコントローラまたはスイッチにありがちだった煩雑な機能が排除される。表示装置２０は、日常生活で必要な機能だけを直感的に提供する。図６は、ユーザが直感的に全館空調の制御を行う（言い換えれば、複数の空調機器を制御する）ための表示画面の一例を示す図である。 Further, the display device 20 eliminates unnecessary information from a large amount of information and provides only necessary information to the user. For example, the device control function of the display device 20 eliminates the complicated function that is often present in the conventional remote controller or switch. The display device 20 intuitively provides only necessary functions in daily life. FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the whole building (in other words, to control a plurality of air conditioning devices).
　［表示装置の機能：通知］
　また、表示装置２０は、ユーザが欲しい情報、ユーザが逃したくない通知に１タップでアクセスできるように構成されている。例えば、表示装置２０のホーム画面には、表示装置２０に対応する機器の状態またはお知らせが通知される。図７は、通知が行われているときの表示画面の一例を示す図である。図７に示されるように、例えば、ユーザは、玄関に設置された表示装置２０から帰宅後すぐに新着録画を確認したり、書斎に設置された表示装置２０からドアホンの来客を確認したりすることができる。 [Display device function: Notification]
Further, the display device 20 is configured so that the information desired by the user and the notification the user does not want to miss can be accessed with one tap. For example, the home screen of the display device 20 is notified of the status or notification of the device corresponding to the display device 20. FIG. 7 is a diagram showing an example of a display screen when the notification is given. As shown in FIG. 7, for example, the user confirms a new recording from the display device 20 installed at the entrance immediately after returning home, or confirms a visitor of the intercom from the display device 20 installed in the study. be able to.
　図８～図１１は、通知される内容の一例を示す図である。図８に示されるように、表示装置２０によれば、ユーザは、帰宅後すぐに、玄関、または、好きな場所から新着録画を帰宅チェック及び視聴することができる。また、図９に示されるように、表示装置２０によれば、ユーザは、建物の中のどこからでもインターホン装置に応答したり、不在時の履歴を確認したりすることができる。また、図１０に示されるように、表示装置２０によれば、ユーザは、バスタブのお湯はり完了を、建物の中のどこからでも確認することができる。図１１に示されるように、表示装置２０によれば、ユーザは、家族の誰かが残した伝言を確認することもできる。 8 to 11 are diagrams showing examples of notified contents. As shown in FIG. 8, according to the display device 20, the user can check the homecoming recording and watch the new arrival recording from the entrance or any place immediately after returning home. Further, as shown in FIG. 9, the display device 20 enables the user to respond to the intercom device and confirm the history of absence from anywhere in the building. Further, as shown in FIG. 10, according to the display device 20, the user can confirm completion of hot water in the bathtub from anywhere in the building. As shown in FIG. 11, according to the display device 20, the user can also check the message left by someone in the family.
　［表示装置の機能：シーン制御］
　また、ユーザは、表示装置２０を通じて複数の機器を動作させることにより、建物中の環境を自在に切り替えることができる。建物の中の環境を１タップ、または、タイマーでユーザの求める状態に切り替える制御は、シーン制御とも記載される。シーン制御では、表示装置２０に対応した機器であれば、建物の中のどの空間（部屋）に設置された機器であっても一度に制御することができる。例えば、建物に設置された全ての電動シャッター、照明機器、及び、空調機器を快適な目覚めに適した状態にしたり、帰宅時に必要な機器の設定を一度に行ったりすることが可能である。 [Display function: scene control]
Moreover, the user can freely switch the environment in the building by operating a plurality of devices through the display device 20. The control for switching the environment in the building to the state desired by the user with one tap or a timer is also referred to as scene control. In the scene control, as long as the device is compatible with the display device 20, any device installed in any space (room) in the building can be controlled at once. For example, it is possible to put all the electric shutters, lighting equipment, and air conditioning equipment installed in a building into a state suitable for comfortable awakening, or to set necessary equipment at once when returning home.
　シーン制御の具体例について説明する。図１２は、起床時のシーン制御を行うための表示画面の一例を示す図であり、起床時のシーン制御では、例えば、アラームを鳴らす、電動シャッターを開く、及び、照明機器を点灯させる（オンする）、といった制御がタイマーで実現される。起床時のシーン制御は、ユーザに心地の良い目覚めを提供し、建物の中を朝の時間帯に適した環境にする。図１３は、帰宅時のシーン制御を行うための表示画面の一例を示す図であり、帰宅時のシーン制御では、例えば、電動シャッターを開く、照明機器を点灯させる、空調機器をオンするといった制御が１タップで実現される。つまり、帰宅時に必要なことがタップ１つで実現される。 Explain a concrete example of scene control. FIG. 12 is a diagram showing an example of a display screen for performing scene control when waking up. In the scene control when waking up, for example, an alarm is sounded, an electric shutter is opened, and a lighting device is turned on (on. Control) is realized by a timer. The scene control when waking up provides a comfortable wake-up for the user and makes the inside of the building an environment suitable for the morning hours. FIG. 13 is a diagram showing an example of a display screen for performing scene control when returning home. In the scene control when returning home, for example, control such as opening an electric shutter, lighting an illumination device, or turning on an air conditioner is performed. Is realized with one tap. In other words, what you need when you go home is realized with one tap.
　なお、シーン制御は、あらかじめプリセットで複数種類用意されているが、ユーザが好みに合わせて新たに作成し、登録することができる。例えば、ユーザは、在宅勤務時のシーン制御、及び、就寝前のシーン制御などを新たに作成して登録することができる。 Note that scene control is prepared in multiple preset types in advance, but the user can newly create and register it according to their preferences. For example, the user can newly create and register scene control for working from home and scene control before going to bed.
　図１４は、在宅勤務時のシーン制御を行うための表示画面の一例を示す図であり、在宅勤務時のシーン制御では、例えば、照明機器を調光し、かつ、空調機器の設定温度が低めに設定されることで、ユーザの集中力及び作業効率を高めることができる、作業に適した環境が実現される。図１５は、就寝前のシーン制御を行うための表示画面の一例を示す図であり、就寝前のシーン制御を行うための表示画面の一例を示す図であり、就寝前のシーン制御では、例えば、照明機器が暗く調光され、電動シャッターが閉じられ、かつ、空調機器の設定温度が低めに設定されることで、建物の中を快適に睡眠に導入することができる環境にすることができる。ユーザは、就寝前のシーン制御を、寝室に設置された表示装置２０だけでなく、リビングまたはダイニングに設置された表示装置２０からも指示することができる。 FIG. 14 is a diagram showing an example of a display screen for performing scene control when working from home. In the scene control when working from home, for example, the lighting device is dimmed and the set temperature of the air conditioning device is low. By setting to, an environment suitable for work can be realized in which the user's concentration and work efficiency can be improved. FIG. 15 is a diagram showing an example of a display screen for performing scene control before going to bed, and is a diagram showing an example of a display screen for performing scene control before going to bed. Lighting equipment is dimmed, the electric shutter is closed, and the temperature setting of the air conditioning equipment is set to a low level, which makes it possible to create an environment in which the building can be comfortably introduced to sleep. . The user can instruct scene control before going to bed not only from the display device 20 installed in the bedroom but also from the display device 20 installed in the living room or dining room.
　［表示装置の機能：アプリケーション］
　表示装置２０には、様々なアプリケーション（アプリケーションプログラム）がインストールされていてもよい。図１６は、アプリケーションの選択画面の一例を示す図である。様々なアプリケーションがインストールされていれば、ユーザは、実行するアプリケーションを選択することで、建物の中の空気の状態、及び、建物における電気使用量の状態を確認することができる。また、ユーザは、現在放送中のテレビ番組、及び、録画番組をチェックすることもできる。また、表示装置２０は、サーバ装置から新たなアプリケーションの提供を受けることもできる。 [Display function: Application]
Various applications (application programs) may be installed in the display device 20. FIG. 16 is a diagram showing an example of an application selection screen. If various applications are installed, the user can confirm the state of the air in the building and the state of the amount of electricity used in the building by selecting the application to be executed. The user can also check the television programs currently being broadcast and recorded programs. The display device 20 can also receive a new application provided from the server device.
　例えば、ユーザは、図１６の選択画面中の「空気」のアイコンを選択することで、建物の中の各部屋の空気の状態（具体的には、温度、湿度、におい、ハウスダスト、及び、ＰＭ２．５濃度などの空気質）を把握することができる。図１７は、各部屋の空気質を示す画面の一例を示す図であり、図１８は、リビングの空気質の詳細画面の一例を示す図である。図１７に示されるような画面がタッチスクリーン２１に表示されれば、ユーザは、各部屋の空気質を一目で把握することができる。また、図１８に示されるような画面がタッチスクリーン２１に表示されれば、ユーザは、特定の部屋の空気質の日ごと（あるいは月ごと）の変化を確認することができる。なお、表示装置２０は、例えば、空気質を計測するセンサからセンシング結果を示す信号を取得することにより、空気質を管理することができる。 For example, the user selects the “air” icon in the selection screen of FIG. 16 to select the air condition of each room in the building (specifically, temperature, humidity, odor, house dust, and Air quality such as PM2.5 concentration) can be grasped. FIG. 17 is a diagram showing an example of a screen showing the air quality of each room, and FIG. 18 is a diagram showing an example of a detailed screen of the air quality of the living room. If the screen as shown in FIG. 17 is displayed on the touch screen 21, the user can grasp the air quality of each room at a glance. If the screen as shown in FIG. 18 is displayed on the touch screen 21, the user can confirm the daily (or monthly) change in the air quality of the specific room. The display device 20 can manage the air quality, for example, by acquiring a signal indicating the sensing result from a sensor that measures the air quality.
　また、例えば、ユーザは、図１６の選択画面中の「電気」のアイコンを選択することで、建物の中の各部屋の電気使用量を把握することができる。図１９は、電気使用量を示す画面の第一の例を示す図であり、図２０は、電気使用量を示す画面の第二の例を示す図である。なお、表示装置２０は、例えば、建物に設置された通信機能を有する分電盤などから電気使用量を示す信号を取得することにより、建物における現在または過去の電気使用量を分岐回路ごとに管理し、ユーザに画像として提供することができる。また、表示装置２０は、サーバ装置から他のユーザの電気使用量（一般的な電気使用量であってもよい）を示す情報を取得することにより、図１９に示されるように、ユーザの電気使用量と他のユーザの電気使用量とを並べて表示することができる。 Further, for example, the user can grasp the electricity usage amount of each room in the building by selecting the “electricity” icon in the selection screen of FIG. 16. FIG. 19 is a diagram showing a first example of the screen showing the electricity usage amount, and FIG. 20 is a diagram showing a second example of the screen showing the electricity usage amount. The display device 20 manages the current or past amount of electricity used in the building for each branch circuit, for example, by acquiring a signal indicating the amount of electricity used from a distribution board or the like having a communication function installed in the building. However, it can be provided to the user as an image. In addition, the display device 20 acquires the information indicating the electricity usage amount of another user (may be a general electricity usage amount) from the server device, and thus, as shown in FIG. The usage amount and the power usage amount of other users can be displayed side by side.
　また、例えば、ユーザは、図１６の選択画面中の「ホームメッセンジャー」のアイコンを選択することで、建物の中で他の部屋にいる家族と会話することができる。図２１は、ホームメッセンジャーのアプリケーションを実行中の画面の第一の例を示す図であり、図２２は、ホームメッセンジャーのアプリケーションを実行中の画面の第二の例を示す図である。ホームメッセンジャーのアプリケーションが実行されれば、キッチンから子供部屋に「ごはんができたよ」と伝えたり、玄関からダイニングに「ただいま」と伝えたりすることができる。つまり、部屋同士でのコミュニケーションの可能性が広がる。 Further, for example, the user can have a conversation with a family member in another room in the building by selecting the "home messenger" icon on the selection screen of FIG. 21 is a diagram showing a first example of a screen on which a home messenger application is being executed, and FIG. 22 is a diagram showing a second example of a screen on which a home messenger application is being executed. If the home messenger application is executed, the kitchen can tell the children's room that "rice is ready", or the entrance can tell the dining room that "you're home". In other words, the possibility of communication between rooms expands.
　また、例えば、ユーザは、図１６の選択画面中の「ドアホン」のアイコンを選択することで、表示装置２０が設置された部屋から表示装置２０と通信接続されたドアホン（言い換えれば、インターホン装置）に応答することができる。図２３は、ドアホンのアプリケーションを実行中の画面の第一の例（ドアホンが撮影している訪問者の画像の表示画面）を示す図である。また、表示装置２０に建物の外を撮像するカメラが通信接続されれば、ユーザは、表示装置２０を通じて建物の外の様子を視認することもできる。図２４は、ドアホンのアプリケーションを実行中の画面の第二の例（ドアホン及びカメラの選択画面）を示す図である。 Further, for example, the user selects the “doorphone” icon in the selection screen of FIG. 16 to cause a doorphone that is communicatively connected to the display device 20 from the room in which the display device 20 is installed (in other words, an intercom device). Can respond to. FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of image of visitor imaged by doorphone). Further, if a camera for imaging the outside of the building is communicatively connected to the display device 20, the user can visually recognize the outside of the building through the display device 20. FIG. 24 is a diagram showing a second example (doorphone / camera selection screen) of the screen during execution of the doorphone application.
　また、例えば、ユーザは、図１６の選択画面中の「伝言」のアイコンを選択することで、表示装置２０を伝言板として使用することができる。図２５は、伝言のアプリケーションを実行中の画面の第一の例（手書き入力画面）を示す図である。図２６は、伝言のアプリケーションを実行中の画面の第二の例（複数の伝言の選択画面）を示す図である。なお、伝言は、動画像または静止画像として記憶する（つまり、録画する）こともできるし、音声として記憶する（つまり、録音する）こともできる。 Further, for example, the user can use the display device 20 as a message board by selecting the “message” icon in the selection screen of FIG. FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen on which the message application is being executed. FIG. 26 is a diagram showing a second example of a screen on which a message application is being executed (a screen for selecting a plurality of messages). The message can be stored (that is, recorded) as a moving image or a still image, or can be stored (that is, recorded) as a voice.
　また、例えば、ユーザは、図１６の選択画面中の「動画」のアイコンを選択することで、表示装置２０と通信接続されたチューナ装置によって受信される、現在放送中のテレビ番組、及び、表示装置２０と通信接続された動画コンテンツ記憶装置から提供される録画番組をチェックすることもできる。図２７～図２９は、動画のアプリケーションを実行中の画面の一例を示す図である。ユーザは、帰宅してすぐに玄関に設置された表示装置２０を用いて新着録画を確認したり、寝室で着替えながら寝室に設置された表示装置２０を用いて朝のニュースをチェックしたりすることができる。つまり、暮らしの中での情報との接し方の幅が広がる。 In addition, for example, the user selects the “movie” icon in the selection screen of FIG. 16 to display the currently broadcast television program and display which are received by the tuner device that is communicatively connected to the display device 20. It is also possible to check the recorded program provided from the moving image content storage device communicatively connected to the device 20. 27 to 29 are diagrams showing examples of screens during execution of a moving image application. The user checks the new recordings using the display device 20 installed at the entrance immediately after returning home, or checks the morning news using the display device 20 installed in the bedroom while changing clothes in the bedroom. You can In other words, the range of ways to interact with information in your life will expand.
　また、例えば、ユーザは、図１６の選択画面中の「音楽」のアイコンを選択することで、表示装置２０と通信接続された音楽コンテンツ記憶装置から提供される音楽を楽しむこともできる。図３０～図３２は、音楽のアプリケーションを実行中の画面の一例を示す図である。ユーザは、表示装置２０が設置されたどの部屋でも音楽を楽しむことができる。また、表示装置２０に別体のスピーカ装置が通信接続されれば、当該スピーカ装置から音楽を出力することも可能である。 Also, for example, the user can enjoy the music provided from the music content storage device communicatively connected to the display device 20 by selecting the “music” icon on the selection screen of FIG. 16. 30 to 32 are diagrams showing examples of screens during execution of the music application. The user can enjoy music in any room where the display device 20 is installed. Also, if a separate speaker device is communicatively connected to the display device 20, it is possible to output music from the speaker device.
　また、例えば、ユーザは、図１６の選択画面中の「写真」のアイコンを選択することで、表示装置２０と通信接続された静止画コンテンツ記憶装置から提供される写真を楽しむこともできる。図３３～図３５は、写真のアプリケーションを実行中の画面の一例を示す図である。ユーザは、表示装置２０が設置されたどの部屋でも写真を楽しむことができる。 Also, for example, the user can enjoy the photo provided from the still image content storage device communicatively connected to the display device 20 by selecting the “photo” icon in the selection screen of FIG. 33 to 35 are diagrams showing examples of screens during execution of the photo application. The user can enjoy the photograph in any room where the display device 20 is installed.
　［表示装置の機能：ユーザの操作をトリガとした情報の提示］
　表示装置２０は、日常生活の中でユーザが行う「照明機器を点灯する」「空調機器の電源をオフする」「お風呂を沸かす」といった普段の行為をトリガとして、よりよいくらしに繋がる行為、または、状況に応じた最適な体験など（具体的には、コンテンツまたは機能など）を提示することができる。つまり、表示装置２０は、機器へのユーザの操作をトリガとして、ユーザへの情報の提示を行うことができる。図３６は、空調機器のリモートコントローラへの操作をトリガとして情報を提示する例を説明するための図である。 [Function of display device: presentation of information triggered by user operation]
The display device 20 is an action that leads to a better life, triggered by everyday actions performed by the user in daily life, such as "turning on the lighting device", "turning off the power of the air conditioning device", and "heating the bath". Alternatively, it is possible to present an optimal experience and the like (specifically, content or function) according to the situation. That is, the display device 20 can present information to the user, triggered by the user's operation on the device. FIG. 36 is a diagram for explaining an example of presenting information by using an operation on a remote controller of an air conditioner as a trigger.
　図３６の例では、ユーザが空調機器のリモートコントローラに対して空調機器の電源をオフする操作を行うと（図３６の（ａ））、表示装置２０は、これをトリガとして空調機器の消費電力を削減するための空調機器の使用方法に関するアドバイス（例えば、１時間程度部屋を離れるだけであれば、電源をオンにしたままのほうが消費電力が低いこと）を表示する（図３６の（ｂ））。 In the example of FIG. 36, when the user operates the remote controller of the air conditioner to turn off the power of the air conditioner ((a) of FIG. 36), the display device 20 uses this as a trigger to reduce the power consumption of the air conditioner. 36. Displaying advice on how to use the air conditioner to reduce the power consumption (for example, if the user leaves the room for about one hour, the power consumption is lower when the power is on) ((b) in FIG. 36). ).
　また、図３７は、照明機器を点灯及び消灯するための壁スイッチへの操作をトリガとして情報を提示する例を説明するための図である。図３７の例では、ユーザが深夜帰宅時に玄関の照明機器を点灯すると（図３７の（ａ））、表示装置２０は、これをトリガとして深夜の時間帯に適した調光設定を表示する（図３７の（ｂ））。 Further, FIG. 37 is a diagram for explaining an example of presenting information by using an operation on a wall switch for turning on and off the lighting device as a trigger. In the example of FIG. 37, when the user turns on the illumination device at the entrance when returning home at midnight ((a) of FIG. 37), the display device 20 displays the light control setting suitable for the midnight time zone by using this as a trigger ( FIG. 37 (b)).
　また、図３８は、給湯器への操作をトリガとして情報を提示する例を説明するための図である。図３８の例では、ユーザが、給湯器の操作パネルへバスタブへのお湯はりを指示する操作を行うと、表示装置２０は、これをトリガとしてバスタイムを豊かにする入浴グッズをリコメンドする画像を表示する。 Further, FIG. 38 is a diagram for explaining an example of presenting information by using an operation on the water heater as a trigger. In the example of FIG. 38, when the user operates the operation panel of the water heater to instruct hot water to the bathtub, the display device 20 uses this as a trigger to display an image recommending bathing goods that enriches the bath time. indicate.
　このように、表示装置２０は、機器へのユーザの操作をトリガとして様々な情報を提示することができる。なお、図３６～図３８は、情報提示の例を示すものである。表示装置２０に接続される機器、及び、各種サービスの組み合わせにより様々な情報提示が可能である。 In this way, the display device 20 can present various information triggered by the user's operation on the device. 36 to 38 show examples of information presentation. Various information can be presented by combining the devices connected to the display device 20 and various services.
　［表示装置の機能：その他の情報の提示］
　表示装置２０は、機器の使用ログ、日時データ、及び、サーバ装置（クラウドサーバ）から提供される天気情報などを組み合わせて、家族の安全及び健康を守る機能、家事を楽しく助けてくれるアドバイス、並びに、家族の好みに合わせたおすすめコンテンツなどを提供することもできる。図３９は、このようなその他の情報の表示画面の一例を示す図である。以下、表示装置２０が提示可能な情報の具体例について説明する。 [Function of display device: presentation of other information]
The display device 20 combines a device use log, date and time data, weather information provided from a server device (cloud server), and the like to protect the safety and health of a family, advice for helping housework happily, and , It is also possible to provide recommended contents that match the tastes of the family. FIG. 39 is a diagram showing an example of a display screen of such other information. Hereinafter, a specific example of information that the display device 20 can present will be described.
　表示装置２０は、例えば、サーバ装置から天気情報（言い換えれば、気象情報）の提供を受けることにより、荒天であること、及び、気象警報を表示することができる。図４０は、気象警報の表示画面の一例を示す図である。表示装置２０は、荒天であること、及び、気象警報を表示することにより、家族の安心をサポートすることができる。 The display device 20 can display that it is a stormy weather and a weather warning by being provided with weather information (in other words, weather information) from the server device, for example. FIG. 40 is a diagram showing an example of a display screen of a weather warning. The display device 20 can support the peace of mind of the family by displaying stormy weather and displaying a weather warning.
　また、表示装置２０は、電気錠の状態と時間帯などに基づいて、鍵のかけ忘れを防止するための通知画面を表示することができる。図４１は、鍵のかけ忘れを防止するための通知画面の一例を示す図である。表示装置２０は、鍵のかけ忘れを防止するための通知を行うことにより、家族の安心をサポートすることができる。 Further, the display device 20 can display a notification screen for preventing forgetting to lock the key, based on the state of the electric lock and the time zone. FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key. The display device 20 can support the peace of mind of the family by giving a notification for preventing forgetting to lock the lock.
　また、表示装置２０は、花粉情報と在宅状況とに応じて、花粉除去に最適な空気清浄機の制御をリコメンドすることができる。図４２は、花粉除去に最適な空気清浄機の制御をリコメンドする表示画面の一例を示す図である。表示装置２０は、花粉除去に最適な空気清浄機の制御をリコメンドすることにより、家族の健康をサポートすることができる。 Further, the display device 20 can recommend the control of the air purifier that is most suitable for pollen removal, depending on the pollen information and the home-based situation. FIG. 42 is a diagram showing an example of a display screen recommending the control of the air purifier most suitable for pollen removal. The display device 20 can support the health of the family by recommending control of the air purifier that is most suitable for pollen removal.
　また、表示装置２０は、照明機器及び電動シャッターの使用ログからユーザの睡眠コンディションを推定し、睡眠状態の改善に関する提案を行うことができる。図４３は、睡眠状態の改善を提案する表示画面の一例を示す図である。表示装置２０は、睡眠状態の改善に関する提案を行うことにより、家族の健康をサポートすることができる。 Also, the display device 20 can estimate the sleep condition of the user from the usage log of the lighting device and the electric shutter, and can make a proposal regarding improvement of the sleep state. FIG. 43 is a diagram illustrating an example of a display screen that proposes improvement of a sleep state. The display device 20 can support the health of the family by making a proposal regarding improvement of the sleep state.
　表示装置２０は、例えば、サーバ装置から天気情報（言い換えれば、天気ＡＰＩ（Ａｐｐｌｉｃａｔｉｏｎ　Ｐｒｏｇｒａｍｍｉｎｇ　Ｉｎｔｅｒｆａｃｅ）の情報）の提供を受けることにより、ベストな洗濯のタイミングを通知することができる。図４４は、洗濯のタイミングの通知画面の一例を示す図である。表示装置２０は、花粉が多い季節には、部屋干しをリコメンドすることもできる。表示装置２０は、洗濯のタイミングを通知することで、家事をサポートすることができる。 The display device 20 can notify the best washing timing, for example, by receiving weather information (in other words, information of weather API (Application Programming Interface)) from the server device. FIG. 44 is a diagram showing an example of a notification screen for the laundry timing. The display device 20 can also recommend drying the room in the season when pollen is abundant. The display device 20 can support housework by notifying the laundry timing.
　また、表示装置２０は、サーバ装置から提供される天気情報に含まれる週の平均気温と、当日の気温の差に基づいて、服装（厚着または薄着）に関する提案を行うことができる。図４５は、服装に関する提案を行う表示画面の一例を示す図である。表示装置２０は、雨の日には雨具の携帯を提案することもできる。 Further, the display device 20 can make a proposal regarding clothes (thick or light clothing) based on the difference between the average temperature of the week included in the weather information provided by the server device and the temperature of the day. FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothes. The display device 20 can also suggest carrying a rain gear on a rainy day.
　また、表示装置２０は、サーバ装置から提供される天気情報に含まれる紫外線指数に基づいて、日中（朝～昼の時間帯）に紫外線に関する注意喚起を行うことができる。図４６は、紫外線に関する注意喚起を行う表示画面の一例を示す図である。表示装置２０は、紫外線に関する注意喚起を行うことにより、ユーザの美容をサポートすることができる。 Further, the display device 20 can alert the user about ultraviolet rays during the day (morning to daytime) based on the ultraviolet ray index included in the weather information provided from the server device. FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays. The display device 20 can support the beauty of the user by calling attention to ultraviolet rays.
　また、表示装置２０は、テレビの視聴履歴、及び、動画コンテンツ記憶装置の録画ログからユーザの好みに合いそうな番組を録画し、提示することができる。図４７は、ユーザの好みに合いそうな番組を提示する表示画面の一例を示す図である。 Also, the display device 20 can record and present a program that is likely to suit the user's preference from the viewing history of the television and the recording log of the moving image content storage device. FIG. 47 is a diagram showing an example of a display screen that presents programs that are likely to suit the user's preference.
　また、表示装置２０は、記念日などに特別な機器制御を行うことができる。例えば、表示装置２０は、クリスマスに、機器を用いたクリスマス用の演出を行うための表示画面を表示する。図４８及び図４９は、クリスマス用の演出を行うための表示画面の一例を示す図である。このような表示画面を通じてユーザの承認が得られると、表示装置２０が設置された部屋において、スピーカ（音楽）及び照明機器（光）によるクリスマス用の演出が行われる。 Moreover, the display device 20 can perform special device control on an anniversary or the like. For example, the display device 20 displays a display screen for performing a Christmas effect using the device at Christmas. 48 and 49 are diagrams each showing an example of a display screen for performing a Christmas effect. When the user's approval is obtained through such a display screen, a Christmas effect is performed by the speaker (music) and the lighting device (light) in the room where the display device 20 is installed.
　［表示装置の表示画面の構成］
　次に、表示装置２０のホーム（Ｈｏｍｅ）画面の構成について説明する。図５０は、表示装置２０のホーム画面の構成を示す図である。 [Display screen configuration of display device]
Next, the configuration of the home screen of the display device 20 will be described. FIG. 50 is a diagram showing the configuration of the home screen of the display device 20.
　図５０に示されるように、表示装置２０のホーム画面は、（ａ）「Ａｐｐｓ　Ｌａｙｅｒ（アプリレイヤ）」、（ｂ）「Ｐｕｓｈ　Ｌａｙｅｒ（プッシュレイヤ）」、及び、（ｃ）「Ｃｏｎｔｒｏｌ　Ｌａｙｅｒ（コントロールレイヤ）」の３階建ての構造（３層構造）を有している。プッシュレイヤが基点となり、プッシュレイヤの画面が表示されているときにタッチスクリーン２１に対して上から下へ向かう方向のスワイプ操作が行われると、アプリレイヤの画面に遷移する。また、プッシュレイヤの画面が表示されているときにタッチスクリーン２１に対して下から上へ向かう方向のスワイプ操作が行われると、コントロールレイヤの画面に遷移する。 As shown in FIG. 50, the home screen of the display device 20 has (a) "Apps Layer (application layer)", (b) "Push Layer (push layer)", and (c) "Control Layer (control layer)". Layer) ”has a three-story structure (three-layer structure). When the push layer serves as a base point and a swipe operation is performed on the touch screen 21 from the top to the bottom while the push layer screen is displayed, the screen transitions to the application layer screen. When the touch screen 21 is swiped in the direction from the bottom to the top while the push layer screen is displayed, the screen changes to the control layer screen.
　［プッシュレイヤ］
　まず、基点となるプッシュレイヤについて、図５０の（ｂ）を参照しながら説明する。プッシュレイヤは、リコメンド及び通知などの表示装置２０の基本となるプッシュ型インタラクションのレイヤである。プッシュレイヤの画面には、表示装置２０に通信接続される機器から、当該機器が起点として発信する、通知またはリコメンドなどの情報が表示される。 [Push layer]
First, the push layer serving as the base point will be described with reference to FIG. The push layer is a push-type interaction layer that is the basis of the display device 20 such as recommendations and notifications. On the screen of the push layer, information such as a notification or a recommendation transmitted from a device that is communicatively connected to the display device 20 as a starting point is displayed.
　図５０の（ｂ）に示されるように、表示装置２０は、人感センサなどによって表示装置２０の周囲におけるユーザの有無を検知し、ユーザが表示装置２０の周囲（つまり、表示装置２０の近く）にいるときには通知またはリコメンドなどの情報を画面に表示する。一方、表示装置２０は、ユーザが表示装置２０の周囲（つまり、表示装置２０の近く）にいないときには、表示すべき通知またはリコメンドなどの情報があったとしても画面に表示しない。図５１は、ユーザが表示装置２０の近くにいないときのプッシュレイヤの画面の一例を示す図である。 As shown in (b) of FIG. 50, the display device 20 detects the presence or absence of the user around the display device 20 by a human sensor or the like, and the user detects the presence of the user around the display device 20 (that is, near the display device 20). ) Displays information such as notifications or recommendations on the screen. On the other hand, when the user is not around the display device 20 (that is, near the display device 20), the display device 20 does not display the information such as the notification or the recommendation to be displayed on the screen. FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device 20.
　また、表示すべき通知またはリコメンドなどの情報が複数ある場合、これらの情報を示すアイコンは、例えば、左右方向に並んで表示される。図５２は、複数のアイコンを含むプッシュレイヤの画面の一例を示す図である。複数のアイコンは、例えば、情報が生成された時刻が新しいものほど左側、というように、生成された時刻の順序で左右方向に一列に並んで配置される。アイコンの表示領域に対して左右方向のスワイプ操作（言い換えれば、スクロール操作）が行われると、アイコンがスクロールされる。このとき、時刻、日付、及び、天気の表示領域は維持（固定）されたまま、アイコンのみがスクロールされる。複数のアイコンのそれぞれがタップ操作されると、当該アイコンが示す情報に関連するアプリレイヤの画面、または、コントロールレイヤの画面に遷移する。 Also, if there are multiple pieces of information such as notifications or recommendations that should be displayed, the icons indicating these pieces of information are displayed side by side, for example. FIG. 52 is a diagram showing an example of a push layer screen including a plurality of icons. The plurality of icons are arranged in a line in the left-right direction in the order of the generated time, for example, the one having a newer time when the information is generated is on the left side. When a horizontal swipe operation (in other words, scroll operation) is performed on the icon display area, the icon is scrolled. At this time, only the icon is scrolled while the display areas of time, date, and weather are maintained (fixed). When each of the plurality of icons is tapped, the screen changes to the screen of the application layer or the screen of the control layer related to the information indicated by the icon.
　なお、プッシュレイヤの画面は、時間帯に応じて表示態様が変更されてもよい。例えば、プッシュレイヤの画面の背景色は、夜間の時間帯においてそれ以外の時間帯よりも暗い色に変更されてもよい。図５３は、このようなナイトモードにおけるプッシュレイヤの画面の一例を示す図である。 Note that the display mode of the push layer screen may be changed depending on the time of day. For example, the background color of the screen of the push layer may be changed to a darker color in the night time zone than in the other time zones. FIG. 53 is a diagram showing an example of a push layer screen in such a night mode.
　［コントロールレイヤ］
　次に、コントロールレイヤについて、図５０の（ａ）を参照しながら説明する。コントロールレイヤは、キッチンの照明機器を消灯したり、全館空調を設定したりするなど、機器カテゴリ、場所（部屋）ごとにグルーピングされた機器を個別に制御するためのレイヤである。ユーザは、コントロールレイヤの画面に含まれる機器のアイコンをタップ操作することで、機器のオン及びオフを画面遷移なしで行うことができる。つまり、ユーザは、シンプルに機器を制御することができる。また、ユーザは、機器のアイコンをロングタップ操作することで、機器の詳細な制御を行うことができる。 [Control layer]
Next, the control layer will be described with reference to FIG. The control layer is a layer for individually controlling the devices grouped for each device category and place (room), such as turning off lighting devices in the kitchen and setting air conditioning in the whole building. The user can turn the device on and off without screen transition by tapping the device icon included in the control layer screen. That is, the user can simply control the device. Also, the user can perform detailed control of the device by long-tap operation of the device icon.
　複数の機器のアイコンのそれぞれは、当該機器のオン及びオフの状態が一目でわかるように、オン及びオフの状態に応じて異なる態様（例えば、色が異なる態様）で表示される。例えば、機器がオン状態である場合、当該機器のアイコンはカラーで表示され、機器がオフ状態である場合、当該機器のアイコンは、モノクロ（グレースケール、ウォッシュアウト）で表示される。図５４は、機器がオフ状態である場合のコントロールレイヤの画面の一例を示す図である。また、機器のアイコンには、機器の動作状態を示す文字が含まれてもよい。 Respective icons of a plurality of devices are displayed in different modes (for example, in different colors) according to the on and off states so that the on and off states of the devices can be seen at a glance. For example, when the device is in the on state, the icon of the device is displayed in color, and when the device is in the off state, the icon of the device is displayed in monochrome (grayscale, washout). FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state. In addition, the device icon may include characters indicating the operating state of the device.
　コントロールレイヤの画面において、機器のアイコンは、左右方向に一列に並んで配置され、アイコンの表示領域に対して左右方向のスワイプ操作（言い換えれば、スクロール操作）が行われると、アイコンがスクロールされる。複数の機器のアイコンがスクロールすることがユーザに伝わるように、デフォルト状態においてタッチスクリーン２１の最も右側に位置するアイコンは、一部が途切れるように表示される。 On the control layer screen, the device icons are arranged in a line in the left-right direction, and when a left-right swipe operation (in other words, scroll operation) is performed on the icon display area, the icon is scrolled. . The icon located on the rightmost side of the touch screen 21 in the default state is displayed so that a part of the icon is interrupted so that the user can be informed that the icons of a plurality of devices scroll.
　複数の機器のアイコンは、当該機器が設置されている場所（部屋）に応じた順序で配置される。図５０の（ａ）の例では、建物全体に関連するアイコン（例えば、シーン制御のアイコン）が一番左側に配置され、その右側に、表示装置２０が設置されている部屋（例えば、リビング）に設置されている機器のアイコンが配置される。この右側には、例えば、リビングに最も近い部屋に設置されている機器のアイコンが配置される。このように、コントロールレイヤの画面においては、表示装置２０が設置されている部屋に近い部屋に設置されている機器のアイコンほど左側（言い換えれば、デフォルト状態（初期状態）でアクセスしやすい位置）に配置される。つまり、複数の機器のアイコンは、機器の設置位置に基づく順序（言い換えれば、設置位置に関連する順序）で配置される。 -The icons of multiple devices are arranged in the order according to the place (room) where the devices are installed. In the example of FIG. 50A, an icon (for example, a scene control icon) related to the entire building is arranged on the leftmost side, and on the right side thereof, a room (for example, a living room) in which the display device 20 is installed. The icon of the device installed in is placed. On the right side, for example, icons of devices installed in the room closest to the living room are arranged. As described above, on the screen of the control layer, the icon of the device installed in the room closer to the room in which the display device 20 is installed is on the left side (in other words, the position that is easily accessible in the default state (initial state)). Will be placed. That is, the icons of the plurality of devices are arranged in an order based on the installation positions of the devices (in other words, an order related to the installation positions).
　複数の機器のアイコンが一画面に収まらない場合、複数の機器のアイコンのうち比較的左側に配置されているアイコンは、デフォルト状態で画面内に位置するが、比較的右側に配置されているアイコンは、デフォルト状態では画面内に位置せず、スクロールして初めて画面内に現れる。 If the icons of multiple devices do not fit on one screen, the icons on the relatively left side of the icons of the multiple devices are located on the screen in the default state, but are on the relatively right side. Is not on the screen in the default state and appears on the screen only after scrolling.
　表示装置２０を通じて制御可能な複数の機器の数が多い場合、複数の機器のアイコンの数は非常に多くなる。そこで、コントロールレイヤの画面の左下には、ジャンプショートカット（「全室」、「リビング」、「キッチン」などの建物の中の場所（空間）を示す文字）が設けられている。ユーザは、ジャンプショートカットをタップ操作することで、タップ操作された文字が示す場所に設置された機器のアイコンを画面内に位置させる（複数のアイコンが自動的にスクロールする）ことができる。 When the number of devices that can be controlled through the display device 20 is large, the number of icons of the devices is very large. Therefore, a jump shortcut (characters indicating a place (space) in the building such as “all rooms”, “living room”, and “kitchen”) is provided at the lower left of the screen of the control layer. By tapping the jump shortcut, the user can position the icon of the device installed at the location indicated by the tapped character on the screen (a plurality of icons automatically scroll).
　なお、機器のアイコンの配置は、ユーザの好みに応じて変更することもできる。図５５は、機器のアイコンの移動及び削除画面の一例を示す図である。ユーザは、機器のアイコンの移動及び削除画面において、機器のアイコンに対してドラッグアンドドロップ操作を行うことで、機器のアイコンの配置（左右の位置関係）を変更することができる。 Note that the device icon layout can be changed according to the user's preference. FIG. 55 is a diagram showing an example of a screen for moving and deleting icons of devices. The user can change the arrangement (left-right positional relationship) of the device icon by performing a drag-and-drop operation on the device icon on the device icon movement / deletion screen.
　［アプリレイヤ］
　次に、アプリレイヤについて、図５０の（ｃ）を参照しながら説明する。アプリレイヤは、建物における消費電力をチェックしたり、動画を視聴したりするために使用される。アプリレイヤでは、複数のアイコンが、ユーザのやりたい行動、体験アクションごとにカテゴライズされる。また、デベロッパから提供される新たなアプリケーション、及び、将来的に提供される新たなサービスは、アプリレイヤに追加される。アプリレイヤの画面からは、図１６～図３５で説明したアプリケーションプログラムを実行することができる。 [App layer]
Next, the application layer will be described with reference to FIG. The application layer is used to check the power consumption in the building and watch a video. In the application layer, multiple icons are categorized according to the user's desired action or experience action. Also, new applications provided by the developer and new services provided in the future are added to the application layer. The application program described in FIGS. 16 to 35 can be executed from the application layer screen.
　なお、アプリレイヤから実行できることと、コントロールレイヤから実行できることとは、例えば、以下のように分類される。アプリレイヤから実行できることは、いわゆる家電（建物の壁などに固定されていない機器）など、追加及び変更が容易な機器、及び、設備機器（建物の壁などに固定されている照明機器、空調機器などの機器）であるが情報を参照して動作する機器の制御などである。 What can be executed from the application layer and what can be executed from the control layer are classified as follows, for example. What can be executed from the application layer is equipment that is easy to add and change, such as so-called home appliances (equipment that is not fixed to the wall of the building), and equipment (lighting equipment and air conditioning equipment that is fixed to the wall of the building, etc.). Device) but refers to control of a device that operates by referring to information.
　一方、コントロールレイヤから実行できることは、設備機器の制御などである。なお、アプリレイヤ及びコントロールレイヤの両方から同じ制御が実行できる場合もある。 On the other hand, what can be executed from the control layer is control of equipment. In some cases, the same control can be executed from both the application layer and the control layer.
　［距離別状態表示］
　プッシュレイヤの画面は、表示装置２０と表示装置２０の前に立つ人との距離に応じて表示態様が変更されてもよい。つまり、表示装置２０は、ユーザとの距離に応じて表示を自動で切り替えてもよい。図５６は、プッシュレイヤの画面の表示態様の変更を説明するための図である。 [Display status by distance]
The display mode of the push layer screen may be changed according to the distance between the display device 20 and a person standing in front of the display device 20. That is, the display device 20 may automatically switch the display according to the distance to the user. FIG. 56 is a diagram for explaining the change of the display mode of the push layer screen.
　図５６に示されるように、プッシュレイヤの画面は、ユーザが表示装置２０から１ｍの範囲に位置している場合（例えば、ユーザが表示装置２０を操作中、または、表示装置２０の目の前に立っている状態）には通常状態で表示される。プッシュレイヤの画面は、ユーザが表示装置２０から１ｍ以上３ｍ未満の範囲に位置している場合（ユーザが表示装置２０が設置された部屋にいる場合）には、アンビエント状態で表示される。また、プッシュレイヤの画面は、ユーザが表示装置２０から３ｍ以上離れて位置している場合（例えば、ユーザが表示装置２０が設置された部屋に不在の場合）には、スリープ状態（例えば、黒画）で表示される。 As shown in FIG. 56, the screen of the push layer is when the user is located within a range of 1 m from the display device 20 (for example, while the user is operating the display device 20 or in front of the display device 20). Standing state) is displayed in the normal state. The screen of the push layer is displayed in the ambient state when the user is located within the range of 1 m or more and less than 3 m from the display device 20 (when the user is in the room where the display device 20 is installed). Also, the push layer screen is in a sleep state (for example, black when the user is located 3 m or more away from the display device 20 (for example, when the user is not in the room where the display device 20 is installed)). Image).
　アンビエント状態は、通知が主張しすぎないよう配慮しつつ、離れた位置からでも通知の有無を確認できるような状態を意味する。アンビエント状態のプッシュレイヤの画面は、例えば、白色の背景に時刻と通知アイコンとを表示することによって実現される。 Ambient state means a state in which the presence or absence of a notification can be confirmed even from a distant position while taking care not to insist on the notification too much. The push layer screen in the ambient state is realized, for example, by displaying the time and the notification icon on a white background.
　なお、プッシュレイヤの画面においては、画面の左側に、現在の日時、及び、天気などが常に表示される。このように、ユーザが常に表示させておきたい情報は、ユーザ設定によって変更されてもよい。ユーザが常に表示させておきたい情報には、具体的には、時刻、天気、室外の温度及び湿度、室内の温度及び湿度、空気質（言い換えれば、空気の汚れ具合。におい、及び、ＰＭ２．５濃度など）、電力使用量、太陽光発電システムなどの発電量、家族のスケジュール、今日は何の日か、などが含まれる。ユーザが常に表示させておきたい情報は、文字または表示を大きめにするなど、多少離れた位置からでもユーザが視認できることが考慮されるとよい。 Note: On the push layer screen, the current date and time, weather, etc. are always displayed on the left side of the screen. In this way, the information that the user always wants to display may be changed by the user setting. The information that the user always wants to display includes, specifically, time, weather, outdoor temperature and humidity, indoor temperature and humidity, air quality (in other words, the degree of contamination of air. Smell, and PM2. 5 concentration, etc., power consumption, power generation amount of solar power generation system, family schedule, what day is today, etc. The information that the user always wants to display may be considered such that the user can visually recognize it even from a slightly distant position, for example, by enlarging the characters or the display.
　［プッシュレイヤ以外の表示レイヤにおける通知］
　表示装置２０において、コントロールレイヤの画面、または、アプリレイヤの画面が表示されているときにユーザに対して通知すべき情報が発生した場合の通知方法について説明する。コントロールレイヤの画面、または、アプリレイヤの画面が表示されているときに行われる通知には、通常プッシュ通知と、強制優先プッシュ通知とがある。図５７は、アプリレイヤの画面が表示されているときに行われる通知を説明するための図である。なお、図示されないが、コントロールレイヤの画面が表示されているときに行われる通知も同様である。 [Notification in display layer other than push layer]
A method of notifying when the screen of the control layer or the screen of the application layer is displayed on the display device 20 and information to be notified to the user occurs will be described. The notification given when the screen of the control layer or the screen of the application layer is displayed includes a normal push notification and a forced priority push notification. FIG. 57 is a diagram for explaining a notification performed when the application layer screen is displayed. Although not shown, the same applies to the notification given when the screen of the control layer is displayed.
　図５７の（ａ）及び（ｂ）に示されるように、通常プッシュ通知では、アプリレイヤの画面の上部に、通知内容が重畳表示される。アプリケーションの実行中には、アプリケーションの実行画面（図１７～図３５のような画面）では通知は行われず、実行画面からアプリレイヤの画面に戻ったときに、画面の上部に通知内容が重畳される。通知内容が重畳された領域がタップ操作されると、例えば、通知が終了されて図５７の（ａ）の状態に戻る。通知が機器の制御に関するものである場合、通知内容が重畳された領域がタップ操作されると、機器を制御するための画面（コントロールレイヤの画面、後述の制御画面など）に遷移する。 As shown in (a) and (b) of FIG. 57, in the normal push notification, the content of the notification is superimposed and displayed on the upper part of the screen of the application layer. While the application is being executed, the notification is not displayed on the application execution screen (screens shown in FIGS. 17 to 35), and when the execution screen returns to the app layer screen, the notification content is superimposed on the upper part of the screen. It When the area on which the notification content is superimposed is tap-operated, for example, the notification ends and the state returns to the state of (a) of FIG. When the notification is related to control of the device, when the area on which the notification content is superimposed is tapped, a screen for controlling the device (control layer screen, control screen described later, etc.) is displayed.
　通常プッシュ通知として行われる通知は、例えば、表示装置２０の設置記念日の通知、ユーザまたは家族の誕生日の通知、重要メッセージの通知、温度及び湿度が異常であることの通知、電動シャッターが開くときの通知、電気錠が開くときの通知、宅配ボックスに関する通知などである。 Notifications that are normally performed as push notifications include, for example, notification of the anniversary of the installation of the display device 20, notification of the birthday of the user or family, notification of an important message, notification of abnormal temperature and humidity, and opening of the electric shutter. The notification includes a notification of the time, a notification when the electric lock is opened, and a notification regarding the delivery box.
　一方、強制優先プッシュ通知は、着信のようにユーザによる即時の対応が必要な通知であり、言い換えれば、どんな操作が行われていてもすぐに知らせたい（通常プッシュ通知よりも重要度が高い）通知である。図５７の（ａ）及び図５７の（ｃ）に示されるように、強制優先プッシュ通知をする必要が生じた場合には、操作中であっても全画面が通知画面に切り替えられる。 On the other hand, the forced priority push notification is a notification that requires immediate response from the user like an incoming call, in other words, it wants to be notified immediately regardless of any operation (more important than normal push notification). It is a notification. As shown in (a) of FIG. 57 and (c) of FIG. 57, when the forced priority push notification is required, the entire screen is switched to the notification screen even during the operation.
　強制優先プッシュ通知として行われる通知は、例えば、停電（連携／非連携）の通知、電力の使用過多の通知（ピークアラーム）、インターホン装置による訪問者を示す通知（図５７の（ｃ））、他の部屋（つまり、他の表示装置２０）からのコールなどが含まれる。 The notification performed as the forced priority push notification includes, for example, a power outage (cooperation / non-cooperation) notification, a power overuse notification (peak alarm), a notification indicating a visitor by an intercom device ((c) in FIG. 57), Calls from other rooms (that is, other display devices 20) are included.
　［チュートリアルの表示］
　表示装置２０は、アプリケーションなどの初回起動時に、チュートリアル（具体的には、そのアプリケーションでできることの概要、及び、代表的な操作など）を表示する。図５８は、最初にコントロールレイヤの画面が表示されたときに（図５８の（ａ）、（ｂ））、コントロールレイヤのチュートリアルが表示される（図５８の（ｃ））例を説明するための図である。 [View Tutorial]
The display device 20 displays a tutorial (specifically, an outline of what can be done by the application and typical operations) when the application or the like is activated for the first time. FIG. 58 is for explaining an example in which the tutorial of the control layer is displayed ((c) of FIG. 58) when the screen of the control layer is first displayed ((a) and (b) of FIG. 58). FIG.
　チュートリアルの表示には、アニメーション（言い換えれば、動画）が用いられる。個別に説明が必要な場合には、画面上に吹き出しまたは文字が表示されたり、画面上に操作を予期させるアニメーションが表示されたりする。これにより、表示装置２０は、操作方法をわかりやすくユーザに提示することができる。 Animation (in other words, video) is used to display the tutorial. When individual explanation is required, a balloon or a character is displayed on the screen, or an animation for predicting an operation is displayed on the screen. Accordingly, the display device 20 can present the operation method to the user in an easy-to-understand manner.
　チュートリアルでは、情報量（文言及び内容など）をそぎ落とすことで、ユーザがストレスを感じることが抑制される。また、チュートリアルは、ユーザが必要な箇所に素早くアクセスできるように、スワイプ操作などのユーザ操作で次の項目に進める構成となっており、これによりユーザがわずらわしさを感じることが抑制される。詳細な機能及び操作説明はオンラインマニュアルに記載され、表示装置２０は、オンラインマニュアルの記載場所へユーザがスムーズにたどり着くことができるように案内表示を行う。 ▽ In the tutorial, by removing the amount of information (words and contents, etc.), it is possible to prevent users from feeling stress. In addition, the tutorial is configured to advance to the next item by a user operation such as a swipe operation so that the user can quickly access a necessary portion, and this can prevent the user from feeling annoying. Detailed functions and operating instructions are described in the online manual, and the display device 20 displays guidance so that the user can smoothly reach the place where the online manual is described.
　［全館空調の制御画面］
　次に、ユーザがコントロールレイヤから機器を制御するときの詳細画面（以下、制御画面とも記載される）について説明する。まず、建物の中の全館空調を行うための制御画面について、図示により説明する。図５９は、コントロールレイヤの画面に表示される全館空調を行うためのアイコン（以下、単に、全館空調のアイコンとも記載される）の一例（具体的には、全館空調の状態に応じたアイコンの変化の一例）を示す図である。図６０は、全館空調のアイコンが操作されたときの画面遷移を示す図である。なお、全館空調のアイコンは、例えば、コントロールレイヤの画面の「全室」タブにはグルーピング（言い換えれば、関連付け）されない。また、全館空調は、常時オンが基本であり、シングルタップ操作に適していないため、全館空調のアイコンに対してシングルタップ操作及びロングタップ操作のいずれの操作が行われた場合も図６０のモーダルウィンドウが表示される。全館空調は、表示装置２０からはオフにできない仕様であってもよい。 [Control screen for the entire building air conditioning]
Next, a detailed screen (hereinafter, also referred to as a control screen) when the user controls the device from the control layer will be described. First, a control screen for performing air conditioning in the entire building will be described with reference to the drawings. FIG. 59 is an example of an icon (hereinafter, also simply referred to as an entire building air conditioning icon) for performing the entire building air conditioning displayed on the screen of the control layer (specifically, an icon corresponding to the state of the entire air conditioning). It is a figure which shows an example of a change. FIG. 60 is a diagram showing screen transitions when the icon for the air conditioning in the entire building is operated. It should be noted that the entire building air conditioning icon is not grouped (in other words, associated) with the "all rooms" tab on the control layer screen, for example. In addition, the entire building air conditioning is basically always on and is not suitable for single tap operation. Therefore, even if either single tap operation or long tap operation is performed on the entire building air conditioning icon, the modal shown in FIG. A window is displayed. The entire building air conditioning may have a specification that cannot be turned off from the display device 20.
　なお、図６１は、自動セーブ運転時の全館空調の制御画面の一例を示す図であり、図６２は、お出かけモード（お出かけ中）における全館空調の制御画面の一例を示す図である。これらの制御画面は、全館空調システムのオリジナルリモートコントローラから操作が行われたときのみ表示される。 61. FIG. 61 is a diagram showing an example of the control screen for the entire building air conditioning during the automatic save operation, and FIG. 62 is a diagram showing an example of the control screen for the whole building air conditioning in the outing mode (during outing). These control screens are displayed only when an operation is performed from the original remote controller of the air conditioning system in the whole building.
　［空調機器の制御画面］
　次に、空調機器の制御画面について、図示により説明する。図６３は、コントロールレイヤの画面に表示される空調機器を制御するためのアイコン（以下、単に、空調機器のアイコンとも記載される）の一例（具体的には、空調機器の状態に応じたアイコンの変化の一例）を示す図である。図６４は、空調機器のアイコンがロングタップ操作されたときの画面遷移を示す図である。 [Control screen of air conditioning equipment]
Next, the control screen of the air conditioner will be described with reference to the drawings. FIG. 63 is an example of an icon (hereinafter, also simply referred to as an icon of an air conditioner) for controlling the air conditioner displayed on the screen of the control layer (specifically, an icon corresponding to the state of the air conditioner). FIG. 4 is a diagram showing an example of the change of FIG. FIG. 64 is a diagram showing screen transitions when the icon of the air conditioner is long-tap operated.
　［ヒートポンプ式給湯器の制御画面］
　次に、ヒートポンプ式給湯器の制御画面について、図示により説明する。図６５は、コントロールレイヤの画面に表示されるヒートポンプ式給湯器を制御するためのアイコン（以下、単に、ヒートポンプ式給湯器のアイコンとも記載される）の一例（具体的には、ヒートポンプ式給湯器の状態に応じたアイコンの変化の一例）を示す図である。図６６は、ヒートポンプ式給湯器のアイコンがロングタップ操作されたときの画面遷移を示す第一の図である。図６７は、ヒートポンプ式給湯器のアイコンがロングタップ操作されたときの画面遷移を示す第二の図である。なお、ガス給湯器についても同様のアイコンが使用され、同様の画面遷移が行われる。 [Control screen of heat pump water heater]
Next, the control screen of the heat pump water heater will be described with reference to the drawings. FIG. 65 is an example of an icon (hereinafter, also simply referred to as a heat pump water heater icon) for controlling the heat pump water heater displayed on the screen of the control layer (specifically, a heat pump water heater). FIG. 4 is a diagram showing an example of change of an icon according to the state of FIG. FIG. 66 is a first diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater. FIG. 67 is a second diagram showing a screen transition when a long tap operation is performed on the icon of the heat pump water heater. Similar icons are used for the gas water heater, and similar screen transitions are performed.
　［燃料電池システムが備える給湯器の制御画面］
　次に、燃料電池システムが備える給湯器の制御画面について、図示により説明する。図６８は、コントロールレイヤの画面に表示される、燃料電池システムが備える給湯器を制御するためのアイコン（以下、単に、燃料電池システムのアイコンとも記載される）の一例（具体的には、燃料電池システムが備える給湯器の状態に応じたアイコンの変化の一例）を示す図である。図６９は、燃料電池システムのアイコンがロングタップ操作されたときの画面遷移を示す図である。 [Control screen of the water heater provided in the fuel cell system]
Next, the control screen of the water heater provided in the fuel cell system will be described with reference to the drawings. FIG. 68 is an example of an icon (specifically, also referred to as an icon of the fuel cell system, hereinafter) for controlling the water heater provided in the fuel cell system, which is displayed on the screen of the control layer (specifically, fuel). It is a figure which shows an example of a change of the icon according to the state of the water heater with which a battery system is equipped. FIG. 69 is a diagram showing screen transitions when a long tap operation is performed on the icon of the fuel cell system.
　［電動シャッターの制御画面］
　次に、電動シャッターの制御画面について、図示により説明する。図７０は、コントロールレイヤの画面に表示される、電動シャッターを制御するためのアイコン（以下、単に、電動シャッターのアイコンとも記載される）の一例（具体的には、電動シャッターの状態に応じたアイコンの変化の一例）を示す図である。図７０に示されるように、電動シャッターの動作中は、アイコンがアニメーションされることでユーザに電動シャッターの状態をわかりやすく提示することができる。なお、電動ブラインドについても同様のアイコン（アイコンのタイトルは「シャッター」から「ブラインド」に変更される）が使用される。 [Control screen of electric shutter]
Next, the control screen of the electric shutter will be described with reference to the drawings. FIG. 70 shows an example of an icon (hereinafter, also simply referred to as an electric shutter icon) for controlling the electric shutter displayed on the screen of the control layer (specifically, depending on the state of the electric shutter). It is a figure which shows an example of a change of an icon. As shown in FIG. 70, during the operation of the electric shutter, the icon is animated to present the state of the electric shutter to the user in an easy-to-understand manner. A similar icon (the title of the icon is changed from "shutter" to "blind") is also used for the electric blind.
　図７１は、電動シャッター（または電動ブラインド）のアイコンがロングタップ操作されたときの画面遷移を示す図である。コントロールレイヤの画面の「全室」タブにグルーピング（言い換えれば、関連付け）された電動シャッターのアイコンがロングタップ操作された場合には、建物の中の複数の電動シャッターが一括制御される。コントロールレイヤの画面の各部屋タブにグルーピングされた電動シャッターのアイコンがロングタップ操作された場合には、当該部屋に設置された電動シャッターが制御される。 FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter (or the electric blind) is long-tap operated. When a long-tap operation is performed on the electric shutter icon grouped (in other words, associated) with the “all rooms” tab on the control layer screen, a plurality of electric shutters in the building are collectively controlled. When the icon of the electric shutter grouped in each room tab on the screen of the control layer is long-tap operated, the electric shutter installed in the room is controlled.
　［電気錠の制御画面］
　次に、電気錠の制御画面について、図示により説明する。図７２は、コントロールレイヤの画面に表示される、電気錠を制御するためのアイコン（以下、単に、電気錠のアイコンとも記載される）の一例（具体的には、電動錠の状態に応じたアイコンの変化の一例）を示す図である。図７３は、電気錠のアイコンがロングタップ操作されたときの画面遷移を示す図である。コントロールレイヤの画面の「全室」タブにグルーピングされた電気錠のアイコンがロングタップ操作された場合には、建物の中の複数の電気錠が一括制御される。コントロールレイヤの画面の各部屋タブにグルーピングされた電気錠のアイコンがロングタップ操作された場合には、当該部屋に設置された電気錠が制御される。 [Control screen of electric lock]
Next, the control screen of the electric lock will be described with reference to the drawings. FIG. 72 shows an example of an icon (hereinafter, also simply referred to as an electric lock icon) for controlling the electric lock displayed on the screen of the control layer (specifically, depending on the state of the electric lock). It is a figure which shows an example of a change of an icon. FIG. 73 is a diagram showing screen transitions when a long tap operation is performed on the electric lock icon. When the electric lock icon grouped in the "All rooms" tab on the control layer screen is long-tapped, a plurality of electric locks in the building are collectively controlled. When the electric lock icon grouped in each room tab on the screen of the control layer is long-tap operated, the electric lock installed in the room is controlled.
　［空気清浄機の制御画面］
　次に、空気清浄機（例えば、天井埋め込み型の空気清浄機）の制御画面について、図示により説明する。図７４は、コントロールレイヤの画面に表示される、空気清浄機を制御するためのアイコン（以下、単に、空気清浄機のアイコンとも記載される）の一例（具体的には、空気清浄機の状態に応じたアイコンの変化の一例）を示す図である。図７５は、空気清浄機のアイコンがロングタップ操作されたときの画面遷移を示す図である。 [Air purifier control screen]
Next, a control screen of an air cleaner (for example, a ceiling-embedded air cleaner) will be described with reference to the drawings. FIG. 74 shows an example of an icon for controlling the air purifier (hereinafter, also simply referred to as an air purifier icon) displayed on the screen of the control layer (specifically, the state of the air purifier). FIG. 6 is a diagram showing an example of change of an icon according to FIG. FIG. 75: is a figure which shows a screen transition when the icon of an air purifier is long tap-operated.
　［機器がイレギュラーな状態であることを示す画面］
　コントロールレイヤの画面において、システム異常時、オフライン時、不定時など、機器がイレギュラーな状態に陥った場合には、機器のアイコンが異常を示す態様に変化する。異常を示しているアイコンが操作されると、イレギュラーな状態であることを示す画面が表示される。図７６は、機器がイレギュラーな状態に陥った場合の画面遷移を示す図である。図７６の（ａ）は、システム異常時の画面の一例を示す図であり、図７６の（ｂ）は、オフライン時の画面の一例を示す図である。 [Screen showing that the device is in an irregular state]
When the device falls into an irregular state on the screen of the control layer, such as when the system is abnormal, offline, or indefinite, the icon of the device changes to a mode indicating an abnormality. When the icon indicating an abnormality is operated, a screen indicating that it is in an irregular state is displayed. FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state. 76 (a) is a diagram showing an example of a screen when the system is abnormal, and FIG. 76 (b) is a diagram showing an example of a screen when offline.
　なお、イレギュラーな状態は、例えば、離脱状態、不定状態、及び、故障状態に区別される。離脱状態は、表示装置２０と機器との通信接続が途絶えた状態を意味し、不定状態は、表示装置２０と機器とは通信接続されているが数値検出まで時間がかかる状態（例えば、起動中の状態）を意味する。故障状態は、機器そのものが故障していることを意味する。 Note that irregular states are classified into, for example, a detached state, an indefinite state, and a failure state. The detached state means a state in which the communication connection between the display device 20 and the device is lost, and the indefinite state is a state in which the display device 20 and the device are connected by communication but it takes time to detect a numerical value (for example, starting State). The failure state means that the device itself is out of order.
　［初期設定画面］
　表示装置２０は、設置時に当該表示装置２０の設置場所が設定される。図７７は、このような初期設定画面、及び、初期設定画面からの画面遷移を示す図である。図７７に示されるように、初期設定画面（図７７の（ａ））に設置場所の名称を入力するときには、入力画面（図７７の（ｂ））に遷移する。 [Initial setting screen]
The installation location of the display device 20 is set when the display device 20 is installed. FIG. 77 is a diagram showing such an initial setting screen and screen transition from the initial setting screen. As shown in FIG. 77, when inputting the name of the installation place on the initial setting screen ((a) of FIG. 77), the screen changes to the input screen ((b) of FIG. 77).
　初期設定が完了すると、初期設定が完了したことを通知する画面（図７７の（ｃ））が表示される。その後、所定の操作（図７７の例では、上方向へのスワイプ操作）が行われると、プッシュレイヤの画面（図７７の（ｄ））に遷移する。このとき、上述のようにチュートリアルの画面がモーダルウィンドウとして自動的に表示される（図７７の（ｅ））。 When the initial settings are completed, the screen ((c) in Fig. 77) notifying that the initial settings are completed is displayed. After that, when a predetermined operation (in the example of FIG. 77, a swipe operation in the upward direction) is performed, the screen changes to the push layer screen ((d) of FIG. 77). At this time, the tutorial screen is automatically displayed as a modal window as described above ((e) in FIG. 77).
　［表示制御システムの構成］
　次に、表示装置２０を含む表示制御システムであって、実施の形態に係る表示制御システムの構成について説明する。図７８は、実施の形態に係る表示制御システムの機能構成を示すブロック図である。 [Display control system configuration]
Next, a configuration of a display control system including the display device 20, which is a display control system according to the embodiment will be described. FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment.
　実施の形態に係る表示制御システム１０は、制御対象機器（第一制御対象機器４１及び第二制御対象機器４２）を制御するための画像の表示を行うシステムである。表示制御システム１０は、表示装置２０と、制御装置３０と、第一制御対象機器４１と、第二制御対象機器４２と、センサ４３と、サーバ装置５０とを備える。表示装置２０、制御装置３０、第一制御対象機器４１、第二制御対象機器４２、及び、センサ４３は、例えば、住宅などの建物、または、当該建物の敷地内に設置される。 The display control system 10 according to the embodiment is a system that displays an image for controlling the control target devices (the first control target device 41 and the second control target device 42). The display control system 10 includes a display device 20, a control device 30, a first control target device 41, a second control target device 42, a sensor 43, and a server device 50. The display device 20, the control device 30, the first control target device 41, the second control target device 42, and the sensor 43 are installed in, for example, a building such as a house or the site of the building.
　表示装置２０は、機器の制御に関するユーザーインターフェース装置として機能する装置である。表示装置２０は、建物に設置された複数の機器に直接的または間接的に通信可能に接続される。言い換えれば、表示装置２０は、住設機器または家電機器などを含む制御対象機器と直接または制御装置を介して間接に接続される。表示装置２０は、例えば、建物内部の壁に設置される。表示装置２０は、タッチスクリーン２１と、制御部２２と、記憶部２３と、通信部２４とを備える。 The display device 20 is a device that functions as a user interface device related to device control. The display device 20 is directly or indirectly communicatively connected to a plurality of devices installed in a building. In other words, the display device 20 is directly or indirectly connected to a control target device including a home appliance, a home electric appliance, or the like via the control device. The display device 20 is installed, for example, on a wall inside a building. The display device 20 includes a touch screen 21, a control unit 22, a storage unit 23, and a communication unit 24.
　タッチスクリーン２１は、具体的には、ユーザの操作を受け付けるタッチパネル２１ａと、画像（動画像または静止画像）を表示する表示部２１ｂとを含む。タッチパネル２１ａは、取得部の一例である。タッチパネル２１ａは、例えば、静電容量方式のタッチパネルであるが、抵抗膜方式のタッチパネルであってもよい。表示部２１ｂは、例えば、液晶パネルまたは有機ＥＬ（Ｅｌｅｃｔｒｏ　Ｌｕｍｉｎｅｓｃｅｎｃｅ）パネルなどの表示パネルである。 Specifically, the touch screen 21 includes a touch panel 21a that receives a user operation and a display unit 21b that displays an image (moving image or still image). The touch panel 21a is an example of an acquisition unit. The touch panel 21a is, for example, a capacitance type touch panel, but may be a resistive film type touch panel. The display unit 21b is, for example, a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel.
　制御部２２は、タッチパネル２１ａによって受け付けられた操作に応じて制御対象機器を動作させるための制御、及び、表示部２１ｂへの画像の表示に関する制御を行う。制御部２２は、例えば、マイクロコンピュータによって実現されるが、プロセッサによって実現されてもよい。 The control unit 22 performs control for operating the control target device according to the operation received by the touch panel 21a and control for displaying an image on the display unit 21b. The control unit 22 is realized by, for example, a microcomputer, but may be realized by a processor.
　記憶部２３は、制御部２２が実行する制御プログラムなどが記憶される記憶装置である。記憶部２３は、例えば、半導体メモリなどによって実現される。 The storage unit 23 is a storage device in which a control program executed by the control unit 22 is stored. The storage unit 23 is realized by, for example, a semiconductor memory.
　通信部２４は、表示装置２０が、制御装置３０、第二制御対象機器４２、及び、サーバ装置５０と通信するための通信回路（言い換えれば、通信モジュール）である。通信部２４は、例えば、制御部２２の制御に基づいて制御対象機器の制御要求を制御装置３０に送信する。また、通信部２４は、制御部２２の制御に基づいて、第二制御対象機器４２を制御するための制御信号を第二制御対象機器４２に送信する。通信部２４は、例えば、センサからセンシング結果を示す信号を受信する。通信部２４は、例えば、無線通信を行うが、有線通信を行ってもよい。通信部２４によって行われる通信の通信規格は特に限定されない。 The communication unit 24 is a communication circuit (in other words, a communication module) for the display device 20 to communicate with the control device 30, the second controlled device 42, and the server device 50. The communication unit 24 transmits a control request for the control target device to the control device 30 based on the control of the control unit 22, for example. Further, the communication unit 24 transmits a control signal for controlling the second control target device 42 to the second control target device 42 based on the control of the control unit 22. The communication unit 24 receives, for example, a signal indicating the sensing result from the sensor. The communication unit 24 performs wireless communication, for example, but may perform wired communication. The communication standard of communication performed by the communication unit 24 is not particularly limited.
　制御装置３０は、例えば、ＨＥＭＳ（Ｈｏｍｅ　Ｅｎｅｒｇｙ　Ｍａｎａｇｅｍｅｎｔ　Ｓｙｓｔｅｍ）コントローラであり、通信部２４によって送信される制御要求に基づいて、第一制御対象機器４１の制御を行う。制御装置３０は、エネルギーマネジメント機能を有するＨＥＭＳコントローラに限定されず、エネルギーマネジメント機能を有しない他のホームコントローラ、または、ゲートウェイ装置であってもよい。 The control device 30 is, for example, a HEMS (Home Energy Management System) controller, and controls the first control target device 41 based on a control request transmitted by the communication unit 24. The control device 30 is not limited to the HEMS controller having the energy management function, and may be another home controller having no energy management function or a gateway device.
　第一制御対象機器４１は、制御装置３０によって制御される機器であり、表示装置２０に間接的に通信可能に接続される。第一制御対象機器４１は、具体的には、制御装置３０から送信される制御信号に基づいて動作する。第一制御対象機器４１には、例えば、蓄電池システム、燃料電池システム、太陽光発電システム、照明機器、ヒートポンプ式給湯機、電動シャッター、または、電気錠などの機器が含まれる。なお、制御装置３０及び第一制御対象機器４１の間では、例えば、Ｅｃｈｏｎｅｔ　Ｌｉｔｅ（登録商標）などの通信規格に準拠した無線通信が行われる。 The first controlled device 41 is a device controlled by the control device 30 and is indirectly connected to the display device 20 so as to be communicable. Specifically, the first control target device 41 operates based on a control signal transmitted from the control device 30. The first control target device 41 includes, for example, a storage battery system, a fuel cell system, a solar power generation system, a lighting device, a heat pump water heater, an electric shutter, or a device such as an electric lock. In addition, between the control device 30 and the first control target device 41, for example, wireless communication based on a communication standard such as Echonet Lite (registered trademark) is performed.
　第二制御対象機器４２は、表示装置２０によって制御される機器であり、表示装置２０に直接的に通信可能に接続される。第二制御対象機器４２は、具体的には、表示装置２０から送信される制御信号に基づいて動作する。第二制御対象機器４２には、例えば、インターホン装置、または、空調機器などの機器が含まれる。 The second control target device 42 is a device controlled by the display device 20, and is directly communicably connected to the display device 20. The second controlled device 42 specifically operates based on a control signal transmitted from the display device 20. The second control target device 42 includes, for example, a device such as an intercom device or an air conditioning device.
　なお、第一制御対象機器４１として説明された機器が第二制御対象機器４２に含まれてもよいし、第二制御対象機器４２として説明された機器が第一制御対象機器４１に含まれてもよい。制御対象の機器には、住設機器または家電機器が含まれればよい。 The device described as the first control target device 41 may be included in the second control target device 42, and the device described as the second control target device 42 may be included in the first control target device 41. Good. The equipment to be controlled may include household equipment or household appliances.
　センサ４３は、建物内の環境などをセンシングし、センシング結果を示す信号を表示装置２０に送信する。これにより、表示装置２０は、建物内の環境を表示することができる。また、表示装置２０は、建物内の環境に基づいて制御対象機器を制御することもできる。センサ４３には、圧力センサ、温度センサ、湿度センサ、または、照度センサなどが含まれる。 The sensor 43 senses the environment inside the building and transmits a signal indicating the sensing result to the display device 20. Accordingly, the display device 20 can display the environment inside the building. In addition, the display device 20 can also control the control target device based on the environment in the building. The sensor 43 includes a pressure sensor, a temperature sensor, a humidity sensor, an illuminance sensor, or the like.
　サーバ装置５０は、クラウドサーバである。サーバ装置５０及び表示装置２０が連携することにより様々なサービスが実現される。 The server device 50 is a cloud server. Various services are realized by the cooperation of the server device 50 and the display device 20.
　［動作］
　次に、表示制御システム１０の動作（言い換えれば、表示装置２０などのコンピュータによって実行される表示制御方法）について説明する。図７９は、表示制御システム１０の動作例１のフローチャートである。なお、図７９の動作は、図５０をベースとした、図５７の通常プッシュ通知の場合に対応する動作であり、以下では図５０、図５７、及び、図７９を用いて説明が行われる。 [motion]
Next, an operation of the display control system 10 (in other words, a display control method executed by a computer such as the display device 20) will be described. FIG. 79 is a flowchart of the operation example 1 of the display control system 10. The operation of FIG. 79 is an operation corresponding to the case of the normal push notification of FIG. 57 based on FIG. 50, and will be described below with reference to FIGS. 50, 57, and 79.
　まず、表示装置２０の制御部２２は、タッチスクリーン２１（より具体的には、表示部２１ｂ）に、第１の表示レイヤを表示する（Ｓ１１）。第１の表示レイヤは、例えば、図５０の（ｂ）のプッシュレイヤに相当する。第１の表示レイヤは、第１のカテゴリに属する表示オブジェクトを有する。第１のカテゴリに属する表示オブジェクトは、具体的には、図５０の（ｂ）において、プッシュレイヤの画面に表示されている矩形のアイコンである。第１のカテゴリは、例えば、制御対象機器（言い換えれば、複数の機器）の各々の状態を通知するためのユーザーインターフェースである。 First, the control unit 22 of the display device 20 displays the first display layer on the touch screen 21 (more specifically, the display unit 21b) (S11). The first display layer corresponds to, for example, the push layer in (b) of FIG. The first display layer has display objects belonging to the first category. Specifically, the display object belonging to the first category is a rectangular icon displayed on the push layer screen in FIG. 50 (b). The first category is, for example, a user interface for notifying the state of each device to be controlled (in other words, a plurality of devices).
　次に、タッチパネル２１ａは、第１の表示レイヤがタッチスクリーン２１に表示されている間に行われた当該タッチスクリーン２１に対する第１の接触に関する情報を取得する（Ｓ１２）。 Next, the touch panel 21a acquires information regarding the first touch on the touch screen 21 performed while the first display layer is displayed on the touch screen 21 (S12).
　次に、制御部２２は、第１の接触に関する情報が、第１の方向への接触位置の移動を含むか否かを判定する（Ｓ１３）。第１の方向の方向への接触位置の移動は、例えば、上方向へのスワイプ操作に基づく接触位置の移動である。 Next, the control unit 22 determines whether the information on the first contact includes the movement of the contact position in the first direction (S13). The movement of the contact position in the first direction is, for example, movement of the contact position based on an upward swipe operation.
　制御部２２は、第１の接触に関する情報が、第１の方向への接触位置の移動を含むと判定した場合に（Ｓ１３でＹｅｓ）、表示部２１ｂに表示される画像を第１の表示レイヤから第２の表示レイヤに移行させる（Ｓ１４）。第２の表示レイヤは、例えば、図５０の（ｃ）のコントロールレイヤに相当する。第２の表示レイヤは、第１のカテゴリと異なる第２のカテゴリに属する表示オブジェクトを有する。第２のカテゴリに属する表示オブジェクトは、具体的には、図５０の（ｃ）において、コントロールレイヤの画面に表示されている矩形のアイコンである。第２のカテゴリは、制御対象機器（複数の機器）の各々の状態を制御するためのユーザーインターフェースである。 When the control unit 22 determines that the information regarding the first contact includes the movement of the contact position in the first direction (Yes in S13), the image displayed on the display unit 21b is displayed in the first display layer. To the second display layer (S14). The second display layer corresponds to the control layer in (c) of FIG. 50, for example. The second display layer has display objects that belong to a second category different from the first category. Specifically, the display object belonging to the second category is a rectangular icon displayed on the screen of the control layer in (c) of FIG. The second category is a user interface for controlling each state of the control target device (a plurality of devices).
　その後、制御部２２は、通信部２４を介して制御対象機器の状態を取得し（Ｓ１５）、制御対象機器の状態に変化があるか否かを判定する（Ｓ１６）。制御部２２は、制御対象機器の状態に変化があると判定した場合（Ｓ１６でＹｅｓ）、機器の状態の変化を通知する（Ｓ１７）。具体的には、表示部２１ｂは、制御部２２の制御に基づいて、表示中の第２の表示レイヤの一部に機器の状態の変化を通知する表示オブジェクトを重畳する。つまり、制御部２２は、第２の表示レイヤがタッチスクリーン２１に表示されている間に制御対象機器の状態に変化があった場合に、第２の表示レイヤにおいて当該変化を通知する表示オブジェクトを表示する。 After that, the control unit 22 acquires the state of the control target device via the communication unit 24 (S15), and determines whether the state of the control target device has changed (S16). When the control unit 22 determines that the state of the control target device has changed (Yes in S16), the control unit 22 notifies the change of the state of the device (S17). Specifically, based on the control of the control unit 22, the display unit 21b superimposes a display object that notifies the change of the state of the device on a part of the second display layer being displayed. That is, when the state of the control target device changes while the second display layer is displayed on the touch screen 21, the control unit 22 displays a display object that notifies the change in the second display layer. indicate.
　なお、ステップＳ１３において、第１の接触に関する情報が、第１の方向への接触位置の移動を含まないと判定された場合には（Ｓ１３でＮｏ）、ステップＳ１４以降の処理は行われない。また、ステップＳ１６において、制御対象機器の状態に変化がないと判定された場合（Ｓ１６でＮｏ）、ステップＳ１７の処理は行われない。 If it is determined in step S13 that the information regarding the first contact does not include the movement of the contact position in the first direction (No in S13), the processes in step S14 and thereafter are not performed. If it is determined in step S16 that the state of the control target device has not changed (No in S16), the process of step S17 is not performed.
　以上のような表示制御方法は、機器の状態をユーザに通知することができる。 The display control method as described above can notify the user of the device status.
　なお、制御部２２は、第２の表示レイヤがタッチスクリーン２１に表示されている間に制御対象機器の状態に変化があった場合に、第２の表示レイヤから、状態変化があった制御対象機器の使用画面に移行してもよい。図８０は、このような表示制御システム１０の動作例２のフローチャートである。 It should be noted that the control unit 22 controls the second display layer to change the state of the control target device when the state of the control target device changes while the second display layer is displayed on the touch screen 21. You may move to the device usage screen. FIG. 80 is a flowchart of an operation example 2 of such a display control system 10.
　動作例２は、図５７の強制優先プッシュ通知の場合に相当する動作である。制御部２２は、制御対象機器の状態に変化があると判定した場合（Ｓ１６でＹｅｓ）、状態変化があった制御対象機器の使用画面に移行する（Ｓ１８）。制御部２２は、例えば、インターホンの状態に変化があった場合に、インターホンの使用画面に移行する。インターホンの使用画面は、例えば、全画面に表示される。 The operation example 2 is an operation corresponding to the case of the forced priority push notification in FIG. When the control unit 22 determines that the state of the control target device has changed (Yes in S16), the control unit 22 shifts to the use screen of the control target device having the state change (S18). The control unit 22 shifts to the intercom use screen when, for example, the state of the intercom changes. The use screen of the intercom is displayed on the full screen, for example.
　以上のような表示制御方法は、着信のようにユーザによる即時の対応が必要な場合には、使用画面を表示してユーザに即時の対応を促すことができる。なお、動作例１及び動作例２は、状態変化があった制御対象機器がどのような機器であるか（あるいは、どのような状態変化か）に応じて切り替えられてもよい。 The display control method described above can display a usage screen and prompt the user for an immediate response when the user needs an immediate response such as an incoming call. In addition, the operation example 1 and the operation example 2 may be switched according to what kind of device the control target device having the state change is (or what kind of state change).
　なお、上記の動作における「第２の表示レイヤがタッチスクリーン２１に表示されている間」は、広義の意味であり、第２の表示レイヤが表示されるような操作が行われた後、別のレイヤが表示されるような操作が行われる前の期間（つまり、第２の表示レイヤが表示されるべき期間）の意味である。 It should be noted that “while the second display layer is displayed on the touch screen 21” in the above operation has a broad meaning, and is different after an operation for displaying the second display layer is performed. This means a period before an operation for displaying the layer (1) is performed (that is, a period in which the second display layer should be displayed).
　もちろん、「第２の表示レイヤがタッチスクリーン２１に表示されている間」には、ユーザが視認可能な態様で実際に第２の表示レイヤがタッチスクリーン２１に表示されている間が含まれる。これだけでなく、「第２の表示レイヤがタッチスクリーン２１に表示されている間」には、第２の表示レイヤがタッチスクリーン２１に表示されていたときにスリープ状態（黒画）になっている場合（つまり、ユーザが視認不可能な態様で第２の表示レイヤがタッチスクリーン２１に表示されている間）も含まれる。 Of course, “while the second display layer is displayed on the touch screen 21” includes the time when the second display layer is actually displayed on the touch screen 21 in a manner that can be visually recognized by the user. In addition to this, during "while the second display layer is displayed on the touch screen 21", the sleep state (black image) is set when the second display layer is displayed on the touch screen 21. The case (that is, while the second display layer is displayed on the touch screen 21 in a manner invisible to the user) is also included.
　例えば、第２の表示レイヤがタッチスクリーン２１に表示されているときにユーザが建物から外出した場合、タッチスクリーン２１はスリープ状態となる。このようなユーザの外出中に訪問者が建物を訪問し、訪問者の画像がインターホンに録画されると、インターホンの状態は変化したといえる。このような場合もインターホンの状態の変化を通知する表示オブジェクトが第２の表示レイヤの一部に重畳される。この場合、インターホンの状態の変化を通知する表示オブジェクトは、スリープ状態の画面に重畳されてもよいし、ユーザが帰宅してスリープ状態が解除されるような操作が行われた時に実際に表示される第２の表示レイヤにインターホンの状態の変化を通知する表示オブジェクトが重畳されていてもよい。 For example, if the user goes out of the building while the second display layer is displayed on the touch screen 21, the touch screen 21 enters a sleep state. When a visitor visits a building while such a user is out and an image of the visitor is recorded on the intercom, it can be said that the state of the intercom has changed. Even in such a case, the display object notifying the change of the state of the intercom is superimposed on a part of the second display layer. In this case, the display object that notifies the change of the intercom state may be superimposed on the screen in the sleep state, or may be actually displayed when the user returns home and performs an operation such as canceling the sleep state. A display object for notifying the change of the state of the intercom may be superimposed on the second display layer.
　（その他の実施の形態）
　以上、実施の形態について説明したが、本発明は、上記実施の形態に限定されるものではない。 (Other embodiments)
Although the embodiments have been described above, the present invention is not limited to the above embodiments.
　例えば、上記実施の形態において、特定の処理部が実行する処理を別の処理部が実行してもよい。例えば、表示装置によって行われる処理の一部または全部は、制御装置またはサーバ装置によって行われてもよい。 For example, in the above-mentioned embodiment, the processing executed by a specific processing unit may be executed by another processing unit. For example, part or all of the processing performed by the display device may be performed by the control device or the server device.
　また、上記実施の形態における装置間の通信方法については特に限定されるものではない。装置間では、無線通信が行われてもよいし、有線通信が行われてもよい。また、装置間では、無線通信及び有線通信が組み合わされてもよい。また、上記実施の形態において２つの装置が通信を行う場合、２つの装置間には図示されない中継装置が介在してもよい。 Also, the communication method between the devices in the above embodiment is not particularly limited. Wireless communication may be performed between devices, or wired communication may be performed. In addition, wireless communication and wired communication may be combined between the devices. Further, in the above embodiment, when two devices communicate with each other, a relay device (not shown) may be interposed between the two devices.
　また、上記実施の形態のフローチャートで説明された処理の順序は、一例である。複数の処理の順序は変更されてもよいし、複数の処理は並行して実行されてもよい。 Also, the order of the processes described in the flowcharts of the above embodiments is an example. The order of the plurality of processes may be changed, or the plurality of processes may be executed in parallel.
　また、上記実施の形態において、各構成要素は、各構成要素に適したソフトウェアプログラムを実行することによって実現されてもよい。各構成要素は、ＣＰＵまたはプロセッサなどのプログラム実行部が、ハードディスクまたは半導体メモリなどの記録媒体に記録されたソフトウェアプログラムを読み出して実行することによって実現されてもよい。 Also, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.
　また、各構成要素は、ハードウェアによって実現されてもよい。例えば、各構成要素は、回路（または集積回路）でもよい。これらの回路は、全体として１つの回路を構成してもよいし、それぞれ別々の回路でもよい。また、これらの回路は、それぞれ、汎用的な回路でもよいし、専用の回路でもよい。 Also, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole or may be separate circuits. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.
　また、本発明の全般的または具体的な態様は、システム、装置、方法、集積回路、コンピュータプログラムまたはコンピュータ読み取り可能なＣＤ－ＲＯＭなどの記録媒体で実現されてもよい。また、システム、装置、方法、集積回路、コンピュータプログラム及び記録媒体の任意な組み合わせで実現されてもよい。 Further, the general or specific aspects of the present invention may be realized by a recording medium such as a system, a device, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM. Further, the system, the device, the method, the integrated circuit, the computer program, and the recording medium may be implemented in any combination.
　例えば、本発明は、表示制御システムなどのコンピュータによって実行される表示制御方法として実現されてもよいし、このような表示制御方法をコンピュータに実行させるためのプログラムとして実現されてもよい。また、本発明は、このようなプログラムが記録されたコンピュータ読み取り可能な非一時的な記録媒体として実現されてもよい。 For example, the present invention may be realized as a display control method executed by a computer such as a display control system, or may be realized as a program for causing a computer to execute such a display control method. Further, the present invention may be realized as a computer-readable non-transitory recording medium in which such a program is recorded.
　また、上記実施の形態では、表示制御システムは、複数の装置によって実現されたが、単一の装置として実現されてもよい。表示制御システムは、例えば、表示装置に相当する単一の装置として実現されてもよいし、制御装置に相当する単一の装置として実現されてもよいし、サーバ装置に相当する単一の装置として実現されてもよい。表示制御システムが複数の装置によって実現される場合、表示制御システムが備える構成要素は、複数の装置にどのように振り分けられてもよい。 Also, in the above embodiment, the display control system is realized by a plurality of devices, but it may be realized as a single device. The display control system may be realized, for example, as a single device corresponding to a display device, a single device corresponding to a control device, or a single device corresponding to a server device. May be realized as. When the display control system is realized by a plurality of devices, the components included in the display control system may be distributed to the plurality of devices in any way.
　その他、各実施の形態に対して当業者が思いつく各種変形を施して得られる形態、または、本発明の趣旨を逸脱しない範囲で各実施の形態における構成要素及び機能を任意に組み合わせることで実現される形態も本発明に含まれる。 In addition, it is realized by making various modifications to those skilled in the art by those skilled in the art, or by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention. The present invention also includes a form.
　１０　表示制御システム
　２０　表示装置
　２１　タッチスクリーン
　２１ａ　タッチパネル
　２１ｂ　表示部
　２２　制御部
　２３　記憶部
　２４　通信部
　３０　制御装置
　４１　第一制御対象機器
　４２　第二制御対象機器
　４３　センサ
　５０　サーバ装置 10 display control system 20 display device 21 touch screen 21a touch panel 21b display unit 22 control unit 23 storage unit 24 communication unit 30 control device 41 first control target device 42 second control target device 43 sensor 50 server device

Claims (4)

  1. 　コンピュータによって実行される表示制御方法であって、
    　機器の状態を通知するためのユーザーインターフェースである第１のカテゴリの表示オブジェクトを有する第１の表示レイヤがタッチスクリーンに表示されている間に行われた当該タッチスクリーンに対する第１の接触に関する情報を取得するステップと、
    　前記第１の接触に関する情報が、第１の方向への接触位置の移動を含む場合に、前記第１の表示レイヤから、前記第１のカテゴリと異なる第２のカテゴリの表示オブジェクトを有する第２の表示レイヤに移行するステップと、
    　前記機器の状態を取得するステップと、
    　前記第２の表示レイヤが前記タッチスクリーンに表示されている間に前記機器の状態に変化があった場合に、前記第２の表示レイヤにおいて当該変化を通知する表示オブジェクトを表示するステップと、を含む、
    　表示制御方法。     A display control method executed by a computer,
    Information regarding a first touch on the touch screen made while the first display layer having the display object of the first category, which is a user interface for notifying the state of the device, is displayed on the touch screen. The steps to get,
    A second object having a second category display object different from the first category from the first display layer, when the information about the first contact includes a movement of the contact position in the first direction. To move to the display layer of
    Obtaining the status of the device,
    Displaying a display object notifying the change in the second display layer when the state of the device changes while the second display layer is displayed on the touch screen. Including,
    Display control method.
  2. 　前記第２の表示レイヤが前記タッチスクリーンに表示されている間に前記機器の状態に変化があった場合に、前記第２の表示レイヤから、状態変化があった前記機器の使用画面に移行するステップをさらに含む、
    　請求項１に記載の表示制御方法。     When there is a change in the state of the device while the second display layer is displayed on the touch screen, the second display layer shifts to a use screen of the device that has changed the state. Further including steps,
    The display control method according to claim 1.
  3. 　請求項１または２に記載の表示制御方法をコンピュータに実行させるためのプログラム。 A program for causing a computer to execute the display control method according to claim 1 or 2.
  4. 　機器の状態を通知するためのユーザーインターフェースである第１のカテゴリの表示オブジェクトを有する第１の表示レイヤがタッチスクリーンに表示されている間に行われた当該タッチスクリーンに対する第１の接触に関する情報を取得する取得部と、
    　前記第１の接触に関する情報が、第１の方向への接触位置の移動を含む場合に、前記第１の表示レイヤから、前記第１のカテゴリと異なる第２のカテゴリの表示オブジェクトを有する第２の表示レイヤに移行する制御部とを備え、
    　前記制御部は、前記機器の状態を取得し、前記第２の表示レイヤが前記タッチスクリーンに表示されている間に前記機器の状態に変化があった場合に、前記第２の表示レイヤにおいて当該変化を通知する表示オブジェクトを表示する、
    　表示制御システム。     Information regarding a first touch on the touch screen made while the first display layer having the display object of the first category, which is a user interface for notifying the state of the device, is displayed on the touch screen. An acquisition unit to acquire,
    A second object having a second category display object different from the first category from the first display layer, when the information about the first contact includes a movement of the contact position in the first direction. And a control unit that shifts to the display layer of
    The control unit obtains the state of the device, and if the state of the device changes while the second display layer is displayed on the touch screen, the control unit acquires the state in the second display layer. Display a display object to notify the change,
    Display control system.
PCT/JP2019/026380 2018-10-25 2019-07-02 Display control method and display control system WO2020084836A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2020552518A JPWO2020084836A1 (en) 2018-10-25 2019-07-02 Display control method and display control system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862750525P 2018-10-25 2018-10-25
US62/750,525 2018-10-25

Publications (1)

Publication Number Publication Date
WO2020084836A1 true WO2020084836A1 (en) 2020-04-30

Family

ID=70331501

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/026380 WO2020084836A1 (en) 2018-10-25 2019-07-02 Display control method and display control system

Country Status (2)

Country Link
JP (1) JPWO2020084836A1 (en)
WO (1) WO2020084836A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102613548B1 (en) * 2022-12-14 2023-12-13 송현민 Window Replacement Display device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014067123A (en) * 2012-09-25 2014-04-17 Sharp Corp Information processor
JP2015530664A (en) * 2012-09-07 2015-10-15 グーグル インコーポレイテッド Stackable workspace on electronic devices
JP2017123564A (en) * 2016-01-07 2017-07-13 ソニー株式会社 Controller, display unit, method, and program

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10140019B2 (en) * 2012-12-28 2018-11-27 Sony Corporation Information processing apparatus and information processing method for display of plurality of images based on user operation
JP6244957B2 (en) * 2014-02-10 2017-12-13 凸版印刷株式会社 Display control apparatus, display control method, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015530664A (en) * 2012-09-07 2015-10-15 グーグル インコーポレイテッド Stackable workspace on electronic devices
JP2014067123A (en) * 2012-09-25 2014-04-17 Sharp Corp Information processor
JP2017123564A (en) * 2016-01-07 2017-07-13 ソニー株式会社 Controller, display unit, method, and program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102613548B1 (en) * 2022-12-14 2023-12-13 송현민 Window Replacement Display device

Also Published As

Publication number Publication date
JPWO2020084836A1 (en) 2021-09-30

Similar Documents

Publication Publication Date Title
US11372433B2 (en) Thermostat user interface
US9952573B2 (en) Systems and methods for a graphical user interface of a controller for an energy-consuming system having spatially related discrete display elements
US10778461B2 (en) Appliance control system, home controller, remote control method, and recording medium
US20170045864A1 (en) Systems and Methods for Energy-Efficient Control of an Energy-Consuming System
CN113203168A (en) Automatic control system for building
US11372530B2 (en) Using a wireless mobile device and photographic image of a building space to commission and operate devices servicing the building space
JP6150913B2 (en) Energy management system, energy management controller, energy management method, and program
JP7122615B2 (en) Display control method and display control system
WO2020084836A1 (en) Display control method and display control system
JP7042454B2 (en) Information terminal and operation program of information terminal
JP7033724B2 (en) Information terminal and operation support program
WO2020084835A1 (en) Display control method and display control system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19875626

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020552518

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19875626

Country of ref document: EP

Kind code of ref document: A1