JPWO2020084834A1 - Display control method and display control system - Google Patents

Abstract

The display control method includes a step (S12) of acquiring information regarding the first contact with the touch screen performed while the first display layer is displayed on the touch screen, and information regarding the first contact. When the movement of the contact position in the first direction is included, the step (S14) of shifting from the first display layer to the second display layer and the information regarding the first contact are perpendicular to the first direction. When the movement of the contact position in the second direction is included, the step (S16) of moving the display position of the display object included in the first display layer in the second direction is included.

Description

The present invention relates to a display control method for displaying the status of residential IoT (Internet of Things) devices such as housing equipment and home appliances, and a display control system.

In recent years, 24-hour ventilation systems installed in houses, EcoCute (registered trademark) / gas water heaters, interphones / electric locks, electric shutters, floor heating and other housing equipment, air conditioners, air purifiers, lighting equipment, televisions, etc. Residential IoT (Internet of Things) systems that collectively and coordinately control home appliances such as DVD recorders are attracting attention.

In the residential IoT system, the status of each device is displayed on an ambient panel, which is an information terminal, through, for example, Echonet Lite (registered trademark) or KNX (registered trademark) as a protocol for controlling each device. By making the desired settings on the panel, each device can be controlled not only independently but also in a coordinated manner.

The present invention provides a display control method and a display control system in which a user can easily switch display layers.

The display control method according to one aspect of the present invention is a display control method executed by a computer, in which rows are displayed while a first display layer having display objects belonging to the first category is displayed on the touch screen. From the first display layer, when the step of acquiring the information regarding the first contact with the touch screen and the information regarding the first contact includes the movement of the contact position in the first direction. The step of migrating to the second display layer having display objects belonging to the second category different from the first category and the information regarding the first contact are in the second direction perpendicular to the first direction. In the case of including the movement of the contact position of the above, the step of moving the display position of the display object included in the first display layer in the second direction is included.

The program according to one aspect of the present invention is a program for causing a computer to execute the display control method.

The display control system according to one aspect of the present invention provides information on a first contact with a touch screen while a first display layer having display objects belonging to the first category is displayed on the touch screen. A second category different from the first category from the first display layer when the acquisition unit for acquiring the above and the information regarding the first contact include the movement of the contact position in the first direction. The control unit includes a control unit that shifts to a second display layer having a display object belonging to the above, and the control unit has a contact position in a second direction in which information regarding the first contact is perpendicular to the first direction. When the movement of the display object is included, the display position of the display object included in the first display layer is moved in the second direction.

According to the display control method and the display control system of the present invention, the user can easily switch the display layer.

FIG. 1 is a front view of the display device according to the embodiment. FIG. 2 is a perspective view of the display device according to the embodiment. FIG. 3 is a diagram showing an example of a display screen of a display device installed at the entrance. FIG. 4 is a diagram showing an example of a display screen of a display device installed in the dining room. FIG. 5 is a diagram showing an example of a display screen of a display device installed in the bedroom. FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building. FIG. 7 is a diagram showing an example of a display screen when a notification is being performed. FIG. 8 is a diagram showing a first example of the content to be notified. FIG. 9 is a diagram showing a second example of the content to be notified. FIG. 10 is a diagram showing a third example of the content to be notified. FIG. 11 is a diagram showing a fourth example of the content to be notified. FIG. 12 is a diagram showing an example of a display screen for controlling a scene when waking up. FIG. 13 is a diagram showing an example of a display screen for controlling a scene when returning home. FIG. 14 is a diagram showing an example of a display screen for controlling a scene when working from home. FIG. 15 is a diagram showing an example of a display screen for controlling a scene before going to bed. FIG. 16 is a diagram showing an example of an application selection screen. FIG. 17 is a diagram showing an example of a screen showing the air quality of each room. FIG. 18 is a diagram showing an example of a detailed screen of air quality in the living room. FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used. FIG. 20 is a diagram showing a second example of a screen showing the amount of electricity used. FIG. 21 is a diagram showing a first example of a screen while executing a home messenger application. FIG. 22 is a diagram showing a second example of a screen in which the home messenger application is being executed. FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of an image of a visitor taken by the doorphone). FIG. 24 is a diagram showing a second example (doorphone and camera selection screen) of the screen during execution of the doorphone application. FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen during execution of the message application. FIG. 26 is a diagram showing a second example (a plurality of message selection screens) of a screen in which a message application is being executed. FIG. 27 is a diagram showing a first example of a screen during execution of a moving image application. FIG. 28 is a diagram showing a second example of a screen in which a moving image application is being executed. FIG. 29 is a diagram showing a third example of a screen in which a moving image application is being executed. FIG. 30 is a diagram showing a first example of a screen in which a music application is being executed. FIG. 31 is a diagram showing a second example of a screen in which a music application is being executed. FIG. 32 is a diagram showing a third example of a screen in which a music application is being executed. FIG. 33 is a diagram showing a first example of a screen running a photographic application. FIG. 34 is a diagram showing a second example of a screen running a photographic application. FIG. 35 is a diagram showing a third example of a screen in which the photographic application is being executed. FIG. 36 is a diagram for explaining an example of presenting information triggered by an operation of an air conditioner on a remote controller. FIG. 37 is a diagram for explaining an example of presenting information triggered by an operation on a wall switch for turning on and off a lighting device. FIG. 38 is a diagram for explaining an example of presenting information triggered by an operation on the water heater. FIG. 39 is a diagram showing an example of a display screen for other information. FIG. 40 is a diagram showing an example of a weather warning display screen. FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key. FIG. 42 is a diagram showing an example of a display screen that recommends the control of an air purifier that is optimal for pollen removal. FIG. 43 is a diagram showing an example of a display screen that proposes improvement of the sleep state. FIG. 44 is a diagram showing an example of a washing timing notification screen. FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothing. FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays. FIG. 47 is a diagram showing an example of a display screen that presents a program that seems to suit the user's taste. FIG. 48 is a diagram showing a first example of a display screen for performing a Christmas effect. FIG. 49 is a diagram showing a second example of a display screen for performing a Christmas effect. FIG. 50 is a diagram showing a configuration of a home screen of the display device according to the embodiment. FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device. FIG. 52 is a diagram showing an example of a screen of a push layer including a plurality of icons. FIG. 53 is a diagram showing an example of a screen of the push layer in the night mode. FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state. FIG. 55 is a diagram showing an example of a screen for moving and deleting an icon of a device. FIG. 56 is a diagram for explaining a change in the display mode of the screen of the push layer. FIG. 57 is a diagram for explaining a notification made when the screen of the application layer is displayed. FIG. 58 is a diagram for explaining an example in which the tutorial of the control layer is displayed when the screen of the control layer is displayed for the first time. FIG. 59 is a diagram showing an example of an icon for performing air conditioning in the entire building displayed on the screen of the control layer. FIG. 60 is a diagram showing screen transitions when the icon for air conditioning in the entire building is operated. FIG. 61 is a diagram showing an example of a control screen for air conditioning in the entire building during automatic save operation. FIG. 62 is a diagram showing an example of a control screen for air conditioning in the entire building in the outing mode. FIG. 63 is a diagram showing an example of an icon for controlling the air conditioner displayed on the screen of the control layer. FIG. 64 is a diagram showing a screen transition when the icon of the air conditioner is operated by long tapping. FIG. 65 is a diagram showing an example of an icon for controlling the heat pump type water heater displayed on the screen of the control layer. FIG. 66 is a first diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. FIG. 67 is a second diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. FIG. 68 is a diagram showing an example of an icon for controlling the water heater included in the fuel cell system, which is displayed on the screen of the control layer. FIG. 69 is a diagram showing a screen transition when the icon of the fuel cell system is operated by long tapping. FIG. 70 is a diagram showing an example of an icon for controlling the electric shutter displayed on the screen of the control layer. FIG. 71 is a diagram showing a screen transition when the electric shutter icon is operated by a long tap. FIG. 72 is a diagram showing an example of an icon for controlling the electric lock displayed on the screen of the control layer. FIG. 73 is a diagram showing a screen transition when the electric lock icon is operated by a long tap. FIG. 74 is a diagram showing an example of an icon for controlling the air purifier displayed on the screen of the control layer. FIG. 75 is a diagram showing a screen transition when the icon of the air purifier is operated by long tapping. FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state. FIG. 77 is a diagram showing an initial setting screen and a screen transition from the initial setting screen. FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment. FIG. 79 is a flowchart of the operation of the display control system according to the embodiment.

Hereinafter, embodiments will be specifically described with reference to the drawings. It should be noted that all of the embodiments described below show comprehensive or specific examples. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the components in the following embodiments, the components not described in the independent claims will be described as arbitrary components.

It should be noted that each figure is a schematic view and is not necessarily exactly shown. Further, in each figure, substantially the same configuration may be designated by the same reference numerals, and duplicate description may be omitted or simplified.

(Embodiment)
[Overview of display device]
First, an outline of the display device according to the embodiment will be described. FIG. 1 is a front view of the display device according to the embodiment. FIG. 2 is a perspective view of the display device according to the embodiment.

The display device 20 is a dedicated terminal used in a system (for example, a display control system described later) that provides services related to a new lifestyle that is centered on people. The display device 20 can provide the user with a beautifully integrated new form of involvement with housing equipment and home appliances. In addition, the display device 20 can provide the user with a value tailored to the resident in cooperation with the server device.

The display device 20 is installed inside a building such as a house (for example, a wall). The display device 20 also includes a touch screen 21 and is used as an integrated remote controller for the user to control the equipment installed in the building. According to the display device 20, it is not necessary to install a remote controller for each device, so that complexity can be removed from the building.

Further, if the display device 20 is installed in each of a plurality of spaces (entrance, dining room, bedroom, etc.) in the building, the user can confirm the living behavior or the setting of the device in the building. It can be done from anywhere inside. FIG. 3 is a diagram showing an example of a display screen of the display device 20 installed at the entrance, FIG. 4 is a diagram showing an example of the display screen of the display device 20 installed in the dining room, and FIG. 5 is a diagram showing an example of the display screen of the display device 20 installed in the dining room. It is a figure which shows an example of the display screen of the display device 20 installed in a bedroom. For example, the user can close the front door key or the electric shutter in the living room from the bedroom, or turn off the air conditioner and lighting equipment in the house from the front door.

Further, the display device 20 eliminates unnecessary items from a large amount of information and provides only necessary items to the user. For example, the device control function of the display device 20 eliminates complicated functions that are often found in conventional remote controllers or switches. The display device 20 intuitively provides only the functions necessary for daily life. FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building (in other words, control a plurality of air conditioning devices).

[Display device function: Notification]
Further, the display device 20 is configured so that the information desired by the user and the notification that the user does not want to miss can be accessed with one tap. For example, the home screen of the display device 20 is notified of the status or notification of the device corresponding to the display device 20. FIG. 7 is a diagram showing an example of a display screen when a notification is being performed. As shown in FIG. 7, for example, the user confirms a new recording immediately after returning home from the display device 20 installed at the entrance, or confirms the visitor of the doorphone from the display device 20 installed in the study. be able to.

8 to 11 are diagrams showing an example of the content to be notified. As shown in FIG. 8, according to the display device 20, the user can check and watch the new recording from the entrance or a favorite place immediately after returning home. Further, as shown in FIG. 9, according to the display device 20, the user can respond to the intercom device from anywhere in the building and check the history when he / she is absent. Further, as shown in FIG. 10, according to the display device 20, the user can confirm the completion of hot water in the bathtub from anywhere in the building. As shown in FIG. 11, according to the display device 20, the user can also check the message left by someone in the family.

[Display device function: Scene control]
In addition, the user can freely switch the environment in the building by operating a plurality of devices through the display device 20. The control of switching the environment in the building to the state requested by the user with one tap or a timer is also described as scene control. In the scene control, as long as the device is compatible with the display device 20, any device installed in any space (room) in the building can be controlled at once. For example, it is possible to make all the electric shutters, lighting devices, and air conditioners installed in the building suitable for comfortable awakening, and to set the necessary devices at once when returning home.

A specific example of scene control will be described. FIG. 12 is a diagram showing an example of a display screen for controlling a scene when waking up. In scene control when waking up, for example, an alarm is sounded, an electric shutter is opened, and a lighting device is turned on (on). Controls such as) are realized by a timer. Waking-up scene control provides the user with a comfortable awakening and makes the building an environment suitable for the morning hours. FIG. 13 is a diagram showing an example of a display screen for controlling the scene at the time of returning home. In the scene control at the time of returning home, for example, control such as opening an electric shutter, turning on a lighting device, and turning on an air conditioner is performed. Is realized with one tap. In other words, what you need to do when you get home is realized with just one tap.

Although a plurality of types of scene controls are prepared in advance as presets, the user can newly create and register them according to his / her preference. For example, the user can newly create and register a scene control when working from home, a scene control before going to bed, and the like.

FIG. 14 is a diagram showing an example of a display screen for controlling a scene when working from home. In the scene control when working from home, for example, the lighting device is dimmed and the set temperature of the air conditioner is low. By setting to, an environment suitable for work is realized, which can enhance the concentration and work efficiency of the user. FIG. 15 is a diagram showing an example of a display screen for controlling a scene before going to bed, and is a diagram showing an example of a display screen for controlling a scene before going to bed. By dimming the lighting equipment, closing the electric shutter, and setting the temperature of the air conditioning equipment to a low level, it is possible to create an environment where the inside of the building can be comfortably introduced into sleep. .. The user can instruct the scene control before going to bed not only from the display device 20 installed in the bedroom but also from the display device 20 installed in the living room or the dining room.

[Display device function: Application]
Various applications (application programs) may be installed in the display device 20. FIG. 16 is a diagram showing an example of an application selection screen. If various applications are installed, the user can check the state of air in the building and the state of electricity usage in the building by selecting the application to be executed. The user can also check the TV program currently being broadcast and the recorded program. The display device 20 can also receive a new application from the server device.

For example, by selecting the "air" icon in the selection screen of FIG. 16, the user can select the air condition (specifically, temperature, humidity, odor, house dust, and air condition) of each room in the building. Air quality such as PM2.5 concentration) can be grasped. FIG. 17 is a diagram showing an example of a screen showing the air quality of each room, and FIG. 18 is a diagram showing an example of a detailed screen of the air quality of the living room. If the screen as shown in FIG. 17 is displayed on the touch screen 21, the user can grasp the air quality of each room at a glance. Further, if the screen as shown in FIG. 18 is displayed on the touch screen 21, the user can confirm the daily (or monthly) change in the air quality of a specific room. The display device 20 can manage the air quality by, for example, acquiring a signal indicating a sensing result from a sensor that measures the air quality.

Further, for example, the user can grasp the amount of electricity used in each room in the building by selecting the "electricity" icon in the selection screen of FIG. FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used, and FIG. 20 is a diagram showing a second example of a screen showing the amount of electricity used. The display device 20 manages the current or past electricity usage in the building for each branch circuit by acquiring a signal indicating the electricity usage from, for example, a distribution board having a communication function installed in the building. It can be provided to the user as an image. Further, the display device 20 acquires the information indicating the electricity usage of another user (which may be a general electricity usage) from the server device, so that the electricity of the user is shown in FIG. The usage amount and the electricity usage amount of other users can be displayed side by side.

Also, for example, the user can talk with a family member in another room in the building by selecting the "home messenger" icon in the selection screen of FIG. FIG. 21 is a diagram showing a first example of a screen in which a home messenger application is being executed, and FIG. 22 is a diagram showing a second example of a screen in which a home messenger application is being executed. Once the home messenger application is running, you can tell the children's room that you've got rice from the kitchen, or you can tell the dining room that you're home from the front door. In other words, the possibility of communication between rooms expands.

Further, for example, the user selects the "doorphone" icon in the selection screen of FIG. 16 to communicate with the display device 20 from the room in which the display device 20 is installed (in other words, the intercom device). Can respond to. FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of an image of a visitor taken by the doorphone). Further, if a camera that images the outside of the building is connected to the display device 20 by communication, the user can also visually recognize the outside of the building through the display device 20. FIG. 24 is a diagram showing a second example (doorphone and camera selection screen) of the screen during execution of the doorphone application.

Further, for example, the user can use the display device 20 as a message board by selecting the "message" icon in the selection screen of FIG. 16. FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen during execution of the message application. FIG. 26 is a diagram showing a second example (a plurality of message selection screens) of a screen in which a message application is being executed. The message can be stored (that is, recorded) as a moving image or a still image, or can be stored (that is, recorded) as a voice.

Further, for example, the user selects the "moving image" icon in the selection screen of FIG. 16 to display the currently broadcasting TV program received by the tuner device communicatively connected to the display device 20. It is also possible to check the recorded program provided from the moving image content storage device which is communicatively connected to the device 20. 27 to 29 are diagrams showing an example of a screen during execution of a moving image application. The user can check new recordings using the display device 20 installed at the entrance immediately after returning home, or check the morning news using the display device 20 installed in the bedroom while changing clothes in the bedroom. Can be done. In other words, the range of ways to interact with information in daily life will expand.

Further, for example, the user can enjoy the music provided from the music content storage device which is communicatively connected to the display device 20 by selecting the "music" icon in the selection screen of FIG. 30 to 32 are diagrams showing an example of a screen during execution of a music application. The user can enjoy music in any room in which the display device 20 is installed. Further, if a separate speaker device is connected to the display device 20 by communication, it is possible to output music from the speaker device.

Further, for example, the user can enjoy the photo provided by the still image content storage device communicatively connected to the display device 20 by selecting the "photo" icon in the selection screen of FIG. 33 to 35 are diagrams showing an example of a screen during execution of the photographic application. The user can enjoy the photograph in any room in which the display device 20 is installed.

[Display device function: Presentation of information triggered by user operation]
The display device 20 is an act that leads to a better life by using the usual actions such as "turning on the lighting device", "turning off the power of the air conditioner", and "boiling the bath" that the user performs in daily life as a trigger. Alternatively, it is possible to present the optimum experience (specifically, content or function, etc.) according to the situation. That is, the display device 20 can present information to the user by using the user's operation on the device as a trigger. FIG. 36 is a diagram for explaining an example of presenting information triggered by an operation of an air conditioner on a remote controller.

In the example of FIG. 36, when the user performs an operation of turning off the power of the air conditioner with respect to the remote controller of the air conditioner ((a) of FIG. 36), the display device 20 uses this as a trigger to consume the power of the air conditioner. (For example, if you only leave the room for about an hour, the power consumption is lower when the power is on) to reduce the amount of power consumption ((b) in FIG. 36). ).

Further, FIG. 37 is a diagram for explaining an example in which information is presented by using an operation on a wall switch for turning on and off the lighting device as a trigger. In the example of FIG. 37, when the user turns on the lighting device at the entrance when returning home at midnight ((a) of FIG. 37), the display device 20 uses this as a trigger to display the dimming setting suitable for the midnight time zone ((a) of FIG. 37). (B) of FIG. 37.

Further, FIG. 38 is a diagram for explaining an example of presenting information triggered by an operation on the water heater. In the example of FIG. 38, when the user instructs the operation panel of the water heater to add hot water to the bathtub, the display device 20 uses this as a trigger to display an image of recommending bathing goods that enrich the bath time. indicate.

In this way, the display device 20 can present various information triggered by the user's operation on the device. It should be noted that FIGS. 36 to 38 show an example of information presentation. Various information can be presented by combining the devices connected to the display device 20 and various services.

[Display device function: Presentation of other information]
The display device 20 combines device usage logs, date and time data, weather information provided by the server device (cloud server), etc., to protect the safety and health of the family, advice to help with household chores, and advice. , It is also possible to provide recommended content according to the taste of the family. FIG. 39 is a diagram showing an example of a display screen for such other information. Hereinafter, specific examples of information that can be presented by the display device 20 will be described.

The display device 20 can display the weather warning and the stormy weather by receiving the weather information (in other words, the weather information) from the server device, for example. FIG. 40 is a diagram showing an example of a weather warning display screen. The display device 20 can support the peace of mind of the family by displaying the weather warning and the stormy weather.

Further, the display device 20 can display a notification screen for preventing forgetting to lock the key based on the state of the electric lock, the time zone, and the like. FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key. The display device 20 can support the peace of mind of the family by giving a notification to prevent forgetting to lock the key.

In addition, the display device 20 can recommend the control of the air purifier that is optimal for pollen removal according to the pollen information and the home situation. FIG. 42 is a diagram showing an example of a display screen that recommends the control of an air purifier that is optimal for pollen removal. The display device 20 can support the health of the family by recommending the control of the air purifier that is optimal for pollen removal.

In addition, the display device 20 can estimate the sleep condition of the user from the usage log of the lighting device and the electric shutter, and make a proposal for improving the sleep state. FIG. 43 is a diagram showing an example of a display screen that proposes improvement of the sleep state. The display device 20 can support the health of the family by making proposals for improving the sleep state.

The display device 20 can notify the best washing timing by receiving, for example, weather information (in other words, weather API (Application Programming Interface) information) from the server device. FIG. 44 is a diagram showing an example of a washing timing notification screen. The display device 20 can also recommend room drying in the season when there is a lot of pollen. The display device 20 can support household chores by notifying the timing of washing.

Further, the display device 20 can make a proposal regarding clothes (thick clothes or light clothes) based on the difference between the average weekly temperature included in the weather information provided by the server device and the temperature on the day. FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothing. The display device 20 can also propose to carry rain gear on a rainy day.

In addition, the display device 20 can call attention to ultraviolet rays during the daytime (morning to noon time zone) based on the ultraviolet index included in the weather information provided by the server device. FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays. The display device 20 can support the beauty of the user by calling attention to ultraviolet rays.

Further, the display device 20 can record and present a program that seems to suit the user's taste from the TV viewing history and the recording log of the video content storage device. FIG. 47 is a diagram showing an example of a display screen that presents a program that seems to suit the user's taste.

In addition, the display device 20 can perform special device control on anniversaries and the like. For example, the display device 20 displays a display screen for performing a Christmas effect using a device at Christmas. 48 and 49 are diagrams showing an example of a display screen for performing a Christmas effect. When the user's approval is obtained through such a display screen, a Christmas effect is performed by the speaker (music) and the lighting device (light) in the room where the display device 20 is installed.

[Display device display screen configuration]
Next, the configuration of the home screen of the display device 20 will be described. FIG. 50 is a diagram showing a configuration of a home screen of the display device 20.

As shown in FIG. 50, the home screen of the display device 20 has (a) “Apps Layer”, (b) “Push Layer”, and (c) “Control Layer”. It has a three-story structure (three-layer structure) of "layer)". When the push layer serves as a base point and a swipe operation is performed on the touch screen 21 in the direction from top to bottom while the screen of the push layer is displayed, the screen transitions to the screen of the application layer. Further, when the touch screen 21 is swiped in the direction from the bottom to the top while the screen of the push layer is displayed, the screen transitions to the screen of the control layer.

[Push layer]
First, the push layer serving as a base point will be described with reference to FIG. 50 (b). The push layer is a layer of push-type interaction that is the basis of the display device 20 for recommendations and notifications. On the screen of the push layer, information such as notifications or recommendations transmitted from the device connected to the display device 20 as a starting point is displayed.

As shown in FIG. 50 (b), the display device 20 detects the presence or absence of a user in the vicinity of the display device 20 by a motion sensor or the like, and the user is in the vicinity of the display device 20 (that is, near the display device 20). ) Displays information such as notifications or recommendations on the screen. On the other hand, when the user is not around the display device 20 (that is, near the display device 20), the display device 20 does not display information such as notifications or recommendations to be displayed on the screen. FIG. 51 is a diagram showing an example of a screen of the push layer when the user is not near the display device 20.

Further, when there is a plurality of information such as notifications or recommendations to be displayed, the icons indicating the information are displayed side by side, for example, in the left-right direction. FIG. 52 is a diagram showing an example of a screen of a push layer including a plurality of icons. The plurality of icons are arranged in a row in the left-right direction in the order of the generated time, for example, the newer the information is generated, the left side. When a left / right swipe operation (in other words, a scroll operation) is performed on the display area of the icon, the icon is scrolled. At this time, only the icon is scrolled while the time, date, and weather display areas are maintained (fixed). When each of the plurality of icons is tapped, the screen transitions to the screen of the application layer or the screen of the control layer related to the information indicated by the icon.

The display mode of the push layer screen may be changed according to the time zone. For example, the background color of the push layer screen may be changed to a darker color during the night time zone than at other time zones. FIG. 53 is a diagram showing an example of a screen of the push layer in such a night mode.

[Control layer]
Next, the control layer will be described with reference to FIG. 50 (a). The control layer is a layer for individually controlling the devices grouped by the device category and location (room), such as turning off the lighting equipment in the kitchen and setting the air conditioning in the entire building. By tapping the device icon included in the control layer screen, the user can turn the device on and off without screen transition. That is, the user can simply control the device. In addition, the user can perform detailed control of the device by long-tapping the device icon.

Each of the icons of the plurality of devices is displayed in different modes (for example, different colors) depending on the on and off states so that the on and off states of the devices can be seen at a glance. For example, when the device is on, the icon of the device is displayed in color, and when the device is off, the icon of the device is displayed in monochrome (grayscale, washout). FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state. Further, the device icon may include characters indicating the operating state of the device.

On the control layer screen, the device icons are arranged in a row in the left-right direction, and when a left-right swipe operation (in other words, a scroll operation) is performed on the icon display area, the icon is scrolled. .. In the default state, the icon located on the rightmost side of the touch screen 21 is displayed so as to be partially interrupted so that the user can be informed that the icons of the plurality of devices are scrolling.

The icons of the plurality of devices are arranged in an order according to the place (room) where the device is installed. In the example of (a) of FIG. 50, an icon related to the entire building (for example, a scene control icon) is arranged on the leftmost side, and a room (for example, a living room) in which a display device 20 is installed is arranged on the right side thereof. The icon of the device installed in is placed. On the right side, for example, an icon of a device installed in the room closest to the living room is arranged. In this way, on the control layer screen, the icon of the device installed in the room closer to the room where the display device 20 is installed is on the left side (in other words, a position that is easily accessible in the default state (initial state)). Be placed. That is, the icons of the plurality of devices are arranged in an order based on the device installation position (in other words, an order related to the installation position).

If the icons of multiple devices do not fit on one screen, the icons of multiple devices located on the relatively left side are located on the screen by default, but the icons placed on the relatively right side. Is not located on the screen in the default state, but appears on the screen only after scrolling.

When the number of a plurality of devices that can be controlled through the display device 20 is large, the number of icons of the plurality of devices becomes very large. Therefore, a jump shortcut (characters indicating a place (space) in a building such as "all rooms", "living room", and "kitchen") is provided at the lower left of the screen of the control layer. By tapping the jump shortcut, the user can position the icon of the device installed at the location indicated by the tapped character on the screen (multiple icons automatically scroll).

The arrangement of the device icons can also be changed according to the user's preference. FIG. 55 is a diagram showing an example of a screen for moving and deleting an icon of a device. The user can change the arrangement (left-right positional relationship) of the device icons by performing a drag-and-drop operation on the device icons on the device icon movement / deletion screen.

[App layer]
Next, the application layer will be described with reference to FIG. 50 (c). The app layer is used to check the power consumption of a building and watch videos. In the app layer, multiple icons are categorized according to the action the user wants to do and the experience action. In addition, new applications provided by developers and new services provided in the future will be added to the application layer. From the screen of the application layer, the application program described with reference to FIGS. 16 to 35 can be executed.

It should be noted that what can be executed from the application layer and what can be executed from the control layer are classified as follows, for example. What can be executed from the app layer is equipment that can be easily added and changed, such as so-called home appliances (equipment that is not fixed to the wall of a building), and equipment (lighting equipment that is fixed to the wall of a building, air conditioning equipment, etc.). (Equipment such as), but control of equipment that operates by referring to information.

On the other hand, what can be executed from the control layer is the control of equipment. In some cases, the same control can be executed from both the application layer and the control layer.

[Status display by distance]
The display mode of the push layer screen may be changed according to the distance between the display device 20 and a person standing in front of the display device 20. That is, the display device 20 may automatically switch the display according to the distance to the user. FIG. 56 is a diagram for explaining a change in the display mode of the screen of the push layer.

As shown in FIG. 56, the screen of the push layer is when the user is located within a range of 1 m from the display device 20 (for example, the user is operating the display device 20 or in front of the display device 20). It is displayed in the normal state in the standing state). The push layer screen is displayed in an ambient state when the user is located within a range of 1 m or more and less than 3 m from the display device 20 (when the user is in the room where the display device 20 is installed). Further, the push layer screen is in a sleep state (for example, black) when the user is located at a distance of 3 m or more from the display device 20 (for example, when the user is absent from the room where the display device 20 is installed). It is displayed as a picture).

The ambient state means a state in which the presence or absence of a notification can be confirmed even from a distant position while taking care not to overstate the notification. The screen of the push layer in the ambient state is realized by displaying the time and the notification icon on a white background, for example.

On the push layer screen, the current date and time, the weather, and the like are always displayed on the left side of the screen. In this way, the information that the user always wants to display may be changed by the user setting. The information that the user always wants to display includes the time, weather, outdoor temperature and humidity, indoor temperature and humidity, air quality (in other words, the degree of air pollution, odor, and PM2. 5 concentration etc.), power consumption, power generation amount of solar power generation system etc., family schedule, what day is today, etc. are included. It is advisable to consider that the information that the user always wants to display can be visually recognized by the user even from a slightly distant position, such as by enlarging the characters or the display.

[Notification in display layer other than push layer]
A method of notifying when information to be notified to the user occurs when the screen of the control layer or the screen of the application layer is displayed in the display device 20 will be described. The notifications given when the control layer screen or the application layer screen is displayed include normal push notifications and forced priority push notifications. FIG. 57 is a diagram for explaining a notification made when the screen of the application layer is displayed. Although not shown, the same applies to the notification given when the screen of the control layer is displayed.

As shown in FIGS. 57A and 57B, in the normal push notification, the notification content is superimposed and displayed on the upper part of the screen of the application layer. During application execution, no notification is given on the application execution screen (screens as shown in FIGS. 17 to 35), and when the application layer screen is returned from the execution screen, the notification content is superimposed on the upper part of the screen. NS. When the area on which the notification contents are superimposed is tapped, for example, the notification is terminated and the state returns to the state of FIG. 57 (a). When the notification is related to the control of the device, when the area on which the notification content is superimposed is tapped, the screen transitions to the screen for controlling the device (control layer screen, control screen described later, etc.).

Notifications that are normally performed as push notifications include, for example, notification of the installation anniversary of the display device 20, notification of the birthday of the user or family, notification of important messages, notification of abnormal temperature and humidity, and opening of the electric shutter. Notifications when, notifications when the electric lock opens, notifications about the delivery box, etc.

On the other hand, forced priority push notifications are notifications that require immediate response by the user, such as incoming calls, in other words, you want to be notified immediately no matter what operation is being performed (more important than normal push notifications). It is a notification. As shown in (a) of FIG. 57 and (c) of FIG. 57, when it becomes necessary to give a forced priority push notification, the entire screen is switched to the notification screen even during the operation.

The notifications performed as forced priority push notifications include, for example, a power failure (cooperation / non-cooperation) notification, a power usage overuse notification (peak alarm), and a notification indicating a visitor by an intercom device (FIG. 57 (c)). Calls from other rooms (ie, other display devices 20) and the like are included.

[View Tutorial]
The display device 20 displays a tutorial (specifically, an outline of what the application can do, typical operations, etc.) when the application or the like is started for the first time. FIG. 58 is for explaining an example in which the control layer tutorial is displayed ((c) in FIG. 58) when the screen of the control layer is first displayed ((a) and (b) in FIG. 58). It is a figure of.

Animation (in other words, video) is used to display the tutorial. If individual explanations are required, balloons or characters may be displayed on the screen, or animations that anticipate operations may be displayed on the screen. As a result, the display device 20 can present the operation method to the user in an easy-to-understand manner.

In the tutorial, the amount of information (wording and content, etc.) is cut off to prevent the user from feeling stress. In addition, the tutorial is configured to advance to the next item by user operation such as swipe operation so that the user can quickly access the necessary part, which suppresses the user from feeling annoyed. Detailed functions and operation explanations are described in the online manual, and the display device 20 provides guidance and display so that the user can smoothly reach the description location of the online manual.

[Control screen for air conditioning in the entire building]
Next, a detailed screen (hereinafter, also referred to as a control screen) when the user controls the device from the control layer will be described. First, a control screen for air-conditioning the entire building will be described by illustration. FIG. 59 shows an example (specifically, an icon corresponding to the state of the whole building air conditioning) of an icon (hereinafter, also simply referred to as a whole building air conditioning icon) displayed on the screen of the control layer for performing the whole building air conditioning. It is a figure which shows an example of change). FIG. 60 is a diagram showing screen transitions when the icon for air conditioning in the entire building is operated. Note that the icons for air conditioning in the entire building are not grouped (in other words, associated) with, for example, the "all rooms" tab on the screen of the control layer. In addition, since the air conditioning in the entire building is basically always on and is not suitable for the single tap operation, the modal in FIG. 60 shows whether the single tap operation or the long tap operation is performed on the icon of the air conditioning in the entire building. A window is displayed. The air conditioning in the entire building may be a specification that cannot be turned off from the display device 20.

Note that FIG. 61 is a diagram showing an example of a control screen for air conditioning in the entire building during automatic save operation, and FIG. 62 is a diagram showing an example of a control screen for air conditioning in the entire building in the outing mode (during going out). These control screens are displayed only when the operation is performed from the original remote controller of the air conditioning system in the entire building.

[Control screen for air conditioning equipment]
Next, the control screen of the air conditioner will be described by illustration. FIG. 63 shows an example (specifically, an icon according to the state of the air conditioner) of an icon for controlling the air conditioner displayed on the screen of the control layer (hereinafter, also simply referred to as an icon of the air conditioner). It is a figure which shows an example) of the change of. FIG. 64 is a diagram showing a screen transition when the icon of the air conditioner is operated by long tapping.

[Control screen of heat pump type water heater]
Next, the control screen of the heat pump type water heater will be described by illustration. FIG. 65 shows an example (specifically, a heat pump type water heater) of an icon for controlling the heat pump type water heater displayed on the screen of the control layer (hereinafter, also simply referred to as a heat pump type water heater icon). It is a figure which shows an example of the change of the icon according to the state of. FIG. 66 is a first diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. FIG. 67 is a second diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. The same icon is used for the gas water heater, and the same screen transition is performed.

[Control screen of the water heater provided in the fuel cell system]
Next, the control screen of the water heater included in the fuel cell system will be described by illustration. FIG. 68 is an example (specifically, fuel) of an icon (hereinafter, also simply referred to as a fuel cell system icon) for controlling a water heater included in the fuel cell system, which is displayed on the screen of the control layer. It is a figure which shows an example of the change of the icon according to the state of the water heater provided in the battery system). FIG. 69 is a diagram showing a screen transition when the icon of the fuel cell system is operated by long tapping.

[Power shutter control screen]
Next, the control screen of the electric shutter will be described by illustration. FIG. 70 shows an example (specifically, depending on the state of the electric shutter) of an icon for controlling the electric shutter (hereinafter, also simply referred to as an icon of the electric shutter) displayed on the screen of the control layer. It is a figure which shows an example of the change of an icon). As shown in FIG. 70, during the operation of the electric shutter, the state of the electric shutter can be presented to the user in an easy-to-understand manner by animating the icon. A similar icon (the title of the icon is changed from "shutter" to "blind") is used for the electric blind.

FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter (or electric blind) is operated by a long tap. When the grouped (in other words, associated) electric shutter icon on the "All rooms" tab of the control layer screen is operated by long tapping, multiple electric shutters in the building are collectively controlled. When the electric shutter icon grouped on each room tab of the control layer screen is operated by long tapping, the electric shutter installed in the room is controlled.

[Electric lock control screen]
Next, the control screen of the electric lock will be described by illustration. FIG. 72 shows an example (specifically, depending on the state of the electric lock) of an icon for controlling the electric lock (hereinafter, also simply referred to as an electric lock icon) displayed on the screen of the control layer. It is a figure which shows an example of the change of an icon). FIG. 73 is a diagram showing a screen transition when the electric lock icon is operated by a long tap. When the electric lock icon grouped on the "All Rooms" tab of the control layer screen is operated by long tapping, multiple electric locks in the building are collectively controlled. When the electric lock icon grouped on each room tab of the control layer screen is operated by long tapping, the electric lock installed in the room is controlled.

[Air purifier control screen]
Next, the control screen of the air purifier (for example, the ceiling-embedded air purifier) will be described by illustration. FIG. 74 shows an example (specifically, the state of the air purifier) of an icon for controlling the air purifier (hereinafter, also simply referred to as an icon of the air purifier) displayed on the screen of the control layer. It is a figure which shows an example of the change of the icon according to. FIG. 75 is a diagram showing a screen transition when the icon of the air purifier is operated by long tapping.

[Screen showing that the device is in an irregular state]
On the control layer screen, when the device falls into an irregular state such as when the system is abnormal, offline, or indefinite, the device icon changes to indicate an abnormality. When the icon indicating the abnormality is operated, a screen indicating that the state is irregular is displayed. FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state. FIG. 76 (a) is a diagram showing an example of a screen when a system abnormality occurs, and FIG. 76 (b) is a diagram showing an example of a screen when offline.

The irregular state is classified into, for example, a detached state, an indefinite state, and a failure state. The detached state means that the communication connection between the display device 20 and the device is cut off, and the indefinite state means that the display device 20 and the device are connected to each other by communication, but it takes time to detect the numerical value (for example, during startup). State). The failure state means that the device itself is out of order.

[Initial setting screen]
When the display device 20 is installed, the installation location of the display device 20 is set. FIG. 77 is a diagram showing such an initial setting screen and a screen transition from the initial setting screen. As shown in FIG. 77, when the name of the installation location is input to the initial setting screen ((a) of FIG. 77), the screen transitions to the input screen ((b) of FIG. 77).

When the initial setting is completed, a screen ((c) in FIG. 77) for notifying that the initial setting is completed is displayed. After that, when a predetermined operation (in the example of FIG. 77, an upward swipe operation) is performed, the screen transitions to the push layer screen ((d) of FIG. 77). At this time, the tutorial screen is automatically displayed as a modal window as described above ((e) in FIG. 77).

[Display control system configuration]
Next, the configuration of the display control system according to the embodiment of the display control system including the display device 20 will be described. FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment.

The display control system 10 according to the embodiment is a system that displays an image for controlling the control target device (first control target device 41 and second control target device 42). The display control system 10 includes a display device 20, a control device 30, a first control target device 41, a second control target device 42, a sensor 43, and a server device 50. The display device 20, the control device 30, the first control target device 41, the second control target device 42, and the sensor 43 are installed in, for example, a building such as a house or the site of the building.

The display device 20 is a device that functions as a user interface device for controlling the device. The display device 20 is directly or indirectly communicably connected to a plurality of devices installed in the building. In other words, the display device 20 is directly or indirectly connected to the controlled object device including the housing equipment or the home electric appliance through the control device. The display device 20 is installed on a wall inside the building, for example. The display device 20 includes a touch screen 21, a control unit 22, a storage unit 23, and a communication unit 24.

Specifically, the touch screen 21 includes a touch panel 21a that accepts a user's operation and a display unit 21b that displays an image (moving image or still image). The touch panel 21a is an example of an acquisition unit. The touch panel 21a is, for example, a capacitance type touch panel, but may be a resistive film type touch panel. The display unit 21b is, for example, a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel.

The control unit 22 controls to operate the device to be controlled according to the operation received by the touch panel 21a, and controls the display of the image on the display unit 21b. The control unit 22 is realized by, for example, a microcomputer, but may be realized by a processor.

The storage unit 23 is a storage device that stores a control program or the like executed by the control unit 22. The storage unit 23 is realized by, for example, a semiconductor memory or the like.

The communication unit 24 is a communication circuit (in other words, a communication module) for the display device 20 to communicate with the control device 30, the second control target device 42, and the server device 50. The communication unit 24 transmits, for example, a control request for the device to be controlled to the control device 30 based on the control of the control unit 22. Further, the communication unit 24 transmits a control signal for controlling the second control target device 42 to the second control target device 42 based on the control of the control unit 22. The communication unit 24 receives, for example, a signal indicating a sensing result from the sensor. The communication unit 24 performs wireless communication, for example, but may perform wired communication. The communication standard of the communication performed by the communication unit 24 is not particularly limited.

The control device 30 is, for example, a HEMS (Home Energy Management System) controller, and controls the first control target device 41 based on a control request transmitted by the communication unit 24. The control device 30 is not limited to the HEMS controller having an energy management function, and may be another home controller or a gateway device having no energy management function.

The first control target device 41 is a device controlled by the control device 30, and is indirectly and communicably connected to the display device 20. Specifically, the first control target device 41 operates based on the control signal transmitted from the control device 30. The first controlled device 41 includes devices such as a storage battery system, a fuel cell system, a photovoltaic power generation system, a lighting device, a heat pump type water heater, an electric shutter, or an electric lock. In addition, wireless communication conforming to a communication standard such as Echonet Lite (registered trademark) is performed between the control device 30 and the first control target device 41.

The second controlled device 42 is a device controlled by the display device 20, and is directly and communicably connected to the display device 20. Specifically, the second control target device 42 operates based on the control signal transmitted from the display device 20. The second controlled device 42 includes, for example, an intercom device or a device such as an air conditioner.

The device described as the first control target device 41 may be included in the second control target device 42, and the device described as the second control target device 42 may be included in the first control target device 41. May be good. The equipment to be controlled may include housing equipment or home appliances.

The sensor 43 senses the environment in the building and transmits a signal indicating the sensing result to the display device 20. As a result, the display device 20 can display the environment in the building. The display device 20 can also control the device to be controlled based on the environment in the building. The sensor 43 includes a pressure sensor, a temperature sensor, a humidity sensor, an illuminance sensor, and the like.

The server device 50 is a cloud server. Various services are realized by linking the server device 50 and the display device 20.

[motion]
Next, the operation of the display control system 10 (in other words, the display control method executed by a computer such as the display device 20) will be described. FIG. 79 is a flowchart of the operation of the display control system 10. The operation of FIG. 79 is an operation corresponding to FIG. 50, and will be described below with reference to FIGS. 50 and 79.

First, the control unit 22 of the display device 20 displays the first display layer on the touch screen 21 (more specifically, the display unit 21b) (S11). The first display layer corresponds to, for example, the push layer shown in FIG. 50 (b). The first display layer has display objects that belong to the first category. Specifically, the display object belonging to the first category is a rectangular icon displayed on the screen of the push layer in FIG. 50 (b). The first category is, for example, a user interface for notifying the status of each of the controlled devices (in other words, a plurality of devices).

Next, the touch panel 21a acquires information regarding the first contact with the touch screen 21 made while the first display layer is displayed on the touch screen 21 (S12).

Next, the control unit 22 determines whether or not the information regarding the first contact includes the movement of the contact position in the first direction (S13). The movement of the contact position in the first direction is, for example, the movement of the contact position based on the swipe operation in the upward direction.

The "first direction" here means a direction as an element of the vector, and is distinguished from a direction from top to bottom and a direction from bottom to top. In addition, when the user swipes diagonally, the diagonal component of the swipe operation is decomposed into a vertical component and a horizontal component, and the size of the component in the upward direction (vertical direction) becomes left and right. When the magnitude of the component in the direction is larger than the magnitude of the component in the direction, it is determined that such an oblique swipe operation is a movement of the contact position in the first direction. The same applies to the second direction and the third direction described later.

When the control unit 22 determines that the information regarding the first contact includes the movement of the contact position in the first direction (Yes in S13), the control unit 22 displays the image displayed on the display unit 21b as the first display layer. To the second display layer (S14). The second display layer corresponds to, for example, the control layer of FIG. 50 (c). The second display layer has display objects that belong to a second category different from the first category. Specifically, the display object belonging to the second category is a rectangular icon displayed on the screen of the control layer in (c) of FIG. 50. The second category is a user interface for controlling the state of each of the controlled devices (plural devices).

When the control unit 22 determines that the information regarding the first contact does not include the movement of the contact position in the first direction (No in S13), the information regarding the first contact is the first direction. It is determined whether or not the movement of the contact position in the vertical second direction is included (S15). The movement of the contact position in the second direction is, for example, the movement of the contact position based on a swipe operation in the lateral direction (right direction or left direction). When the control unit 22 determines that the information regarding the first contact includes the movement of the contact position in the second direction perpendicular to the first direction (Yes in S15), the control unit 22 has the first display layer. The display position of the display object is moved in the second direction (S16).

When the control unit 22 determines that the information regarding the first contact does not include the movement of the contact position in the second direction perpendicular to the first direction (No in S15), the information regarding the first contact. Determines whether or not includes the movement of the contact position in the third direction, which is 180 degrees different from the first direction (S17). The movement of the contact position in the third direction is, for example, the movement of the contact position based on the swipe operation in the downward direction. When the control unit 22 determines that the information regarding the first contact includes the movement of the contact position in the third direction (Yes in S17), the control unit 22 displays the image displayed on the display unit 21b as the first display layer. To the third display layer (S18). The third display layer corresponds to, for example, the application layer of FIG. 50 (a). The third display layer has a first category and display objects belonging to a third category different from the second category. Specifically, the display object belonging to the third category is a rectangular icon displayed on the screen of the application layer in FIG. 50A. The third category is a user interface for providing content related to each of the controlled devices (plural devices).

When the control unit 22 determines that the information regarding the first contact does not include the movement of the contact position in the third direction (No in S17), the operation ends. That is, the first display layer remains displayed on the touch screen 21.

In the above operation, the first display layer, the second display layer, and the third display layer may be interchanged with each other. That is, the first category, the second category, and the third category each have (i) a user interface for notifying the status of each of the plurality of devices, and (ii) each of the plurality of devices. It may be either a user interface for controlling the state or (iii) a user interface for providing content related to each of the plurality of devices.

According to the above operation (display control method), the user can easily operate the display layer.

(Other embodiments)
Although the embodiments have been described above, the present invention is not limited to the above embodiments.

For example, in the above embodiment, another processing unit may execute the processing executed by the specific processing unit. For example, some or all of the processing performed by the display device may be performed by the control device or the server device.

Further, the communication method between the devices in the above embodiment is not particularly limited. Wireless communication may be performed or wired communication may be performed between the devices. Further, wireless communication and wired communication may be combined between the devices. Further, when two devices communicate with each other in the above embodiment, a relay device (not shown) may be interposed between the two devices.

Further, the order of processing described in the flowchart of the above embodiment is an example. The order of the plurality of processes may be changed, and the plurality of processes may be executed in parallel.

Further, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

In addition, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits from each other. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.

In addition, general or specific embodiments of the present invention may be realized in recording media such as systems, devices, methods, integrated circuits, computer programs or computer-readable CD-ROMs. Further, it may be realized by any combination of a system, a device, a method, an integrated circuit, a computer program and a recording medium.

For example, the present invention may be realized as a display control method executed by a computer such as a display control system, or may be realized as a program for causing a computer to execute such a display control method. Further, the present invention may be realized as a computer-readable non-temporary recording medium in which such a program is recorded.

Further, in the above embodiment, the display control system is realized by a plurality of devices, but may be realized as a single device. The display control system may be realized as, for example, a single device corresponding to a display device, a single device corresponding to a control device, or a single device corresponding to a server device. It may be realized as. When the display control system is realized by a plurality of devices, the components included in the display control system may be distributed to the plurality of devices in any way.

In addition, it is realized by applying various modifications to each embodiment that can be conceived by those skilled in the art, or by arbitrarily combining the components and functions of each embodiment within the range not deviating from the gist of the present invention. Also included in the present invention.

10 Display control system 20 Display device 21 Touch screen 21a Touch panel 21b Display unit 22 Control unit 23 Storage unit 24 Communication unit 30 Control device 41 First control target device 42 Second control target device 43 Sensor 50 Server device

Claims (7)

A display control method performed by a computer
A step of retrieving information about a first contact with a touch screen made while a first display layer having display objects belonging to the first category is displayed on the touch screen.
When the information regarding the first contact includes the movement of the contact position in the first direction, the first display layer has a display object belonging to a second category different from the first category. Steps to move to the display layer of 2 and
When the information regarding the first contact includes the movement of the contact position in the second direction perpendicular to the first direction, the display position of the display object possessed by the first display layer is referred to as the second display position. Including steps to move in the direction of
Display control method. The computer is directly or indirectly communicatively connected to multiple devices installed in the building.
The first category is a user interface for notifying the status of each of the plurality of devices.
The second category is a user interface for controlling the state of each of the plurality of devices.
The display control method according to claim 1. The second display layer has a plurality of the display objects belonging to the second category.
The plurality of display objects are arranged in an order based on the installation positions of the plurality of devices.
The display control method according to claim 2. When the information regarding the first contact includes the movement of the contact position in a third direction which is 180 degrees different from the first direction, the first display layer, the first category, and the first. Including a step of moving to a third display layer having display objects belonging to a third category different from the second category.
The display control method according to claim 1. The computer is directly or indirectly communicatively connected to multiple devices installed in the building.
The first category, the second category, and the third category are each
(I) A user interface for notifying the status of each of the plurality of devices,
(Ii) A user interface for controlling the state of each of the plurality of devices,
(Iii) One of the user interfaces for providing content related to each of the plurality of devices.
The display control method according to claim 4. A program for causing a computer to execute the display control method according to any one of claims 1 to 5. An acquisition unit that acquires information about a first contact with the touch screen while the first display layer having display objects belonging to the first category is displayed on the touch screen.
When the information regarding the first contact includes the movement of the contact position in the first direction, the first display layer has a display object belonging to a second category different from the first category. It is equipped with a control unit that shifts to the display layer of 2.
The control unit displays the display object included in the first display layer when the information regarding the first contact includes a movement of the contact position in a second direction perpendicular to the first direction. Move the position in the second direction,
Display control system.

Images