JPWO2020084836A1 - Display control method and display control system - Google Patents

Abstract

The display control method includes a step (S12) of acquiring information regarding the first contact with the touch screen performed while the first display layer is displayed on the touch screen, and information regarding the first contact. When the movement of the contact position in the first direction is included, the step of shifting from the first display layer to the second display layer (S14), the step of acquiring the state of the device (S15), and the second. When there is a change in the state of the device while the display layer of is displayed on the touch screen, a step (S17) of displaying a display object notifying the change in the second display layer is included.

Description

The present invention relates to a display control method for displaying the status of residential IoT (Internet of Things) devices such as housing equipment and home appliances, and a display control system.

In recent years, 24-hour ventilation systems installed in houses, EcoCute (registered trademark) / gas water heaters, interphones / electric locks, electric shutters, floor heating and other housing equipment, air conditioners, air purifiers, lighting equipment, televisions, etc. Residential IoT (Internet of Things) systems that collectively and coordinately control home appliances such as DVD recorders are attracting attention.

In the residential IoT system, the status of each device is displayed on an ambient panel, which is an information terminal, through, for example, Echonet Lite (registered trademark) or KNX (registered trademark) as a protocol for controlling each device. By making the desired settings on the panel, each device can be controlled not only independently but also in a coordinated manner.

The present invention provides a display control method and a display control system capable of notifying a user of the state of a device.

The display control method according to one aspect of the present invention is a display control method executed by a computer, and is a first display layer having a display object of the first category, which is a user interface for notifying the state of a device. The step of acquiring information about the first contact with the touch screen performed while is displayed on the touch screen, and the information about the first contact includes the movement of the contact position in the first direction. In this case, a step of shifting from the first display layer to a second display layer having a display object of a second category different from the first category, a step of acquiring the state of the device, and the first step. When there is a change in the state of the device while the display layer of 2 is displayed on the touch screen, the step of displaying a display object notifying the change in the second display layer is included.

The program according to one aspect of the present invention is a program for causing a computer to execute the display control method.

The display control system according to one aspect of the present invention is performed while the first display layer having the display objects of the first category, which is a user interface for notifying the state of the device, is displayed on the touch screen. From the first display layer, when the acquisition unit for acquiring the information regarding the first contact with the touch screen and the information regarding the first contact include the movement of the contact position in the first direction. A control unit that shifts to a second display layer having a display object of a second category different from the first category is provided, the control unit acquires the state of the device, and the second display layer When there is a change in the state of the device while being displayed on the touch screen, a display object for notifying the change is displayed in the second display layer.

The display control method and display control system of the present invention can notify the user of the state of the device.

FIG. 1 is a front view of the display device according to the embodiment. FIG. 2 is a perspective view of the display device according to the embodiment. FIG. 3 is a diagram showing an example of a display screen of a display device installed at the entrance. FIG. 4 is a diagram showing an example of a display screen of a display device installed in the dining room. FIG. 5 is a diagram showing an example of a display screen of a display device installed in the bedroom. FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building. FIG. 7 is a diagram showing an example of a display screen when a notification is being performed. FIG. 8 is a diagram showing a first example of the content to be notified. FIG. 9 is a diagram showing a second example of the content to be notified. FIG. 10 is a diagram showing a third example of the content to be notified. FIG. 11 is a diagram showing a fourth example of the content to be notified. FIG. 12 is a diagram showing an example of a display screen for controlling a scene when waking up. FIG. 13 is a diagram showing an example of a display screen for controlling a scene when returning home. FIG. 14 is a diagram showing an example of a display screen for controlling a scene when working from home. FIG. 15 is a diagram showing an example of a display screen for controlling a scene before going to bed. FIG. 16 is a diagram showing an example of an application selection screen. FIG. 17 is a diagram showing an example of a screen showing the air quality of each room. FIG. 18 is a diagram showing an example of a detailed screen of air quality in the living room. FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used. FIG. 20 is a diagram showing a second example of a screen showing the amount of electricity used. FIG. 21 is a diagram showing a first example of a screen while executing a home messenger application. FIG. 22 is a diagram showing a second example of a screen in which the home messenger application is being executed. FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of an image of a visitor taken by the doorphone). FIG. 24 is a diagram showing a second example (doorphone and camera selection screen) of the screen during execution of the doorphone application. FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen during execution of the message application. FIG. 26 is a diagram showing a second example (a plurality of message selection screens) of a screen in which a message application is being executed. FIG. 27 is a diagram showing a first example of a screen during execution of a moving image application. FIG. 28 is a diagram showing a second example of a screen in which a moving image application is being executed. FIG. 29 is a diagram showing a third example of a screen in which a moving image application is being executed. FIG. 30 is a diagram showing a first example of a screen in which a music application is being executed. FIG. 31 is a diagram showing a second example of a screen in which a music application is being executed. FIG. 32 is a diagram showing a third example of a screen in which a music application is being executed. FIG. 33 is a diagram showing a first example of a screen running a photographic application. FIG. 34 is a diagram showing a second example of a screen running a photographic application. FIG. 35 is a diagram showing a third example of a screen in which the photographic application is being executed. FIG. 36 is a diagram for explaining an example of presenting information triggered by an operation of an air conditioner on a remote controller. FIG. 37 is a diagram for explaining an example of presenting information triggered by an operation on a wall switch for turning on and off a lighting device. FIG. 38 is a diagram for explaining an example of presenting information triggered by an operation on the water heater. FIG. 39 is a diagram showing an example of a display screen for other information. FIG. 40 is a diagram showing an example of a weather warning display screen. FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key. FIG. 42 is a diagram showing an example of a display screen that recommends the control of an air purifier that is optimal for pollen removal. FIG. 43 is a diagram showing an example of a display screen that proposes improvement of the sleep state. FIG. 44 is a diagram showing an example of a washing timing notification screen. FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothing. FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays. FIG. 47 is a diagram showing an example of a display screen that presents a program that seems to suit the user's taste. FIG. 48 is a diagram showing a first example of a display screen for performing a Christmas effect. FIG. 49 is a diagram showing a second example of a display screen for performing a Christmas effect. FIG. 50 is a diagram showing a configuration of a home screen of the display device according to the embodiment. FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device. FIG. 52 is a diagram showing an example of a screen of a push layer including a plurality of icons. FIG. 53 is a diagram showing an example of a screen of the push layer in the night mode. FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state. FIG. 55 is a diagram showing an example of a screen for moving and deleting an icon of a device. FIG. 56 is a diagram for explaining a change in the display mode of the screen of the push layer. FIG. 57 is a diagram for explaining a notification made when the screen of the application layer is displayed. FIG. 58 is a diagram for explaining an example in which the tutorial of the control layer is displayed when the screen of the control layer is displayed for the first time. FIG. 59 is a diagram showing an example of an icon for performing air conditioning in the entire building displayed on the screen of the control layer. FIG. 60 is a diagram showing screen transitions when the icon for air conditioning in the entire building is operated. FIG. 61 is a diagram showing an example of a control screen for air conditioning in the entire building during automatic save operation. FIG. 62 is a diagram showing an example of a control screen for air conditioning in the entire building in the outing mode. FIG. 63 is a diagram showing an example of an icon for controlling the air conditioner displayed on the screen of the control layer. FIG. 64 is a diagram showing a screen transition when the icon of the air conditioner is operated by long tapping. FIG. 65 is a diagram showing an example of an icon for controlling the heat pump type water heater displayed on the screen of the control layer. FIG. 66 is a first diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. FIG. 67 is a second diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. FIG. 68 is a diagram showing an example of an icon for controlling the water heater included in the fuel cell system, which is displayed on the screen of the control layer. FIG. 69 is a diagram showing a screen transition when the icon of the fuel cell system is operated by long tapping. FIG. 70 is a diagram showing an example of an icon for controlling the electric shutter displayed on the screen of the control layer. FIG. 71 is a diagram showing a screen transition when the electric shutter icon is operated by a long tap. FIG. 72 is a diagram showing an example of an icon for controlling the electric lock displayed on the screen of the control layer. FIG. 73 is a diagram showing a screen transition when the electric lock icon is operated by a long tap. FIG. 74 is a diagram showing an example of an icon for controlling the air purifier displayed on the screen of the control layer. FIG. 75 is a diagram showing a screen transition when the icon of the air purifier is operated by long tapping. FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state. FIG. 77 is a diagram showing an initial setting screen and a screen transition from the initial setting screen. FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment. FIG. 79 is a flowchart of an operation example 1 of the display control system according to the embodiment. FIG. 80 is a flowchart of an operation example 2 of the display control system according to the embodiment.

Hereinafter, embodiments will be specifically described with reference to the drawings. It should be noted that all of the embodiments described below show comprehensive or specific examples. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the components in the following embodiments, the components not described in the independent claims will be described as arbitrary components.

It should be noted that each figure is a schematic view and is not necessarily exactly shown. Further, in each figure, substantially the same configuration may be designated by the same reference numerals, and duplicate description may be omitted or simplified.

(Embodiment)
[Overview of display device]
First, an outline of the display device according to the embodiment will be described. FIG. 1 is a front view of the display device according to the embodiment. FIG. 2 is a perspective view of the display device according to the embodiment.

The display device 20 is a dedicated terminal used in a system (for example, a display control system described later) that provides services related to a new lifestyle that is centered on people. The display device 20 can provide the user with a beautifully integrated new form of involvement with housing equipment and home appliances. In addition, the display device 20 can provide the user with a value tailored to the resident in cooperation with the server device.

The display device 20 is installed inside a building such as a house (for example, a wall). The display device 20 also includes a touch screen 21 and is used as an integrated remote controller for the user to control the equipment installed in the building. According to the display device 20, it is not necessary to install a remote controller for each device, so that complexity can be removed from the building.

Further, if the display device 20 is installed in each of a plurality of spaces (entrance, dining room, bedroom, etc.) in the building, the user can confirm the behavior of living or the setting of the device in the building. It can be done from anywhere inside. FIG. 3 is a diagram showing an example of a display screen of the display device 20 installed at the entrance, FIG. 4 is a diagram showing an example of the display screen of the display device 20 installed in the dining room, and FIG. 5 is a diagram showing an example of the display screen of the display device 20 installed in the dining room. It is a figure which shows an example of the display screen of the display device 20 installed in a bedroom. For example, the user can close the front door key or the electric shutter in the living room from the bedroom, or turn off the air conditioner and lighting equipment in the house from the front door.

Further, the display device 20 eliminates unnecessary information from a large amount of information and provides only the necessary information to the user. For example, the device control function of the display device 20 eliminates complicated functions that are often found in conventional remote controllers or switches. The display device 20 intuitively provides only the functions necessary for daily life. FIG. 6 is a diagram showing an example of a display screen for the user to intuitively control the air conditioning in the entire building (in other words, control a plurality of air conditioning devices).

[Display device function: Notification]
Further, the display device 20 is configured so that the information desired by the user and the notification that the user does not want to miss can be accessed with one tap. For example, the home screen of the display device 20 is notified of the status or notification of the device corresponding to the display device 20. FIG. 7 is a diagram showing an example of a display screen when a notification is being performed. As shown in FIG. 7, for example, the user confirms a new recording immediately after returning home from the display device 20 installed at the entrance, or confirms the visitor of the doorphone from the display device 20 installed in the study. be able to.

8 to 11 are diagrams showing an example of the content to be notified. As shown in FIG. 8, according to the display device 20, the user can check and watch the new recording from the entrance or a favorite place immediately after returning home. Further, as shown in FIG. 9, according to the display device 20, the user can respond to the intercom device from anywhere in the building and check the history when he / she is absent. Further, as shown in FIG. 10, according to the display device 20, the user can confirm the completion of hot water in the bathtub from anywhere in the building. As shown in FIG. 11, according to the display device 20, the user can also check the message left by someone in the family.

[Display device function: Scene control]
In addition, the user can freely switch the environment in the building by operating a plurality of devices through the display device 20. The control of switching the environment inside the building to the state requested by the user with one tap or a timer is also described as scene control. In the scene control, as long as the device is compatible with the display device 20, any device installed in any space (room) in the building can be controlled at once. For example, it is possible to make all the electric shutters, lighting devices, and air conditioners installed in the building suitable for comfortable awakening, and to set the necessary devices at once when returning home.

A specific example of scene control will be described. FIG. 12 is a diagram showing an example of a display screen for controlling a scene when waking up. In scene control when waking up, for example, an alarm is sounded, an electric shutter is opened, and a lighting device is turned on (on). Controls such as) are realized by a timer. Waking-up scene control provides the user with a comfortable awakening and makes the building an environment suitable for the morning hours. FIG. 13 is a diagram showing an example of a display screen for controlling the scene at the time of returning home. In the scene control at the time of returning home, for example, control such as opening an electric shutter, turning on a lighting device, and turning on an air conditioner is performed. Is realized with one tap. In other words, what you need to do when you get home is realized with just one tap.

Although a plurality of types of scene controls are prepared in advance as presets, the user can newly create and register them according to his / her preference. For example, the user can newly create and register a scene control when working from home, a scene control before going to bed, and the like.

FIG. 14 is a diagram showing an example of a display screen for controlling a scene when working from home. In the scene control when working from home, for example, the lighting device is dimmed and the set temperature of the air conditioner is low. By setting to, an environment suitable for work is realized, which can enhance the user's concentration and work efficiency. FIG. 15 is a diagram showing an example of a display screen for controlling a scene before going to bed, and is a diagram showing an example of a display screen for controlling a scene before going to bed. By dimming the lighting equipment, closing the electric shutter, and setting the temperature of the air conditioner to a low level, it is possible to create an environment where the inside of the building can be comfortably introduced into sleep. .. The user can instruct the scene control before going to bed not only from the display device 20 installed in the bedroom but also from the display device 20 installed in the living room or the dining room.

[Display device function: Application]
Various applications (application programs) may be installed in the display device 20. FIG. 16 is a diagram showing an example of an application selection screen. If various applications are installed, the user can check the state of air in the building and the state of electricity usage in the building by selecting the application to be executed. The user can also check the TV program currently being broadcast and the recorded program. The display device 20 can also receive a new application from the server device.

For example, by selecting the "air" icon in the selection screen of FIG. 16, the user can select the air condition (specifically, temperature, humidity, odor, house dust, and air condition) of each room in the building. Air quality such as PM2.5 concentration) can be grasped. FIG. 17 is a diagram showing an example of a screen showing the air quality of each room, and FIG. 18 is a diagram showing an example of a detailed screen of the air quality of the living room. If the screen as shown in FIG. 17 is displayed on the touch screen 21, the user can grasp the air quality of each room at a glance. Further, if the screen as shown in FIG. 18 is displayed on the touch screen 21, the user can confirm the daily (or monthly) change in the air quality of a specific room. The display device 20 can manage the air quality by, for example, acquiring a signal indicating a sensing result from a sensor that measures the air quality.

Further, for example, the user can grasp the amount of electricity used in each room in the building by selecting the "electricity" icon in the selection screen of FIG. FIG. 19 is a diagram showing a first example of a screen showing the amount of electricity used, and FIG. 20 is a diagram showing a second example of a screen showing the amount of electricity used. The display device 20 manages the current or past electricity usage in the building for each branch circuit by acquiring a signal indicating the electricity usage from, for example, a distribution board having a communication function installed in the building. It can be provided to the user as an image. Further, the display device 20 acquires the information indicating the electricity usage of another user (which may be a general electricity usage) from the server device, so that the electricity of the user is shown in FIG. The usage amount and the electricity usage amount of other users can be displayed side by side.

Also, for example, the user can talk with a family member in another room in the building by selecting the "home messenger" icon in the selection screen of FIG. FIG. 21 is a diagram showing a first example of a screen in which a home messenger application is being executed, and FIG. 22 is a diagram showing a second example of a screen in which a home messenger application is being executed. Once the home messenger application is running, you can tell the children's room that you've got rice from the kitchen, or you can tell the dining room that you're home from the front door. In other words, the possibility of communication between rooms expands.

Further, for example, the user selects the "doorphone" icon in the selection screen of FIG. 16 to communicate with the display device 20 from the room in which the display device 20 is installed (in other words, the intercom device). Can respond to. FIG. 23 is a diagram showing a first example of a screen during execution of the doorphone application (display screen of an image of a visitor taken by the doorphone). Further, if a camera that images the outside of the building is connected to the display device 20 by communication, the user can also visually recognize the outside of the building through the display device 20. FIG. 24 is a diagram showing a second example (doorphone and camera selection screen) of the screen during execution of the doorphone application.

Further, for example, the user can use the display device 20 as a message board by selecting the "message" icon in the selection screen of FIG. 16. FIG. 25 is a diagram showing a first example (handwriting input screen) of a screen during execution of the message application. FIG. 26 is a diagram showing a second example (a plurality of message selection screens) of a screen in which a message application is being executed. The message can be stored (that is, recorded) as a moving image or a still image, or can be stored (that is, recorded) as a voice.

Further, for example, the user selects the "moving image" icon in the selection screen of FIG. 16 to display the currently broadcasting TV program received by the tuner device communicatively connected to the display device 20. It is also possible to check the recorded program provided from the moving image content storage device which is communicatively connected to the device 20. 27 to 29 are diagrams showing an example of a screen during execution of a moving image application. The user can check new recordings using the display device 20 installed at the entrance immediately after returning home, or check the morning news using the display device 20 installed in the bedroom while changing clothes in the bedroom. Can be done. In other words, the range of ways to interact with information in daily life will expand.

Further, for example, the user can enjoy the music provided from the music content storage device which is communicatively connected to the display device 20 by selecting the "music" icon in the selection screen of FIG. 30 to 32 are diagrams showing an example of a screen during execution of a music application. The user can enjoy music in any room in which the display device 20 is installed. Further, if a separate speaker device is connected to the display device 20 by communication, it is possible to output music from the speaker device.

Further, for example, the user can enjoy the photo provided by the still image content storage device communicatively connected to the display device 20 by selecting the "photo" icon in the selection screen of FIG. 33 to 35 are diagrams showing an example of a screen during execution of the photographic application. The user can enjoy the photograph in any room in which the display device 20 is installed.

[Display device function: Presentation of information triggered by user operation]
The display device 20 is an act that leads to a better life by using the usual actions such as "turning on the lighting device", "turning off the power of the air conditioner", and "boiling a bath" that the user performs in daily life as a trigger. Alternatively, it is possible to present the optimum experience (specifically, content or function, etc.) according to the situation. That is, the display device 20 can present information to the user by using the user's operation on the device as a trigger. FIG. 36 is a diagram for explaining an example of presenting information triggered by an operation of an air conditioner on a remote controller.

In the example of FIG. 36, when the user performs an operation of turning off the power of the air conditioner with respect to the remote controller of the air conditioner ((a) of FIG. 36), the display device 20 uses this as a trigger to consume the power of the air conditioner. (For example, if you only leave the room for about an hour, the power consumption is lower when the power is on) to reduce the amount of power consumption ((b) in FIG. 36). ).

Further, FIG. 37 is a diagram for explaining an example in which information is presented by using an operation on a wall switch for turning on and off the lighting device as a trigger. In the example of FIG. 37, when the user turns on the lighting device at the entrance when returning home at midnight ((a) of FIG. 37), the display device 20 uses this as a trigger to display the dimming setting suitable for the midnight time zone ((a) of FIG. 37). (B) of FIG. 37.

Further, FIG. 38 is a diagram for explaining an example of presenting information triggered by an operation on the water heater. In the example of FIG. 38, when the user instructs the operation panel of the water heater to add hot water to the bathtub, the display device 20 uses this as a trigger to display an image of recommending bathing goods that enrich the bath time. indicate.

In this way, the display device 20 can present various information triggered by the user's operation on the device. It should be noted that FIGS. 36 to 38 show an example of information presentation. Various information can be presented by combining the devices connected to the display device 20 and various services.

[Display device function: Presentation of other information]
The display device 20 combines device usage logs, date and time data, weather information provided by the server device (cloud server), etc., to protect the safety and health of the family, advice to help with household chores, and advice. , It is also possible to provide recommended content according to the taste of the family. FIG. 39 is a diagram showing an example of such other information display screens. Hereinafter, specific examples of information that can be presented by the display device 20 will be described.

The display device 20 can display the weather warning and the stormy weather by receiving the weather information (in other words, the weather information) from the server device, for example. FIG. 40 is a diagram showing an example of a weather warning display screen. The display device 20 can support the peace of mind of the family by displaying the weather warning and the stormy weather.

Further, the display device 20 can display a notification screen for preventing forgetting to lock the key based on the state of the electric lock, the time zone, and the like. FIG. 41 is a diagram showing an example of a notification screen for preventing forgetting to lock the key. The display device 20 can support the peace of mind of the family by giving a notification to prevent forgetting to lock the key.

In addition, the display device 20 can recommend the control of the air purifier that is optimal for pollen removal according to the pollen information and the home situation. FIG. 42 is a diagram showing an example of a display screen that recommends the control of an air purifier that is optimal for pollen removal. The display device 20 can support the health of the family by recommending the control of the air purifier that is optimal for pollen removal.

In addition, the display device 20 can estimate the sleep condition of the user from the usage log of the lighting device and the electric shutter, and make a proposal for improving the sleep state. FIG. 43 is a diagram showing an example of a display screen that proposes improvement of the sleep state. The display device 20 can support the health of the family by making proposals for improving the sleep state.

The display device 20 can notify the best washing timing by receiving, for example, weather information (in other words, weather API (Application Programming Interface) information) from the server device. FIG. 44 is a diagram showing an example of a washing timing notification screen. The display device 20 can also recommend room drying in the season when there is a lot of pollen. The display device 20 can support household chores by notifying the timing of washing.

Further, the display device 20 can make a proposal regarding clothes (thick clothes or light clothes) based on the difference between the average weekly temperature included in the weather information provided by the server device and the temperature on the day. FIG. 45 is a diagram showing an example of a display screen for making a proposal regarding clothing. The display device 20 can also propose to carry rain gear on a rainy day.

In addition, the display device 20 can call attention to ultraviolet rays during the daytime (morning to noon time zone) based on the ultraviolet index included in the weather information provided by the server device. FIG. 46 is a diagram showing an example of a display screen for calling attention to ultraviolet rays. The display device 20 can support the beauty of the user by calling attention to ultraviolet rays.

Further, the display device 20 can record and present a program that seems to suit the user's taste from the TV viewing history and the recording log of the video content storage device. FIG. 47 is a diagram showing an example of a display screen that presents a program that seems to suit the user's taste.

In addition, the display device 20 can perform special device control on anniversaries and the like. For example, the display device 20 displays a display screen for performing a Christmas effect using a device at Christmas. 48 and 49 are diagrams showing an example of a display screen for performing a Christmas effect. When the user's approval is obtained through such a display screen, a Christmas effect is performed by the speaker (music) and the lighting device (light) in the room where the display device 20 is installed.

[Display device display screen configuration]
Next, the configuration of the home screen of the display device 20 will be described. FIG. 50 is a diagram showing a configuration of a home screen of the display device 20.

As shown in FIG. 50, the home screen of the display device 20 has (a) “Apps Layer”, (b) “Push Layer”, and (c) “Control Layer”. It has a three-story structure (three-layer structure) of "layer)". When the push layer serves as the base point and the swipe operation in the direction from top to bottom is performed on the touch screen 21 while the screen of the push layer is displayed, the screen transitions to the screen of the application layer. Further, when the touch screen 21 is swiped in the direction from the bottom to the top while the screen of the push layer is displayed, the screen transitions to the screen of the control layer.

[Push layer]
First, the push layer serving as a base point will be described with reference to FIG. 50 (b). The push layer is a layer of push-type interaction that is the basis of the display device 20 for recommendations and notifications. On the screen of the push layer, information such as a notification or a recommendation transmitted from a device communication-connected to the display device 20 as a starting point is displayed.

As shown in FIG. 50 (b), the display device 20 detects the presence or absence of a user in the vicinity of the display device 20 by a motion sensor or the like, and the user is in the vicinity of the display device 20 (that is, near the display device 20). ) Displays information such as notifications or recommendations on the screen. On the other hand, when the user is not around the display device 20 (that is, near the display device 20), the display device 20 does not display information such as notifications or recommendations to be displayed on the screen. FIG. 51 is a diagram showing an example of a push layer screen when the user is not near the display device 20.

Further, when there is a plurality of information such as notifications or recommendations to be displayed, the icons indicating the information are displayed side by side in the left-right direction, for example. FIG. 52 is a diagram showing an example of a screen of a push layer including a plurality of icons. The plurality of icons are arranged in a row in the left-right direction in the order of the generated time, for example, the newer the information is generated, the left side. When a left / right swipe operation (in other words, a scroll operation) is performed on the display area of the icon, the icon is scrolled. At this time, only the icon is scrolled while the display areas of the time, date, and weather are maintained (fixed). When each of the plurality of icons is tapped, the screen transitions to the screen of the application layer or the screen of the control layer related to the information indicated by the icon.

The display mode of the push layer screen may be changed according to the time zone. For example, the screen background color of the push layer may be changed to a darker color during the night time zone than at other time zones. FIG. 53 is a diagram showing an example of a screen of the push layer in such a night mode.

[Control layer]
Next, the control layer will be described with reference to FIG. 50 (a). The control layer is a layer for individually controlling the devices grouped by the device category and location (room), such as turning off the lighting equipment in the kitchen and setting the air conditioning in the entire building. By tapping the device icon included in the control layer screen, the user can turn the device on and off without screen transition. That is, the user can simply control the device. In addition, the user can perform detailed control of the device by long-tapping the device icon.

Each of the icons of the plurality of devices is displayed in different modes (for example, different colors) depending on the on and off states so that the on and off states of the devices can be seen at a glance. For example, when the device is on, the icon of the device is displayed in color, and when the device is off, the icon of the device is displayed in monochrome (grayscale, washout). FIG. 54 is a diagram showing an example of a screen of the control layer when the device is in the off state. Further, the device icon may include characters indicating the operating state of the device.

On the control layer screen, the device icons are arranged in a row in the left-right direction, and when a left-right swipe operation (in other words, a scroll operation) is performed on the icon display area, the icon is scrolled. .. In the default state, the icon located on the rightmost side of the touch screen 21 is displayed so as to be partially interrupted so that the user can be informed that the icons of the plurality of devices are scrolling.

The icons of the plurality of devices are arranged in an order according to the place (room) where the device is installed. In the example of (a) of FIG. 50, an icon related to the entire building (for example, a scene control icon) is arranged on the leftmost side, and a room (for example, a living room) in which a display device 20 is installed is arranged on the right side thereof. The icon of the device installed in is placed. On the right side, for example, an icon of a device installed in the room closest to the living room is arranged. In this way, on the control layer screen, the icon of the device installed in the room closer to the room where the display device 20 is installed is on the left side (in other words, a position that is easily accessible in the default state (initial state)). Be placed. That is, the icons of the plurality of devices are arranged in an order based on the device installation position (in other words, an order related to the installation position).

If the icons of multiple devices do not fit on one screen, the icons of multiple devices located on the relatively left side are located on the screen by default, but the icons placed on the relatively right side. Is not located on the screen in the default state, but appears on the screen only after scrolling.

When the number of a plurality of devices that can be controlled through the display device 20 is large, the number of icons of the plurality of devices becomes very large. Therefore, at the lower left of the control layer screen, jump shortcuts (characters indicating places (spaces) in the building such as "all rooms", "living room", and "kitchen") are provided. By tapping the jump shortcut, the user can position the icon of the device installed at the location indicated by the tapped character on the screen (multiple icons automatically scroll).

The arrangement of the device icons can also be changed according to the user's preference. FIG. 55 is a diagram showing an example of a screen for moving and deleting an icon of a device. The user can change the arrangement (left-right positional relationship) of the device icons by performing a drag-and-drop operation on the device icons on the device icon movement / deletion screen.

[App layer]
Next, the application layer will be described with reference to FIG. 50 (c). The app layer is used to check the power consumption of a building and watch videos. In the app layer, multiple icons are categorized according to the action the user wants to do and the experience action. In addition, new applications provided by developers and new services provided in the future will be added to the application layer. From the screen of the application layer, the application program described with reference to FIGS. 16 to 35 can be executed.

It should be noted that what can be executed from the application layer and what can be executed from the control layer are classified as follows, for example. What can be executed from the app layer is equipment that can be easily added and changed, such as so-called home appliances (equipment that is not fixed to the wall of a building), and equipment (lighting equipment that is fixed to the wall of a building, air conditioning equipment, etc.). (Equipment such as), but control of equipment that operates by referring to information.

On the other hand, what can be executed from the control layer is the control of equipment. In some cases, the same control can be executed from both the application layer and the control layer.

[Status display by distance]
The display mode of the push layer screen may be changed according to the distance between the display device 20 and a person standing in front of the display device 20. That is, the display device 20 may automatically switch the display according to the distance to the user. FIG. 56 is a diagram for explaining a change in the display mode of the screen of the push layer.

As shown in FIG. 56, the screen of the push layer is when the user is located within a range of 1 m from the display device 20 (for example, the user is operating the display device 20 or in front of the display device 20). It is displayed in the normal state in the standing state). The push layer screen is displayed in an ambient state when the user is located within a range of 1 m or more and less than 3 m from the display device 20 (when the user is in the room where the display device 20 is installed). Further, the push layer screen is in a sleep state (for example, black) when the user is located at a distance of 3 m or more from the display device 20 (for example, when the user is absent from the room where the display device 20 is installed). It is displayed as a picture).

The ambient state means a state in which the presence or absence of a notification can be confirmed even from a distant position while taking care not to overstate the notification. The screen of the push layer in the ambient state is realized by displaying the time and the notification icon on a white background, for example.

On the push layer screen, the current date and time, the weather, and the like are always displayed on the left side of the screen. In this way, the information that the user always wants to display may be changed by the user setting. The information that the user always wants to display includes time, weather, outdoor temperature and humidity, indoor temperature and humidity, air quality (in other words, air pollution, odor, and PM2. 5 concentration etc.), power consumption, power generation amount of solar power generation system etc., family schedule, what day is today, etc. are included. It is advisable to consider that the information that the user always wants to display can be visually recognized by the user even from a slightly distant position, such as by enlarging the characters or the display.

[Notification in display layer other than push layer]
A method of notifying when information to be notified to the user occurs when the screen of the control layer or the screen of the application layer is displayed in the display device 20 will be described. The notifications given when the control layer screen or the application layer screen is displayed include normal push notifications and forced priority push notifications. FIG. 57 is a diagram for explaining a notification made when the screen of the application layer is displayed. Although not shown, the same applies to the notification given when the control layer screen is displayed.

As shown in FIGS. 57A and 57B, in the normal push notification, the notification content is superimposed and displayed on the upper part of the screen of the application layer. During application execution, no notification is given on the application execution screen (screens as shown in FIGS. 17 to 35), and when the application layer screen is returned from the execution screen, the notification content is superimposed on the upper part of the screen. NS. When the area on which the notification contents are superimposed is tapped, for example, the notification is terminated and the state returns to the state of FIG. 57 (a). When the notification is related to the control of the device, when the area on which the notification content is superimposed is tapped, the screen transitions to the screen for controlling the device (control layer screen, control screen described later, etc.).

Notifications that are normally performed as push notifications include, for example, notification of the installation anniversary of the display device 20, notification of the birthday of the user or family, notification of important messages, notification of abnormal temperature and humidity, and opening of the electric shutter. Notifications when, notifications when the electric lock opens, notifications about the delivery box, etc.

On the other hand, forced priority push notifications are notifications that require immediate response by the user, such as incoming calls, in other words, you want to be notified immediately no matter what operation is being performed (more important than normal push notifications). It is a notification. As shown in (a) of FIG. 57 and (c) of FIG. 57, when it becomes necessary to give a forced priority push notification, the entire screen is switched to the notification screen even during the operation.

The notifications performed as forced priority push notifications include, for example, a power failure (cooperation / non-cooperation) notification, a power usage overuse notification (peak alarm), and a notification indicating a visitor by an intercom device (FIG. 57 (c)). Calls from other rooms (ie, other display devices 20) and the like are included.

[View Tutorial]
The display device 20 displays a tutorial (specifically, an outline of what the application can do, typical operations, etc.) when the application or the like is started for the first time. FIG. 58 is for explaining an example in which the control layer tutorial is displayed ((c) in FIG. 58) when the screen of the control layer is first displayed ((a) and (b) in FIG. 58). It is a figure of.

Animation (in other words, video) is used to display the tutorial. If individual explanations are required, balloons or characters may be displayed on the screen, or animations that anticipate operations may be displayed on the screen. As a result, the display device 20 can present the operation method to the user in an easy-to-understand manner.

In the tutorial, the amount of information (wording and content, etc.) is cut off to prevent the user from feeling stress. In addition, the tutorial is configured to advance to the next item by user operation such as swipe operation so that the user can quickly access the necessary part, which suppresses the user from feeling annoyed. Detailed functions and operation explanations are described in the online manual, and the display device 20 provides guidance and display so that the user can smoothly reach the description location of the online manual.

[Control screen for air conditioning in the entire building]
Next, a detailed screen (hereinafter, also referred to as a control screen) when the user controls the device from the control layer will be described. First, the control screen for air-conditioning the entire building in the building will be described by illustration. FIG. 59 shows an example (specifically, an icon corresponding to the state of the whole building air conditioning) of an icon (hereinafter, also simply referred to as a whole building air conditioning icon) displayed on the screen of the control layer for performing the whole building air conditioning. It is a figure which shows an example of change). FIG. 60 is a diagram showing screen transitions when the icon for air conditioning in the entire building is operated. Note that the icons for air conditioning in the entire building are not grouped (in other words, associated) with, for example, the "all rooms" tab on the screen of the control layer. In addition, since the air conditioning in the entire building is basically always on and is not suitable for the single tap operation, the modal in FIG. 60 shows whether the single tap operation or the long tap operation is performed on the icon of the air conditioning in the entire building. A window is displayed. The air conditioning in the entire building may be a specification that cannot be turned off from the display device 20.

Note that FIG. 61 is a diagram showing an example of a control screen for air conditioning in the entire building during automatic save operation, and FIG. 62 is a diagram showing an example of a control screen for air conditioning in the entire building in the outing mode (during going out). These control screens are displayed only when the operation is performed from the original remote controller of the air conditioning system in the entire building.

[Control screen for air conditioning equipment]
Next, the control screen of the air conditioner will be described by illustration. FIG. 63 shows an example (specifically, an icon according to the state of the air conditioner) of an icon for controlling the air conditioner displayed on the screen of the control layer (hereinafter, also simply referred to as an icon of the air conditioner). It is a figure which shows an example) of the change of. FIG. 64 is a diagram showing a screen transition when the icon of the air conditioner is operated by long tapping.

[Control screen of heat pump type water heater]
Next, the control screen of the heat pump type water heater will be described by illustration. FIG. 65 shows an example (specifically, a heat pump type water heater) of an icon for controlling the heat pump type water heater displayed on the screen of the control layer (hereinafter, also simply referred to as a heat pump type water heater icon). It is a figure which shows an example of the change of the icon according to the state of. FIG. 66 is a first diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. FIG. 67 is a second diagram showing a screen transition when the icon of the heat pump type water heater is operated by long tapping. The same icon is used for the gas water heater, and the same screen transition is performed.

[Control screen of the water heater provided in the fuel cell system]
Next, the control screen of the water heater included in the fuel cell system will be described by illustration. FIG. 68 is an example (specifically, fuel) of an icon (hereinafter, also simply referred to as a fuel cell system icon) for controlling a water heater included in the fuel cell system, which is displayed on the screen of the control layer. It is a figure which shows an example of the change of the icon according to the state of the water heater provided in the battery system). FIG. 69 is a diagram showing a screen transition when the icon of the fuel cell system is operated by long tapping.

[Power shutter control screen]
Next, the control screen of the electric shutter will be described by illustration. FIG. 70 shows an example (specifically, depending on the state of the electric shutter) of an icon for controlling the electric shutter (hereinafter, also simply referred to as an icon of the electric shutter) displayed on the screen of the control layer. It is a figure which shows an example of the change of an icon). As shown in FIG. 70, during the operation of the electric shutter, the state of the electric shutter can be presented to the user in an easy-to-understand manner by animating the icon. A similar icon (the title of the icon is changed from "shutter" to "blind") is used for the electric blind.

FIG. 71 is a diagram showing a screen transition when the icon of the electric shutter (or electric blind) is operated by a long tap. When the grouped (in other words, associated) electric shutter icon is operated by long tapping on the "All rooms" tab of the control layer screen, multiple electric shutters in the building are collectively controlled. When the electric shutter icon grouped on each room tab of the control layer screen is operated by long tapping, the electric shutter installed in the room is controlled.

[Electric lock control screen]
Next, the control screen of the electric lock will be described by illustration. FIG. 72 shows an example (specifically, depending on the state of the electric lock) of an icon for controlling the electric lock (hereinafter, also simply referred to as an electric lock icon) displayed on the screen of the control layer. It is a figure which shows an example of the change of an icon). FIG. 73 is a diagram showing a screen transition when the electric lock icon is operated by a long tap. When the electric lock icon grouped on the "All Rooms" tab of the control layer screen is operated by long tapping, multiple electric locks in the building are collectively controlled. When the electric lock icon grouped on each room tab of the control layer screen is operated by long tapping, the electric lock installed in the room is controlled.

[Air purifier control screen]
Next, the control screen of the air purifier (for example, the ceiling-embedded air purifier) will be described by illustration. FIG. 74 shows an example (specifically, the state of the air purifier) of an icon for controlling the air purifier (hereinafter, also simply referred to as an icon of the air purifier) displayed on the screen of the control layer. It is a figure which shows an example of the change of the icon according to. FIG. 75 is a diagram showing a screen transition when the icon of the air purifier is operated by long tapping.

[Screen showing that the device is in an irregular state]
On the control layer screen, when the device falls into an irregular state such as when the system is abnormal, offline, or indefinite, the device icon changes to indicate an abnormality. When the icon indicating the abnormality is operated, a screen indicating that the state is irregular is displayed. FIG. 76 is a diagram showing screen transitions when the device falls into an irregular state. FIG. 76 (a) is a diagram showing an example of a screen when a system abnormality occurs, and FIG. 76 (b) is a diagram showing an example of a screen when offline.

The irregular state is classified into, for example, a detached state, an indefinite state, and a failure state. The detached state means that the communication connection between the display device 20 and the device is cut off, and the indefinite state means that the display device 20 and the device are connected to each other by communication, but it takes time to detect the numerical value (for example, during startup). State). The failure state means that the device itself is out of order.

[Initial setting screen]
When the display device 20 is installed, the installation location of the display device 20 is set. FIG. 77 is a diagram showing such an initial setting screen and a screen transition from the initial setting screen. As shown in FIG. 77, when the name of the installation location is input to the initial setting screen ((a) of FIG. 77), the screen transitions to the input screen ((b) of FIG. 77).

When the initial setting is completed, a screen ((c) in FIG. 77) for notifying that the initial setting is completed is displayed. After that, when a predetermined operation (in the example of FIG. 77, an upward swipe operation) is performed, the screen transitions to the push layer screen ((d) of FIG. 77). At this time, the tutorial screen is automatically displayed as a modal window as described above ((e) in FIG. 77).

[Display control system configuration]
Next, the configuration of the display control system according to the embodiment of the display control system including the display device 20 will be described. FIG. 78 is a block diagram showing a functional configuration of the display control system according to the embodiment.

The display control system 10 according to the embodiment is a system that displays an image for controlling the control target device (first control target device 41 and second control target device 42). The display control system 10 includes a display device 20, a control device 30, a first control target device 41, a second control target device 42, a sensor 43, and a server device 50. The display device 20, the control device 30, the first control target device 41, the second control target device 42, and the sensor 43 are installed in, for example, a building such as a house or the site of the building.

The display device 20 is a device that functions as a user interface device for controlling the device. The display device 20 is directly or indirectly communicably connected to a plurality of devices installed in the building. In other words, the display device 20 is directly or indirectly connected to the controlled object device including the housing equipment or the home electric appliance through the control device. The display device 20 is installed on a wall inside the building, for example. The display device 20 includes a touch screen 21, a control unit 22, a storage unit 23, and a communication unit 24.

Specifically, the touch screen 21 includes a touch panel 21a that accepts a user's operation and a display unit 21b that displays an image (moving image or still image). The touch panel 21a is an example of an acquisition unit. The touch panel 21a is, for example, a capacitance type touch panel, but may be a resistive film type touch panel. The display unit 21b is, for example, a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel.

The control unit 22 controls to operate the device to be controlled according to the operation received by the touch panel 21a, and controls the display of the image on the display unit 21b. The control unit 22 is realized by, for example, a microcomputer, but may be realized by a processor.

The storage unit 23 is a storage device that stores a control program or the like executed by the control unit 22. The storage unit 23 is realized by, for example, a semiconductor memory or the like.

The communication unit 24 is a communication circuit (in other words, a communication module) for the display device 20 to communicate with the control device 30, the second control target device 42, and the server device 50. The communication unit 24 transmits, for example, a control request for the device to be controlled to the control device 30 based on the control of the control unit 22. Further, the communication unit 24 transmits a control signal for controlling the second control target device 42 to the second control target device 42 based on the control of the control unit 22. The communication unit 24 receives, for example, a signal indicating a sensing result from the sensor. The communication unit 24 performs wireless communication, for example, but may perform wired communication. The communication standard of the communication performed by the communication unit 24 is not particularly limited.

The control device 30 is, for example, a HEMS (Home Energy Management System) controller, and controls the first control target device 41 based on a control request transmitted by the communication unit 24. The control device 30 is not limited to the HEMS controller having an energy management function, and may be another home controller or a gateway device having no energy management function.

The first controlled device 41 is a device controlled by the control device 30, and is indirectly communicably connected to the display device 20. Specifically, the first control target device 41 operates based on the control signal transmitted from the control device 30. The first controlled device 41 includes devices such as a storage battery system, a fuel cell system, a photovoltaic power generation system, a lighting device, a heat pump type water heater, an electric shutter, or an electric lock. In addition, wireless communication conforming to a communication standard such as Echonet Lite (registered trademark) is performed between the control device 30 and the first control target device 41.

The second controlled device 42 is a device controlled by the display device 20 and is directly and communicably connected to the display device 20. Specifically, the second control target device 42 operates based on the control signal transmitted from the display device 20. The second controlled device 42 includes, for example, an intercom device or a device such as an air conditioner.

The device described as the first control target device 41 may be included in the second control target device 42, and the device described as the second control target device 42 may be included in the first control target device 41. May be good. The equipment to be controlled may include housing equipment or home appliances.

The sensor 43 senses the environment in the building and transmits a signal indicating the sensing result to the display device 20. As a result, the display device 20 can display the environment inside the building. In addition, the display device 20 can also control the device to be controlled based on the environment in the building. The sensor 43 includes a pressure sensor, a temperature sensor, a humidity sensor, an illuminance sensor, and the like.

The server device 50 is a cloud server. Various services are realized by linking the server device 50 and the display device 20.

[motion]
Next, the operation of the display control system 10 (in other words, the display control method executed by a computer such as the display device 20) will be described. FIG. 79 is a flowchart of an operation example 1 of the display control system 10. The operation of FIG. 79 is based on FIG. 50 and corresponds to the case of the normal push notification of FIG. 57, and will be described below with reference to FIGS. 50, 57, and 79.

First, the control unit 22 of the display device 20 displays the first display layer on the touch screen 21 (more specifically, the display unit 21b) (S11). The first display layer corresponds to, for example, the push layer shown in FIG. 50 (b). The first display layer has display objects that belong to the first category. Specifically, the display object belonging to the first category is a rectangular icon displayed on the screen of the push layer in FIG. 50 (b). The first category is, for example, a user interface for notifying the status of each of the controlled devices (in other words, a plurality of devices).

Next, the touch panel 21a acquires information regarding the first contact with the touch screen 21 made while the first display layer is displayed on the touch screen 21 (S12).

Next, the control unit 22 determines whether or not the information regarding the first contact includes the movement of the contact position in the first direction (S13). The movement of the contact position in the first direction is, for example, the movement of the contact position based on the swipe operation in the upward direction.

When the control unit 22 determines that the information regarding the first contact includes the movement of the contact position in the first direction (Yes in S13), the control unit 22 displays the image displayed on the display unit 21b as the first display layer. To the second display layer (S14). The second display layer corresponds to, for example, the control layer shown in FIG. 50 (c). The second display layer has display objects that belong to a second category different from the first category. Specifically, the display object belonging to the second category is a rectangular icon displayed on the screen of the control layer in FIG. 50 (c). The second category is a user interface for controlling the state of each of the controlled devices (plural devices).

After that, the control unit 22 acquires the state of the control target device via the communication unit 24 (S15), and determines whether or not there is a change in the state of the control target device (S16). When the control unit 22 determines that there is a change in the state of the device to be controlled (Yes in S16), the control unit 22 notifies the change in the state of the device (S17). Specifically, the display unit 21b superimposes a display object for notifying a change in the state of the device on a part of the second display layer being displayed, based on the control of the control unit 22. That is, when the state of the controlled device changes while the second display layer is displayed on the touch screen 21, the control unit 22 displays a display object that notifies the change in the second display layer. indicate.

If it is determined in step S13 that the information regarding the first contact does not include the movement of the contact position in the first direction (No in S13), the processing after step S14 is not performed. If it is determined in step S16 that there is no change in the state of the controlled device (No in S16), the process of step S17 is not performed.

The display control method as described above can notify the user of the state of the device.

When the state of the control target device changes while the second display layer is displayed on the touch screen 21, the control unit 22 changes the state from the second display layer. You may move to the device usage screen. FIG. 80 is a flowchart of an operation example 2 of such a display control system 10.

The operation example 2 is an operation corresponding to the case of the forced priority push notification of FIG. 57. When the control unit 22 determines that there is a change in the state of the control target device (Yes in S16), the control unit 22 shifts to the use screen of the control target device in which the state has changed (S18). The control unit 22 shifts to the intercom use screen, for example, when there is a change in the state of the intercom. The screen for using the intercom is displayed on the full screen, for example.

With the display control method as described above, when an immediate response by the user is required such as an incoming call, the usage screen can be displayed to prompt the user to respond immediately. The operation example 1 and the operation example 2 may be switched according to what kind of device (or what kind of state change) the controlled target device that has undergone a state change is.

In the above operation, "while the second display layer is displayed on the touch screen 21" has a broad meaning, and is different after the operation for displaying the second display layer is performed. It means the period before the operation such that the layer of is displayed (that is, the period in which the second display layer should be displayed).

Of course, "while the second display layer is displayed on the touch screen 21" includes while the second display layer is actually displayed on the touch screen 21 in a manner visible to the user. Not only this, "while the second display layer is displayed on the touch screen 21", the sleep state (black image) is set when the second display layer is displayed on the touch screen 21. The case (that is, while the second display layer is displayed on the touch screen 21 in a manner invisible to the user) is also included.

For example, if the user goes out of the building while the second display layer is displayed on the touch screen 21, the touch screen 21 goes to sleep. It can be said that the state of the intercom has changed when the visitor visits the building while the user is out and the image of the visitor is recorded on the intercom. Even in such a case, a display object for notifying the change in the state of the intercom is superimposed on a part of the second display layer. In this case, the display object that notifies the change in the state of the intercom may be superimposed on the screen in the sleep state, or is actually displayed when the user returns home and performs an operation such that the sleep state is released. A display object that notifies a change in the state of the intercom may be superimposed on the second display layer.

(Other embodiments)
Although the embodiments have been described above, the present invention is not limited to the above embodiments.

For example, in the above embodiment, another processing unit may execute the processing executed by the specific processing unit. For example, some or all of the processing performed by the display device may be performed by the control device or the server device.

Further, the communication method between the devices in the above embodiment is not particularly limited. Wireless communication may be performed or wired communication may be performed between the devices. Further, wireless communication and wired communication may be combined between the devices. Further, when two devices communicate with each other in the above embodiment, a relay device (not shown) may be interposed between the two devices.

Further, the order of processing described in the flowchart of the above embodiment is an example. The order of the plurality of processes may be changed, and the plurality of processes may be executed in parallel.

Further, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

In addition, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits from each other. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.

In addition, general or specific embodiments of the present invention may be realized in recording media such as systems, devices, methods, integrated circuits, computer programs or computer-readable CD-ROMs. Further, it may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program and a recording medium.

For example, the present invention may be realized as a display control method executed by a computer such as a display control system, or may be realized as a program for causing a computer to execute such a display control method. Further, the present invention may be realized as a computer-readable non-temporary recording medium in which such a program is recorded.

Further, in the above embodiment, the display control system is realized by a plurality of devices, but may be realized as a single device. The display control system may be realized as, for example, a single device corresponding to a display device, a single device corresponding to a control device, or a single device corresponding to a server device. It may be realized as. When the display control system is realized by a plurality of devices, the components included in the display control system may be distributed to the plurality of devices in any way.

In addition, it is realized by applying various modifications to each embodiment that can be conceived by those skilled in the art, or by arbitrarily combining the components and functions of each embodiment within the range not deviating from the gist of the present invention. Also included in the present invention.

10 Display control system 20 Display device 21 Touch screen 21a Touch panel 21b Display unit 22 Control unit 23 Storage unit 24 Communication unit 30 Control device 41 First control target device 42 Second control target device 43 Sensor 50 Server device

Claims (4)

A display control method performed by a computer
Information about the first contact with the touch screen while the first display layer with the first category display objects, which is the user interface for notifying the device status, is displayed on the touch screen. Steps to get and
When the information regarding the first contact includes the movement of the contact position in the first direction, the second display layer has a display object of a second category different from the first category. Steps to move to the display layer of
The step of acquiring the state of the device and
When there is a change in the state of the device while the second display layer is displayed on the touch screen, a step of displaying a display object notifying the change in the second display layer is performed. include,
Display control method. When the state of the device changes while the second display layer is displayed on the touch screen, the screen shifts from the second display layer to the use screen of the device whose state has changed. Including more steps,
The display control method according to claim 1. A program for causing a computer to execute the display control method according to claim 1 or 2. Information about the first contact with the touch screen while the first display layer with the first category display objects, which is the user interface for notifying the device status, is displayed on the touch screen. The acquisition department to acquire and
When the information regarding the first contact includes the movement of the contact position in the first direction, the second display layer has a display object of a second category different from the first category. Equipped with a control unit that shifts to the display layer of
The control unit acquires the state of the device, and when the state of the device changes while the second display layer is displayed on the touch screen, the control unit obtains the state of the device and causes the second display layer to change the state. Display display objects that notify changes,
Display control system.

Images