WO2022124389A1 - Display control system and program - Google Patents

Display control system and program Download PDF

Info

Publication number
WO2022124389A1
WO2022124389A1 PCT/JP2021/045473 JP2021045473W WO2022124389A1 WO 2022124389 A1 WO2022124389 A1 WO 2022124389A1 JP 2021045473 W JP2021045473 W JP 2021045473W WO 2022124389 A1 WO2022124389 A1 WO 2022124389A1
Authority
WO
WIPO (PCT)
Prior art keywords
setting
unit
information
display
control unit
Prior art date
Application number
PCT/JP2021/045473
Other languages
French (fr)
Japanese (ja)
Inventor
彩衣 吉川
早人 池部
敬一 田中
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2022124389A1 publication Critical patent/WO2022124389A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Definitions

  • This disclosure relates to display technology, and particularly to display control systems and programs that display information.
  • Non-Patent Document 1 When equipment such as lighting equipment and air conditioning equipment installed in facilities such as houses are connected to the control device, these devices can be controlled from the control device. Further, when a smart meter installed in a facility is connected to a control device, information such as power consumption can be managed by the control device, and the information is reflected in the control of the device (see, for example, Non-Patent Document 1). ..
  • the convenience of the user is improved. Further, in order to improve the convenience of the user, it is preferable that the setting in the control device is made by the voice input by the user. However, if the user makes a mistake in voice input, the wrong setting will be made. Therefore, it is required to improve the certainty of operation while improving the convenience of the user.
  • the present disclosure has been made in view of such a situation, and the purpose of the present disclosure is to provide a technique for improving the certainty of operation while improving the convenience of the user.
  • the display control system of one aspect of the present disclosure is a communication unit capable of communicating with one or more devices, a command specified based on voice information, and the communication unit can communicate with each other.
  • the acquisition unit that acquires commands that include settings that indicate settings related to various devices, and the first screen that shows the first setting information before executing the settings specified based on the commands acquired by the acquisition unit. It includes a display control unit for displaying on the display unit and a device control unit for executing settings.
  • the display control unit causes the display unit to display a second screen on which the second setting information after the device control unit has executed the setting is displayed, following the first screen.
  • any combination of the above components and the conversion of the expression of the present disclosure between a method, an apparatus, a system, a computer program, a recording medium on which a computer program is recorded, or the like is also effective as an aspect of the present disclosure. be.
  • the embodiment relates to a control system including a control device capable of controlling a plurality of devices installed in a facility such as a house.
  • the control device is, for example, a controller of a power control system (EMS: Energy Management System).
  • EMS Energy Management System
  • the equipment includes housing equipment, home appliances, building / store equipment, that is, lighting, air conditioning, refrigeration, electric power equipment, general white goods, sensors, actuators, shutters, and the like.
  • the device can execute communication with the control device by ECHONET Lite (registered trademark), which is one of the communication protocols in EMS.
  • the control device is equipped with a microphone in order to improve the convenience when controlling the device via the control device.
  • the user speaks a control instruction of the device to the microphone as a voice.
  • the instruction to control the device also includes the instruction to confirm the state of the device.
  • the control device converts the voice into an electric signal, and transmits the voice converted into the electric signal (hereinafter, referred to as “voice information”) to the voice conversion server device.
  • voice information converts the content of the voice information into text information by performing voice recognition on the voice information received from the control device, and sends the text information to the command generation server device.
  • the command generation server device generates a command corresponding to the content of the text information received from the voice conversion server device. The generated command is sent to the controller.
  • the control device is connected to the device by ECHONET Lite (registered trademark), and controls the device according to the instruction indicated by the command.
  • the instruction to control the device generated by the user is "Turn on the air conditioner”
  • the command for turning on the air conditioner turns on the air conditioner.
  • the electricity usage is acquired from the smart meter by the command for confirming the electricity usage. If the control is such that the operation of the device is directly instructed, the control is automatically performed according to the voice generated by the user, which improves the convenience of the user.
  • the operation on the control device is performed not only when directly instructing the operation of the device but also when setting the device.
  • the device setting is, for example, switching on / off the function provided in the device, setting the name of the device, and the like.
  • the control device first displays a screen (hereinafter referred to as "first screen") showing setting information (hereinafter referred to as "first setting information") before the new setting is executed by the user. do. Following this, the control device first displays a screen (hereinafter referred to as "second screen") showing setting information (hereinafter referred to as "second setting information") after the new setting is executed by the user. Display following the screen. By seeing the change from the first screen to the second screen, the user can confirm that the setting generated by himself / herself is reflected.
  • FIG. 1 is a diagram showing a configuration of a control system.
  • the control system 1000 includes a first device 200a, a second device 200b, a second device 200n, a control device 300, a router 400, a network 420, a voice conversion server device 500, and a command generation server device 550, which are collectively referred to as the device 200.
  • the device 200, the control device 300, and the router 400 are installed in the facility 100.
  • (1) overall configuration, (2) voice setting, (3) first example, (4) second example, (5) third example, and (6) fourth example will be described in this order.
  • the facility 100 is a building to be controlled by the control system 1000, and is, for example, a detached house.
  • the facility 100 is not limited to a detached house, but may be a dwelling unit of an apartment house, an office building, a commercial facility, or the like.
  • Each device 200 is, for example, a lighting device, an air conditioner, an electric shutter, and an electric lock.
  • Each device 200 is connected to the control device 300 by a HAN (Home Area Network), a specific low power radio, or the like.
  • the control device 300 has a function as, for example, a HEMS (Home Energy Management System) controller, and controls the operation of the device 200.
  • the control device 300 may be one device or may be a connection of a plurality of devices.
  • the control device 300 is also called a display control system.
  • the control device 300 includes a first communication unit 310, a second communication unit 312, a microphone 320, an operation unit 322, a speaker 324, a display unit 326, a storage unit 328, and a processing unit 330.
  • the processing unit 330 includes a generation unit 340, an acquisition unit 350, a display control unit 352, an audio output unit 354, and an equipment control unit 356.
  • the first communication unit 310 can communicate with one or more devices 200 by wire communication or wireless communication.
  • the first communication unit 310 has a HAN communication function.
  • the processing unit 330 is composed of, for example, a microcomputer having a processor and a memory. When the processor executes the program recorded in the storage unit 328, various functions of the processing unit 330 are realized by the computer system.
  • One of the various functions is a function of controlling the operation of the device 200, and the control device 300 displays an operation screen for receiving an operation on the device 200 on the display unit 326.
  • the operation unit 322 is a user interface capable of receiving an operation from the user, and is, for example, a button. Further, the operation unit 322 may be a touch panel integrated with the display unit 326. The operation unit 322 receives a user's instruction on the operation screen displayed on the display unit 326. The operation unit 322 outputs the received instruction to the processing unit 330.
  • the processing unit 330 generates control information for instructing the operation of the device 200 based on the instruction received by the operation unit 322.
  • the first communication unit 310 transmits control information to the device 200.
  • the device 200 Upon receiving the control information from the control device 300, the device 200 executes an operation according to the control information. For example, the device 200 is turned on or off according to the control information.
  • the first communication unit 310 may be connected to a smart meter (not shown) and receive power information indicating the power consumed in the facility 100.
  • the processing unit 330 generates control information based on the power information received by the first communication unit 310. For example, when the electric power becomes larger than the threshold value, the processing unit 330 generates control information for increasing the set temperature at the time of cooling in the air conditioner.
  • the first communication unit 310 transmits control information to the device 200.
  • the device 200 Upon receiving the control information from the control device 300, the device 200 executes an operation according to the control information, for example, an operation of raising the set temperature during cooling.
  • the second communication unit 312 executes wireless communication or wired communication separately from the first communication unit 310.
  • a wireless LAN Local Area Network
  • the second communication unit 312 of the control device 300 is connected to the router 400 and is connected to the network 420 via the router 400.
  • the network 420 is, for example, an IP (Internet Protocol) network.
  • a voice conversion server device 500 and a command generation server device 550 are connected to the network 420.
  • the microphone 320 of the control device 300 receives the voice spoken by the user who is the speaker.
  • the voice includes, for example, the name of the device 200 to be set and the content of the setting for the device 200 (hereinafter, referred to as “setting content”).
  • the generation unit 340 generates voice information by converting the voice received by the microphone 320 into an electric signal.
  • the second communication unit 312 transmits voice information to the voice conversion server device 500 via the router 400 and the network 420.
  • the voice conversion server device 500 receives voice information from the control device 300.
  • the voice conversion server device 500 executes voice conversion for voice information. Since a known technique may be used for voice conversion, the description thereof is omitted here.
  • voice conversion the voice conversion server device 500 generates text information corresponding to the content of the voice information.
  • the voice conversion server device 500 transmits text information to the command generation server device 550 via the network 420.
  • the command generation server device 550 receives text information from the voice conversion server device 500.
  • the command generation server device 550 specifies the name and setting contents of the device 200 to be set by executing the recognition process for the text information. Since a known technique may be used for the recognition process, the description thereof is omitted here. Further, the command generation server device 550 stores in advance the correspondence between the setting contents and the command, and by referring to the correspondence, the command corresponding to the control content is obtained from the setting contents included in the text information. Perform the conversion to.
  • the conversion to commands may be done by machine learning.
  • the command is a predetermined command for setting the device 200.
  • the command generation server device 550 transmits a command to the control device 300 via the network 420 and the router 400.
  • the second communication unit 312 of the control device 300 receives a command from the command generation server device 550.
  • the acquisition unit 350 acquires a command.
  • the command includes a content that is specified based on voice information and that the first communication unit 310 instructs a setting regarding a communicable device 200.
  • the acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
  • the display control unit 352 is a screen (as described above, "first screen") showing setting information (referred to as “first setting information” as described above) before executing the setting according to the setting content from the acquisition unit 350. ”) Is displayed on the display unit 326. By looking at the first screen displayed on the display unit 326, the user can confirm the first setting information to which the new setting is not reflected.
  • the display control unit 352 outputs the setting contents to the device control unit 356.
  • the device control unit 356 When the device control unit 356 receives the setting content, it acquires the control information according to the setting content. Since a known technique may be used for conversion from the setting contents to the control information, the description thereof is omitted here.
  • the device control unit 356 transmits control information to the device 200 via the first communication unit 310. This corresponds to performing the settings for the device 200.
  • the device 200 executes the setting according to the control information, the device 200 transmits the state information for notifying that the setting has been executed to the control device 300.
  • the first communication unit 310 of the control device 300 receives the state information from the device 200.
  • the display control unit 352 shows the setting information (hereinafter, referred to as "second setting information” as described above) after the device control unit 356 executes the setting.
  • a screen (hereinafter, referred to as "second screen” as described above) is displayed on the display unit 326 following the first screen. The user can confirm the second setting information reflecting the new setting by seeing that the first screen displayed on the display unit 326 changes to the second screen.
  • the voice output unit 354 may output a confirmation voice from the speaker 324 for notifying the user that the second setting information is to be transferred.
  • the first example is a situation in which the solar power utilization mode setting is turned on.
  • the device 200 connected to the control device 300 is a photovoltaic power generation device and a measurement unit.
  • the device 200 includes at least one of a natural refrigerant heat pump water heater, an electric vehicle charging facility, and a creation and storage cooperation system.
  • the solar utilization mode is a function in which the control device 300 confirms the weather forecast the day before, reduces the boiling amount of the natural refrigerant heat pump water heater at night, and boil that amount with the photovoltaic power generation device the next day. At that time, even if the weather changes suddenly, the electricity stored in the storage battery supports the boiling of the natural refrigerant heat pump water heater.
  • AI solar charge is the name of the device 200 that collectively refers to the above-mentioned device 200, and "on” is the setting content.
  • the generation unit 340 generates voice information including "Turn on AI solar charge”.
  • the second communication unit 312 transmits voice information to the voice conversion server device 500.
  • the voice conversion server device 500 generates text information corresponding to "Turn on AI solar charge" by executing voice conversion on the voice information and sends it to the command generation server device 550.
  • the command generation server device 550 receives text information from the voice conversion server device 500.
  • the command generation server device 550 executes conversion into a command by executing recognition processing for text information.
  • the command generation server device 550 transmits a command to the control device 300.
  • the second communication unit 312 of the control device 300 receives a command from the command generation server device 550.
  • the acquisition unit 350 acquires a command.
  • the command includes a content that is specified based on voice information and that the first communication unit 310 instructs a setting regarding a communicable device 200.
  • the acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
  • the display control unit 352 displays a screen according to the setting contents. 2 (a)-(b) show a screen displayed on the display unit 326.
  • FIG. 2A shows the first screen.
  • the first screen shows the first setting information 600 in which the solar utilization mode is off.
  • the notification information 602 is also shown on the first screen.
  • the notification information 602 is, for example, a precaution for the user accompanying the transition to the second setting information. That is, the display control unit 352 displays the notification information 602 while displaying the first screen on the display unit 326.
  • the voice output unit 354 outputs "Set the AI solar charge function. Do you agree with the precautions?" From the speaker 324 as a confirmation voice for notifying the user that the second setting information is to be transferred.
  • FIG. 2B will be described later and returns to FIG.
  • control device 300 When agreeing to the precautions, the user utters "Yes, I agree.” To the microphone 320 of the control device 300. Subsequent control device 300, voice conversion server device 500, and command generation server device 550 execute the same processing as before, and the second communication unit 312 of the control device 300 receives the command from the command generation server device 550. ..
  • the acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
  • the device control unit 356 sets the sunlight utilization mode setting to on for the device 200 according to the setting content received by the display control unit 352. This corresponds to executing the setting when the consent information for the notification information is acquired.
  • FIG. 2B shows the second screen.
  • the second screen shows the notification information 602 in which the solar utilization mode is on. That is, the display control unit 352 causes the display unit 326 to display the second screen on which the second setting information 604 after the device control unit 356 executes the setting is displayed following the first screen.
  • the audio output unit 354 has set the AI solar charge function to "Yes”. Is output from the speaker 324.
  • the second example is a situation in which the name of the device 200 is set. Communication of voice information, text information, and commands between the control device 300, the voice conversion server device 500, and the command generation server device 550 may be performed in the same manner as in the first embodiment, and thus the description thereof is omitted here. , The processing in the control device 300 will be mainly described.
  • the user When setting the device name of the device 200 in a situation where the device 200 is an air conditioner and the device name has not been set, the user utters "I want to set the name" to the microphone 320 of the control device 300. do.
  • the generation unit 340 generates voice information including "I want to set a name”.
  • the second communication unit 312 transmits voice information to the voice conversion server device 500.
  • the second communication unit 312 of the control device 300 receives a command from the command generation server device 550.
  • the acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
  • the display control unit 352 displays a screen according to the setting content.
  • name setting spoken by the user, there are name settings for a plurality of types of targets. Therefore, there is not enough information in the command corresponding to the voice information that you want to set the name.
  • FIGS. 3 (a)-(c) show another screen displayed on the display unit 326.
  • FIG. 3A shows a screen displayed when the command information is insufficient.
  • the screen shows the first option 610 and the second option 612.
  • the number of choices is not limited to "2". That is, the display control unit 352 causes the display unit 326 to display a plurality of options when there is insufficient information in the command.
  • the voice output unit 354 outputs the voice "There are some name settings. Please select the setting you want to implement. There are device names and circuit names.” From the speaker 324.
  • FIGS. 3 (b)-(c) will be described later, and will return to FIG. 1.
  • the user speaks to the microphone 320 of the control device 300, "I want to set the device name.”
  • the generation unit 340 generates voice information including "I want to set a device name”.
  • the second communication unit 312 transmits voice information to the voice conversion server device 500.
  • the second communication unit 312 of the control device 300 receives a command from the command generation server device 550.
  • the acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
  • the display control unit 352 displays a screen according to the setting content.
  • FIG. 3B shows the first screen. On the first screen, the first setting information 600 whose device name is the initial setting "air conditioner 01" is shown.
  • the voice output unit 354 outputs the voice "The device name is the setting screen. Please select the device you want to set.” From the speaker 324.
  • FIG. 3C will be described later and returns to FIG.
  • the user speaks to the microphone 320 of the control device 300, "Make the air conditioner 01 a living room air conditioner.”
  • the generation unit 340 generates voice information including "turning the air conditioner 01 into a living room air conditioner”.
  • the second communication unit 312 transmits voice information to the voice conversion server device 500.
  • the second communication unit 312 of the control device 300 receives a command from the command generation server device 550.
  • the acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
  • the device control unit 356 changes the device name "air conditioner 01" to the device name "living air conditioner” according to the setting content received by the display control unit 352. This corresponds to executing the setting when the information specifying one of the options is acquired.
  • FIG. 3C shows a second screen. On the second screen, the second setting information 604 whose device name is the initial setting "living room air conditioner" is shown. That is, when the display control unit 352 acquires the information that identifies one of the options, the display control unit 352 causes the display unit 326 to display the second screen.
  • the voice output unit 354 outputs the voice "The air conditioner 01 has been changed to the living room air conditioner" from the speaker 324.
  • the third example is a situation where scene control is set.
  • Scene control is to control one or more devices 200 by a combination of one or more conditions.
  • the user's utterances for setting the scene control are, for example, "take a bath at 8 pm", “turn off the air conditioner when it gets cool”, and “turn on the lights when returning home”. "Turn on the lights when you get home” is equivalent to turning on the lights when the electric lock is opened.
  • 4 (a)-(b) show still another screen displayed on the display unit 326.
  • FIG. 4A shows the first screen.
  • the first setting information 600 before the scene control setting is displayed on the first screen.
  • FIG. 4B shows a second screen.
  • the second setting information 604 after the scene control setting is displayed on the second screen.
  • the fourth example is a situation in which a notification mode is set.
  • the user's utterance for setting the notification mode is, for example, "setting the notification mode".
  • 5 (a)-(b) show still another screen displayed on the display unit 326.
  • FIG. 5A shows the first screen.
  • the first screen shows the first setting information 600 in which the notification mode is off.
  • FIG. 5B shows a second screen.
  • the second screen shows the second setting information 604 in which the notification mode is on.
  • the subject of the device, system, or method in this disclosure is equipped with a computer. By executing the program by this computer, the function of the subject of the device, system, or method in the present disclosure is realized.
  • a computer has a processor that operates according to a program as a main hardware configuration. The type of processor does not matter as long as the function can be realized by executing the program.
  • the processor is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or an LSI (Large Scale Integration).
  • IC semiconductor integrated circuit
  • LSI Large Scale Integration
  • the program is recorded on a non-temporary recording medium such as a computer-readable ROM, optical disc, or hard disk drive.
  • the program may be stored in a recording medium in advance, or may be supplied to the recording medium via a wide area communication network including the Internet or the like.
  • FIG. 6 is a sequence diagram showing a display procedure by the control system 1000.
  • the control device 300 receives the voice input (S10), the control device 300 transmits the voice information to the voice conversion server device 500 (S12).
  • the voice conversion server device 500 generates text information (S14)
  • the voice conversion server device 500 transmits the text information to the command generation server device 550 (S16).
  • the command generation server device 550 generates a command (S18)
  • the command generation server device 550 transmits the command to the control device 300 (S20).
  • the control device 300 displays the first screen on the display unit 326 (S22).
  • control device 300 When the control device 300 receives the voice input (S24), the control device 300 transmits the voice information to the voice conversion server device 500 (S26).
  • the voice conversion server device 500 generates text information (S28) and transmits the text information to the command generation server device 550 (S30).
  • the command generation server device 550 When the command generation server device 550 generates a command (S32), the command generation server device 550 transmits the command to the control device 300 (S34).
  • the control device 300 transmits control information to the device 200 (S36).
  • the device 200 executes the setting according to the control information, the device 200 transmits the state information to the control device 300 (S38).
  • the control device 300 displays the second screen on the display unit 326 (S40).
  • the first screen showing the first setting information before executing the setting specified based on the command is displayed, and then the second setting information after executing the setting is shown. Since the second screen is displayed following the first screen, the setting contents can be confirmed even when the device 200 is set by voice. Further, since the setting contents are confirmed even when the device 200 is set by voice, the reliability of the operation can be improved while improving the convenience of the user. Further, since the confirmation voice for notifying the user of the transition to the second setting information is output, the convenience of the user can be further improved.
  • the notification information to the user accompanying the transition to the second setting information is displayed, and the setting is executed when the consent information for the notification information is obtained. Information can be confirmed by the user. In addition, if there is missing information in the command, multiple options are displayed, and if information that identifies one of the options is acquired, the setting is executed and the second screen is displayed, which is convenient for the user. Can be further improved.
  • the outline of one aspect of this disclosure is as follows.
  • the display control system of one aspect of the present disclosure is a communication unit (310) capable of communicating with one or more devices (200), a command specified based on voice information, and the communication unit (310) communicates with each other.
  • the acquisition unit (350) that acquires a command containing the content instructing the setting related to the possible device (200), and the first before executing the setting specified based on the command acquired by the acquisition unit (350).
  • a display control unit (352) for displaying a first screen on which setting information is displayed on a display unit (326), and a device control unit (356) for executing the setting are provided.
  • the display control unit (352) causes the display unit (326) to display a second screen on which the second setting information after the device control unit (356) has executed the setting is displayed, following the first screen.
  • An audio output unit (354) may be further provided.
  • the voice output unit (354) outputs a confirmation voice for notifying the user that the second setting information is to be transferred.
  • the display control unit (352) While the display control unit (352) is displaying the first screen on the display unit (326), the display control unit (352) displays the notification information to the user accompanying the transition to the second setting information, and the device control unit (356). ) Executes the setting when the consent information for the notification information is acquired.
  • the display control unit (352) causes the display unit (326) to display a plurality of options when there is insufficient information in the command, and the device control unit (356) displays information for specifying one of the options.
  • the display control unit (352) causes the display unit (326) to display the second screen when the information for specifying one of the options is acquired.
  • the voice conversion server device 500 and the command generation server device 550 are separately configured.
  • the present invention is not limited to this, and for example, the voice conversion server device 500 and the command generation server device 550 may be integrally configured. Further, at least one of the voice conversion server device 500 and the command generation server device 550 may be included in the control device 300. According to this modification, the degree of freedom of configuration can be improved.

Abstract

A first communication unit (310) is capable of communicating with one or more pieces of equipment. An acquisition unit (350) acquires a command which is identified on the basis of voice information and which includes content designating a setting related to a piece of equipment. A display control unit (352) displays, on a display unit (326), a first screen indicating first setting information prior to the setting identified from the acquired command being executed. An equipment control unit (356) executes the setting. The display control unit (352) displays, on the display unit (326) following the first screen, a second screen indicating second setting information after the equipment control unit (356) has executed the setting.

Description

表示制御システムおよびプログラムDisplay control system and program
　本開示は、表示技術に関し、特に情報を表示する表示制御システムおよびプログラムに関する。 This disclosure relates to display technology, and particularly to display control systems and programs that display information.
　住宅等の施設に設置された照明機器、空調機器等の機器を制御装置に接続すると、制御装置からこれらの機器が制御可能になる。また、施設に設置されたスマートメータを制御装置に接続すると、制御装置において消費電量等の情報を管理可能になるとともに、その情報が機器の制御に反映される（例えば、非特許文献１参照）。 When equipment such as lighting equipment and air conditioning equipment installed in facilities such as houses are connected to the control device, these devices can be controlled from the control device. Further, when a smart meter installed in a facility is connected to a control device, information such as power consumption can be managed by the control device, and the information is reflected in the control of the device (see, for example, Non-Patent Document 1). ..
　マイクロフォンを備えたスマートスピーカが制御装置に接続され、ユーザによる音声入力によって制御装置に接続された機器が制御されると、ユーザの利便性が向上する。また、ユーザの利便性を向上させるために、ユーザによる音声入力によって制御装置における設定がなされる方が好ましい。しかしながら、ユーザによる音声入力においてユーザの言い間違いが生じると、誤った設定がなされてしまう。そのため、ユーザの利便性を向上しながら、操作の確実性を向上することが求められる。 When a smart speaker equipped with a microphone is connected to the control device and the device connected to the control device is controlled by voice input by the user, the convenience of the user is improved. Further, in order to improve the convenience of the user, it is preferable that the setting in the control device is made by the voice input by the user. However, if the user makes a mistake in voice input, the wrong setting will be made. Therefore, it is required to improve the certainty of operation while improving the convenience of the user.
　本開示はこうした状況に鑑みなされたものであり、その目的は、ユーザの利便性を向上しながら、操作の確実性を向上する技術を提供することにある。 The present disclosure has been made in view of such a situation, and the purpose of the present disclosure is to provide a technique for improving the certainty of operation while improving the convenience of the user.
　上記課題を解決するために、本開示のある態様の表示制御システムは、１以上の機器と通信可能な通信部と、音声情報に基づいて特定されたコマンドであって、かつ通信部が通信可能な機器に関する設定を指示する内容が含まれたコマンドを取得する取得部と、取得部において取得したコマンドをもとに特定された設定を実行する前の第１設定情報が示される第１画面を表示部に表示させる表示制御部と、設定を実行する機器制御部とを備える。表示制御部は、機器制御部が設定を実行した後の第２設定情報が示される第２画面を第１画面に続いて表示部に表示させる。 In order to solve the above problems, the display control system of one aspect of the present disclosure is a communication unit capable of communicating with one or more devices, a command specified based on voice information, and the communication unit can communicate with each other. The acquisition unit that acquires commands that include settings that indicate settings related to various devices, and the first screen that shows the first setting information before executing the settings specified based on the commands acquired by the acquisition unit. It includes a display control unit for displaying on the display unit and a device control unit for executing settings. The display control unit causes the display unit to display a second screen on which the second setting information after the device control unit has executed the setting is displayed, following the first screen.
　なお、以上の構成要素の任意の組合せ、本開示の表現を方法、装置、システム、コンピュータプログラム、またはコンピュータプログラムを記録した記録媒体などの間で変換したものもまた、本開示の態様として有効である。 It should be noted that any combination of the above components and the conversion of the expression of the present disclosure between a method, an apparatus, a system, a computer program, a recording medium on which a computer program is recorded, or the like is also effective as an aspect of the present disclosure. be.
　本開示によれば、ユーザの利便性を向上しながら、操作の確実性を向上できる。 According to the present disclosure, it is possible to improve the certainty of operation while improving the convenience of the user.
本実施例に係る制御システムの構成を示す図である。It is a figure which shows the structure of the control system which concerns on this Example. 図２（ａ）－（ｂ）は、図１の表示部に表示される画面を示す図である。2 (a)-(b) are views showing a screen displayed on the display unit of FIG. 1. 図３（ａ）－（ｃ）は、図１の表示部に表示される別の画面を示す図である。3 (a)-(c) are views showing another screen displayed on the display unit of FIG. 1. 図４（ａ）－（ｂ）は、図１の表示部に表示されるさらに別の画面を示す図である。4 (a)-(b) are views showing still another screen displayed on the display unit of FIG. 1. 図５（ａ）－（ｂ）は、図１の表示部に表示されるさらに別の画面を示す図である。5 (a)-(b) are views showing still another screen displayed on the display unit of FIG. 1. 図１の制御システムによる表示手順を示すシーケンス図である。It is a sequence diagram which shows the display procedure by the control system of FIG.
　本開示の実施例を具体的に説明する前に、本実施例の概要を説明する。実施例は、住宅等の施設に設置された複数の機器を制御可能な制御装置を含む制御システムに関する。制御装置は、例えば、電力制御システム（ＥＭＳ：Ｅｎｅｒｇｙ　Ｍａｎａｇｅｍｅｎｔ　Ｓｙｓｔｅｍ）のコントローラである。また、機器は、住宅設備機器、家電製品、ビル・店舗設備機器、すなわち照明、空調、冷蔵、電力設備、一般白物家電製品、センサ、アクチュエータ、シャッターなどを含む。機器は、ＥＭＳにおける通信プロトコルの１つであるＥＣＨＯＮＥＴ　Ｌｉｔｅ（登録商標）により、制御装置との通信を実行可能である。 Before concretely explaining the embodiment of the present disclosure, the outline of the present embodiment will be described. The embodiment relates to a control system including a control device capable of controlling a plurality of devices installed in a facility such as a house. The control device is, for example, a controller of a power control system (EMS: Energy Management System). In addition, the equipment includes housing equipment, home appliances, building / store equipment, that is, lighting, air conditioning, refrigeration, electric power equipment, general white goods, sensors, actuators, shutters, and the like. The device can execute communication with the control device by ECHONET Lite (registered trademark), which is one of the communication protocols in EMS.
　制御装置を介して機器を制御する際の利便性を向上するために、制御装置には、マイクロフォンが備えられる。ユーザは、機器の制御の指示を音声としてマイクロフォンに発話する。機器の制御の指示には、機器の状態の確認の指示も含まれる。制御装置は、音声を電気信号に変換して、電気信号に変換された音声（以下、「音声情報」という）を音声変換サーバ装置に送信する。音声変換サーバ装置は、制御装置から受信した音声情報に対して音声認識を実行することによって音声情報の内容をテキスト情報に変換し、テキスト情報をコマンド生成サーバ装置に送信する。コマンド生成サーバ装置は、音声変換サーバ装置から受信したテキスト情報の内容に対応したコマンドを生成する。生成されたコマンドは、制御装置に送信される。制御装置は、ＥＣＨＯＮＥＴ　Ｌｉｔｅ（登録商標）によって機器を接続しており、コマンドにおいて示された指示に応じて機器を制御する。 The control device is equipped with a microphone in order to improve the convenience when controlling the device via the control device. The user speaks a control instruction of the device to the microphone as a voice. The instruction to control the device also includes the instruction to confirm the state of the device. The control device converts the voice into an electric signal, and transmits the voice converted into the electric signal (hereinafter, referred to as “voice information”) to the voice conversion server device. The voice conversion server device converts the content of the voice information into text information by performing voice recognition on the voice information received from the control device, and sends the text information to the command generation server device. The command generation server device generates a command corresponding to the content of the text information received from the voice conversion server device. The generated command is sent to the controller. The control device is connected to the device by ECHONET Lite (registered trademark), and controls the device according to the instruction indicated by the command.
　例えば、ユーザが発生した機器の制御の指示が「エアーコンディショナをオンにして」であれば、エアーコンディショナをオンにするためのコマンドによって、エアコンディショナがオンにされる。例えば、ユーザが発生した機器の制御の指示が「今日の電気代を教えて」であれば、電気の使用量を確認するためのコマンドによって、スマートメータから電気の使用量が取得される。このような機器の動作を直接指示するような制御であれば、ユーザが発生した音声に応じて制御が自動的になされることによって、ユーザの利便性が向上する。 For example, if the instruction to control the device generated by the user is "Turn on the air conditioner", the command for turning on the air conditioner turns on the air conditioner. For example, if the user's instruction to control the device is "Tell me about today's electricity bill", the electricity usage is acquired from the smart meter by the command for confirming the electricity usage. If the control is such that the operation of the device is directly instructed, the control is automatically performed according to the voice generated by the user, which improves the convenience of the user.
　一方、制御装置に対する操作は、機器の動作を直接指示する場合だけではなく、機器を設定する場合にもなされる。機器の設定とは、例えば、機器に備えられた機能のオン／オフを切りかえること、機器の名称を設定すること等である。このような設定を音声により実行する場合、ユーザの言い間違いが生じると、誤った設定がなされてしまう。そのため、前述のごとく、ユーザの利便性を向上しながら、操作の確実性を向上することが求められる。 On the other hand, the operation on the control device is performed not only when directly instructing the operation of the device but also when setting the device. The device setting is, for example, switching on / off the function provided in the device, setting the name of the device, and the like. When such a setting is executed by voice, if the user makes a mistake, the wrong setting will be made. Therefore, as described above, it is required to improve the certainty of operation while improving the convenience of the user.
　本実施例に係る制御装置は、ユーザによる新たな設定が実行される前の設定情報（以下、「第１設定情報」という）が示される画面（以下、「第１画面」という）をまず表示する。これに続いて、制御装置は、ユーザによる新たな設定が実行された後の設定情報（以下、「第２設定情報」という）が示される画面（以下、「第２画面」という）を第１画面に続いて表示する。ユーザは、第１画面から第２画面への変化を見ることによって、自らが発生した設定が反映されていることを確認可能である。 The control device according to the present embodiment first displays a screen (hereinafter referred to as "first screen") showing setting information (hereinafter referred to as "first setting information") before the new setting is executed by the user. do. Following this, the control device first displays a screen (hereinafter referred to as "second screen") showing setting information (hereinafter referred to as "second setting information") after the new setting is executed by the user. Display following the screen. By seeing the change from the first screen to the second screen, the user can confirm that the setting generated by himself / herself is reflected.
　図１は、制御システムの構成を示す図である。制御システム１０００は、機器２００と総称される第１機器２００ａ、第２機器２００ｂ、第Ｎ機器２００ｎ、制御装置３００、ルータ４００、ネットワーク４２０、音声変換サーバ装置５００、コマンド生成サーバ装置５５０を含む。機器２００、制御装置３００、ルータ４００は施設１００内に設置される。以下では、（１）全体構成、（２）音声による設定、（３）第１例、（４）第２例、（５）第３例、（６）第４例の順に説明する。 FIG. 1 is a diagram showing a configuration of a control system. The control system 1000 includes a first device 200a, a second device 200b, a second device 200n, a control device 300, a router 400, a network 420, a voice conversion server device 500, and a command generation server device 550, which are collectively referred to as the device 200. The device 200, the control device 300, and the router 400 are installed in the facility 100. Hereinafter, (1) overall configuration, (2) voice setting, (3) first example, (4) second example, (5) third example, and (6) fourth example will be described in this order.
（１）全体構成
　施設１００は、制御システム１０００による制御の対象となる建物であり、例えば戸建て住宅である。施設１００は戸建て住宅に限定されず、集合住宅の住戸でもよいし、オフィスビル、商業施設などでもよい。各機器２００は、例えば、照明装置、エアーコンディショナ、電動シャッター、電気錠である。各機器２００は、ＨＡＮ（Ｈｏｍｅ　Ａｒｅａ　Ｎｅｔｗｏｒｋ）、特定小電力無線等により制御装置３００に接続される。 (1) Overall configuration The facility 100 is a building to be controlled by the control system 1000, and is, for example, a detached house. The facility 100 is not limited to a detached house, but may be a dwelling unit of an apartment house, an office building, a commercial facility, or the like. Each device 200 is, for example, a lighting device, an air conditioner, an electric shutter, and an electric lock. Each device 200 is connected to the control device 300 by a HAN (Home Area Network), a specific low power radio, or the like.
　制御装置３００は、例えば、ＨＥＭＳ（Ｈｏｍｅ　Ｅｎｅｒｇｙ　Ｍａｎａｇｅｍｅｎｔ　Ｓｙｓｔｅｍ）コントローラとしての機能を有し、機器２００の動作を制御する。制御装置３００は、１つの装置であってもよいし、複数の装置の接続であってもよい。制御装置３００は表示制御システムとも呼ばれる。制御装置３００は、第１通信部３１０、第２通信部３１２、マイクロフォン３２０、操作部３２２、スピーカ３２４、表示部３２６、記憶部３２８、処理部３３０を含む。処理部３３０は、生成部３４０、取得部３５０、表示制御部３５２、音声出力部３５４、機器制御部３５６を含む。 The control device 300 has a function as, for example, a HEMS (Home Energy Management System) controller, and controls the operation of the device 200. The control device 300 may be one device or may be a connection of a plurality of devices. The control device 300 is also called a display control system. The control device 300 includes a first communication unit 310, a second communication unit 312, a microphone 320, an operation unit 322, a speaker 324, a display unit 326, a storage unit 328, and a processing unit 330. The processing unit 330 includes a generation unit 340, an acquisition unit 350, a display control unit 352, an audio output unit 354, and an equipment control unit 356.
　第１通信部３１０は、有線通信あるいは無線通信により１以上の機器２００と通信可能である。例えば、第１通信部３１０は、ＨＡＮの通信機能を有する。処理部３３０は、例えば、プロセッサおよびメモリを有するマイクロコンピュータで構成される。プロセッサが、記憶部３２８に記録されたプログラムを実行することにより、コンピュータシステムによって処理部３３０の各種の機能が実現される。 The first communication unit 310 can communicate with one or more devices 200 by wire communication or wireless communication. For example, the first communication unit 310 has a HAN communication function. The processing unit 330 is composed of, for example, a microcomputer having a processor and a memory. When the processor executes the program recorded in the storage unit 328, various functions of the processing unit 330 are realized by the computer system.
　各種の機能のうちの１つが機器２００の動作を制御する機能であり、制御装置３００は、機器２００に対する操作を受けつけるための操作画面を表示部３２６に表示する。操作部３２２は、ユーザからの操作を受付可能なユーザインターフェースであり、例えば、ボタンである。また、操作部３２２は、表示部３２６と一体化されたタッチパネルであってもよい。操作部３２２は、表示部３２６に表示した操作画面に対するユーザの指示を受けつける。操作部３２２は、受けつけた指示を処理部３３０に出力する。 One of the various functions is a function of controlling the operation of the device 200, and the control device 300 displays an operation screen for receiving an operation on the device 200 on the display unit 326. The operation unit 322 is a user interface capable of receiving an operation from the user, and is, for example, a button. Further, the operation unit 322 may be a touch panel integrated with the display unit 326. The operation unit 322 receives a user's instruction on the operation screen displayed on the display unit 326. The operation unit 322 outputs the received instruction to the processing unit 330.
　処理部３３０は、操作部３２２において受けつけた指示をもとに、機器２００の動作を指示するための制御情報を生成する。第１通信部３１０は、機器２００に対して制御情報を送信する。機器２００は、制御装置３００からの制御情報を受信すると、制御情報に応じた動作を実行する。例えば、制御情報に応じて機器２００は電源オンされたり、電源オフされたりする。 The processing unit 330 generates control information for instructing the operation of the device 200 based on the instruction received by the operation unit 322. The first communication unit 310 transmits control information to the device 200. Upon receiving the control information from the control device 300, the device 200 executes an operation according to the control information. For example, the device 200 is turned on or off according to the control information.
　第１通信部３１０は、スマートメータ（図示せず）に接続され、施設１００において消費された電力を示す電力情報を受信してもよい。処理部３３０は、第１通信部３１０において受信した電力情報をもとに制御情報を生成する。例えば、電力がしきい値よりも大きくなった場合に、処理部３３０は、エアーコンディショナにおける冷房時の設定温度を高くするような制御情報を生成する。第１通信部３１０は、機器２００に対して制御情報を送信する。機器２００は、制御装置３００からの制御情報を受信すると、制御情報に応じた動作、例えば、冷房時の設定温度を高くする動作を実行する。 The first communication unit 310 may be connected to a smart meter (not shown) and receive power information indicating the power consumed in the facility 100. The processing unit 330 generates control information based on the power information received by the first communication unit 310. For example, when the electric power becomes larger than the threshold value, the processing unit 330 generates control information for increasing the set temperature at the time of cooling in the air conditioner. The first communication unit 310 transmits control information to the device 200. Upon receiving the control information from the control device 300, the device 200 executes an operation according to the control information, for example, an operation of raising the set temperature during cooling.
　第２通信部３１２は、第１通信部３１０とは別に無線通信あるいは有線通信を実行する。無線通信として、例えば、無線ＬＡＮ（Ｌｏｃａｌ　Ａｒｅａ　Ｎｅｔｗｏｒｋ）が使用されるが、これに限定されない。制御装置３００の第２通信部３１２は、ルータ４００に接続されるとともに、ルータ４００を介してネットワーク４２０に接続される。ネットワーク４２０は、例えば、ＩＰ（Ｉｎｔｅｒｎｅｔ　Ｐｒｏｔｏｃｏｌ）ネットワークである。ネットワーク４２０には、音声変換サーバ装置５００とコマンド生成サーバ装置５５０が接続される。 The second communication unit 312 executes wireless communication or wired communication separately from the first communication unit 310. As the wireless communication, for example, a wireless LAN (Local Area Network) is used, but the wireless communication is not limited to this. The second communication unit 312 of the control device 300 is connected to the router 400 and is connected to the network 420 via the router 400. The network 420 is, for example, an IP (Internet Protocol) network. A voice conversion server device 500 and a command generation server device 550 are connected to the network 420.
（２）音声による設定
　ここでは、ユーザが制御装置３００を介して機器２００を設定する場合を想定する。制御装置３００のマイクロフォン３２０は、発話者であるユーザが発話した音声を受けつける。音声には、例えば、設定対象となる機器２００の名称、機器２００に対する設定の内容（以下、「設定内容」という）が含まれる。生成部３４０は、マイクロフォン３２０で受けつけた音声を電気信号に変換することによって音声情報を生成する。第２通信部３１２は、ルータ４００、ネットワーク４２０を介して音声変換サーバ装置５００に音声情報を送信する。 (2) Voice setting Here, it is assumed that the user sets the device 200 via the control device 300. The microphone 320 of the control device 300 receives the voice spoken by the user who is the speaker. The voice includes, for example, the name of the device 200 to be set and the content of the setting for the device 200 (hereinafter, referred to as “setting content”). The generation unit 340 generates voice information by converting the voice received by the microphone 320 into an electric signal. The second communication unit 312 transmits voice information to the voice conversion server device 500 via the router 400 and the network 420.
　音声変換サーバ装置５００は、制御装置３００からの音声情報を受信する。音声変換サーバ装置５００は、音声情報に対して音声変換を実行する。音声変換には公知の技術が使用されればよいので、ここでは説明を省略する。音声変換によって、音声変換サーバ装置５００は、音声情報の内容に対応したテキスト情報を生成する。音声変換サーバ装置５００は、テキスト情報をネットワーク４２０経由でコマンド生成サーバ装置５５０に送信する。 The voice conversion server device 500 receives voice information from the control device 300. The voice conversion server device 500 executes voice conversion for voice information. Since a known technique may be used for voice conversion, the description thereof is omitted here. By voice conversion, the voice conversion server device 500 generates text information corresponding to the content of the voice information. The voice conversion server device 500 transmits text information to the command generation server device 550 via the network 420.
　コマンド生成サーバ装置５５０は、テキスト情報を音声変換サーバ装置５００から受信する。コマンド生成サーバ装置５５０は、テキスト情報に対する認識処理を実行することによって、設定対象となる機器２００の名称、設定内容を特定する。認識処理には公知の技術が使用されればよいので、ここでは説明を省略する。また、コマンド生成サーバ装置５５０は、設定内容とコマンドとの対応関係を予め記憶しており、当該対応関係を参照することによって、テキスト情報に含まれた設定内容から、当該制御内容に対応したコマンドへの変換を実行する。コマンドへの変換は機械学習によりなされてもよい。コマンドは、機器２００を設定するために予め定められた命令である。コマンド生成サーバ装置５５０は、コマンドをネットワーク４２０、ルータ４００を介して制御装置３００に送信する。 The command generation server device 550 receives text information from the voice conversion server device 500. The command generation server device 550 specifies the name and setting contents of the device 200 to be set by executing the recognition process for the text information. Since a known technique may be used for the recognition process, the description thereof is omitted here. Further, the command generation server device 550 stores in advance the correspondence between the setting contents and the command, and by referring to the correspondence, the command corresponding to the control content is obtained from the setting contents included in the text information. Perform the conversion to. The conversion to commands may be done by machine learning. The command is a predetermined command for setting the device 200. The command generation server device 550 transmits a command to the control device 300 via the network 420 and the router 400.
　制御装置３００の第２通信部３１２は、コマンドをコマンド生成サーバ装置５５０から受信する。取得部３５０はコマンドを取得する。コマンドは、前述のごとく、音声情報に基づいて特定されており、かつ第１通信部３１０が通信可能な機器２００に関する設定を指示する内容を含む。取得部３５０は、コマンドをもとに特定された設定内容を表示制御部３５２に出力する。 The second communication unit 312 of the control device 300 receives a command from the command generation server device 550. The acquisition unit 350 acquires a command. As described above, the command includes a content that is specified based on voice information and that the first communication unit 310 instructs a setting regarding a communicable device 200. The acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
　表示制御部３５２は、取得部３５０からの設定内容に応じた設定を実行する前の設定情報（前述のとおり、「第１設定情報」という）が示される画面（前述の通り、「第１画面」という）を表示部３２６に表示させる。ユーザは、表示部３２６に表示された第１画面を見ることによって、新たな設定が反映されていない第１設定情報を確認可能である。表示制御部３５２は、設定内容を機器制御部３５６に出力する。 The display control unit 352 is a screen (as described above, "first screen") showing setting information (referred to as "first setting information" as described above) before executing the setting according to the setting content from the acquisition unit 350. ”) Is displayed on the display unit 326. By looking at the first screen displayed on the display unit 326, the user can confirm the first setting information to which the new setting is not reflected. The display control unit 352 outputs the setting contents to the device control unit 356.
　機器制御部３５６は、設定内容を受けつけると、設定内容に応じた制御情報を取得する。設定内容から制御情報への変換には公知の技術が使用されればよいので、ここでは説明を省略する。機器制御部３５６は、第１通信部３１０を介して機器２００に制御情報を送信する。これは、機器２００に対する設定を実行することに相当する。機器２００が制御情報に応じて設定を実行した場合、機器２００は、設定を実行したことを通知するための状態情報を制御装置３００に送信する。制御装置３００の第１通信部３１０は、状態情報を機器２００から受信する。 When the device control unit 356 receives the setting content, it acquires the control information according to the setting content. Since a known technique may be used for conversion from the setting contents to the control information, the description thereof is omitted here. The device control unit 356 transmits control information to the device 200 via the first communication unit 310. This corresponds to performing the settings for the device 200. When the device 200 executes the setting according to the control information, the device 200 transmits the state information for notifying that the setting has been executed to the control device 300. The first communication unit 310 of the control device 300 receives the state information from the device 200.
　表示制御部３５２は、第１通信部３１０が状態情報を受信した場合、機器制御部３５６が設定を実行した後の設定情報（以下、前述の通り、「第２設定情報」という）が示される画面（以下、前述の通り、「第２画面」という）を第１画面に続いて表示部３２６に表示させる。ユーザは、表示部３２６に表示された第１画面が第２画面に変化することを見ることによって、新たな設定が反映された第２設定情報を確認可能である。音声出力部３５４は、表示制御部３５２が設定内容を取得部３５０から受けつけた場合、第２設定情報に移行することをユーザに通知するための確認音声をスピーカ３２４から出力してもよい。 When the first communication unit 310 receives the status information, the display control unit 352 shows the setting information (hereinafter, referred to as "second setting information" as described above) after the device control unit 356 executes the setting. A screen (hereinafter, referred to as "second screen" as described above) is displayed on the display unit 326 following the first screen. The user can confirm the second setting information reflecting the new setting by seeing that the first screen displayed on the display unit 326 changes to the second screen. When the display control unit 352 receives the setting content from the acquisition unit 350, the voice output unit 354 may output a confirmation voice from the speaker 324 for notifying the user that the second setting information is to be transferred.
（３）第１例
　第１例は、太陽光活用モード設定をオンにする状況である。その際、制御装置３００に接続される機器２００は、太陽光発電装置、計測ユニットである。また、機器２００には、自然冷媒ヒートポンプ給湯機、電気自動車充電設備、創蓄連携システムのいずれか１つが少なくとも含まれる。太陽光活用モードとは、前日に制御装置３００が天気予報を確認し、夜間の自然冷媒ヒートポンプ給湯機の沸き上げ量を減らして、その分を翌日の太陽光発電装置で沸き上げる機能である。その際、急に天気が変わっても、蓄電池に貯えられた電気によって、自然冷媒ヒートポンプ給湯機の沸き上げがサポートされる。 (3) First example The first example is a situation in which the solar power utilization mode setting is turned on. At that time, the device 200 connected to the control device 300 is a photovoltaic power generation device and a measurement unit. Further, the device 200 includes at least one of a natural refrigerant heat pump water heater, an electric vehicle charging facility, and a creation and storage cooperation system. The solar utilization mode is a function in which the control device 300 confirms the weather forecast the day before, reduces the boiling amount of the natural refrigerant heat pump water heater at night, and boil that amount with the photovoltaic power generation device the next day. At that time, even if the weather changes suddenly, the electricity stored in the storage battery supports the boiling of the natural refrigerant heat pump water heater.
　太陽光活用モード設定がオフにされている状況下においてオンにする場合、ユーザは、制御装置３００のマイクロフォン３２０に対して、「ＡＩ（Ａｒｔｉｆｉｃｉａｌ　Ｉｎｔｅｌｌｉｇｅｎｃｅ）ソーラーチャージ（登録商標）をオンにして」と発話する。「ＡＩソーラーチャージ」は、前述の機器２００を総称する機器２００の名称であり、「オン」が設定内容である。生成部３４０は、「ＡＩソーラーチャージをオンにして」を含む音声情報を生成する。第２通信部３１２は、音声変換サーバ装置５００に音声情報を送信する。 When the solar utilization mode setting is turned off and turned on, the user tells the microphone 320 of the control device 300 to "turn on the AI (Artificial Integrity) solar charge (registered trademark)". Speak. "AI solar charge" is the name of the device 200 that collectively refers to the above-mentioned device 200, and "on" is the setting content. The generation unit 340 generates voice information including "Turn on AI solar charge". The second communication unit 312 transmits voice information to the voice conversion server device 500.
　音声変換サーバ装置５００は、音声情報に対して音声変換を実行することによって、「ＡＩソーラーチャージをオンにして」に対応したテキスト情報を生成してコマンド生成サーバ装置５５０に送信する。コマンド生成サーバ装置５５０は、テキスト情報を音声変換サーバ装置５００から受信する。コマンド生成サーバ装置５５０は、テキスト情報に対する認識処理を実行することによって、コマンドへの変換を実行する。コマンド生成サーバ装置５５０は、コマンドを制御装置３００に送信する。 The voice conversion server device 500 generates text information corresponding to "Turn on AI solar charge" by executing voice conversion on the voice information and sends it to the command generation server device 550. The command generation server device 550 receives text information from the voice conversion server device 500. The command generation server device 550 executes conversion into a command by executing recognition processing for text information. The command generation server device 550 transmits a command to the control device 300.
　制御装置３００の第２通信部３１２は、コマンドをコマンド生成サーバ装置５５０から受信する。取得部３５０はコマンドを取得する。コマンドは、前述のごとく、音声情報に基づいて特定されており、かつ第１通信部３１０が通信可能な機器２００に関する設定を指示する内容を含む。取得部３５０は、コマンドをもとに特定された設定内容を表示制御部３５２に出力する。 The second communication unit 312 of the control device 300 receives a command from the command generation server device 550. The acquisition unit 350 acquires a command. As described above, the command includes a content that is specified based on voice information and that the first communication unit 310 instructs a setting regarding a communicable device 200. The acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352.
　表示制御部３５２は、設定内容に応じた画面を表示する。図２（ａ）－（ｂ）は、表示部３２６に表示される画面を示す。図２（ａ）は、第１画面を示す。第１画面には、太陽光活用モードがオフである第１設定情報６００が示される。また、第１画面には、通知情報６０２も示される。通知情報６０２は、例えば、第２設定情報に移行することに付随するユーザへの注意事項である。つまり、表示制御部３５２は、第１画面を表示部３２６に表示させている間に通知情報６０２を表示させる。音声出力部３５４は、第２設定情報に移行することをユーザに通知するための確認音声として「ＡＩソーラーチャージ機能を設定します。注意事項に同意しますか。」をスピーカ３２４から出力する。図２（ｂ）は後述して、図１に戻る。 The display control unit 352 displays a screen according to the setting contents. 2 (a)-(b) show a screen displayed on the display unit 326. FIG. 2A shows the first screen. The first screen shows the first setting information 600 in which the solar utilization mode is off. The notification information 602 is also shown on the first screen. The notification information 602 is, for example, a precaution for the user accompanying the transition to the second setting information. That is, the display control unit 352 displays the notification information 602 while displaying the first screen on the display unit 326. The voice output unit 354 outputs "Set the AI solar charge function. Do you agree with the precautions?" From the speaker 324 as a confirmation voice for notifying the user that the second setting information is to be transferred. FIG. 2B will be described later and returns to FIG.
　注意事項に同意する場合、ユーザは、制御装置３００のマイクロフォン３２０に対して、「はい。同意します。」と発話する。これに続く制御装置３００、音声変換サーバ装置５００、コマンド生成サーバ装置５５０はこれまでと同様の処理を実行し、制御装置３００の第２通信部３１２は、コマンドをコマンド生成サーバ装置５５０から受信する。取得部３５０は、コマンドをもとに特定された設定内容を表示制御部３５２に出力する。機器制御部３５６は、表示制御部３５２が受けつけた設定内容に応じて、機器２００に対して太陽光活用モード設定をオンに設定する。これは、通知情報に対する同意情報を取得した場合に、設定を実行することに相当する。 When agreeing to the precautions, the user utters "Yes, I agree." To the microphone 320 of the control device 300. Subsequent control device 300, voice conversion server device 500, and command generation server device 550 execute the same processing as before, and the second communication unit 312 of the control device 300 receives the command from the command generation server device 550. .. The acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352. The device control unit 356 sets the sunlight utilization mode setting to on for the device 200 according to the setting content received by the display control unit 352. This corresponds to executing the setting when the consent information for the notification information is acquired.
　図２（ｂ）は、第２画面を示す。第２画面には、太陽光活用モードがオンである通知情報６０２が示される。つまり、表示制御部３５２は、機器制御部３５６が設定を実行した後の第２設定情報６０４が示される第２画面を第１画面に続いて表示部３２６に表示させる。また、音声出力部３５４は、「ＡＩソーラーチャージ機能を「する」に設定しました。」との音声をスピーカ３２４から出力する。 FIG. 2B shows the second screen. The second screen shows the notification information 602 in which the solar utilization mode is on. That is, the display control unit 352 causes the display unit 326 to display the second screen on which the second setting information 604 after the device control unit 356 executes the setting is displayed following the first screen. In addition, the audio output unit 354 has set the AI solar charge function to "Yes". Is output from the speaker 324.
（４）第２例
　第２例は、機器２００の名称を設定する状況である。制御装置３００と音声変換サーバ装置５００とコマンド生成サーバ装置５５０との間における音声情報、テキスト情報、コマンドの通信は実施例１と同様になされればよいので、ここでは、その説明を省略して、制御装置３００における処理を中心に説明する。 (4) Second example The second example is a situation in which the name of the device 200 is set. Communication of voice information, text information, and commands between the control device 300, the voice conversion server device 500, and the command generation server device 550 may be performed in the same manner as in the first embodiment, and thus the description thereof is omitted here. , The processing in the control device 300 will be mainly described.
　機器２００がエアコンディショナであり、かつ機器名称が未設定である状況下において機器２００の機器名称を設定する場合、ユーザは、制御装置３００のマイクロフォン３２０に対して、「名称設定したい」と発話する。生成部３４０は、「名称設定したい」を含む音声情報を生成する。第２通信部３１２は、音声変換サーバ装置５００に音声情報を送信する。 When setting the device name of the device 200 in a situation where the device 200 is an air conditioner and the device name has not been set, the user utters "I want to set the name" to the microphone 320 of the control device 300. do. The generation unit 340 generates voice information including "I want to set a name". The second communication unit 312 transmits voice information to the voice conversion server device 500.
　制御装置３００の第２通信部３１２は、コマンドをコマンド生成サーバ装置５５０から受信する。取得部３５０は、コマンドをもとに特定された設定内容を表示制御部３５２に出力する。表示制御部３５２は、設定内容に応じた画面を表示する。ユーザが発話した「名称設定」には、複数種類の対象に対する名称設定が存在する。そのため、名称設定したいという音声情報に対応したコマンドでは、情報が不足している。 The second communication unit 312 of the control device 300 receives a command from the command generation server device 550. The acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352. The display control unit 352 displays a screen according to the setting content. In the "name setting" spoken by the user, there are name settings for a plurality of types of targets. Therefore, there is not enough information in the command corresponding to the voice information that you want to set the name.
　図３（ａ）－（ｃ）は、表示部３２６に表示される別の画面を示す。図３（ａ）は、コマンドの情報が不足している場合に表示される画面を示す。画面には、第１選択肢６１０、第２選択肢６１２が示される。選択肢の数は「２」に限定されない。つまり、表示制御部３５２は、コマンドに不足している情報がある場合に、複数の選択肢を表示部３２６に表示させる。また、音声出力部３５４は、「名称設定がいくつかあります。実施したい設定を選択してください。機器名称、回路名称があります。」との音声をスピーカ３２４から出力する。図３（ｂ）－（ｃ）は後述して、図１に戻る。ユーザは、制御装置３００のマイクロフォン３２０に対して、「機器名称を設定したい」と発話する。生成部３４０は、「機器名称を設定したい」を含む音声情報を生成する。第２通信部３１２は、音声変換サーバ装置５００に音声情報を送信する。 FIGS. 3 (a)-(c) show another screen displayed on the display unit 326. FIG. 3A shows a screen displayed when the command information is insufficient. The screen shows the first option 610 and the second option 612. The number of choices is not limited to "2". That is, the display control unit 352 causes the display unit 326 to display a plurality of options when there is insufficient information in the command. In addition, the voice output unit 354 outputs the voice "There are some name settings. Please select the setting you want to implement. There are device names and circuit names." From the speaker 324. FIGS. 3 (b)-(c) will be described later, and will return to FIG. 1. The user speaks to the microphone 320 of the control device 300, "I want to set the device name." The generation unit 340 generates voice information including "I want to set a device name". The second communication unit 312 transmits voice information to the voice conversion server device 500.
　制御装置３００の第２通信部３１２は、コマンドをコマンド生成サーバ装置５５０から受信する。取得部３５０は、コマンドをもとに特定された設定内容を表示制御部３５２に出力する。表示制御部３５２は、設定内容に応じた画面を表示する。図３（ｂ）は、第１画面を示す。第１画面には、機器名称が初期設定の「エアコン０１」である第１設定情報６００が示される。音声出力部３５４は、「機器名称を設定画面です。設定したい機器を選択してください。」との音声をスピーカ３２４から出力する。図３（ｃ）は後述して、図１に戻る。ユーザは、制御装置３００のマイクロフォン３２０に対して、「エアコン０１をリビング・エアコンにして」と発話する。生成部３４０は、「エアコン０１をリビング・エアコンにして」を含む音声情報を生成する。第２通信部３１２は、音声変換サーバ装置５００に音声情報を送信する。 The second communication unit 312 of the control device 300 receives a command from the command generation server device 550. The acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352. The display control unit 352 displays a screen according to the setting content. FIG. 3B shows the first screen. On the first screen, the first setting information 600 whose device name is the initial setting "air conditioner 01" is shown. The voice output unit 354 outputs the voice "The device name is the setting screen. Please select the device you want to set." From the speaker 324. FIG. 3C will be described later and returns to FIG. The user speaks to the microphone 320 of the control device 300, "Make the air conditioner 01 a living room air conditioner." The generation unit 340 generates voice information including "turning the air conditioner 01 into a living room air conditioner". The second communication unit 312 transmits voice information to the voice conversion server device 500.
　制御装置３００の第２通信部３１２は、コマンドをコマンド生成サーバ装置５５０から受信する。取得部３５０は、コマンドをもとに特定された設定内容を表示制御部３５２に出力する。機器制御部３５６は、表示制御部３５２が受けつけた設定内容に応じて、機器名称「エアコン０１」を機器名称「リビング・エアコン」に変更する。これは、選択肢の１つを特定する情報を取得した場合に、設定を実行することに相当する。図３（ｃ）は、第２画面を示す。第２画面には、機器名称が初期設定の「リビング・エアコン」である第２設定情報６０４が示される。つまり、表示制御部３５２は、選択肢の１つを特定する情報を取得した場合に、第２画面を表示部３２６に表示させる。また、音声出力部３５４は、「エアコン０１をリビング・エアコンに変更しました。」との音声をスピーカ３２４から出力する。 The second communication unit 312 of the control device 300 receives a command from the command generation server device 550. The acquisition unit 350 outputs the setting contents specified based on the command to the display control unit 352. The device control unit 356 changes the device name "air conditioner 01" to the device name "living air conditioner" according to the setting content received by the display control unit 352. This corresponds to executing the setting when the information specifying one of the options is acquired. FIG. 3C shows a second screen. On the second screen, the second setting information 604 whose device name is the initial setting "living room air conditioner" is shown. That is, when the display control unit 352 acquires the information that identifies one of the options, the display control unit 352 causes the display unit 326 to display the second screen. In addition, the voice output unit 354 outputs the voice "The air conditioner 01 has been changed to the living room air conditioner" from the speaker 324.
（５）第３例
　第３例は、シーン制御を設定する状況である。シーン制御とは、１つ以上の条件の組合せによって、１つ以上の機器２００を制御することである。シーン制御を設定するためのユーザの発話は、例えば、「夜８時にお風呂いれて」、「涼しくなったらエアコン消して」、「帰宅したら照明つけて」である。「帰宅したら照明つけて」は、電気錠が開くと照明が点灯することに相当する。図４（ａ）－（ｂ）は、表示部３２６に表示されるさらに別の画面を示す。図４（ａ）は第１画面を示す。第１画面には、シーン制御設定前の第１設定情報６００が示される。図４（ｂ）は第２画面を示す。第２画面には、シーン制御設定後の第２設定情報６０４が示される。 (5) Third example The third example is a situation where scene control is set. Scene control is to control one or more devices 200 by a combination of one or more conditions. The user's utterances for setting the scene control are, for example, "take a bath at 8 pm", "turn off the air conditioner when it gets cool", and "turn on the lights when returning home". "Turn on the lights when you get home" is equivalent to turning on the lights when the electric lock is opened. 4 (a)-(b) show still another screen displayed on the display unit 326. FIG. 4A shows the first screen. The first setting information 600 before the scene control setting is displayed on the first screen. FIG. 4B shows a second screen. The second setting information 604 after the scene control setting is displayed on the second screen.
（６）第４例
　第４例は、報知モードを設定する状況である。報知モードを設定するためのユーザの発話は、例えば、「報知モードを設定して」である。図５（ａ）－（ｂ）は、表示部３２６に表示されるさらに別の画面を示す。図５（ａ）は第１画面を示す。第１画面には、報知モードがオフである第１設定情報６００が示される。図５（ｂ）は第２画面を示す。第２画面には、報知モードがオンである第２設定情報６０４が示される。 (6) Fourth Example The fourth example is a situation in which a notification mode is set. The user's utterance for setting the notification mode is, for example, "setting the notification mode". 5 (a)-(b) show still another screen displayed on the display unit 326. FIG. 5A shows the first screen. The first screen shows the first setting information 600 in which the notification mode is off. FIG. 5B shows a second screen. The second screen shows the second setting information 604 in which the notification mode is on.
　本開示における装置、システム、または方法の主体は、コンピュータを備えている。このコンピュータがプログラムを実行することによって、本開示における装置、システム、または方法の主体の機能が実現される。コンピュータは、プログラムにしたがって動作するプロセッサを主なハードウェア構成として備える。プロセッサは、プログラムを実行することによって機能を実現することができれば、その種類は問わない。プロセッサは、半導体集積回路（ＩＣ）、またはＬＳＩ（Ｌａｒｇｅ　Ｓｃａｌｅ　Ｉｎｔｅｇｒａｔｉｏｎ）を含む１つまたは複数の電子回路で構成される。複数の電子回路は、１つのチップに集積されてもよいし、複数のチップに設けられてもよい。複数のチップは１つの装置に集約されていてもよいし、複数の装置に備えられていてもよい。プログラムは、コンピュータが読み取り可能なＲＯＭ、光ディスク、ハードディスクドライブなどの非一時的記録媒体に記録される。プログラムは、記録媒体に予め格納されていてもよいし、インターネット等を含む広域通信網を介して記録媒体に供給されてもよい。 The subject of the device, system, or method in this disclosure is equipped with a computer. By executing the program by this computer, the function of the subject of the device, system, or method in the present disclosure is realized. A computer has a processor that operates according to a program as a main hardware configuration. The type of processor does not matter as long as the function can be realized by executing the program. The processor is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or an LSI (Large Scale Integration). A plurality of electronic circuits may be integrated on one chip or may be provided on a plurality of chips. A plurality of chips may be integrated into one device, or may be provided in a plurality of devices. The program is recorded on a non-temporary recording medium such as a computer-readable ROM, optical disc, or hard disk drive. The program may be stored in a recording medium in advance, or may be supplied to the recording medium via a wide area communication network including the Internet or the like.
　以上の構成による制御システム１０００の動作を説明する。図６は、制御システム１０００による表示手順を示すシーケンス図である。制御装置３００は、音声の入力を受けつける（Ｓ１０）と、音声情報を音声変換サーバ装置５００に送信する（Ｓ１２）。音声変換サーバ装置５００は、テキスト情報を生成する（Ｓ１４）と、テキスト情報をコマンド生成サーバ装置５５０に送信する（Ｓ１６）。コマンド生成サーバ装置５５０は、コマンドを生成する（Ｓ１８）と、コマンドを制御装置３００に送信する（Ｓ２０）。制御装置３００は、第１画面を表示部３２６に表示する（Ｓ２２）。 The operation of the control system 1000 with the above configuration will be described. FIG. 6 is a sequence diagram showing a display procedure by the control system 1000. When the control device 300 receives the voice input (S10), the control device 300 transmits the voice information to the voice conversion server device 500 (S12). When the voice conversion server device 500 generates text information (S14), the voice conversion server device 500 transmits the text information to the command generation server device 550 (S16). When the command generation server device 550 generates a command (S18), the command generation server device 550 transmits the command to the control device 300 (S20). The control device 300 displays the first screen on the display unit 326 (S22).
　制御装置３００は、音声の入力を受けつける（Ｓ２４）と、音声情報を音声変換サーバ装置５００に送信する（Ｓ２６）。音声変換サーバ装置５００は、テキスト情報を生成する（Ｓ２８）と、テキスト情報をコマンド生成サーバ装置５５０に送信する（Ｓ３０）。コマンド生成サーバ装置５５０は、コマンドを生成する（Ｓ３２）と、コマンドを制御装置３００に送信する（Ｓ３４）。制御装置３００は、制御情報を機器２００に送信する（Ｓ３６）。機器２００は、制御情報に応じた設定を実行すると、状態情報を制御装置３００に送信する（Ｓ３８）。制御装置３００は、第２画面を表示部３２６に表示する（Ｓ４０）。 When the control device 300 receives the voice input (S24), the control device 300 transmits the voice information to the voice conversion server device 500 (S26). The voice conversion server device 500 generates text information (S28) and transmits the text information to the command generation server device 550 (S30). When the command generation server device 550 generates a command (S32), the command generation server device 550 transmits the command to the control device 300 (S34). The control device 300 transmits control information to the device 200 (S36). When the device 200 executes the setting according to the control information, the device 200 transmits the state information to the control device 300 (S38). The control device 300 displays the second screen on the display unit 326 (S40).
　本実施例によれば、コマンドをもとに特定された設定を実行する前の第１設定情報が示される第１画面を表示させてから、設定を実行した後の第２設定情報が示される第２画面を第１画面に続いて表示させるので、音声により機器２００を設定する場合でも設定内容を確認できる。また、音声により機器２００を設定する場合でも設定内容が確認されるので、ユーザの利便性を向上しながら、操作の確実性を向上できる。また、第２設定情報に移行することをユーザに通知するための確認音声を出力されるので、ユーザの利便性をさらに向上できる。また、第１画面を表示させている間に、第２設定情報に移行することに付随するユーザへの通知情報を表示させ、通知情報に対する同意情報を取得した場合に設定を実行するので、通知情報をユーザに確認させることができる。また、コマンドに不足している情報がある場合に複数の選択肢を表示させ、選択肢の１つを特定する情報を取得した場合に設定を実行して第２画面を表示させるので、ユーザの利便性をさらに向上できる。 According to this embodiment, the first screen showing the first setting information before executing the setting specified based on the command is displayed, and then the second setting information after executing the setting is shown. Since the second screen is displayed following the first screen, the setting contents can be confirmed even when the device 200 is set by voice. Further, since the setting contents are confirmed even when the device 200 is set by voice, the reliability of the operation can be improved while improving the convenience of the user. Further, since the confirmation voice for notifying the user of the transition to the second setting information is output, the convenience of the user can be further improved. In addition, while the first screen is displayed, the notification information to the user accompanying the transition to the second setting information is displayed, and the setting is executed when the consent information for the notification information is obtained. Information can be confirmed by the user. In addition, if there is missing information in the command, multiple options are displayed, and if information that identifies one of the options is acquired, the setting is executed and the second screen is displayed, which is convenient for the user. Can be further improved.
　本開示の一態様の概要は、次の通りである。本開示のある態様の表示制御システムは、１以上の機器（２００）と通信可能な通信部（３１０）と、音声情報に基づいて特定されたコマンドであって、かつ通信部（３１０）が通信可能な機器（２００）に関する設定を指示する内容が含まれたコマンドを取得する取得部（３５０）と、取得部（３５０）において取得したコマンドをもとに特定された設定を実行する前の第１設定情報が示される第１画面を表示部（３２６）に表示させる表示制御部（３５２）と、設定を実行する機器制御部（３５６）とを備える。表示制御部（３５２）は、機器制御部（３５６）が設定を実行した後の第２設定情報が示される第２画面を第１画面に続いて表示部（３２６）に表示させる。 The outline of one aspect of this disclosure is as follows. The display control system of one aspect of the present disclosure is a communication unit (310) capable of communicating with one or more devices (200), a command specified based on voice information, and the communication unit (310) communicates with each other. The acquisition unit (350) that acquires a command containing the content instructing the setting related to the possible device (200), and the first before executing the setting specified based on the command acquired by the acquisition unit (350). (1) A display control unit (352) for displaying a first screen on which setting information is displayed on a display unit (326), and a device control unit (356) for executing the setting are provided. The display control unit (352) causes the display unit (326) to display a second screen on which the second setting information after the device control unit (356) has executed the setting is displayed, following the first screen.
　音声出力部（３５４）をさらに備えてもよい。音声出力部（３５４）は、第２設定情報に移行することをユーザに通知するための確認音声を出力する。 An audio output unit (354) may be further provided. The voice output unit (354) outputs a confirmation voice for notifying the user that the second setting information is to be transferred.
　表示制御部（３５２）は、第１画面を表示部（３２６）に表示させている間に、第２設定情報に移行することに付随するユーザへの通知情報を表示させ、機器制御部（３５６）は、通知情報に対する同意情報を取得した場合に、設定を実行する。 While the display control unit (352) is displaying the first screen on the display unit (326), the display control unit (352) displays the notification information to the user accompanying the transition to the second setting information, and the device control unit (356). ) Executes the setting when the consent information for the notification information is acquired.
　表示制御部（３５２）は、コマンドに不足している情報がある場合に、複数の選択肢を表示部（３２６）に表示させ、機器制御部（３５６）は、選択肢の１つを特定する情報を取得した場合に、設定を実行し、表示制御部（３５２）は、選択肢の１つを特定する情報を取得した場合に、第２画面を表示部（３２６）に表示させる。 The display control unit (352) causes the display unit (326) to display a plurality of options when there is insufficient information in the command, and the device control unit (356) displays information for specifying one of the options. When the information is acquired, the setting is executed, and the display control unit (352) causes the display unit (326) to display the second screen when the information for specifying one of the options is acquired.
　以上、本開示を実施例をもとに説明した。この実施例は例示であり、それらの各構成要素あるいは各処理プロセスの組合せにいろいろな変形例が可能なこと、またそうした変形例も本開示の範囲にあることは当業者に理解されるところである。 Above, this disclosure has been explained based on the examples. It will be appreciated by those skilled in the art that this embodiment is exemplary and that various variations of each of these components or combinations of processing processes are possible and that such modifications are also within the scope of the present disclosure. ..
　本実施例において、音声変換サーバ装置５００とコマンド生成サーバ装置５５０が別に構成されている。しかしながらこれに限らず例えば、音声変換サーバ装置５００とコマンド生成サーバ装置５５０が一体的に構成されてもよい。また、音声変換サーバ装置５００とコマンド生成サーバ装置５５０との少なくとも１つが制御装置３００に含まれてもよい。本変形例によれば、構成の自由度を向上できる。 In this embodiment, the voice conversion server device 500 and the command generation server device 550 are separately configured. However, the present invention is not limited to this, and for example, the voice conversion server device 500 and the command generation server device 550 may be integrally configured. Further, at least one of the voice conversion server device 500 and the command generation server device 550 may be included in the control device 300. According to this modification, the degree of freedom of configuration can be improved.
　本開示によれば、ユーザの利便性を向上しながら、操作の確実性を向上できる。 According to the present disclosure, it is possible to improve the certainty of operation while improving the convenience of the user.
　１００　施設、　２００　機器、　３００　制御装置、　３１０　第１通信部、　３１２　第２通信部、　３２０　マイクロフォン、　３２２　操作部、　３２４　スピーカ、　３２６　表示部、　３２８　記憶部、　３３０　処理部、　３４０　生成部、　３５０　取得部、　３５２　表示制御部、　３５４　音声出力部、　３５６　機器制御部、　４００　ルータ、　４２０　ネットワーク、　５００　音声変換サーバ装置、　５５０　コマンド生成サーバ装置、　１０００　制御システム。 100 facilities, 200 equipment, 300 control device, 310 1st communication unit, 312 2nd communication unit, 320 microphone, 322 operation unit, 324 speaker, 326 display unit, 328 storage unit, 330 processing unit, 340 generation unit, 350 acquisition Unit, 352 display control unit, 354 voice output unit, 356 device control unit, 400 router, 420 network, 500 voice conversion server device, 550 command generation server device, 1000 control system.

Claims (5)

  1. 　１以上の機器と通信可能な通信部と、
    　音声情報に基づいて特定されたコマンドであって、かつ前記通信部が通信可能な前記機器に関する設定を指示する内容が含まれたコマンドを取得する取得部と、
    　前記取得部において取得した前記コマンドをもとに特定された前記設定を実行する前の第１設定情報が示される第１画面を表示部に表示させる表示制御部と、
    　前記設定を実行する機器制御部とを備え、
    　前記表示制御部は、前記機器制御部が前記設定を実行した後の第２設定情報が示される第２画面を前記第１画面に続いて前記表示部に表示させる表示制御システム。     A communication unit that can communicate with one or more devices,
    An acquisition unit that acquires a command that is a command specified based on voice information and that includes a content that indicates a setting related to the device that the communication unit can communicate with.
    A display control unit that displays on the display unit a first screen showing the first setting information before executing the setting specified based on the command acquired by the acquisition unit.
    It is equipped with a device control unit that executes the above settings.
    The display control unit is a display control system that displays a second screen on which the second setting information after the device control unit executes the setting is displayed on the display unit following the first screen.
  2. 　音声出力部をさらに備え、
    　前記音声出力部は、前記第２設定情報に移行することをユーザに通知するための確認音声を出力する、
    　請求項１に記載の表示制御システム。     With more audio output
    The voice output unit outputs a confirmation voice for notifying the user of the transition to the second setting information.
    The display control system according to claim 1.
  3. 　前記表示制御部は、前記第１画面を前記表示部に表示させている間に、前記第２設定情報に移行することに付随するユーザへの通知情報を表示させ、
    　前記機器制御部は、前記通知情報に対する同意情報を取得した場合に、前記設定を実行する、
    　請求項１または２に記載の表示制御システム。     While the display control unit is displaying the first screen on the display unit, the display control unit displays notification information to the user accompanying the transition to the second setting information.
    The device control unit executes the setting when the consent information for the notification information is acquired.
    The display control system according to claim 1 or 2.
  4. 　前記表示制御部は、前記コマンドに不足している情報がある場合に、複数の選択肢を前記表示部に表示させ、
    　前記機器制御部は、前記選択肢の１つを特定する情報を取得した場合に、前記設定を実行し、
    　前記表示制御部は、前記選択肢の１つを特定する情報を取得した場合に、前記第２画面を前記表示部に表示させる、
    　請求項１から３のいずれか１項に記載の表示制御システム。     The display control unit causes the display unit to display a plurality of options when there is insufficient information in the command.
    When the device control unit acquires the information that identifies one of the options, the device control unit executes the setting.
    When the display control unit acquires information that identifies one of the options, the display control unit causes the display unit to display the second screen.
    The display control system according to any one of claims 1 to 3.
  5. 　請求項１から４のいずれか１項に記載の表示制御システムに実行させるためのプログラム。 A program for causing the display control system according to any one of claims 1 to 4 to execute.
PCT/JP2021/045473 2020-12-10 2021-12-10 Display control system and program WO2022124389A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020205108A JP2022092342A (en) 2020-12-10 2020-12-10 Display control system and program
JP2020-205108 2020-12-10

Publications (1)

Publication Number Publication Date
WO2022124389A1 true WO2022124389A1 (en) 2022-06-16

Family

ID=81974545

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/045473 WO2022124389A1 (en) 2020-12-10 2021-12-10 Display control system and program

Country Status (2)

Country Link
JP (1) JP2022092342A (en)
WO (1) WO2022124389A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002170034A (en) * 2000-11-30 2002-06-14 Seiko Instruments Inc Contents server and contents delivery method
JP2003228390A (en) * 2002-02-01 2003-08-15 Toshiba Corp Voice controller
WO2014171144A1 (en) * 2013-04-19 2014-10-23 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Control method for household electrical appliance, household electrical appliance control system, and gateway
JP2017166791A (en) * 2016-03-18 2017-09-21 パナソニックＩｐマネジメント株式会社 Control method of information terminal in air conditioning control system, and air conditioning control system
JP2019101264A (en) * 2017-12-04 2019-06-24 シャープ株式会社 External controller, voice interactive control system, control method, and program
JP2019198987A (en) * 2018-05-14 2019-11-21 コニカミノルタ株式会社 Operation screen display device, image processing apparatus, and program
JP2020040568A (en) * 2018-09-12 2020-03-19 川崎重工業株式会社 Vehicle setting change system
JP2021055947A (en) * 2019-09-30 2021-04-08 ダイキン工業株式会社 Air conditioning system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002170034A (en) * 2000-11-30 2002-06-14 Seiko Instruments Inc Contents server and contents delivery method
JP2003228390A (en) * 2002-02-01 2003-08-15 Toshiba Corp Voice controller
WO2014171144A1 (en) * 2013-04-19 2014-10-23 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Control method for household electrical appliance, household electrical appliance control system, and gateway
JP2017166791A (en) * 2016-03-18 2017-09-21 パナソニックＩｐマネジメント株式会社 Control method of information terminal in air conditioning control system, and air conditioning control system
JP2019101264A (en) * 2017-12-04 2019-06-24 シャープ株式会社 External controller, voice interactive control system, control method, and program
JP2019198987A (en) * 2018-05-14 2019-11-21 コニカミノルタ株式会社 Operation screen display device, image processing apparatus, and program
JP2020040568A (en) * 2018-09-12 2020-03-19 川崎重工業株式会社 Vehicle setting change system
JP2021055947A (en) * 2019-09-30 2021-04-08 ダイキン工業株式会社 Air conditioning system

Also Published As

Publication number Publication date
JP2022092342A (en) 2022-06-22

Similar Documents

Publication Publication Date Title
JP7348558B2 (en) equipment control system
KR101931782B1 (en) Smart home scenario switching method and system
US20070156256A1 (en) Home automation system and method utilizing outdoor environmental conditions
JP2010075015A (en) Demand control system for household electric appliance
US10031496B2 (en) Control system, control apparatus, information equipment, and control method
CN105074715B (en) Consumer facility device, control apparatus, and control method
WO2022124389A1 (en) Display control system and program
WO2014171000A1 (en) Power management system and terminal device
US9934680B2 (en) Managing the control of an electrical device controllable by infrared control signals
JP6910221B2 (en) Air conditioner
WO2024021575A1 (en) Guest room intelligent control method and apparatus, device, and storage medium
US10084610B2 (en) Control apparatus and control method
CN212519027U (en) Intelligent home system based on voice control
WO2018158894A1 (en) Air conditioning control device, air conditioning control method, and program
JP6902716B2 (en) Energy management modules, energy management equipment, energy management systems, and programs
WO2019221001A1 (en) Processing system and program
WO2016038563A1 (en) Automation methods and systems for controlling physical devices
WO2021024990A1 (en) Control system and control method
JP7162169B2 (en) processor, remote control system, program
JP2019179295A (en) Input support unit and input support system
JP2020129183A (en) Control device, control system, and control method
TWI587595B (en) Remote power control method and system thereof
JP2022090461A (en) Control system and control method
TW202110154A (en) Home appliance controlling system and home appliance controlling thereof
JP2022013035A (en) Voice control system and voice control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21903485

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21903485

Country of ref document: EP

Kind code of ref document: A1