JP2022111605A - Display system control method, display device control method, and display system - Google Patents

Abstract

To perform properly switching between an image muting ON state and an image muting OFF state.SOLUTION: A control method is provided for a second display system 1B including a voice assistant device 300 that is communicably connected to a server device 100, and a second projector 200B that is communicably connected to the voice assistant device 300. The voice assistant device 300 transmits, to the server device 100, command information JC corresponding to a voice command given by a user, and receives, from the server device 100, response information JR corresponding to the command information JC. The second projector 200B is configured to be switchable between an ON state and an OFF state of image muting for displaying an image, and is switched from the image muting ON state to the image muting OFF state in accordance with the command information JC and/or the response information JR, and displays an image corresponding to the response information JR.SELECTED DRAWING: Figure 4

Description

The present invention relates to a display system control method, a display device control method, and a display system.

2. Description of the Related Art Conventionally, techniques related to an image mute function and an audio mute function in a display device are known (see, for example, Patent Document 1).
Japanese Patent Application Laid-Open No. 2002-200000 describes that a display device capable of voice input starts accepting a voice operation when it detects a state that triggers a predetermined voice start trigger. For example, when the automatic power-off function operates, a method is described in which acceptance of voice operation is started and automatic power-off is canceled by voice operation.

International Publication No. 2020-158435

However, with the technique described in Patent Literature 1, if the image is muted when the voice operation is received, there is a possibility that the image cannot be displayed even if the response includes an image.

One aspect of solving the above problems is a control method for a display system including a voice assistant device communicably connected to a server device and a display device communicably connected to the voice assistant device, wherein the voice The assistant device receives a voice instruction from the user, transmits instruction information corresponding to the received instruction to the server device, receives response information corresponding to the instruction information from the server device, and the display device a first state for displaying an image and a second state for stopping the display of an image, the second state being switched from the first state to the first state based on at least one of the instruction information and the response information; to display an image corresponding to the response information.

Another aspect of solving the above problem is a control method for a display device including a voice assistant device communicably connected to a server device, wherein the voice assistant device receives a voice instruction from a user, Instruction information corresponding to the accepted instruction is transmitted to the server device, response information corresponding to the instruction information is received from the server device, and the display device displays a first state of displaying an image, and displays the image. It is configured to be switchable between a second state of stopping, and switches from the second state to the first state based on at least one of the instruction information and the response information, and displays an image corresponding to the response information.

Yet another aspect of solving the above problems is a display system comprising a voice assistant device communicably connected to a server device and a display device communicably connected to the voice assistant device, wherein the voice The assistant device receives a voice instruction from the user, transmits instruction information corresponding to the received instruction to the server device, receives response information corresponding to the instruction information from the server device, and the display device a first state for displaying an image and a second state for stopping the display of an image, the second state being switched from the first state to the first state based on at least one of the instruction information and the response information; to display an image corresponding to the response information.

The figure which shows an example of a structure of the display system which concerns on 1st Embodiment. FIG. 5 is a diagram showing an example of the operation of the first projector; 4 is a flowchart showing an example of processing of the first projector; The figure which shows an example of a structure of the display system which concerns on 2nd Embodiment.

Hereinafter, this embodiment will be described with reference to the drawings.
The display system 1 according to the present embodiment includes a first display system 1A, which is the display system according to the first embodiment described with reference to FIGS. 1 to 3, and a second embodiment described with reference to FIG. and a second display system 1B, which is a display system according to.

[First embodiment]
FIG. 1 is a diagram showing an example of the configuration of a first display system 1A, which is a display system according to the first embodiment.
The first display system 1A includes a first projector 200A. The first projector 200A is wirelessly communicably connected to the server device 100, for example, in accordance with Wi-Fi (registered trademark).

The server device 100 supplies image information and audio information to the first projector 200A in response to a request from the first projector 200A.
In the first embodiment, the server device 100 is connected to the first projector 200A via Wi-Fi (registered trademark) so as to be able to communicate wirelessly with the first projector 200A. may be connected.

The first projector 200A includes a projection section 210 and a drive section 220 that drives the projection section 210 . The projection unit 210 forms an optical image and projects the image onto the screen SC. Note that in the first embodiment, the projection unit 210 projects an image corresponding to image information from the server device 100 onto the screen SC.
The first projector 200A corresponds to an example of a "display device".
The projection section 210 includes a light source section 211 , an optical modulator 212 and a projection optical system 213 . The driver 220 includes a light source driver 221 and a light modulator driver 222 .

The light source unit 211 includes a lamp light source such as a halogen lamp, a xenon lamp, an extra-high pressure mercury lamp, or a solid light source such as an LED (Light Emitting Diode) or a laser light source.
Also, the light source unit 211 may include a reflector that guides the light emitted by the light source to the light modulation device 212 and an auxiliary reflector. Furthermore, the light source unit 211 may include a lens group for enhancing the optical characteristics of the projected light, a polarizing plate, or a light control element for reducing the amount of light emitted by the light source on the path leading to the light modulation device 212. good.
The light source drive unit 221 is connected to the internal bus 207 and turns on and off the light source of the light source unit 211 according to instructions from the control unit 250 that is also connected to the internal bus 207 .

The light modulation device 212 includes, for example, three liquid crystal panels 215 corresponding to the three primary colors of R, G and B. R indicates red, G indicates green, and B indicates blue. That is, the light modulation device 212 includes a liquid crystal panel 215 corresponding to R-color light, a liquid crystal panel 215 corresponding to G-color light, and a liquid crystal panel 215 corresponding to B-color light.
The light emitted by the light source unit 211 is separated into three color lights of RGB, and is incident on the corresponding liquid crystal panel 215 . Each of the three liquid crystal panels 215 is a transmissive liquid crystal panel and modulates transmitted light to generate image light PL. The image light PL modulated by passing through each liquid crystal panel 215 is synthesized by a synthesizing optical system such as a cross dichroic prism and emitted to the projection optical system 213 .
In the first embodiment, the case where the light modulation device 212 includes a transmissive liquid crystal panel 215 as a light modulation element will be described, but the present invention is not limited to this. The light modulation element may be a reflective liquid crystal panel or a digital micromirror device.

The light modulator 212 is driven by a light modulator driver 222 . The light modulation device driving section 222 is connected to the image processing section 245 .
Image data corresponding to the primary colors of R, G, and B are input from the image processing unit 245 to the light modulation device driving unit 222 . The light modulator driver 222 converts the input image data into a data signal suitable for the operation of the liquid crystal panel 215 . The light modulator driving section 222 applies a voltage to each pixel of each liquid crystal panel 215 based on the converted data signal, and draws an image on each liquid crystal panel 215 .

The projection optical system 213 includes lenses, mirrors, and the like that form an image of the incident image light PL on the screen SC. The projection optical system 213 also includes a zoom mechanism for enlarging or reducing the image projected on the screen SC, a focus adjustment mechanism for adjusting focus, a lens shift mechanism for adjusting the projection direction of the image light PL, and the like.

The first projector 200A includes an operation unit 231, a remote control light receiving unit 233, an input interface 235, a storage unit 237, a voice assistant control unit 241, a frame memory 243, an image processing unit 245, a control unit 250, a speaker 247, and a wireless communication unit 249. Further prepare. The input interface 235, storage unit 237, voice assistant control unit 241, image processing unit 245, and control unit 250 are connected via the internal bus 207 so as to be able to communicate with each other.

The operation unit 231 includes various buttons and switches provided on the surface of the casing of the first projector 200A, generates operation signals corresponding to the operations of these buttons and switches, and outputs them to the input interface 235 . The input interface 235 has a circuit that outputs an operation signal input from the operation unit 231 to the control unit 250 .

The remote control light receiving section 233 receives an infrared signal transmitted from the remote controller 5 and decodes the received infrared signal to generate an operation signal. Remote control light receiving section 233 outputs the generated operation signal to input interface 235 . The input interface 235 outputs the operation signal input from the remote control light receiving section 233 to the control section 250 .

The remote control 5 has a microphone 51 . The remote controller 5 encodes the audio signal input to the microphone 51 into an infrared signal and transmits the infrared signal to the remote controller light receiving section 233 . The remote control light receiving unit 233 decodes the received infrared signal to generate an audio signal. Remote control light receiving unit 233 outputs the generated audio signal to input interface 235 . The input interface 235 outputs the audio signal input from the remote control light receiving section 233 to the voice assistant control section 241 .

The storage unit 237 is, for example, a magnetic recording device such as a HDD (Hard Disk Drive), or a storage device using a semiconductor storage element such as an SSD (Solid State Drive) or flash memory. The storage unit 237 stores programs executed by the control unit 250, data processed by the control unit 250, image information, audio information, and the like.

The image processing unit 245 and the frame memory 243 can be configured by integrated circuits, for example. Integrated circuits include LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), and PLD (Programmable Logic Device). PLDs include, for example, FPGAs (Field-Programmable Gate Arrays). Also, part of the configuration of the integrated circuit may include analog circuitry, or may be a combination of a processor and an integrated circuit. A combination of a processor and an integrated circuit is called a microcontroller (MCU), SoC (System-on-a-chip), system LSI, chipset, or the like.

The image processing unit 245 develops the image information input from the voice assistant control unit 241 in the frame memory 243 . The frame memory 243 has multiple banks. Each bank has a storage capacity capable of writing image information for one frame. The frame memory 243 is configured by, for example, SDRAM (Synchronous Dynamic Random Access Memory).

The image processing unit 245 performs image processing such as resolution conversion processing, resizing processing, distortion aberration correction, shape correction processing, digital zoom processing, and image color and brightness adjustment on the image data developed in the frame memory 243. process.
The image processing unit 245 also generates a vertical synchronization signal by converting the input frame frequency of the vertical synchronization signal into a drawing frequency. The generated vertical sync signal is called an output sync signal. The image processing section 245 outputs the generated output synchronization signal to the light modulation device driving section 222 .

Speaker 247 outputs sound according to instructions from voice assistant control unit 241 .

The wireless communication unit 249 is connected to the server device 100 so as to be wirelessly communicable with the server device 100, for example, in accordance with Wi-Fi (registered trademark). Wireless communication unit 249 transmits instruction information JC corresponding to the audio signal input to microphone 51 to server device 100 . Also, the wireless communication unit 249 receives response information JR corresponding to the instruction information JC from the server device 100 . The response information JR includes image information and audio information.

The voice assistant control unit 241 has a memory 241A and a processor 241B.
The memory 241A is a storage device that nonvolatilely stores programs and data executed by the processor 241B. The memory 241A is composed of a magnetic storage device, a semiconductor storage device such as a flash ROM (Read Only Memory), or other types of non-volatile storage devices. The memory 241A may also include a RAM (Random Access Memory) that forms a work area for the processor 241B. The memory 241A stores data processed by the voice assistant control unit 241 and control programs executed by the processor 241B.

The processor 241B may be composed of a single processor, or may be configured such that a plurality of processors function as the processor 241B. Processor 241B executes a control program to control voice assistant controller 241 . The processor 241B executes control programs to implement, for example, voice assistant functions.

The voice assistant control section 241 is connected to the speaker 247 and the wireless communication section 249 and executes the voice assistant function.
That is, voice assistant control unit 241 transmits instruction information JC corresponding to the voice signal input to microphone 51 of remote controller 5 to server device 100 via wireless communication unit 249 . Voice assistant control unit 241 then receives response information JR corresponding to instruction information JC from server device 100 via wireless communication unit 249 . Also, the voice assistant control section 241 causes the control section 250 to project an image corresponding to the image information included in the response information JR. The voice assistant control unit 241 also causes the speaker 247 to output voice corresponding to the voice information included in the response information JR.

Also, the voice assistant control unit 241 controls the voice mute function.
The audio mute function is a function that prohibits audio output from the speaker 247 . When the audio mute is on, the output of audio from the speaker 247 is prohibited, and when the audio mute is off, the output of audio from the speaker 247 is permitted. Note that setting the audio mute to OFF corresponds to "release the audio mute".
The voice assistant control unit 241 corresponds to an example of a "voice assistant device".

The control unit 250 has a memory 251 and a processor 253 .
The memory 251 is a storage device that non-volatilely stores programs and data executed by the processor 253 . The memory 251 is composed of a magnetic storage device, a semiconductor storage device such as a flash ROM, or other types of non-volatile storage devices. The memory 251 may also include a RAM forming a work area for the processor 253 . The memory 251 stores data processed by the control unit 250 and control programs executed by the processor 253 .

The processor 253 may be composed of a single processor, or may be configured such that multiple processors function as the processor 253 . The processor 253 executes control programs to control each part of the first projector 200A. For example, the processor 253 outputs to the image processing section 245 an image processing execution instruction corresponding to the operation accepted by the operation section 231 and the remote controller 5 and the parameters used for this image processing. The parameters include, for example, geometric correction parameters for correcting geometric distortion of the image projected onto the screen SC. In addition, the processor 253 controls the light source driving section 221 to control the lighting and extinguishing of the light source section 211 and adjust the brightness of the light source section 211 .

Also, the processor 253 of the control unit 250 executes the control program stored in the memory 251 to control the image mute function.
The image mute function is a function that prohibits projection of images from the projection unit 210 . When the image mute is on, the projection of the image from the projection unit 210 is prohibited, and when the image mute is off, the projection of the image from the projection unit 210 is permitted.
A state in which image muting is on corresponds to an example of a “second state”. A state in which image muting is off corresponds to an example of a “first state”.

Next, an example of processing of the control unit 250 of the first projector 200A will be described with reference to FIG. FIG. 2 is a diagram showing an example of the operation of the first projector 200A.
In the initial state shown on the left side of FIG. 2, image mute is set to ON and audio mute is set to OFF. For example, the voice assistant control unit 241 receives streaming music information from the server device 100 and outputs audio corresponding to the streaming music information from the speaker 247 .

In the state shown in the center of FIG. 2 , the user inputs an instruction to the voice assistant control section 241 to the microphone 51 arranged on the remote control 5 . For example, the user inputs into the microphone 51 the voice "What is the weather today?"
Voice assistant control unit 241 transmits instruction information JC corresponding to the voice signal input to microphone 51 to server device 100 via wireless communication unit 249 . Voice assistant control unit 241 then receives response information JR corresponding to instruction information JC from server device 100 via wireless communication unit 249 . The response information JR includes image information and audio information.
The voice assistant control unit 241 keeps the voice mute turned off in order to output the voice corresponding to the voice information included in the response information JR. Also, the control unit 250 switches the image mute from ON to OFF in order to project an image corresponding to the image information included in the response information JR.
Then, the voice assistant control section 241 outputs the voice corresponding to the voice information included in the response information JR from the speaker 247 . Also, the control unit 250 projects an image PW corresponding to the image information included in the response information JR received by the voice assistant control unit 241 .

When the output of the image information and the audio information included in the response information JR is completed, the control unit 250 switches the image mute from off to on. In addition, the voice assistant control unit 241 keeps the voice mute turned off in order to restart the output of the voice corresponding to the streaming music information.
As a result, as shown on the right side of FIG. 2, the image mute is set to ON and the audio mute is set to OFF. The voice assistant control unit 241 then receives the streaming music information from the server device 100 and resumes outputting the audio corresponding to the streaming music information from the speaker 247 .

As described with reference to FIG. 2, the control unit 250 sets the image muting function based on the response information JR, so the image muting function can be properly set. For example, when the response information JR includes image information, the control unit 250 sets the image mute to off. Further, for example, when the response information JR does not include image information, the control unit 250 sets the image mute to ON.
Also, since the voice assistant control unit 241 sets the voice mute function based on the response information JR, the voice mute function can be set appropriately. For example, when the response information JR includes voice information, the voice assistant control unit 241 sets voice mute to off. Further, for example, when the response information JR does not include voice information, the voice assistant control unit 241 sets voice mute to ON.

In FIG. 2, the case where the response information JR includes image information and audio information has been described, but the present invention is not limited to this. For example, when the response information JR does not include image information, the control unit 250 keeps the image mute turned on.

Also, in FIG. 2, the case where the image mute is set to the on state and the audio mute is set to the off state in the initial state has been described, but the present invention is not limited to this. In the initial state, for example, image muting may be set to OFF and audio muting may be set to ON. In this case, when the voice assistant control unit 241 receives the response information JR including voice information, the voice assistant control unit 241 switches the voice mute from ON to OFF. Then, when the output of the voice information included in the response information JR is completed, the voice assistant control unit 241 switches voice mute from off to on.

Also, in FIG. 2, the case where the control unit 250 sets the image muting function based on the response information JR has been described, but the present invention is not limited to this. The control unit 250 may set the image mute function based on the instruction information JC.
Also, in FIG. 2, the case where the voice assistant control unit 241 sets the voice mute function based on the response information JR has been described, but the present invention is not limited to this. The voice assistant control unit 241 may set the voice mute function based on the instruction information JC.

FIG. 3 is a flowchart showing an example of processing of the first projector 200A. FIG. 3 illustrates a case where the control unit 250 sets the image mute function based on the instruction information JC, and the voice assistant control unit 241 sets the audio mute function based on the instruction information JC.

For example, when the instruction information JC indicates that the user intends to display an image, the control unit 250 sets the image mute to OFF, and the instruction information JC indicates that the user does not intend to display an image. In this case, the control unit 250 sets the image mute to on.
For example, when "AAA" indicates a title including an image and the instruction information JC corresponds to an instruction from the user to "play AAA", the control unit 250 controls the control unit 250 so that the instruction information JC It is judged to indicate that the display is intended.
Further, for example, when "BBB" indicates a title of only music and the instruction information JC corresponds to an instruction from the user "Let me hear BBB", the control unit 250 controls the instruction information JC to It is judged to indicate that the image display is not intended.
Further, when the instruction information JC indicates that the user intends to output voice, the voice assistant control unit 241 sets the audio mute to OFF, and the instruction information JC indicates that the user does not intend to output voice. , the voice assistant control unit 241 sets the voice mute to ON.

As shown in FIG. 3, first, in step S101, the remote controller 5 receives an infrared signal corresponding to the voice instruction signal based on a voice instruction from the user for instructing streaming reproduction of music content. 233.
Next, in step S<b>201 , the remote controller light receiving unit 233 of the first projector 200</b>A converts the infrared signal into a voice instruction signal and transmits the voice instruction signal to the voice assistant control unit 241 . The voice assistant control unit 241 generates instruction information JC based on the voice instruction signal, transmits the instruction information JC to the control unit 250 and to the server device 100 . Also, the voice assistant control unit 241 sets the voice mute to off based on the instruction information JC. Also, the control unit 250 sets the image mute to ON based on the instruction information JC.

Next, in step S301, the server device 100 prepares for streaming reproduction of music content.
Then, in step S303, the server device 100 performs streaming reproduction of the music content. The server device 100 also transmits response information JR including audio information resulting from streaming playback of the music content to the first projector 200A.
Next, in step S203, the voice assistant control unit 241 of the first projector 200A receives the response information JR, and outputs from the speaker 247 the voice corresponding to the voice information included in the response information JR.

Next, in step S103, the remote controller 5 transmits an infrared signal corresponding to the voice instruction signal to the remote control light receiving unit 233 of the first projector 200A based on the voice instruction from the user to instruct the provision of weather information.
Next, in step S<b>205 , the remote controller light receiving unit 233 of the first projector 200</b>A converts the infrared signal into a voice instruction signal and transmits the voice instruction signal to the voice assistant control unit 241 . The voice assistant control unit 241 generates instruction information JC based on the voice instruction signal, transmits the instruction information JC to the control unit 250 and to the server device 100 . Also, the voice assistant control unit 241 keeps the voice mute off based on the instruction information JC. Also, the control unit 250 of the first projector 200A switches the image mute to OFF based on the instruction information JC.

Next, in step S305, server device 100 prepares to provide weather information.
Next, in step S307, the server device 100 transmits response information JR including audio information and image information indicating weather information to the first projector 200A.
Next, in step S207, the voice assistant control unit 241 of the first projector 200A receives the response information JR, and outputs from the speaker 247 the voice corresponding to the voice information included in the response information JR. Also, the control unit 250 of the first projector 200A projects an image corresponding to the image information included in the response information JR according to the instruction from the voice assistant control unit 241. FIG.

Next, in step S209, the voice assistant control unit 241 determines whether the output of the voice corresponding to the voice information included in the response information JR and the projection of the image corresponding to the image information included in the response information JR have ended. determine whether
When the voice assistant control unit 241 determines that the voice output and the image projection have not ended (step S209; NO), the process returns to step S207. When the voice assistant control unit 241 determines that the output of the sound and the projection of the image are finished (step S209; YES), the voice assistant control unit 241 outputs the instruction information JC to restart the streaming reproduction of the music content. is sent to the server device 100, and the process proceeds to step S211.
Then, in step S211, the voice assistant control section 241 of the first projector 200A switches the image mute to ON based on the instruction information JC.
Also, in step S309, the server device 100 prepares to restart the streaming reproduction of the music content.

Next, in step S311, the server apparatus 100 resumes streaming reproduction of music content. The server device 100 also transmits response information JR including audio information resulting from streaming playback of the music content to the first projector 200A.
Next, in step S213, the voice assistant control unit 241 of the first projector 200A receives the response information JR, and outputs from the speaker 247 the voice corresponding to the voice information included in the response information JR. After that, the process ends.

When the control unit 250 sets the image muting function based on the response information JR as described with reference to FIG. Compared to , the image mute function can be set earlier. Therefore, it is possible to suppress the delay in projecting the image due to the time required for setting the image mute function.
In addition, since the voice assistant control unit 241 sets the voice mute function based on the instruction information JC, compared to the case where the voice assistant control unit 241 sets the voice mute function based on the response information JR, Audio mute function can be set early. Therefore, it is possible to suppress the delay in audio output due to the time required to set the audio mute function.

FIG. 2 illustrates a case where the control unit 250 sets the image muting function based on the response information JR, and FIG. 3 illustrates a case where the control unit 250 sets the image muting function based on the instruction information JC. has been described, but is not limited to these. The control unit 250 may set the image mute function based on the instruction information JC and the response information JR. In this case, the delay in projecting the image due to the time required for setting the image muting function can be suppressed, and the image muting function can be properly set.
Further, FIG. 2 illustrates a case where the voice assistant control unit 241 sets the voice mute function based on the response information JR, and FIG. Although the case of setting the mute function has been described, the present invention is not limited to this. The voice assistant control unit 241 may set the voice mute function based on the instruction information JC and the response information JR. In this case, it is possible to suppress the delay in audio output due to the time required to set the audio mute function, and to properly set the audio mute function.

[Second embodiment]
FIG. 4 is a diagram showing an example of the configuration of a second display system 1B, which is a display system according to the second embodiment. In the following description, differences between the second display system 1B shown in FIG. 4 and the first display system 1A shown in FIG. 1 will be mainly described.
The second display system 1B includes a second projector 200B and a voice assistant device 300.
That is, the second display system 1B is different from the first display system 1A shown in FIG. 1 in that the voice assistant device 300 is provided. In addition, in FIG. 4, the same reference numerals are given to the same configurations as those shown in FIG. 1, and the description thereof will be omitted.
The second projector 200B corresponds to an example of a "display device".

The second projector 200B differs from the first projector 200A shown in FIG. 1 in that it does not include the voice assistant control section 241 and the speaker 247. Also, the second projector 200B is different in that it includes a wireless communication unit 240 instead of the wireless communication unit 249 of the first projector 200A shown in FIG.
Wireless communication unit 240 is configured to be capable of wireless communication with wireless communication unit 249 of voice assistant device 300 in accordance with Wi-Fi (registered trademark) or the like.
Also, the remote controller 5 shown in FIG. 4 is different in that the microphone 51 shown in FIG. 1 is not provided.

The voice assistant device 300 performs voice assistant functions.
Voice assistant device 300 includes voice assistant control unit 241 , speaker 247 , microphone 248 , and wireless communication unit 249 .
Microphone 248 accepts voice instructions from the user. Microphone 248 outputs a voice instruction signal indicating a voice instruction to voice assistant control section 241 .
Also, the wireless communication unit 249 is configured to be capable of wireless communication with the wireless communication unit 240 of the second projector 200B and the server device 100 in accordance with Wi-Fi (registered trademark) or the like.

The voice assistant control section 241 of the voice assistant device 300 has substantially the same configuration as the voice assistant control section 241 of the first projector 200A shown in FIG.
The voice assistant controller 241 of the first projector 200A shown in FIG. 1 transmits information to and from the controller 250 via the internal bus 207 . In contrast, the voice assistant control section 241 of the voice assistant device 300 shown in FIG. 4 is different in that it communicates with the second projector 200B via the wireless communication section 249 .

As described with reference to FIGS. 1 and 4, the voice assistant device 300 shown in FIG. 4 is obtained by extracting the configuration related to the voice assistant function of the first projector 200A shown in FIG.
In other words, the first projector 200A shown in FIG. 1 is configured integrally with the second projector 200B shown in FIG. 4 and the voice assistant device 300 .

As described with reference to FIGS. 1 and 4, the second display system 1B shown in FIG. 4 has the same configuration as the first display system 1A shown in FIG. Effective.

As described above with reference to FIGS. 1 to 4, the control method of the second display system 1B according to the present embodiment includes the voice assistant device 300 communicably connected to the server device 100, the voice assistant device 300 and a second projector 200B communicatively connected to the second display system 1B, wherein the voice assistant device 300 receives a voice instruction from the user and outputs an instruction corresponding to the received instruction. The information JC is transmitted to the server device 100, the response information JR corresponding to the instruction information JC is received from the server device 100, and the second projector 200B turns off the image mute for displaying the image and stops displaying the image. The image mute is configured to be switchable between the on state and the on state, and based on at least one of the instruction information JC and the response information JR, the image mute is switched from the on state to the image mute off state, corresponding to the response information JR. Display an image.
That is, the second projector 200B switches from the image mute ON state to the image mute OFF state based on at least one of the instruction information JC and the response information JR, and displays an image corresponding to the response information JR.
Therefore, it is possible to appropriately switch between the image mute ON state and the image mute OFF state. Therefore, user convenience can be improved.

In addition, after the display of the image corresponding to the response information JR is completed, the second projector 200B switches from the image mute OFF state to the image mute ON state.
Therefore, after the display of the image corresponding to the response information JR is finished, it is not necessary to display the image, so that the image mute can be appropriately switched from the off state to the on state. Therefore, user convenience can be improved.

In addition, the second projector 200B maintains the image mute ON state when the response information JR does not include image information.
Therefore, when the response information JR does not include image information, there is no need to display an image, so the image mute ON state can be properly maintained. Therefore, user convenience can be improved.

Also, the voice assistant device 300 cancels the voice mute that prohibits the output of voice from the speaker 247 when the response information JR includes voice information.
Therefore, the audio mute that prohibits the output of audio from the speaker 247 can be properly canceled. Therefore, user convenience can be improved.

The control method of the first projector 200A according to the present embodiment is a control method of the first projector 200A including the voice assistant control unit 241 communicably connected to the server device 100, and the voice assistant control unit 241 , transmits instruction information JC corresponding to the received instruction to the server device 100, receives response information JR corresponding to the instruction information JC from the server device 100, and the first projector 200A outputs an image can be switched between an image mute off state that displays the image and an image mute on state that stops displaying the image, and the image mute is on based on at least one of the instruction information JC and the response information JR , the image mute is turned off, and an image corresponding to the response information JR is displayed.
That is, the first projector 200A switches from the image mute ON state to the image mute OFF state based on at least one of the instruction information JC and the response information JR, and displays an image corresponding to the response information JR.
Therefore, it is possible to appropriately switch between the image mute ON state and the image mute OFF state. Therefore, user convenience can be improved.

A second display system 1B according to the present embodiment includes a voice assistant device 300 communicably connected to the server device 100 and a second projector 200B communicably connected to the voice assistant device 300. 1B, the voice assistant device 300 receives a voice instruction from the user, transmits instruction information corresponding to the received instruction to the server apparatus 100, and transmits response information JR corresponding to the instruction information JC to the server apparatus 100. , and the second projector 200B is configured to be able to switch between an image mute OFF state for displaying an image and an image mute ON state for stopping image display. Based on at least one of them, the state of image muting is switched from the on state to the off state of image muting, and the image corresponding to the response information JR is displayed.
That is, the second projector 200B switches from the image mute ON state to the image mute OFF state based on at least one of the instruction information JC and the response information JR, and displays an image corresponding to the response information JR.
Therefore, it is possible to appropriately switch between the image mute ON state and the image mute OFF state. Therefore, user convenience can be improved.

The present embodiment described above is a preferred embodiment. However, it is not limited to this embodiment described above, and various modifications can be made without departing from the scope of the invention.
Although the case where the voice assistant control unit 241 controls the voice mute function has been described in the present embodiment, the present invention is not limited to this. For example, the controller 250 may control an audio mute function.
Also, in the present embodiment, the case where the control unit 250 controls the image mute function has been described, but the present invention is not limited to this. For example, the voice assistant control section 241 may control the image mute function.

In the present embodiment, a case where the control unit 250 sets the image mute function based on the response information JR will be described with reference to FIG. 2, and with reference to FIG. Although the case of setting the image mute function has been described based on, the present invention is not limited to this. The control unit 250 may set the image mute function based on at least one of the instruction information JC and the response information JR. For example, the control unit 250 may set the image mute function based on the instruction information JC and the response information JR.

Further, in the present embodiment, with reference to FIG. 2, the case where the voice assistant control unit 241 sets the voice mute function based on the response information JR will be described, and with reference to FIG. 241 sets the audio mute function based on the instruction information JC, but the present invention is not limited to this. The voice assistant control unit 241 may set the voice mute function based on at least one of the instruction information JC and the response information JR. For example, the voice assistant control unit 241 may set the voice mute function based on the instruction information JC and the response information JR.

In this embodiment, the case where the "display device" is the first projector 200A or the second projector 200B has been described, but the present invention is not limited to this. The “display device” may be, for example, a display such as an LCD (Liquid Crystal Display).

Moreover, each functional unit shown in FIGS. 1 and 4 shows a functional configuration, and a specific implementation form is not particularly limited. That is, it is not always necessary to implement hardware corresponding to each functional unit individually, and it is also possible to adopt a configuration in which one processor executes a program to realize the functions of a plurality of functional units. Further, a part of the functions realized by software in the above embodiments may be realized by hardware, or a part of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of each of the first projector 200A, the second projector 200B, and the voice assistant device 300 can be arbitrarily changed without departing from the scope.

Also, the processing unit of the flowchart shown in FIG. 3 is divided according to the main processing content in order to facilitate understanding of the processing of the control unit 250 and the voice assistant control unit 241 of the first projector 200A. There are no restrictions on the division method or names of the processing units shown in the respective flowcharts of FIG. can also be split to include the processing of Also, the processing order of the above flowchart is not limited to the illustrated example.

In addition, the control method of the second display system 1B causes the processor 253 included in the second projector 200B to execute a control program corresponding to the control method of the second display system 1B, and causes the processor 241B included in the voice assistant device 300 to It can be realized by executing a control program corresponding to the control method of the two-display system 1B. These control programs can also be recorded in a computer-readable recording medium. A magnetic or optical recording medium or a semiconductor memory device can be used as the recording medium. Specifically, flexible disks, HDDs, CD-ROMs (Compact Disk Read Only Memory), DVDs, Blu-ray (registered trademark) Discs, magneto-optical disks, flash memories, card-type recording media, and other portable or fixed recording medium of the formula. Also, the recording medium may be a non-volatile storage device such as RAM, ROM, HDD, etc., which is an internal storage device provided in the second projector 200B or the voice assistant device 300 . Also, a control program corresponding to the control method of the second display system 1B is stored in a server device or the like, and each control program is downloaded from the server device to the second projector 200B and the voice assistant device 300, whereby the second display can be performed. The control method of system 1B can also be implemented.

Also, the control method of the first projector 200A is such that a control program corresponding to the control method of the first projector 200A is installed in each of the processor 253 of the control unit 250 and the processor 241B of the voice assistant control unit 241 provided in the first projector 200A. This can be achieved by executing These control programs can also be recorded in a computer-readable recording medium. A magnetic or optical recording medium or a semiconductor memory device can be used as the recording medium. Specific examples include portable or fixed recording media such as flexible discs, HDDs, CD-ROMs, DVDs, Blu-ray (registered trademark) discs, magneto-optical discs, flash memories, and card-type recording media. . Also, the recording medium may be a non-volatile storage device such as a RAM, ROM, HDD, etc., which is an internal storage device provided in the first projector 200A. Also, a control program corresponding to the control method of the first projector 200A is stored in a server device or the like, and each control program is downloaded from the server device to the first projector 200A, thereby realizing the control method of the first projector 200A. You can also

1 Display system 1A First display system 1B Second display system 5 Remote controller 51 Microphone 100 Server device 200A First projector (display device) 200B Second projector (display device ), 210...Projection section 211...Light source section 212...Light modulation device 213...Projection optical system 215...Liquid crystal panel 220...Drive section 221...Light source drive section 222...Light modulation device drive section 231... Second operation unit 241 Voice assistant control unit (voice assistant device) 241A Memory 241B Processor 245 Image processing unit 247 Speaker 248 Microphone 249 Wireless communication unit 250 Control unit 251...Memory, 253...Processor, 300...Voice assistant device, JC...Instruction information, JR...Response information, PL...Image light, PW...Image, SC...Screen.

Claims (6)

A control method for a display system comprising a voice assistant device communicatively connected to a server device and a display device communicatively connected to the voice assistant device,
The voice assistant device is
Receiving voice instructions from the user,
sending instruction information corresponding to the received instruction to the server device;
receiving response information corresponding to the instruction information from the server device;
The display device
configured to be switchable between a first state in which an image is displayed and a second state in which image display is stopped;
switching from the second state to the first state based on at least one of the instruction information and the response information;
displaying an image corresponding to the response information;
How to control the display system. The display device
switching from the first state to the second state after the display of the image corresponding to the response information is completed;
A method of controlling a display system according to claim 1 . The display device
maintaining the second state if the response information does not include image information;
3. A method of controlling a display system according to claim 1 or 2. The voice assistant device is
If the response information includes audio information, cancel audio mute that prohibits output of audio from the speaker;
The display system control method according to any one of claims 1 to 3. A control method for a display device comprising a voice assistant device communicatively connected to a server device, comprising:
The voice assistant device is
Receiving voice instructions from the user,
sending instruction information corresponding to the received instruction to the server device;
receiving response information corresponding to the instruction information from the server device;
The display device
configured to be switchable between a first state in which an image is displayed and a second state in which image display is stopped;
switching from the second state to the first state based on at least one of the instruction information and the response information;
displaying an image corresponding to the response information;
Display device control method. A display system comprising a voice assistant device communicatively connected to a server device and a display device communicatively connected to the voice assistant device,
The voice assistant device is
Receiving voice instructions from the user,
sending instruction information corresponding to the received instruction to the server device;
receiving response information corresponding to the instruction information from the server device;
The display device
configured to be switchable between a first state in which an image is displayed and a second state in which image display is stopped;
switching from the second state to the first state based on at least one of the instruction information and the response information;
displaying an image corresponding to the response information;
display system.

Images