JP2021174236A - Control device, computer program, and control system - Google Patents

Abstract

To improve operability of a controlled device capable of executing a plurality of functions.SOLUTION: An operation accepting device 11 outputs an operation detection signal OS corresponding to an operation inputted by a user. A voice accepting device 12 outputs a voice detection signal VS corresponding to a voice uttered by the user. A control device 13 outputs a first control signal CS1 for causing a controlled device 14 to execute a first function, on the basis of the operation detection signal OS. When accepting the voice detection signal VS corresponding to a prescribed voice, the control device 13 outputs a second control signal CS2 for causing the controlled device 14 to execute a second function different from the first function, on the basis of the operation detection signal OS.SELECTED DRAWING: Figure 1

Description

The present invention relates to a control device that causes a controlled device to perform a plurality of functions. The present invention also relates to a computer program executed by a processing unit of the control device and a control system including the control device.

Patent Document 1 discloses a control device mounted on a moving body to control the operation of a display device which is an example of a controlled device. The device has an operation surface that accepts operations by the fingers of the occupant of the moving body. The operation of the display device is controlled according to the operation input to the operation surface.

Japanese Unexamined Patent Publication No. 2016-115121

An object of the present invention is to improve the operability of a controlled device capable of performing a plurality of functions.

One aspect for achieving the above object is a control device.
A reception unit that receives an operation detection signal corresponding to an operation input by the user and a voice detection signal corresponding to the voice emitted by the user.
A processing unit that causes the controlled device to execute the first function based on the operation detection signal, and
Is equipped with
When the receiving unit receives the voice detection signal corresponding to the specified voice, the processing unit causes the controlled device to execute a second function different from the first function based on the operation detection signal.

One aspect of achieving the above object is a computer program executed by a processing unit of a control device.
By being executed, the control device
The controlled device is made to execute the first function based on the operation detection signal corresponding to the operation input by the user.
When the voice detection signal corresponding to the specified voice emitted by the user is received, the controlled device is made to execute a second function different from the first function based on the operation detection signal.

One aspect of achieving the above objectives is a control system.
Controlled device and
An operation reception device that outputs an operation detection signal corresponding to the operation input by the user,
A voice reception device that outputs a voice detection signal corresponding to the voice emitted by the user, and
A control device that causes the controlled device to execute the first function based on the operation detection signal, and
Is equipped with
When the control device receives the voice detection signal corresponding to the specified voice, the control device causes the controlled device to execute a second function different from the first function based on the operation detection signal.

According to the configuration according to each of the above aspects, the user's operation input to the operation receiving device can be assigned not only to a plurality of functions that can be executed by the controlled device, but also from a state in which the first function can be executed. The transition to a state in which the second function can be executed can be performed by emitting a specified voice. Since the seamless feeling that can be given to the user when switching the functions is enhanced, the operability of the controlled device capable of executing a plurality of functions can be enhanced.

The functional configuration of the control system according to one embodiment is illustrated. An example is a vehicle equipped with the control system of FIG. The flow of processing executed by the control device of FIG. 1 is illustrated. The operation of the control system of FIG. 1 is illustrated. The operation of the control system of FIG. 1 is illustrated. The operation of the control system of FIG. 1 is illustrated.

An example of the embodiment will be described in detail below with reference to the accompanying drawings. FIG. 1 illustrates the functional configuration of the control system 10 according to the embodiment.

The control system 10 can be mounted on a vehicle 20 having a passenger compartment illustrated in FIG. The vehicle 20 is an example of a moving body.

As illustrated in FIG. 1, the control system 10 includes an operation receiving device 11. The operation receiving device 11 is configured to receive an operation by the user and output an operation detection signal OS corresponding to the operation. The operation detection signal OS may be an analog signal or a digital signal.

As an example, the operation receiving device 11 may be a touch pad device mounted on the steering wheel 21 or the center cluster 22 illustrated in FIG. As another example, the operation receiving device 11 may be a touch panel device that is a part of the display device 23 arranged in the center cluster 22.

As illustrated in FIG. 1, the control system 10 includes a voice receiving device 12. The voice receiving device 12 is configured to detect the voice emitted by the user and output the voice detection signal VS corresponding to the voice. The voice receiving device 12 can be realized by, for example, a sound collecting microphone device arranged at an appropriate position in the vehicle interior of the vehicle 20. The voice detection signal VS may be an analog signal or a digital signal.

The control system 10 includes a control device 13. The control device 13 includes a reception unit 131 and a processing unit 132. The reception unit 131 is configured to receive the operation detection signal OS from the operation reception device 11 and the voice detection signal VS from the voice reception device 12. When at least one of the operation detection signal OS and the voice detection signal VS is an analog signal, the reception unit 131 may include an appropriate conversion circuit including an A / D converter. The processing unit 132 processes the operation detection signal OS and the voice detection signal VS, which are in the form of digital data.

The control device 13 includes an output unit 133. The processing unit 132 is configured to output either the first control signal CS1 or the second control signal CS2 from the output unit 133 based on the operation detection signal OS. The first control signal CS1 and the second control signal CS2 may be analog signals or digital signals. When the first control signal CS1 and the second control signal CS2 are analog signals, the output unit 133 may include an appropriate conversion circuit including a D / A converter.

The control system 10 includes a controlled device 14. The first control signal CS1 and the second control signal CS2 output from the output unit 133 are input to the controlled device 14. The controlled device 14 is configured to execute the first function based on the first control signal CS1 and execute the second function based on the second control signal CS2. The first function and the second function are different. That is, the controlled device 14 is configured to execute either the first function or the second function based on the operation detection signal OS output from the operation receiving device 11.

FIG. 3 illustrates a flow of processing executed by the processing unit 132 of the control device 13 configured as described above.

The processing unit 132 determines whether the reception unit 131 has received the operation detection signal OS from the operation reception device 11 (STEP 1). The determination is repeated until the operation detection signal OS is accepted (NO in STEP1).

When it is determined that the reception unit 131 has received the operation detection signal OS from the operation reception device 11 (YES in STEP 1), the processing unit 132 transmits the first control signal CS1 to the controlled device 14 through the output unit 133 (YES in STEP 1). STEP2). The first control signal CS1 causes the controlled device 14 to execute the operation related to the first function based on the user's operation received by the operation receiving device 11.

Subsequently, the processing unit 132 determines whether the reception unit 131 has received the voice detection signal VS corresponding to the specific voice specified in advance from the voice reception device 12 (STEP 3). If it is determined that the voice detection signal VS corresponding to the voice is not accepted (NO in STEP3), the process returns to STEP1.

When it is determined that the reception unit 131 has received the voice detection signal VS corresponding to the specific voice specified in advance from the voice reception device 12 (YES in STEP 3), the processing unit 132 first determines based on the operation detection signal OS. The transition from the state of outputting the control signal CS1 to the state of outputting the second control signal CS2 based on the operation detection signal OS.

Subsequently, the processing unit 132 determines whether the reception unit 131 has received the operation detection signal OS from the operation reception device 11 (STEP 4). The determination is repeated until the operation detection signal OS is accepted (NO in STEP4).

When it is determined that the reception unit 131 has received the operation detection signal OS from the operation reception device 11 (YES in STEP 4), the processing unit 132 transmits the second control signal CS2 to the controlled device 14 through the output unit 133 (YES in STEP4). STEP5). The second control signal CS2 causes the controlled device 14 to execute the operation related to the second function based on the user's operation received by the operation receiving device 11.

According to the above configuration, the user's operation input to the operation receiving device 11 can be assigned not only to a plurality of functions that can be executed by the controlled device 14, but also from a state in which the first function can be executed. The transition to a state in which the second function can be executed can be performed by emitting a specified voice. Since the seamless feeling that can be given to the user when switching the functions is enhanced, the operability of the controlled device 14 capable of executing a plurality of functions can be enhanced.

As an example, the controlled device 14 can be the display device 23 illustrated in FIG. The display device 23 is configured to display map information related to a car navigation system, library information related to an audiovisual device, and the like as images. As the first function, the display device 23 scrolls the image in the direction corresponding to the user's operation input to the operation reception device 11. As a second function, the display device 23 displays a drawing corresponding to the user's operation input to the operation reception device 11 on the image.

An example of the operation of the control system 10 including the display device 23 as the controlled device 14 will be described with reference to FIGS. 4 to 6. In each figure, a map image M related to a car navigation system is exemplified as an image displayed on the display device 23. In this example, the operation reception device 11 is a touch panel device provided on at least a part of the screen on which the map image M is displayed on the display device 23. The touch panel device is arranged so as to overlap at least a part of the images illustrated in each figure.

In the initial state illustrated in FIG. 4, the first function is enabled in the display device 23. When the user performs an operation of tracing the surface of the touch panel device, the map image M displayed on the display device 23 scrolls in the traced direction. That is, the first function supports an operation of locating a place on the map desired by the user within the screen of the display device 23.

The operation illustrated in FIG. 4 will be described again with reference to FIG. The processing unit 132 of the control device 13 determines whether the reception unit 131 has received the operation detection signal OS corresponding to the operation of tracing the surface of the touch panel device as the operation reception device 11 (STEP 1).

When the tracing operation is performed by the user, the reception unit 131 receives the operation detection signal OS corresponding to the tracing direction. For example, the operation detection signal OS may include the time-dependent change of the position where the change in capacitance occurs on the touch panel device as information. The processing unit 132 can determine the direction of the tracing operation based on the moving direction of the position.

The processing unit 132 outputs the first control signal CS1 that scrolls the map image M displayed on the display device 23 in the direction corresponding to the tracing operation from the output unit 133 (STEP2).

In this example, the display device 23 has a function of displaying the position of a specific facility on a map image. Examples of specific facilities include parking lots, gas stations, convenience stores, and various restaurants. The second function of the display device 23 supports the setting of conditions for displaying the position of a specific facility on the map image M. Specifically, a tracing operation on the touch panel device is used to specify a range on a map in which the location of a specific facility is desired to be displayed.

In order to enable the second function of the display device 23, the user speaks a word corresponding to the desired information. For example, when a user wants to know the location of a parking lot located within a specific range on a map, he or she speaks "parking lot". "Parking lot" is an example of a predetermined voice.

When the voice reception device 12 receives the voice "parking lot", the display device 23 activates the second function and transitions to a state of accepting an operation for designating a specific range on the map. As illustrated in FIG. 5, when the user performs an operation of tracing the surface of the touch panel device, a line L is drawn on the map image M so as to follow the operation. The line L is used to specify a range on the map that the user wants.

Specifically, the processing unit 132 acquires the geographical position information corresponding to the area on the map surrounded by the figure drawn by the line L as a search condition. Geolocation information is obtained, for example, as a combination of latitude range and longitude range.

As illustrated in FIG. 1, the control device 13 includes a storage unit 134. The storage unit 134 stores various data that can be included in the map image M displayed on the display device 23. The storage unit 134 can be realized by a semiconductor memory or a hard disk device.

When a specific area is designated by the line L, the processing unit 132 searches for the parking lot position data stored in the storage unit 134 that is included in the area. Specifically, the processing unit 132 includes the geographical position information corresponding to the area surrounded by the figure drawn by the line L among the data stored in the storage unit 134, and the type information of "parking lot". Data having both of the above is searched. As a result, as illustrated in FIG. 6, the position P of the parking lot located in the designated area is displayed on the map image M.

The operations illustrated in FIGS. 5 and 6 will be described again with reference to FIG. The processing unit 132 of the control device 13 determines whether the reception unit 131 has received the voice detection signal VS corresponding to the voice “parking lot” (STEP 3).

The processing unit 132 determines the degree of coincidence between the voice information corresponding to the voice detection signal VS and the voice information "parking lot" stored in advance in the storage unit 134. When the degree of agreement exceeds the threshold value, the processing unit 132 determines that the reception unit 131 has received the voice detection signal VS corresponding to the voice "parking lot".

When it is determined that the reception unit 131 has received the voice detection signal VS corresponding to the voice "parking lot", the processing unit 132 outputs the first control signal CS1 based on the operation detection signal OS, and then the operation detection signal. It transitions to the state of outputting the second control signal CS2 based on the OS.

Subsequently, the processing unit 132 determines whether the reception unit 131 has received the operation detection signal OS corresponding to the operation of tracing the surface of the touch panel device as the operation reception device 11 (STEP 4).

When the tracing operation is performed by the user, the reception unit 131 receives the operation detection signal OS corresponding to the tracing locus. The processing unit 132 can determine the tracing locus based on the time-dependent change of the position where the change in capacitance occurs on the touch panel device.

The processing unit 132 outputs a second control signal CS2 from the output unit 133 to cause the display device 23 to draw a line L following the trace locus on the map image M (STEP 5).

According to the configuration as in this example, the same operation of the user input to the touch panel device can be assigned not only to a plurality of functions that can be executed by the display device 23, but also from a state in which the first function can be executed. (Ii) The transition to a state in which the function can be executed can be performed by emitting a specified voice. Since it is not necessary to remove the finger from the touch panel device for the operation of switching the function, the seamless feeling that can be given to the user can be further enhanced.

The same effect can be expected when the operation reception device 11 is realized by the touch pad device mounted on the steering wheel 21 or the center cluster 22.

In the case of this example, the processing unit 132 searches for the position of the "parking lot" based on the voice detection signal VS corresponding to the word "parking lot", and displays the search result of the position on the display device 23. There is. That is, the processing unit 132 performs a data search based on the voice detection signal VS corresponding to the word for enabling the search support function, and displays the result of the data search on the display device 23. Since the utterance of the word used for the search is used as a trigger for the transition from the state in which the scroll function is enabled to the state in which the search support function is enabled, the seamlessness that can be given to the user when transitioning to the search operation is enhanced. be able to.

However, as illustrated in FIG. 3, the transition from the state in which the first function is enabled to the state in which the second function is enabled may be made by activating the voice recognition function by the control device 13. The voice recognition function can be activated, for example, by operating an activation switch arranged at an appropriate position on the steering wheel 21 or the center cluster 22. Alternatively, the voice recognition function may be activated by detecting the utterance of the keyword by the user through the voice reception device 12. Examples of keywords include "search" and "tell me".

Specifically, in a situation where the first function is effective, the processing unit 132 determines whether the voice recognition function has been activated through the above method (STEP 6). If it is determined that the voice recognition function has not been activated (NO in STEP 6), the process returns to STEP 1. When it is determined that the voice recognition function has been activated (YES in STEP 6), the state transitions to the state in which the second function is enabled, and the process proceeds to STEP 3.

According to such a configuration, when a predetermined word is accidentally included in the conversation of the user, it is possible to suppress the occurrence of a situation in which the transition to the state in which the second function is enabled is unexpectedly made.

The processing unit 132 having various functions described so far can be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of general-purpose microprocessors include CPUs, MPUs, and GPUs. A ROM or RAM can be exemplified as a general-purpose memory. In this case, the ROM may store a computer program that executes the above-described processing. The ROM is an example of a storage medium that stores a computer program. The processor specifies at least a part of the computer program stored in the ROM, expands it on the RAM, and performs the above-described processing in cooperation with the RAM. The storage unit 134 may be realized by the general-purpose memory described above.

The processing unit 132 having various functions described so far may be realized by a dedicated integrated circuit capable of executing the above-mentioned computer program such as a microcontroller, ASIC, and FPGA. In this case, the above computer program is pre-installed in the storage element included in the dedicated integrated circuit. The storage element is an example of a storage medium that stores a computer program. The storage unit 134 may be realized by the storage element. The processing unit 132 can also be realized by a combination of a general-purpose microprocessor and a dedicated integrated circuit.

The general-purpose microprocessor or dedicated integrated circuit that executes the search process related to the second function is a general-purpose microprocessor or a general-purpose microprocessor that executes a process of generating an appropriate first control signal CS1 or second control signal CS2 based on the operation detection signal OS. It may be different from the dedicated integrated circuit.

The storage unit 134 may be realized by a server device capable of transmitting and receiving data via the control device 13 and the communication network.

The above embodiments are merely examples for facilitating the understanding of the present invention. The configuration according to the above embodiment may be appropriately changed or improved without departing from the spirit of the present invention.

In the example described with reference to FIGS. 4 to 6, the map image M is displayed on the display device 23, and the line L is traced in order to draw a line L that limits the range on the map for displaying the position of a specific facility. The operation is being used. That is, the location of a specific facility is an example of information to be searched. However, the image displayed on the display device 23 is not limited to the map image M, and the information to be searched is not limited to the location of a specific facility.

For example, a library list or playlist of music content or video content that can be played by an audiovisual device can be displayed on the display device 23. In this case, the line drawn through the tracing operation in the second function can be used to limit a specific genre, artist, or the like from the displayed list. Further, the drawing displayed on the display device 23 through the tracing operation is not limited to the figure. For example, in order to limit the genres and artists having a specific acronym from the displayed list, the acronym may be drawn.

In the above embodiment, as illustrated in FIG. 3, the process ends after the search result based on the second function is displayed. However, as shown by the broken line in the figure, the control device 13 can wait for the reception of the next operation detection signal OS while the second function is enabled. In this case, the operation detection signal OS or the voice detection signal VS for transitioning from the state in which the second function is valid to the state in which the first function is valid can be defined.

In the above embodiment, the image that provides information to the user is displayed on a screen that is a part of the display device 23. However, the display device 23 can be a projector device that projects an image containing predetermined information on the windshield 24 illustrated in FIG.

The control system 10 according to the above embodiment can be mounted on the vehicle 20. When the driver of a moving body such as the vehicle 20 is a user, the time during which the display device 23 can be visually observed is limited. However, according to the configuration according to the above embodiment, the function to which the operation assigned to the operation receiving device 11 is assigned can be changed by emitting the specified voice, so that the time for visually observing the display device 23 can be shortened.

The control system 10 can be applied to a moving body other than the vehicle 20. Examples of other mobiles include railroads, aircraft, ships and the like. The plurality of functions of the controlled device 14 to which the operation for the operation receiving device 11 is assigned can be appropriately determined according to the type of the moving body.

At least one of the operation reception device 11, the voice reception device 12, the control device 13, and the controlled device 14 included in the control system 10 does not need to be mounted on the moving body. For example, a mobile device that can be carried by a user includes an operation reception device 11 and a voice reception device 12, and an operation detection signal OS and voice detection for a stationary device including the control device 13 and the controlled device 14. A configuration in which the signal VS is transmitted wirelessly may be adopted.

10: Control system, 11: Operation reception device, 12: Voice reception device, 13: Control device, 131: Reception unit, 132: Processing unit, 14: Controlled device, 20: Vehicle, 23: Display device, M: Map Image, OS: Operation detection signal, P: Parking lot position, VS: Voice detection signal

Claims (8)

A reception unit that receives an operation detection signal corresponding to an operation input by the user and a voice detection signal corresponding to the voice emitted by the user.
A processing unit that causes the controlled device to execute the first function based on the operation detection signal, and
Is equipped with
When the receiving unit receives the voice detection signal corresponding to the specified voice, the processing unit causes the controlled device to execute a second function different from the first function based on the operation detection signal.
Control device. The controlled device is a display device and
As the first function, the processing unit scrolls the image displayed by the display device in the direction corresponding to the operation, and as the second function, draws the image corresponding to the operation on the display device. Display above,
The control device according to claim 1. The processing unit performs a data search based on the voice detection signal corresponding to the word included in the voice, and displays the result of the data search in the image.
The control device according to claim 2. The processing unit is configured to be able to execute a voice recognition function.
When the processing unit receives the voice detection signal corresponding to the specified voice in the state where the voice recognition function is activated, the first control device receives the voice detection signal based on the operation detection signal. Perform a second function that is different from the function,
The control device according to any one of claims 1 to 3. A computer program executed by the processing unit of the control device.
By being executed, the control device
The controlled device is made to execute the first function based on the operation detection signal corresponding to the operation input by the user.
When a voice detection signal corresponding to the specified voice emitted by the user is received, the controlled device is made to execute a second function different from the first function based on the operation detection signal.
Computer program. Controlled device and
An operation reception device that outputs an operation detection signal corresponding to the operation input by the user,
A voice reception device that outputs a voice detection signal corresponding to the voice emitted by the user, and
A control device that causes the controlled device to execute the first function based on the operation detection signal, and
Is equipped with
When the control device receives the voice detection signal corresponding to the specified voice, the control device causes the controlled device to execute a second function different from the first function based on the operation detection signal.
Control system. The controlled device is a display device and
At least a part of the screen on which the image is displayed on the display device is a part of the operation reception device.
The control system according to claim 6. The operation reception device, the voice reception device, the control device, and the controlled device are configured to be mounted on a moving body.
The control system according to claim 6 or 7.

Images