JP2019018771A - On-vehicle system - Google Patents

Abstract

To provide an on-vehicle system for reducing discomfort applied to other occupants other than a user who performs an operation due to output of an operation sound of a mobile device.SOLUTION: When an operation for controlling a mobile device to a touch panel of a touch panel display unit 13 for left rear seat is performed by a user, a control part 17 stores a touch panel display unit 13 for left rear seat as an operation source touch panel display unit, then, sends a control signal for remote operating the mobile device. The mobile device which received the control signal transfers as a feedback, the operation sound to the control device 17, then the control device 17 which received the operation sound outputs the operation sound from only a rear left speaker 16 which is a speaker corresponding to the touch panel display unit 13 for left rear seat which is stored as the operation source touch panel display unit.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a technique for outputting an operation sound as feedback for a user operation in an in-vehicle system.

  As a technique for outputting an operation sound as feedback to a user's operation, a technique for outputting an operation sound that differs according to the driving state of the vehicle in an in-vehicle system (for example, Patent Document 1) or an application operated in the in-vehicle system There is known a technique (for example, Patent Document 2) that outputs different operation sounds according to the frequency.

  In addition, the output screen and output sound of the application being executed on the mobile device are transferred from the mobile device to the in-vehicle system connected to the mobile device and output from the display device or speaker of the in-vehicle system. A technique for remotely operating a mobile device from an in-vehicle system according to an accepted operation is also known (for example, Patent Document 3).

JP 2016-179723 A JP 2015-20640 A JP 2013-191979 A

  In a vehicle-mounted system, when a mobile device connected to the vehicle-mounted system is remotely operated from the vehicle-mounted system, an operation sound may be transferred from the mobile device to the vehicle-mounted system as feedback of the remote operation. In this case, if the operation sound transferred from the mobile device is output from the speaker of the in-vehicle system, the following problem occurs.

  That is, when there are a plurality of passengers in an automobile, the operation sound is meaningless for other passengers other than the user who performed the operation, and the other passengers feel uncomfortable with the output of the operation sound from the speaker. Will be given.

  Therefore, the present invention has an object to reduce the discomfort of passengers other than the user who performed the operation due to the output of the operation sound transferred from the connected mobile device in the in-vehicle system. And

  In order to achieve the object, the present invention provides a screen displayed on the display when a plurality of displays, a plurality of audio output devices, and the mobile device are connected to an in-vehicle system to which a mobile device can be connected. Control means for remotely operating the mobile device in response to a user operation, and storing a value associated in advance with a display on which the user operation is performed on a displayed screen as an operation source identifier; The operation sound transferred from the mobile device as feedback of the remote operation is obtained only from a part of the sound output devices determined according to the stored value of the operation source identifier among the plurality of sound output devices. Operation sound output control means for outputting is provided.

  Here, in such an in-vehicle system, the plurality of displays are arranged so that seats suitable for visual recognition are different from each other, and an audio output device determined according to a value of the operation source identifier is set as the plurality of audio outputs. It is good also as an audio | voice output apparatus arrange | positioned near the seat suitable for visual recognition of the display with which the value of the said operation origin identifier was matched among apparatuses.

In such an in-vehicle system, each of the plurality of audio output devices may be a speaker or a headphone.
Further, in such an in-vehicle system, as the plurality of displays, a first display disposed in front of the front seat and a second display disposed at a position rearward of the first display in front of the rear seat. The plurality of audio output devices are provided with a first speaker disposed on the front seat side and a second speaker disposed on the rear seat side, and according to the value of the operation source identifier. When the display associated with the value of the operation source identifier is the first display, the audio output device to be determined is the first speaker, and the display associated with the value of the operation source identifier is the In the case of a second display, the second speaker may be used.

  Further, the above in-vehicle system is provided with a touch panel provided on the display surface of the corresponding display corresponding to each display, and is displayed on the display by the control means. You may comprise so that the user operation with respect to the screen may be received by operation of the said touch panel corresponding to the said display.

  In order to achieve the above object, the present invention provides a vehicle-mounted system to which a mobile device can be connected, wherein a plurality of fixedly installed input devices, a plurality of audio output devices, and the mobile device are connected. In response to a user operation on the input device, the mobile device is remotely operated, and a control unit that stores a value previously associated with the input device on which the user operation has been performed as an operation source identifier; The operation sound output from the mobile device as feedback is output from only a part of the sound output devices determined according to the stored value of the operation source identifier among the plurality of sound output devices. Output control means.

  Here, in such an in-vehicle system, the plurality of input devices are arranged so that the seats near the input devices are different from each other, and the audio output device determined according to the value of the operation source identifier is It is good also as an audio | voice output apparatus arrange | positioned near the seat near the input apparatus with which the value of the said operation origin identifier was matched among several audio | voice output apparatuses.

  According to these in-vehicle systems, the operation sound transferred from the mobile device can be output as a response to the operation only from the sound output device near the user who operated the mobile device via the in-vehicle system. it can. Therefore, it is possible to reduce discomfort to passengers other than the user who performed the operation due to the output of the operation sound transferred from the mobile device.

  As described above, according to the present invention, in the in-vehicle system, the output of the operation sound transferred from the connected mobile device may cause discomfort to passengers other than the user who performed the operation. Can be reduced.

It is a block diagram which shows the structure of the vehicle-mounted system which concerns on embodiment of this invention. It is a figure which shows arrangement | positioning of the vehicle-mounted system which concerns on embodiment of this invention. It is a flowchart which shows the remote operation process which concerns on embodiment of this invention. It is a sequence diagram which shows the process example of the remote operation process which concerns on embodiment of this invention. It is a figure which shows the other structural example of the vehicle-mounted system which concerns on embodiment of this invention.

Hereinafter, embodiments of the present invention will be described.
FIG. 1 shows a configuration of an in-vehicle system according to the present embodiment.
The in-vehicle system is a system mounted on an automobile. As shown in the drawing, the front touch panel display unit 11, the right rear seat touch panel display unit 12, the left rear seat touch panel display unit 13, the front speaker 14, the rear right speaker 15, A rear left speaker 16, a control device 17, and peripheral devices 18 such as a storage device, a disk drive, a broadcast receiving device, and a GPS receiver are provided.

  Here, the front touch panel display unit 11, the right rear seat touch panel display unit 12, and the left rear seat touch panel display unit 13 are devices in which a display and a touch panel are integrated.

  As shown in FIGS. 2a and 2b, the front touch panel display unit 11 is installed in the dashboard at a central position in the left-right direction in front of the front seat, and the right rear seat touch panel display unit 12 is behind the right front seat. The left rear seat touch panel display unit 13 is installed behind the left front seat.

  As shown in FIGS. 2a and 2b, the front speaker 14 is a front passenger's speaker and is installed on the left and right front doors. The rear right speaker 15 and the rear left speaker 16 are The rear speaker 15 is installed on the right rear door, and the rear left speaker 16 is installed on the left rear door.

  Returning to FIG. 1, the control device 17 of the in-vehicle system 1 includes a video output control unit 171 that controls display on the display of the front touch panel display unit 11, the right rear seat touch panel display unit 12, and the left rear seat touch panel display unit 13. , A front touch panel display unit 11, a right rear seat touch panel display unit 12, a touch operation input unit 172 that receives an input of a user's touch operation performed on the touch panel of the left rear seat touch panel display unit 13, a front speaker 14, Audio output control unit 173 that controls audio output to the rear right speaker 15, rear left speaker 16, peripheral device control unit 174 that controls the peripheral device 18, the mobile device 2, USB, Bluetooth (registered trademark), Wi-F A mobile device interface 175 that communicates with the mobile device 2 through a communication interface such as i is provided, a control unit 176 that controls each of the above units, and a plurality of applications 177. The mobile device 2 is a device carried by the user, such as a smartphone or a tablet device.

  Here, each application 177 performs display on each touch panel display unit using the function of the video output control unit 171 via the control unit 176, or the function of the touch operation input unit 172 via the control unit 176. The touch operation performed on each touch panel display unit is received and a predetermined process is performed, or a sound is output to each speaker using the function of the audio output control unit 173 via the control unit 176. Each peripheral device 18 can be used by utilizing the function of the peripheral device control unit 174 via the control unit 176.

  The application 177 is, for example, a navigation application that performs route guidance on a map, an AV player application that performs reproduction output of audio content or visual content, and the like.

  The above control device 17 may be configured using a computer having a CPU, a memory, and peripheral circuits. In this case, each part of the control device 17 is realized by the CPU executing a computer program. It may be done.

  Now, when the mobile device 2 is connected to the mobile device interface 175, the control unit 176 transmits the video stream and screen transferred from the mobile device 2 according to the user settings via the video output control unit 171. The audio stream other than the operation sound displayed on the display of the touch panel display unit designated by the user and transferred from the mobile device 2 is output to the speaker designated by the user.

  The control unit 176 also displays the remote operation acceptance screen of the mobile device 2 transferred from the mobile device 2 or the mobile generated by the control unit 176 when the mobile device 2 is connected to the mobile device interface 175. The remote operation acceptance screen of the device 2 is displayed on the display of the touch panel display unit designated by the user via the video output control unit 171, and the user operation on the mobile device 2 by the operation of the touch panel of the touch panel display unit is performed. The remote operation process which receives and controls the mobile apparatus 2 is performed.

FIG. 3 shows a procedure of remote operation processing performed by the control unit 176.
As shown in the figure, the control unit 176 monitors the occurrence of a user operation on the mobile device 2 due to a touch operation on the touch panel of the touch panel display unit displaying a screen for accepting a remote operation of the mobile device 2 in the remote operation processing ( Step 302).

  Then, if a user operation on the mobile device 2 occurs, the identification of the touch panel display unit on which the touch operation has been performed is stored as the identification of the operation source touch panel display unit (step 304).

  Then, a control signal corresponding to the generated user operation is transmitted to the mobile device 2 via the mobile device interface 175, and the mobile device 2 is remotely operated so that the operation corresponding to the generated user operation is performed in the mobile device 2. (Step 306).

  Next, a timer that sets a predetermined timeout time (for example, 0.5 seconds) is started (step 308), the time-out of the timer occurs (step 310), and an operation that is feedback of the mobile device 2 to the remote operation The occurrence of transfer of sound from the mobile device 2 (step 312) is monitored.

If a timeout has occurred (step 310), the processing returns to step 302.
On the other hand, when the operation sound is transferred from the mobile device 2 (step 312), the operation sound is transferred only from the speaker corresponding to the touch panel display unit indicated by the identification of the operation source touch panel display unit stored in step 304. An operation sound is output (step 314). Then, the processing returns to step 302.

Here, in step 314, the touch panel display unit indicated by the identification of the operation source touch panel display unit is
If the front touch panel display unit 11 is used, the speaker corresponding to the front touch panel display unit 1 is used as the front speaker 14 and the operation sound is output only from the front speaker 14. If the touch panel display unit indicated by the identification of the touch panel display unit as the operation source is the right rear seat touch panel display unit 12, the rear right speaker is defined as the rear right speaker 15 corresponding to the right rear seat touch panel display unit 12. Operation sound is output from 15 only. If the touch panel display unit indicated by the identification of the operation source touch panel display unit is the left rear seat touch panel display unit 13, the speaker corresponding to the left rear seat touch panel display unit 13 is used as the rear left speaker 16, and the rear left speaker. The operation sound is output from only 16.

  However, when the touch panel display unit indicated by the identification of the operation source touch panel display unit is the right rear seat touch panel display unit 12 or the left rear seat touch panel display unit 13, the right rear seat touch panel display unit 12 or the left The speakers corresponding to the rear-seat touch panel display unit 13 may be the rear right speaker 15 and the rear left speaker 16, and the operation sound may be output only from the rear right speaker 15 and the rear left speaker 16.

The remote operation process performed by the control unit 176 has been described above.
Hereinafter, a processing example of such remote operation processing will be shown.
Here, the case where the in-vehicle system 1 uses the music playback function of the mobile device 2 connected to the control device 17 will be described as an example.
As shown in FIG. 4, the music playback function of the mobile device 2 transfers the sound of the music 1 being played back to the control device 17 (401), and the control device 17 transmits the sound of the music 1 transferred according to the user setting. When the user performs a skip operation (411) for instructing to skip the playback music piece of the mobile device 2 on the touch panel of the front touch panel display unit 11 during output to the front speaker 14 (402), An operation signal indicating the operation performed on the touch panel from the touch panel display unit 11 is output to the control device 17 (412). The control device 17 that has recognized the occurrence of the skip operation from the operation signal stores the front touch panel display unit 11 as the operation source touch panel display unit, and transmits a control signal requesting the mobile device 2 to skip the reproduced music (413). ).

  The mobile device 2 that has received the control signal transfers the operation sound as feedback to the control device 17 (414), and the control device 17 that has received the operation sound stores the front touch panel display unit 11 stored as the operation source touch panel display unit. The operation sound is output only from the front speaker 14 which is a speaker corresponding to (415). Note that the music sound and the operation sound are transferred from the mobile device 2 to the control device 17 as separate audio streams. Then, the control device 17 outputs the sound of the audio stream of the operation sound from the front speaker 14 while continuing to output the sound of the audio stream of the music from the front speaker 14 as it is.

In addition, the mobile device 2 that has received the control signal for requesting skipping of the playback music changes the playback music to the music 2 and starts transferring the sound of the music 2 to the control device 17 (421).
Then, the music output from the front speaker 14 is switched to the music 2 (422).
After that, when the control device 17 outputs the sound of the music piece 2 transferred from the mobile device 2 to the front speaker 14, the user touches the touch panel of the left rear seat touch panel display unit 13 with respect to the touch panel display unit 13. When a skip operation for instructing to skip the playback music of the mobile device 2 is performed (431), an operation signal indicating the operation content performed on the touch panel is output from the left rear seat touch panel display unit 13 to the control device 17. (432). The control device 17 that has recognized the occurrence of the skip operation from the operation signal stores the left rear seat touch panel display unit 13 as the operation source touch panel display unit and transmits a control signal requesting the mobile device 2 to skip the reproduced music. (433).

  The mobile device 2 that has received the control signal transfers the operation sound as feedback to the control device 17 (434), and the control device 17 that has received the operation sound stores the touch panel for the left rear seat stored as the operation source touch panel display unit. An operation sound is output from only the rear left speaker 16 which is a speaker corresponding to the display unit 13 (435). As described above, the control device 17 outputs the sound of the audio stream of the operation sound from the rear left speaker 16 while continuing to output the sound of the audio stream of the music from the front speaker 14 as it is.

In addition, the mobile device 2 that has received the control signal requesting to skip the playback music changes the playback music to the music 3 and starts transferring the sound of the music 3 to the control device 17 (441).
Thus, the music output from the front speaker 14 is switched to the music 3 (442).
The embodiment of the present invention has been described above.
Thus, according to the present embodiment, the operation sound transferred from the mobile device 2 as a response to the operation is transmitted from only the speaker near the user who has operated the mobile device 2 via the touch panel display unit. Output. Therefore, it is possible to reduce discomfort to passengers other than the user who performed the operation due to the output of the operation sound transferred from the mobile device 2.

  By the way, in the above embodiment, the identification of the touch panel display unit where the user operation on the mobile device 2 is performed is stored as the identification of the touch panel display unit of the operation source, and the operation sound is identified by the touch panel display unit of the operation source. It is output from only the speaker corresponding to the touch panel display unit to be displayed. This is an arbitrary value as long as it is a value indicating the touch panel display unit in which the user operation on the mobile device 2 is performed or the speaker corresponding to the touch panel display unit. The value is stored as operation sound output control information instead of identifying the touch panel display unit of the operation source, and the operation sound is a speaker corresponding to the touch panel display unit indicated by the operation sound output control information, or the operation It may be output only to the speaker indicating output control information.

  Here, as such operation sound output control information, the identification information of the display of the touch panel display unit where the user operation on the mobile device 2 is performed, the identification of the touch panel of the touch panel display unit where the user operation is performed on the mobile device 2 Information, identification information of a speaker corresponding to the touch panel display unit on which a user operation on the mobile device 2 is performed, and the like can be used.

  Moreover, although the case where one touch panel display unit for front seats and two touch panel display units for rear seats are provided has been described in the above embodiment, the number and arrangement of touch panel display units may be arbitrary. However, when a user operation on the mobile device 2 is received by the touch panel display unit, the speaker that outputs the operation sound transferred from the mobile device 2 is located near the user who uses the touch panel display unit that has received the user operation. A speaker is used.

  In the above embodiment, the touch panel display unit in which the display and the touch panel are integrated has been described as receiving the user's operation on the mobile device 2. However, the user's operation is not limited to the remote control device of the in-vehicle system 1. You may make it accept by an input device.

  That is, for example, as shown in FIGS. 5a and 5b, as a display for the rear seat, a rear display 500 installed in a form suspended from the ceiling at a position substantially in the center of the passenger compartment in the front-rear and left-right directions is provided. As an operation for the remote operation acceptance screen of the mobile device 2 displayed on the screen, the remote control device 501 may accept the user's operation on the mobile device 2. When an operation for the mobile device 2 received by the user is received as an operation for the remote operation reception screen of the mobile device 2 displayed on the rear display 500, the operation sound transferred from the mobile device 2 as feedback for the operation is the rear. Output is made from the right speaker 15 and the rear left speaker 16.

  In the above embodiments, headphones may be used in place of at least some of the speakers or in combination with the speakers. That is, for example, a headphone for the right rear seat user and a headphone for the left rear seat user that can be selectively used are provided, and the rear right speaker 15 and the rear left speaker 16 are replaced according to the user's selection. The headphone for the right rear seat user or the headphone for the left rear seat user may be used for audio output to the right rear seat user or the left rear seat user. When the headphone for the right rear seat user or the headphone for the left rear seat user is used for audio output, when the mobile device 2 is operated on the touch panel of the right rear seat touch panel display unit 12, When the operation sound is output to the right rear seat user headphones and the mobile device 2 is operated with the touch panel of the left rear seat touch panel display unit 13, the operation sound is output to the left rear seat user headphones. Output to.

  DESCRIPTION OF SYMBOLS 1 ... In-vehicle system, 2 ... Mobile device, 11 ... Front touch panel display unit, 12 ... Right rear seat touch panel display unit, 13 ... Left rear seat touch panel display unit, 14 ... Front speaker, 15 ... Rear right speaker, 16 ... Rear left speaker, 17 ... control device, 18 ... peripheral device, 171 ... video output control unit, 172 ... touch operation input unit, 173 ... audio output control unit, 174 ... peripheral device control unit, 175 ... mobile device interface, 176 ... Control unit, 177 ... application, 500 ... rear display, 501 ... remote control device.

Claims (7)

An in-vehicle system that can be connected to a mobile device,
Multiple displays, multiple audio output devices,
When the mobile device is connected, the mobile device is remotely operated in response to a user operation on the screen displayed on the display, and the user operation is performed on the displayed screen. Control means for storing a value previously associated with the operation source identifier;
The operation sound transferred from the mobile device as feedback of the remote operation is obtained only from a part of the sound output devices determined according to the stored value of the operation source identifier among the plurality of sound output devices. An in-vehicle system comprising operation sound output control means for outputting. The in-vehicle system according to claim 1,
Each of the plurality of displays is arranged such that a seat suitable for visual recognition is different,
The sound output device determined according to the value of the operation source identifier is arranged near a seat suitable for visual recognition of the display associated with the value of the operation source identifier among the plurality of sound output devices. An in-vehicle system that is an audio output device. The in-vehicle system according to claim 1 or 2,
Each of the plurality of audio output devices is a speaker or a headphone. The in-vehicle system according to claim 1,
As the plurality of displays, a first display disposed in front of the front seat, and a second display disposed in a position behind the first display in front of the rear seat,
As the plurality of audio output devices, a first speaker arranged on the front seat side and a second speaker arranged on the rear seat side,
The audio output device determined according to the value of the operation source identifier is
When the display associated with the value of the operation source identifier is the first display, it is the first speaker;
When the display associated with the value of the operation source identifier is the second display, the in-vehicle system is the second speaker. The in-vehicle system according to claim 1, 2, 3, or 4,
Corresponding to each display, it has a touch panel provided in a form superimposed on the display surface of the corresponding display,
The in-vehicle system, wherein the control means accepts a user operation on a screen displayed on the display by an operation on the touch panel corresponding to the display. An in-vehicle system that can be connected to a mobile device,
A plurality of fixedly installed input devices, a plurality of audio output devices,
When the mobile device is connected, the mobile device is remotely operated in response to a user operation on the input device, and a value previously associated with the input device on which the user operation has been performed is an operation source identifier. Control means for storing as,
The operation sound transferred from the mobile device as feedback of the remote operation is obtained only from a part of the sound output devices determined according to the stored value of the operation source identifier among the plurality of sound output devices. An in-vehicle system comprising operation sound output control means for outputting. The in-vehicle system according to claim 6,
Each of the plurality of input devices is arranged such that a seat near the input device is different,
The audio output device determined according to the value of the operation source identifier is arranged near a seat near the input device associated with the value of the operation source identifier among the plurality of audio output devices. An in-vehicle system that is an audio output device.