CN107783647B - Flexible screen input device and infotainment system - Google Patents

Flexible screen input device and infotainment system Download PDF

Info

Publication number
CN107783647B
CN107783647B CN201610799362.0A CN201610799362A CN107783647B CN 107783647 B CN107783647 B CN 107783647B CN 201610799362 A CN201610799362 A CN 201610799362A CN 107783647 B CN107783647 B CN 107783647B
Authority
CN
China
Prior art keywords
input
user
flexible screen
input device
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610799362.0A
Other languages
Chinese (zh)
Other versions
CN107783647A (en
Inventor
卢星旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Automotive Body Electronic System Wuhu Co Ltd
Original Assignee
Continental Investment China Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Investment China Co ltd filed Critical Continental Investment China Co ltd
Priority to CN201610799362.0A priority Critical patent/CN107783647B/en
Publication of CN107783647A publication Critical patent/CN107783647A/en
Application granted granted Critical
Publication of CN107783647B publication Critical patent/CN107783647B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Abstract

A flexible screen input device and infotainment system comprising: the flexible screen input device comprises a curved surface-shaped input surface, wherein the input screen is integrated with a multi-point touch control module for collecting contact and non-planar operations made by a user on the input surface, and is integrated with a force feedback module for providing operation feedback to the user after the input operation of the user, and the flexible screen input device further comprises: and the input processing module is used for processing the user input operation collected by the multi-point touch control module, generating corresponding input information and controlling the operation feedback. The flexible screen input device can meet the function which can be realized by a plurality of previous operation components, and saves the hardware cost. And, user operation is simplified.

Description

Flexible screen input device and infotainment system
Technical Field
The invention relates to the electronic technology of a vehicle body, in particular to a flexible screen input device and an information entertainment system.
Background
The current infotainment devices in vehicles can be controlled mainly by operating components such as keys, knobs, touch screens of the center control panel, buttons on the steering wheel, and the like. This undoubtedly increases the time of the operation since the user sometimes needs to confirm the position of the operation member to perform the corresponding operation.
In addition, when the user performs different function operations, different operation components also need to be operated, which also increases the complexity of the operations and is not ideal from the perspective of user experience.
Disclosure of Invention
The problem addressed by the present invention is to provide a flexible screen input device to enable a user to control an infotainment device in a simple and time-consuming manner.
In order to solve the above problems, the present invention provides a flexible screen input device including: the flexible screen input device comprises a curved surface-shaped input surface, wherein the input screen is integrated with a multi-point touch control module for collecting contact and non-planar operations made by a user on the input surface, and is integrated with a force feedback module for providing operation feedback to the user after the input operation of the user, and the flexible screen input device further comprises: an input processing module for processing the user input operation collected by the multi-point touch control module, generating corresponding input information and controlling the operation feedback,
the present invention also provides an infotainment system comprising: the flexible screen input device and the information entertainment function processing device; the flexible screen input device includes: the flexible screen input device comprises a curved surface-shaped input surface, wherein the input screen is integrated with a multi-point touch control module for collecting contact and non-planar operations made by a user on the input surface, and is integrated with a force feedback module for providing operation feedback to the user after the input operation of the user, and the flexible screen input device further comprises: the input processing module is used for processing the user input operation collected by the multi-point touch control module, generating corresponding input information, sending the corresponding input information to the information entertainment function processing device and controlling the operation feedback; and the infotainment function processing device performs corresponding processing and presents corresponding infotainment functions after obtaining the input information.
Compared with the prior art, the scheme has the following advantages: the stereo gesture generated by the non-planar operation can define richer information input and function control actions. When a user wants to input information or perform function control, only corresponding gesture actions need to be made on the input surface in the curved surface shape. Therefore, the flexible screen input device can meet the functions which can be realized by a plurality of operation parts before. Thereby also saving hardware costs. And the setting of the operation feedback also enables the user to know the operation process of the user at any time. Thus, time is not needed to confirm or search the position of the relevant operation part, and the time consumption is reduced when the operation is simplified.
Drawings
FIG. 1 is a schematic view of one embodiment of a flexible screen input device of the present invention;
FIG. 2 is a schematic view of another embodiment of a flexible screen input device of the present invention;
FIG. 3 is a schematic view of yet another embodiment of a flexible screen input device of the present invention;
FIG. 4 is a schematic view of one embodiment of the infotainment system of the present invention;
FIG. 5 is a schematic view of another embodiment of the infotainment system of the present invention;
FIG. 6 is a schematic diagram of an implementation of the flexible screen input device of the present invention;
FIG. 7 is a schematic view of one embodiment of the flexible screen input device of the present invention assembled in a vehicle;
FIG. 8 is a schematic diagram of an example of the operation of the infotainment system of the invention;
FIG. 9 is a schematic diagram of another example of the operation of the infotainment system of the invention.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present invention to those skilled in the art. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. Furthermore, it should be understood that the invention is not limited to the specific embodiments described. Rather, it is contemplated that the invention may be practiced with any combination of the following features and elements, whether or not they relate to different embodiments. Thus, the following aspects, features, embodiments and advantages are merely illustrative and should not be considered elements or limitations of the claims except where explicitly recited in a claim.
As described in the related art, when a user operates, for example, an infotainment device in a vehicle, it takes time to confirm the position of an operation member. Even if the touch screen is used for inputting or controlling, the operation position of the user cannot be known without looking at the screen because the operation surface provided by the touch screen is a plane at present. Moreover, in view of the plane limitation of the current touch screen, the gesture actions that can be supported by the touch screen are relatively limited, which also limits the action efficiency of inputting or controlling on the touch screen. Some settings or function items that are hidden deeper on a function menu, for example, may require multiple operations to be performed to achieve this.
In view of the above, the present invention is conceived to enable a user to know his/her own operation position when performing an input or control operation, and to reduce operation steps for achieving a certain function or achieving a certain input by using richer gestures.
Referring to fig. 1, an embodiment of a flexible screen input device according to the present invention includes: the flexible screen input device comprises a curved surface-shaped input surface, wherein the input screen is integrated with a multi-point touch control module for collecting contact and non-planar operations made by a user on the input surface, and is integrated with a force feedback module for providing operation feedback to the user after the input operation of the user, and the flexible screen input device further comprises: and the input processing module is used for processing the user input operation collected by the multi-point touch control module, generating corresponding input information and controlling the operation feedback.
Specifically, referring to fig. 6 in combination, this embodiment of the present invention utilizes the non-planar contact operation performed by the user to implement the input of the stereo gesture. For example, when a user rests a palm of the hand naturally on a curved input surface, it is assumed that all fingers are touching the input surface. Since each finger is located differently in space (the space defined by the xyz axes), this can itself constitute a stereo gesture. And when the number of the fingers contacting the input surface is different, different three-dimensional gestures can be formed. Even slightly changing the position of the fingers on the input surface can constitute different stereo gestures. This is only a static gesture design, and when actions are included, a more rich stereo gesture can be formed. And the input actions or control actions represented by the stereo gestures can be stored in the input processing module in a data-associated manner. When the input processing module identifies a certain three-dimensional gesture from the collected data of the multi-touch module, the corresponding input action or control action can be obtained from the associated data, so that the input information of the user can be confirmed.
In the above analysis, by inputting a stereo gesture on a curved input surface, it should be possible for a user to achieve a certain function or achieve a certain input with a much smaller number of operations than in the prior art. Also, spatial perception on a curved input surface can help a user to more easily locate an operation relative to a planar touch screen or keys, buttons, etc. In addition, the user can clearly know the operation process by combining the operation feedback.
In a specific implementation, the curved surface shape may be a sphere or an arc, which is convenient for a user to operate on the curved surface shape, and on the other hand, makes the user feel comfortable during operation. And the force feedback module may be a vibration module to provide vibration feedback after the user inputs the stereoscopic gesture.
In another embodiment of the flexible screen input device of the present invention shown in fig. 2, a proximity sensing module is added. The proximity sensing module can collect non-contact operations made by a user over the input device. The non-contact operation provides input of a stereo gesture, and only the detection mode is changed from contact detection to non-contact detection. Through increasing and approaching the response module, the user need not touch input device just can carry out gesture operation, has further increased the flexibility of operation.
In yet another embodiment of the flexible screen input device shown in fig. 3, a display screen is further integrated on part or all of the curved surface input surface, so that when the input processing module recognizes a gesture, operation information of a user can be displayed for the user to view and perform subsequent operations. Alternatively, the display screen may display some common operation prompt information, for example, displaying common function shortcut keys in some areas of the curved input surface. Because the input surface is a curved surface, more operation information or operation prompt information can be displayed in a certain space compared with a plane. In other embodiments of the flexible screen input device of the present invention, the proximity sensing module can be eliminated according to the requirements of practical applications. I.e. only a contact operation is provided.
The flexible screen input device of the present invention may further include a data communication module in view of its ease of use as an external input device. The data communication module may support one or more of the presently common data communication modes. Specifically, data communication may be performed through a wire harness, or through a vehicle bus, or wirelessly, such as bluetooth or WiFi.
Fig. 7 is a schematic diagram of an embodiment of the flexible screen input device of the present invention assembled in a vehicle. Referring initially to FIG. 7, the flexible screen input device 100 of the present invention may be mounted in a vehicle near a shift knob, which is an easy location for the driver or copilot to operate. Of course, the flexible screen input device of the present invention may be mounted in other suitable locations within the vehicle to suit, for example, other passengers. When the flexible screen input device of the present invention is mounted in a vehicle, it can communicate data with other subsystems in the vehicle in alternative ways, such as by using the aforementioned wiring harness, vehicle bus, wireless, etc. For example, as an external input device to these subsystems, it may be in data communication with the infotainment function processing apparatus 200 and/or the meter 300.
Referring to fig. 4, the vehicle infotainment system is constructed by using the flexible screen input device as the external input terminal of the existing infotainment processing apparatus. The flexible screen input device is connected with the infotainment function device through a wire harness or a vehicle bus or in a wireless mode (such as Bluetooth or WiFi). And when the wireless mode is selected, the position of the flexible screen input device can be flexibly arranged in the vehicle, so that the passenger can operate the device except the driver.
Compared with the prior art information entertainment system integrating the touch display screen, the information entertainment function processing device only needs to be provided with the display screen. Based on the above analysis, the user can operate or control the infotainment function device through a simpler three-dimensional gesture operation and with less time. In addition, due to rich operation of the three-dimensional gestures, a plurality of input devices in the past can be replaced by a single flexible screen device.
An application example is given below, taking a flexible screen input device as a spherical input surface as an example. When a user listens to music using the infotainment function device, the volume can be adjusted by performing a contact operation of rotating and sliding five fingers (imitating the action of a conventional adjusting knob) on the spherical input surface. The input processing module recognizes the three-dimensional gesture after acquiring the data acquired by the multi-point touch module, and sends the corresponding operation information for adjusting the volume to the infotainment function processing device. The infotainment function processing means performs the operation of volume adjustment after obtaining this operation information. If the five-finger clockwise rotation sliding is to increase the volume and the five-finger anticlockwise rotation sliding is to decrease the volume, when the user makes the five-finger clockwise rotation sliding on the spherical input surface, the infotainment function processing device can correspondingly execute the operation of increasing the volume according to the gesture recognition and the operation information transmission of the input device. Accordingly, the force feedback module may also prompt the user for an action by vibrating.
Similarly, referring to fig. 8, the sound source switching can also be triggered by a contact operation of grabbing on the spherical input surface, and the gesture is recognized as the change of the positions of the five fingers in the xyz space at the beginning and the end of the motion. With continued reference to FIG. 9, the previous or next source is then switched by a touch operation that rotates left or right along the spherical input surface, the gesture being recognized as a change in the position of the operating finger in xyz space at the beginning and end of the action.
As another example, an exhalation of the primary interface may also be triggered by the action of covering the palm of the hand over the spherical input surface.
It can be seen that the user does not need to look at the screen or look for the corresponding key to confirm his operation during the operation. In addition, due to the richness of the analyzed stereo gestures, most of the original motion modes can be completely reserved, and only touch operation is used for simulating, for example, the motion of simulating knob adjustment. Therefore, the user does not need to memorize the action command again, and the operation of the user is further facilitated.
Although fig. 4 only shows an example of a touch operation including a multi-touch module, it can be understood from the above description that a proximity sensing module may be added to increase the support of a non-touch operation. The corresponding processing procedures are similar and are not described herein again.
With continued reference to FIG. 5, in another embodiment of the infotainment system of the present invention, a flexible screen input device having a display screen integrated in whole or in part with the input surface may also be coupled to the infotainment function processing means. The input recognition and control process can refer to the example shown in fig. 4, and some states of the infotainment function processing device can be fed back to the input processing module due to the addition of the display screen to be displayed on the display screen. For example, in the above application example of adjusting the volume, the corresponding volume state can be synchronously displayed on the spherical input device, which is convenient for the user to view. For another example, when the user operation triggers a confirmation screen, the selection areas of "yes" and "no" may be displayed on the display screen, and the user may click one of the areas to select.
Although the present invention has been described with reference to the preferred embodiments, it is not limited thereto. Various changes and modifications within the spirit and scope of the present invention will become apparent to those skilled in the art from this disclosure, and it is intended that the scope of the present invention be defined by the appended claims.

Claims (10)

1. A flexible screen input device, comprising: the flexible screen input device comprises a curved surface-shaped input surface, wherein a multi-point touch module is integrated on the input surface and used for collecting contact and non-planar operations of a user on the input surface so as to obtain the input of static or dynamic three-dimensional gestures of the user, and a force feedback module is integrated and used for providing operation feedback to the user after the input operation of the user, and the flexible screen input device further comprises: and the input processing module is used for storing the input action or the control action represented by the three-dimensional gesture, processing the three-dimensional gesture of the user acquired by the multi-point touch module, identifying the three-dimensional gesture as the corresponding input action or the control action and controlling the operation feedback.
2. The flexible screen input device of claim 1, further comprising: the proximity sensing module is used for acquiring non-contact and non-planar operations of a user on the input equipment to obtain the static or dynamic three-dimensional gesture input of the user; the input processing module is also used for processing the three-dimensional gestures of the user collected by the proximity sensing module and recognizing the three-dimensional gestures as corresponding input actions or control actions.
3. The flexible screen input device of claim 1, wherein the curved shape is a sphere or an arc.
4. A flexible screen input device as recited in claim 1, wherein part or all of the input surface is further integrated with a display screen.
5. The flexible screen input device of claim 1, further comprising: the data communication module supports any one of the following data communication modes: data line, vehicle bus, wireless.
6. An infotainment system, comprising: the flexible screen input device and the information entertainment function processing device; the flexible screen input device includes: the flexible screen input device comprises a curved surface-shaped input surface, wherein a multi-point touch module is integrated on the input surface and used for collecting contact and non-planar operations of a user on the input surface so as to obtain the input of static or dynamic three-dimensional gestures of the user, and a force feedback module is integrated and used for providing operation feedback to the user after the input operation of the user, and the flexible screen input device further comprises: the input processing module is used for storing input actions or control actions represented by the three-dimensional gestures, processing the three-dimensional gestures of the user acquired by the multi-point touch control module, identifying the three-dimensional gestures as corresponding input actions or control actions, sending the corresponding input actions or control actions to the information entertainment function processing device and controlling the operation feedback; and the infotainment function processing device performs corresponding processing and presents corresponding infotainment functions after obtaining the input action or the control action.
7. The infotainment system of claim 6, wherein the flexible screen input device further comprises: the proximity sensing module is used for acquiring non-contact and non-planar operations of a user on the input equipment to obtain the static or dynamic three-dimensional gesture input of the user; the input processing module is also used for processing the three-dimensional gestures of the user collected by the proximity sensing module, recognizing the three-dimensional gestures into corresponding input actions or control actions and sending the input actions or control actions to the information entertainment function processing device.
8. The infotainment system of claim 6, wherein the curved shape is spherical or arcuate.
9. The infotainment system of claim 6, wherein part or all of the input surface is further integrated with a display screen; and the infotainment function processing device sends state information related to the corresponding infotainment function to the flexible screen input equipment after corresponding processing, and the state information is displayed through the display screen.
10. The infotainment system of claim 6 wherein the flexible screen input device and the infotainment function processing means are connected by a wire harness or a vehicle bus or wirelessly.
CN201610799362.0A 2016-08-31 2016-08-31 Flexible screen input device and infotainment system Active CN107783647B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610799362.0A CN107783647B (en) 2016-08-31 2016-08-31 Flexible screen input device and infotainment system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610799362.0A CN107783647B (en) 2016-08-31 2016-08-31 Flexible screen input device and infotainment system

Publications (2)

Publication Number Publication Date
CN107783647A CN107783647A (en) 2018-03-09
CN107783647B true CN107783647B (en) 2021-07-23

Family

ID=61451861

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610799362.0A Active CN107783647B (en) 2016-08-31 2016-08-31 Flexible screen input device and infotainment system

Country Status (1)

Country Link
CN (1) CN107783647B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110194208B (en) * 2019-05-16 2023-10-10 上海蔚来汽车有限公司 Multifunctional steering wheel of automobile and automobile

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7456823B2 (en) * 2002-06-14 2008-11-25 Sony Corporation User interface apparatus and portable information apparatus
JP5710859B2 (en) * 2007-09-21 2015-04-30 ソニー株式会社 Input device and electronic device
CN101727249B (en) * 2008-10-31 2012-02-01 宸鸿光电科技股份有限公司 Manufacturing method of camber-shaped capacitance type touch-control plate
CN102096529A (en) * 2011-01-27 2011-06-15 北京威亚视讯科技有限公司 Multipoint touch interactive system
CN102169388B (en) * 2011-04-02 2013-09-11 苏州泛普纳米科技有限公司 Curve screen based on nanometer touch-control membrane technique and manufacturing method thereof
TWI467427B (en) * 2011-10-07 2015-01-01 Young Optics Inc Touch display apparatus
CN103034331B (en) * 2012-12-12 2016-06-29 中兴通讯股份有限公司 A kind of haptic feedback devices and terminal
US9939900B2 (en) * 2013-04-26 2018-04-10 Immersion Corporation System and method for a haptically-enabled deformable surface
CN104423876B (en) * 2013-09-03 2018-03-27 北京三星通信技术研究有限公司 Mobile terminal and its operation processing method
CN105607772B (en) * 2014-11-13 2020-11-03 现代自动车株式会社 Touch input device and vehicle including the same
CN205239166U (en) * 2015-12-24 2016-05-18 深圳市柔宇科技有限公司 Accuse platform and control panel in car

Also Published As

Publication number Publication date
CN107783647A (en) 2018-03-09

Similar Documents

Publication Publication Date Title
CN110045825B (en) Gesture recognition system for vehicle interaction control
JP2021166058A (en) Gesture based input system using tactile feedback in vehicle
CN104750247B (en) Use single controller and the system and method for supporting the user interface of tactile to control multiple displays
US10144285B2 (en) Method for operating vehicle devices and operating device for such devices
WO2017013834A1 (en) Display manipulation device
US20070268268A1 (en) Touchpad Device
WO2015146003A1 (en) Vehicular portable terminal operation system
JP4960127B2 (en) Operation device
KR20190111095A (en) Method for manipulating interface between human devices and interface between human devices
CN110709273B (en) Method for operating a display device of a motor vehicle, operating device and motor vehicle
JP5640486B2 (en) Information display device
CN109890646B (en) Device for a graphical user interface in a vehicle and method for providing a graphical user interface in a vehicle
US10942630B2 (en) Motor vehicle operator control apparatus having multiple coupled screens
EP3250987A1 (en) Electrostatic haptic actuator and user interface with an electrostatic haptic actuator
JP2019169128A (en) Method for operating man-machine interface and man-machine interface
US20190212912A1 (en) Method for operating a human-machine interface and human-machine interface
US9082292B2 (en) Display apparatus, hardware remote controller, and remote control system
JP6127679B2 (en) Operating device
KR101826552B1 (en) Intecrated controller system for vehicle
CN107783647B (en) Flexible screen input device and infotainment system
JP2017030746A (en) Vehicle and steering unit
CN114040857A (en) Method for operating an operating system in a vehicle and operating system in a vehicle
CN104007999B (en) Method for controlling an application and related system
EP1182535A1 (en) Haptic terminal
KR102324366B1 (en) Handling apparatus for display-based center-fascia and method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 200082 538 Dalian Road, Yangpu District, Shanghai

Applicant after: Mainland Investment (China) Co., Ltd.

Address before: 200082 538 Dalian Road, Yangpu District, Shanghai

Applicant before: Continental Automotive Asia Pacific (Beijing) Co., Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20210901

Address after: 241009 No. 18 Tianzhushan Road, Wuhu City, Anhui Province

Patentee after: Continental automotive body electronic system (Wuhu) Co.,Ltd.

Address before: 200082 538 Dalian Road, Yangpu District, Shanghai

Patentee before: CONTINENTAL INVESTMENT (CHINA) Co.,Ltd.

TR01 Transfer of patent right