CN214335699U - Multifunctional interactive terminal - Google Patents

Multifunctional interactive terminal Download PDF

Info

Publication number
CN214335699U
CN214335699U CN202120553174.6U CN202120553174U CN214335699U CN 214335699 U CN214335699 U CN 214335699U CN 202120553174 U CN202120553174 U CN 202120553174U CN 214335699 U CN214335699 U CN 214335699U
Authority
CN
China
Prior art keywords
central controller
human body
display screen
voice
touch display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202120553174.6U
Other languages
Chinese (zh)
Inventor
唐瑭
李驰
刘岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taikang Insurance Group Co Ltd
Original Assignee
Taikang Insurance Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taikang Insurance Group Co Ltd filed Critical Taikang Insurance Group Co Ltd
Priority to CN202120553174.6U priority Critical patent/CN214335699U/en
Application granted granted Critical
Publication of CN214335699U publication Critical patent/CN214335699U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The utility model discloses a multi-functional mutual terminal, this multi-functional mutual terminal include central controller, touch display screen, sound collection module, speaker and human detection module. The human body detection module detects the distance between a human body and the multifunctional touch screen interaction terminal; when the distance between a human body and the multifunctional touch screen interaction terminal is smaller than a preset distance, the central controller controls the touch display screen to display a main function interface; the loudspeaker plays a preset welcome language according to the control of the central controller; the voice acquisition module acquires a voice instruction; the touch display screen displays a corresponding service interface according to the control of the central controller based on the received user click operation or the voice instruction acquired by the voice acquisition module. The utility model discloses fuse touch display screen, sound collection module, speaker and human detection module multimode sensing equipment, fully mobilize user's sense of touch, sense of hearing and sense of hearing, improve interactive effect in reduce cost.

Description

Multifunctional interactive terminal
Technical Field
The utility model relates to an intelligent interaction technology field especially relates to multi-functional interactive terminal.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
The existing self-service terminal mainly uses a keyboard or a touch screen as an input device, and a small number of self-service terminals are provided with cameras with a face recognition function for recognizing the identity of a user, so that the personalized service function of a certain degree can be realized. However, the interaction mode of the self-service terminal is single, and the keyboard input or the touch screen click is mainly used, so that the whole interaction effect is influenced. The multifunctional intelligent service robot has higher hardware cost and is mainly designed to execute movable service tasks.
Therefore, the existing service terminal has the problems of high cost and poor interaction effect.
SUMMERY OF THE UTILITY MODEL
The embodiment of the utility model provides a multi-functional mutual terminal for improve interactive effect in reduce cost, this multi-functional mutual terminal includes:
the system comprises a central controller, a touch display screen, a sound acquisition module, a loudspeaker and a human body detection module;
the touch display screen, the sound acquisition module, the loudspeaker and the human body detection module are respectively connected with the central controller;
the human body detection module is used for detecting the distance between a human body and the multifunctional touch screen interaction terminal;
the central controller is used for controlling the touch display screen to display the main function interface when the human body detection module detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than a preset distance;
the speaker is used for playing a preset welcome word under the control of the central controller when the human body detection module detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than a preset distance;
the voice acquisition module is used for acquiring voice instructions;
and the touch display screen is used for displaying a corresponding service interface according to the control of the central controller based on the received user click operation or the voice instruction acquired by the voice acquisition module.
The utility model discloses an in the embodiment, central controller still is used for when human detection module detects human and multi-functional touch screen interaction terminal's distance and is not less than preset distance, controls touch display screen display and shows standby interface.
In an embodiment of the present invention, the system further comprises a face image acquisition module and a server; the face image acquisition module and the server are both connected with the central controller;
the system comprises a face image acquisition unit, a central controller and a server, wherein the face image acquisition unit is used for transmitting an acquired user face image to the server through the central controller;
the server is used for comparing the received user face image with a face image database and feeding back user information to the central controller when the user identity identification is passed;
the loudspeaker is used for playing the customized greeting words according to the control of the central controller when the user identification passes; and the device is also used for playing the preset standard greeting according to the control of the central controller when the user identification fails.
In an embodiment of the present invention, the touch display screen is further configured to skip and display a corresponding service interface according to the control of the central controller based on the received user service reservation instruction after the user identity identification passes;
and the loudspeaker is also used for playing the reserved service result according to the control of the central controller after the user finishes the reserved service.
The utility model discloses an in the embodiment, face image acquisition module includes the RGB camera at least.
In an embodiment of the present invention, the central controller is further configured to control the sound collection module to collect the voice information after the voice wake-up word is collected by the sound collection module;
the voice acquisition module is also used for sending the acquired voice information to the server through the central controller;
the server is also used for carrying out voice recognition on the received voice information and feeding back a voice recognition result to the central controller;
and the central controller is also used for controlling the touch display screen to display a corresponding interface according to the voice recognition result fed back by the server and controlling the loudspeaker to play the voice feedback result.
In an embodiment of the present invention, the human body detection module at least includes a depth-of-field camera, and the central controller at least includes an information acquisition unit and an information processing unit;
the information acquisition unit is used for receiving the user depth image acquired by the human body detection module;
the information processing unit is used for identifying the distance between the user depth image received by the information acquisition unit and the multifunctional touch screen interaction terminal;
and the central controller is used for controlling the touch display screen to display the main function interface when the information processing unit identifies that the distance between the user depth image and the multifunctional touch screen interaction terminal is less than a preset distance.
In an embodiment of the present invention, the system further comprises a timer connected to the central controller;
the timer is used for starting timing according to the control of the central controller when the human body detection module detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than a preset distance and the touch display screen displays a main function interface;
and the central controller is also used for controlling the loudspeaker to play preset voice after the timer counts time and exceeds a preset time length.
In an embodiment of the utility model, the device further comprises a power on/off module,
the central controller is used for controlling the touch display screen to display a standby interface after receiving a starting-up instruction; and the central controller is also used for controlling the touch display screen to display a shutdown interface after receiving a shutdown instruction so as to control the multifunctional touch screen interactive terminal to shut down.
The utility model discloses an in the embodiment, sound collection module includes the microphone array at least, and touch display screen includes touch-sensitive screen and display screen at least.
In the embodiment of the utility model, the central controller, the touch display screen, the sound acquisition module, the loudspeaker and the human body detection module; the touch display screen, the sound acquisition module, the loudspeaker and the human body detection module are respectively connected with the central controller. The human body detection module detects the distance between a human body and the multifunctional touch screen interaction terminal; the central controller controls the touch display screen to display a main function interface when the human body detection module detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than a preset distance; when the human body detection module detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than a preset distance, the loudspeaker plays a preset welcome word according to the control of the central controller; the voice acquisition module acquires a voice instruction; the touch display screen displays a corresponding service interface according to the control of the central controller based on the received user click operation or the voice instruction acquired by the voice acquisition module. The embodiment of the utility model provides a fuse touch display screen, sound collection module, speaker and human detection module multimode sensing equipment, fully mobilize user's sense of touch, sense of hearing and sense of hearing, improve interactive effect in reduce cost.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts. In the drawings:
fig. 1 is a schematic diagram of a module structure of a multifunctional touch screen interaction terminal according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a standby interface/main interface switching logic provided in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of another module of the multifunctional touch screen interactive terminal according to an embodiment of the present invention;
fig. 4 is a schematic view of a face recognition logic provided in an embodiment of the present invention;
fig. 5 is a schematic diagram of a speech recognition logic according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention are described in further detail below with reference to the accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
Fig. 1 illustrates a module structure of a multifunctional touch screen interactive terminal provided by an embodiment of the present invention, and for convenience of description, only the parts related to the embodiment of the present invention are shown, and detailed descriptions are as follows:
as shown in fig. 1, the multifunctional touch screen interactive terminal includes:
the system comprises a central controller 101, a touch display screen 102, a sound collection module 103, a loudspeaker 104 and a human body detection module 105, wherein the touch display screen 102, the sound collection module 103, the loudspeaker 104 and the human body detection module 105 are respectively connected with the central controller 101;
and the human body detection module 105 is used for detecting the distance between a human body and the multifunctional interactive terminal.
And the central controller 101 is configured to control the touch display screen 102 to display a main function interface when the human body detection module 105 detects that the distance between the human body and the multifunctional interactive terminal is smaller than a preset distance.
And the loudspeaker 104 is used for playing the preset welcome language according to the control of the central controller 101 when the human body detection module 105 detects that the distance between the human body and the multifunctional interactive terminal is less than the preset distance. The preset welcome words may be, for example, "good morning of visitors", and the like.
And the sound acquisition module 103 is used for acquiring a voice instruction.
And the touch display screen 102 is used for displaying a corresponding service interface according to the control of the central controller 101 based on the received user click operation or the voice instruction acquired by the sound acquisition module 103.
The sound collection module 103 includes at least a microphone array, and the touch display screen 102 includes at least a touch screen and a display screen. The preset distance is a preset distance, and a person skilled in the art can preset the preset distance according to actual conditions and specific requirements. For example, the preset distance is preset to be 3 meters, or the preset distance is preset to be 5 meters, and those skilled in the art can understand that the preset distance may also be preset to be other distances than the above-mentioned 3 meters and 5 meters, for example, 2 meters, which is not limited in particular by the embodiment of the present invention.
After the multifunctional touch screen interaction terminal is started up, the multifunctional touch screen interaction terminal enters a standby state, the central controller 101 controls the touch display screen 102 to display a standby interface, past users are attracted by characters and animations, and when the human body detection module 105 detects that a user approaches, the central controller 101 controls the touch display screen 102 to jump to a main function interface. A user clicks a corresponding service module through the touch display screen 102, and the touch display screen 102 displays a corresponding service interface; the user can also speak a voice instruction (e.g., a navigation word) of the corresponding service module through the sound collection module 103, and the central controller 101 controls the touch display screen 102 to display a corresponding service interface based on the voice instruction; the user can use the touch display screen 102 or the sound acquisition module 103 to input commands in the service module, the operation result is subjected to voice prompt or broadcast through the loudspeaker 104, and the touch display screen 102 performs interface skip according to the operation to complete the query or reservation of the service.
In an embodiment of the present invention, the human body detecting module 105 at least includes a depth-of-field camera, and the central controller 101 at least includes an information collecting unit and an information processing unit. The central controller 101 further includes an information communication unit.
And the information acquisition unit is used for receiving the user depth image acquired by the human body detection module 105.
And the information processing unit is used for identifying the distance between the user depth image received by the information acquisition unit and the multifunctional interactive terminal.
And the central controller 101 is configured to control the touch display screen 102 to display a main function interface when the information processing unit recognizes that the distance between the user depth image and the multifunctional interactive terminal is less than a preset distance.
The touch display screen 102 and the human body detection module 105 are connected with the central controller 101, the depth image returned by the human body detection module 105 is collected and collected through the information acquisition unit, the position of the human body skeleton structure is analyzed and identified in the information processing unit by using an intelligent algorithm, the distance between the human body and the self-service terminal is further calculated, and if the distance is less than or equal to 2 meters, the central controller 101 controls the touch display screen 102 to jump to a functional main page.
In an embodiment of the present invention, fig. 2 shows that the embodiment of the present invention provides a standby interface/main interface switching logic schematic, as shown in fig. 1 and fig. 2, the central controller 101 is further configured to control the touch display screen 102 to display a standby interface when the human body detection module 105 detects that the distance between the human body and the multifunctional interactive terminal is not less than the preset distance.
When the human body detection module 105 detects that the distance between the human body and the multifunctional interactive terminal is not less than the preset distance, the user is considered to leave, and at this time, the central controller 101 controls the touch display screen 102 to display the standby interface.
In the embodiment of the present invention, the central controller 101, the touch display screen 102, the sound collection module 103, the speaker 104, and the human body detection module 105; the touch display screen 102, the sound collection module 103, the speaker 104 and the human body detection module 105 are respectively connected with the central controller 101. The human body detection module 105 detects the distance between a human body and the multifunctional touch screen interaction terminal; when the human body detection module 105 detects that the distance between the human body and the multifunctional touch screen interaction terminal is smaller than the preset distance, the central controller 101 controls the touch display screen 102 to display a main function interface; when the human body detection module 105 detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than the preset distance, the loudspeaker 104 plays a preset welcome word under the control of the central controller 101; the voice acquisition module 103 acquires voice instructions; the touch display screen 102 displays a corresponding service interface according to the control of the central controller 101 based on the received user click operation or the voice instruction acquired by the sound acquisition module 103. The embodiment of the utility model provides a fuse touch display screen 102, sound collection module 103, speaker 104 and human detection module 105 multi-modal sensing equipment, fully mobilize user's sense of touch, sense of hearing and sense of hearing, improve interactive effect in reduce cost.
Fig. 3 shows another module structure of the multifunctional touch screen interactive terminal provided by the embodiment of the present invention, and fig. 4 shows a schematic diagram of a face recognition logic provided by the embodiment of the present invention, which only shows the parts related to the embodiment of the present invention for convenience of description, and the detailed description is as follows:
in an embodiment of the present invention, as shown in fig. 3 and 4, on the basis of the module structure shown in fig. 1, the multifunctional touch screen interactive terminal further includes:
a face image acquisition module 301 and a server 302; the face image acquisition module 301 and the server 302 are both connected with the central controller 101;
acquiring a face image, and sending the acquired face image of the user to a server 302 through a central controller 101;
the server 302 is used for comparing the received user face image with a face image database and feeding back user information to the central controller 101 when the user identity identification is passed;
a speaker 104 for playing a customized greeting under the control of the central controller 101 when the user identification passes; and is also used for playing the preset standard greeting according to the control of the central controller 101 when the user identification fails.
The face image acquisition module 301 at least includes an RGB camera, and the server 302 includes a physical server and a cloud server. Wherein, the preset standard greeting can be, for example, "grandmother, am, please start interacting with me"; the preset standard greeting may be, for example, "visitors are good at am, please begin to interact with me", etc. The user information includes user identity information, user historical use habit information and the like.
In an embodiment of the present invention, the touch display screen 102 is further configured to jump and display a corresponding service interface according to the control of the central controller 101 based on the received user service reservation command after the user identity identification passes;
the speaker 104 is further configured to play the reserved service result according to the control of the central controller 101 after the user completes the reserved service.
In an embodiment of the present invention, fig. 5 shows a schematic diagram of a voice recognition logic provided by an embodiment of the present invention, as shown in fig. 3 and 5, the central controller 101 is further configured to control the sound collection module 103 to collect voice information after the voice collection module 103 collects a voice wake-up word;
the sound collection module 103 is further configured to send collected voice information to the server 302 through the central controller 101;
the server 302 is further configured to perform voice recognition on the received voice information, and feed back a voice recognition result to the central controller 101;
the central controller 101 is further configured to control the touch display screen 102 to display a corresponding interface according to the voice recognition result fed back by the server 302, and control the speaker 104 to play the voice feedback result.
After the touch display screen 102 enters the interactive main interface, the central controller 101 receives input information of the touch display screen 102 and the sound collection module 103 at the same time: when the central controller 101 receives the voice wake-up word, the voice acquisition module 103 is controlled to start acquiring voice information, the voice information is transmitted to the server 302 through the central controller 101, voice recognition is performed by using natural language processing, and a voice recognition result is returned to the central controller 101. The central controller 101 controls the speaker 104 to play the voice feedback result according to the voice recognition result, and controls the touch display screen 102 to perform function skipping or display prompt information.
In an embodiment of the present invention, as shown in fig. 3, on the basis of the above module structure, the multifunctional touch screen interactive terminal further includes a timer 303 connected to the central controller 101.
The timer 303 is used for starting timing according to the control of the central controller 101 when the human body detection module 105 detects that the distance between the human body and the multifunctional interactive terminal is smaller than the preset distance and the main function interface is displayed on the touch display screen 102;
the central controller 101 is further configured to control the speaker 104 to play a preset voice after the timer 303 counts the preset time period.
The timer 303 counts time exceeding a preset time length, which indicates that the user is in front of the multifunctional interactive terminal but is not operating for a long time, so that the central controller 101 controls the speaker 104 to play a preset voice to remind the user to operate in time. The preset time length is a preset time length, and a person skilled in the art can preset the preset time length according to actual conditions and specific requirements. For example, the preset time length is preset to be 1 minute, or the preset time length is preset to be 3 minutes, and those skilled in the art can understand that the preset time length can also be preset to be other time lengths than the above-mentioned 1 minute and 3 minutes, for example, 2 minutes, which is not limited by the embodiment of the present invention.
In an embodiment of the present invention, on the basis of the above module structure, the multifunctional touch screen interactive terminal further includes a power on/off module.
The power on/off module is used for controlling the touch display screen 102 to display a standby interface by the central controller 101 after receiving a power on instruction; and the central controller 101 is further configured to control the touch display screen 102 to display a shutdown interface after receiving a shutdown instruction, so as to control the multifunctional interactive terminal to shutdown.
The embodiment of the utility model provides a multi-functional mutual terminal can place in the public space of longlife community, provides self-service for the community resident. The service contents comprise: community services 5 items: regular bus reservation, outgoing registration, course activities, cate heaven and earth and community news; health services 3 items: traditional Chinese medicine physical examination, heart rate detection and chronic disease introduction; general service 1 item: and (4) weather forecast. The services introduced above are divided into three types, a subscription service, an information query service, and a health detection service. The method comprises the following steps that (1) a reservation service and a health detection service are mainly adopted in the aged-care community, and a large amount of human resources of the community can be occupied every day; in another aspect, the information query service relates to the personal health, daily living and life in the community of the residents, and can increase the knowledge area of the residents and increase the viscosity between the residents and the community.
The embodiment of the utility model provides a multi-functional interactive terminal includes multiple human-computer interaction sensing equipment, for example depth of field camera, microphone array, and multiple interactive equipment is mutually supported, can realize the all-round interaction of human-computer vision, sense of hearing and sense of touch, accords with resident daily communication habit, provides the mutual experience of non-inductive formula for the resident. The utility model discloses having fused multiple intelligent technology, can guiding the resident to accomplish mutual flow smoothly, real completion reservation service has practiced thrift the labour cost for the long-lived community.
The embodiment of the utility model provides a multi-functional interactive terminal can be at the new form of longlife community extension community service: self-service increases the frequency of resident participation in community activities, strengthens the viscidity of resident and community, and the helping hand community develops health management, practices thrift the human cost input of community. Through the non-inductive interactive experience, the resident is guided to perform high-frequency interaction, and the satisfaction degree of the resident is increased. The embodiment of the utility model provides a multi-functional interactive terminal can provide the backstage to self-service terminal, robot, medical health IoT and security protection IoT equipment simultaneously and support; the system can cover public places such as shopping malls, office buildings, museums, hospitals and long-life communities, and the background service of the system can also be used for household IoT equipment and robot products.
The following uses the resident reservation regular bus task of longeval community as an example, briefly explains the utility model provides a multi-functional interactive terminal's theory of operation:
after the multifunctional interactive terminal is started, the touch display screen 102 displays a standby interface, system advertisements can be played in a circulating mode on the standby interface, service functions which can be completed by the equipment are introduced, and interaction is conducted before a user is attracted.
After the user approaches the touch screen 102, the depth-of-field camera collects a depth image and transmits the depth image to the central controller 101, the approach of the user is identified through an intelligent analysis algorithm, and the position of the user relative to the large screen is identified, such as left-right, too close or too far. Then, the image collected by the RGB camera is transmitted to the central controller 101, and further the user identity is recognized by the human face on the cloud server 302, and then the recognition result is returned.
When the user identity is recognized, central controller 101 controls speaker 104 to play a custom greeting and prompts the user to adjust the interaction location, such as: "grandmother, am, today's strong wind, going out please note add clothing, ask you move in the middle and near me and then start interacting with me" when user identity is not recognized, central controller 101 controls speaker 104 to play a standard greeting and prompts the user to adjust the interaction position, such as: "honored guests are good at the morning, and in the strong wind today, go out to pay attention to adding clothes, ask you move to the middle and get close to me, and then start to interact with me. "
At this time, the touch display screen 102 is switched to the function main interface, the central controller 101 starts the timer 303, and if the user does not perform any operation in front of the multifunctional interactive terminal within a specified time, the central controller 101 triggers the speaker 104 to prompt the user to interact with the multifunctional interactive terminal. The user shouts the awakening word 'Xiaotai', the microphone array is awakened and starts to acquire audio signals, the audio signals are connected with the cloud server 302 through the central controller 101, the voice is identified, then the identification result is returned, and when the navigation word 'airliner appointment' is identified, the central controller 101 controls a program to enter an airliner appointment function module; the user may also click a "regular bus reservation" button on the touch screen 102, and the central controller 101 receives the command and controls entry to the regular bus reservation module.
After entering the regular bus reservation module, the central controller 101 starts the timer 303 to control the touch display screen 102 to display the regular bus schedule interface. If the user has not done anything, causing the timer 303 to time out, the central controller 101 will control the touch screen display 102 to return to the interactive home interface.
The user clicks the touch display screen 102 in the regular bus timetable to select the number of the regular bus and the destination, the central controller 101 records corresponding information and controls the touch display screen 102 to jump to a face recognition interface, the RGB camera collects face images and transmits the face images to the central controller 101, the face images are compared with a face library on the cloud server 302, if the user identity cannot be recognized, the speaker 104 prompts that the user identity is failed to be recognized through voice, and the touch display screen 102 jumps to the regular bus timetable interface; if the user identity is recognized, the touch screen display 102 jumps to the detailed information input interface. The user can fill in the detailed information of taking the regular bus, such as information of going with the bus, returning with the bus, accompanying personnel and the like, through the touch display screen 102 to complete the reservation operation; the user can also wake up the microphone array through the voice wake-up word, and the central controller 101 fills in and completes detailed riding information by using the voice recognition function of the cloud server 302, and further completes reservation operation. After the appointment is successful, the central controller 101 controls the loudspeaker 104 to prompt the user that the appointment of the regular bus is successful, and broadcasts the number and time of the regular bus to prompt the user to take the regular bus on time; and then controls the touch display screen 102 to return to the interactive main interface. The user can select other service modules on the interactive main interface for interaction.
The depth of field camera transmits the depth of field image back to the central controller 101 in real time, and after the user is identified to leave, the central controller 101 controls the touch display screen 102 to return to the standby interface to wait for the next man-machine interaction
The utility model discloses an use the scene: the public space of the long-life community provides self-service information inquiry and reservation service for community residents. The utility model discloses can expand to multiple public places such as office staff, hospital, insurance service hall and museum in future.
To sum up, in the embodiment of the present invention, the central controller 101, the touch display screen 102, the sound collection module 103, the speaker 104 and the human body detection module 105; the touch display screen 102, the sound collection module 103, the speaker 104 and the human body detection module 105 are respectively connected with the central controller 101. The human body detection module 105 detects the distance between a human body and the multifunctional touch screen interaction terminal; when the human body detection module 105 detects that the distance between the human body and the multifunctional touch screen interaction terminal is smaller than the preset distance, the central controller 101 controls the touch display screen 102 to display a main function interface; when the human body detection module 105 detects that the distance between a human body and the multifunctional touch screen interaction terminal is smaller than the preset distance, the loudspeaker 104 plays a preset welcome word under the control of the central controller 101; the voice acquisition module 103 acquires voice instructions; the touch display screen 102 displays a corresponding service interface according to the control of the central controller 101 based on the received user click operation or the voice instruction acquired by the sound acquisition module 103. The embodiment of the utility model provides a fuse touch display screen 102, sound collection module 103, speaker 104 and human detection module 105 multi-modal sensing equipment, fully mobilize user's sense of touch, sense of hearing and sense of hearing, improve interactive effect in reduce cost.
The above-mentioned embodiments, further detailed description of the objects, technical solutions and advantages of the present invention, it should be understood that the above-mentioned embodiments are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (10)

1. A multi-functional interactive terminal, comprising:
the system comprises a central controller, a touch display screen, a sound acquisition module, a loudspeaker and a human body detection module;
the touch display screen, the sound acquisition module, the loudspeaker and the human body detection module are respectively connected with the central controller;
the human body detection module is used for detecting the distance between a human body and the multifunctional interactive terminal;
the central controller is used for controlling the touch display screen to display the main function interface when the human body detection module detects that the distance between the human body and the multifunctional interactive terminal is less than the preset distance;
the speaker is used for playing a preset welcome language according to the control of the central controller when the human body detection module detects that the distance between a human body and the multifunctional interactive terminal is less than a preset distance;
the voice acquisition module is used for acquiring voice instructions;
and the touch display screen is used for displaying a corresponding service interface according to the control of the central controller based on the received user click operation or the voice instruction acquired by the voice acquisition module.
2. The multi-functional interactive terminal of claim 1, wherein the central controller is further configured to control the touch display screen to display the standby interface when the human body detection module detects that the distance between the human body and the multi-functional interactive terminal is not less than the preset distance.
3. The multi-functional interactive terminal of claim 1, further comprising a face image acquisition module and a server; the face image acquisition module and the server are both connected with the central controller;
the system comprises a face image acquisition unit, a central controller and a server, wherein the face image acquisition unit is used for transmitting an acquired user face image to the server through the central controller;
the server is used for comparing the received user face image with a face image database and feeding back user information to the central controller when the user identity identification is passed;
the loudspeaker is used for playing the customized greeting words according to the control of the central controller when the user identification passes; and the device is also used for playing the preset standard greeting according to the control of the central controller when the user identification fails.
4. The multi-functional interactive terminal of claim 3, wherein the touch screen is further configured to jump to and display a corresponding service interface according to the control of the central controller based on the received user's service reservation command after the user's identification is passed;
and the loudspeaker is also used for playing the reserved service result according to the control of the central controller after the user finishes the reserved service.
5. The multi-functional interactive terminal of claim 3, characterized in that the face image acquisition module comprises at least an RGB camera.
6. The multi-functional interactive terminal of claim 3, wherein the central controller is further configured to control the voice collection module to collect voice information after the voice wake-up word is collected by the voice collection module;
the voice acquisition module is also used for sending the acquired voice information to the server through the central controller;
the server is also used for carrying out voice recognition on the received voice information and feeding back a voice recognition result to the central controller;
and the central controller is also used for controlling the touch display screen to display a corresponding interface according to the voice recognition result fed back by the server and controlling the loudspeaker to play the voice feedback result.
7. The multi-functional interactive terminal according to claim 1, characterized in that the human body detection module comprises at least a depth of field camera, and the central controller comprises at least an information acquisition unit and an information processing unit;
the information acquisition unit is used for receiving the user depth image acquired by the human body detection module;
the information processing unit is used for identifying the distance between the user depth image received by the information acquisition unit and the multifunctional interactive terminal;
and the central controller is used for controlling the touch display screen to display the main function interface when the information processing unit identifies that the distance between the user depth image and the multifunctional interactive terminal is less than the preset distance.
8. The multi-function interactive terminal of claim 1, further comprising a timer connected to the central controller;
the timer is used for starting timing according to the control of the central controller when the human body detection module detects that the distance between a human body and the multifunctional interactive terminal is smaller than the preset distance and the touch display screen displays the main function interface;
and the central controller is also used for controlling the loudspeaker to play preset voice after the timer counts time and exceeds a preset time length.
9. The multi-function interactive terminal of claim 1, further comprising a power on and power off module,
the central controller is used for controlling the touch display screen to display a standby interface after receiving a starting-up instruction; and the central controller is also used for controlling the touch display screen to display a shutdown interface after receiving the shutdown instruction so as to control the multifunctional interactive terminal to shut down.
10. The multi-functional interactive terminal of claim 1, wherein the sound collection module comprises at least a microphone array and the touch display comprises at least a touch screen and a display screen.
CN202120553174.6U 2021-03-17 2021-03-17 Multifunctional interactive terminal Active CN214335699U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202120553174.6U CN214335699U (en) 2021-03-17 2021-03-17 Multifunctional interactive terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202120553174.6U CN214335699U (en) 2021-03-17 2021-03-17 Multifunctional interactive terminal

Publications (1)

Publication Number Publication Date
CN214335699U true CN214335699U (en) 2021-10-01

Family

ID=77888626

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202120553174.6U Active CN214335699U (en) 2021-03-17 2021-03-17 Multifunctional interactive terminal

Country Status (1)

Country Link
CN (1) CN214335699U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115268293A (en) * 2022-09-29 2022-11-01 珠海进田电子科技有限公司 Touch screen control panel based on whole-house intelligent household appliance control

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115268293A (en) * 2022-09-29 2022-11-01 珠海进田电子科技有限公司 Touch screen control panel based on whole-house intelligent household appliance control

Similar Documents

Publication Publication Date Title
CN106343833A (en) Intelligent mirror
CN110827818B (en) Control method, device, equipment and storage medium of intelligent voice equipment
CN106440192A (en) Household appliance control method, device and system and intelligent air conditioner
CN105094133A (en) Health service robot based on multifunctional intelligent electronic medicine kit
CN204945795U (en) A kind of health service robot based on multifunctional intellectual electronic medicine box
CN109447232A (en) Robot active inquiry method, apparatus, electronic equipment and storage medium
EP3343936A2 (en) Smart electronic device
CN113138705A (en) Method, device and equipment for adjusting display mode of display interface
CN214335699U (en) Multifunctional interactive terminal
CN109619801A (en) Intelligent cosmetic mirror
CN114014111B (en) Non-contact intelligent elevator control system and method
EP3869301A1 (en) Information processing device, information processing method, and computer program
CN212581260U (en) Non-contact man-machine interaction system for elevator
CN111573445A (en) Non-contact man-machine interaction system for elevator
CN110822641A (en) Air conditioner, control method and device thereof and readable storage medium
WO2021212388A1 (en) Interactive communication implementation method and device, and storage medium
CN202771369U (en) Man-machine interface device based on multiprocessor
CN111103982A (en) Data processing method, device and system based on somatosensory interaction
US20210264827A1 (en) Smart interactive display device, smart interactive display system, and interactive display method thereof
CN205438581U (en) Cosmetic service robot
CN209086961U (en) A kind of information kiosk and its system for human-computer interaction
CN104320710A (en) Exclusive interactive system customized aiming at different user groups and interactive method
US20190179421A1 (en) Reminder or gesture control device wearable by a user
CN211466402U (en) Service robot
CN212276808U (en) Integrated terminal device based on artificial intelligence voice interaction system

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant