CN111078036A - Interactive multimedia display system and network-based control method thereof - Google Patents
Interactive multimedia display system and network-based control method thereof Download PDFInfo
- Publication number
- CN111078036A CN111078036A CN202010036483.6A CN202010036483A CN111078036A CN 111078036 A CN111078036 A CN 111078036A CN 202010036483 A CN202010036483 A CN 202010036483A CN 111078036 A CN111078036 A CN 111078036A
- Authority
- CN
- China
- Prior art keywords
- data
- controller
- multimedia
- human
- balancing weight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0362—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/35—Switches specially adapted for specific applications
- H04L49/351—Switches specially adapted for specific applications for local area network [LAN], e.g. Ethernet switches
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to an interactive multimedia display system and a network-based control method thereof, wherein the interactive multimedia display system comprises a display device, a controller, an operating device, a displacement detection device, switch equipment, human-computer interaction equipment and a data memory, multimedia data for the display device to display are stored in the data memory, the operating device is provided with a balancing weight and an operating rod arranged on the balancing weight, the displacement detection device sends displacement detection data aiming at the movement of the balancing weight to the controller for processing, the controller instructs a display screen to display corresponding multimedia data according to the displacement condition of the balancing weight, and the operating experience effect of an ordinary user on the multimedia display system is realized; through the arrangement of the interactive machine equipment, the displacement detection device, the controller and the human-computer interaction equipment establish data interaction based on a local area network, so that the whole multimedia display system is simpler in structure and more convenient to wire and maintain.
Description
Technical Field
The invention relates to the field of multimedia display systems, in particular to an interactive multimedia display system and a network-based control method thereof.
Background
In recent years, with the development of national economy, science and technology, education and culture career and the improvement of comprehensive national force, multimedia technology is rapidly developed, and the application of multimedia display enters various fields of human life, such as museums, science and technology museums, cultural museums, enterprise and public institutions, theme parks, tourist attractions and the like, with extremely strong penetrability.
Current multimedia presentations feature mainly several aspects: firstly, the display occasions are wider; secondly, the displayed content is richer, namely the displayed content can be increased from propaganda policies and reflecting economy; revealing a phenomenon, demonstrating a rule and explaining a scientific principle; and then to establish an enterprise image, introduce a product and the like, tens of thousands of contents and information need to be transmitted.
Although the existing multimedia display scheme meets the requirement of people for acquiring various information to a certain extent and enriches the propaganda forms, a common user serving as a non-multimedia manager still serves as a receiver of multimedia content, lacks the interaction between the user and a multimedia display system, cannot be truly integrated into the transmission process of the multimedia content, and is difficult to realize the interaction between the user and the multimedia display system, thereby greatly reducing the longitudinal degree of people for the existing multimedia display system.
Disclosure of Invention
The first technical problem to be solved by the present invention is to provide an interactive multimedia presentation system aiming at the above prior art.
The second technical problem to be solved by the present invention is to provide a network-based control method for the interactive multimedia presentation system.
The third technical problem to be solved by the present invention is to provide another network-based control method for the interactive multimedia presentation system.
The technical scheme adopted by the invention for solving the first technical problem is as follows: an interactive multimedia presentation system comprising:
a display device;
the controller is connected with the display device;
an object stage having a slide rail disposed along a length direction thereof;
characterized in that, display device has two at least display screens, interactive multimedia display system still includes:
the control device is slidably positioned in the slide rail and is provided with a balancing weight and an operating rod, and the operating rod is arranged on the balancing weight;
the displacement detection device is connected with the controller and is used for detecting the moving distance of the balancing weight; the displacement detection device is arranged at one end part of the slide rail;
the switch equipment at least comprises a local area network switch, wherein one end of the local area network switch is connected with the displacement detection device, and the other end of the local area network switch is connected with the controller;
the man-machine interaction device is provided with an input device for receiving a user instruction, and is connected with the switch device;
a data storage connected to the display device and the controller, respectively, the data storage having a first data storage area for storing environmental parameter data and a second data storage area for storing multimedia data; the second data storage area stores multimedia data; the multimedia data is at least one of video data, audio data, image data and text data.
In an improvement, the interactive multimedia presentation system further comprises:
the projection equipment is provided with an electric bracket for realizing 360-degree rotation and a projector positioned on the electric bracket, wherein the electric bracket and the projector are respectively connected with the controller, and the projector is connected with the data storage;
the light-emitting device is provided with a light-emitting driving chip and a plurality of LED lamps which respectively emit light rays with different colors, and the light-emitting driving chip is connected with the controller;
the audio playing device is respectively connected with the controller and the data memory;
the human body infrared sensor is respectively connected with the controller and the data memory and is arranged on the human-computer interaction equipment;
the gesture recognition device is connected with the controller;
the illumination intensity sensor is respectively connected with the controller and the data memory;
the temperature sensor is respectively connected with the controller and the data memory;
the humidity sensor is respectively connected with the controller and the data memory;
the wind speed sensor is respectively connected with the controller and the data memory;
a smoke releasing device having a smoke releasing unit capable of emitting smoke of different colors;
the air blowing device is connected with the controller;
the heating device is connected with the controller;
the refrigerating device is connected with the controller;
the camera is respectively connected with the controller and the data memory;
the audio acquisition device is connected with the controller and used for acquiring a voice instruction sent by a user;
the audio recognition device is respectively connected with the audio acquisition device, the controller and the data memory;
the man-machine interaction equipment is provided with a Bluetooth device which can be connected with a mobile terminal of a user.
Specifically, in the interactive multimedia display system, the displacement detection device is a distance meter capable of emitting infrared rays to the counterweight.
The technical scheme adopted by the invention for solving the second technical problem is as follows: a network-based control method of the interactive multimedia presentation system is characterized by comprising the following steps:
step 1, the displacement detection device detects the moving distance of a balancing weight in the control device and sends the detected balancing weight displacement data to a controller;
step 2, the controller makes a judgment according to the received balancing weight displacement data:
when the displacement data of the balancing weight block reaches a preset displacement value, the controller commands a display screen corresponding to the preset displacement value to call corresponding multimedia data in the data storage, and the step 3 is carried out; otherwise, the controller does not send the command to any display screen; each display screen corresponds to a preset displacement value, and each preset displacement value is in one-to-one correspondence with the multimedia data in the data storage;
and 3, displaying the called multimedia data by the display screen, and playing the audio data contained in the multimedia data by an audio playing device.
The technical scheme adopted by the invention for solving the third technical problem is as follows: a network-based control method of the interactive multimedia presentation system is characterized by comprising the following steps:
a1, starting the detection work of the human body infrared sensor on the human body infrared signal;
a2, when the human body infrared sensor detects a human body infrared signal, the human body infrared sensor sends the detection result to the controller; otherwise, the human body infrared sensor does not send any information to the controller;
step a3, the controller commands the displacement detection device to start detection work;
a4, the displacement detection device detects the moving distance of the balancing weight in the control device and sends the detected balancing weight displacement data to the controller;
step a5, the controller makes a judgment according to the received counterweight displacement data:
when the displacement data of the balancing weight reaches a preset displacement value, the controller commands the display screen corresponding to the preset displacement value to call the corresponding multimedia data in the data memory, and the step a6 is carried out; otherwise, the controller does not send the command to any display screen; each display screen corresponds to a preset displacement value, and each preset displacement value is in one-to-one correspondence with the multimedia data in the data storage;
step a6, the controller analyzes the multimedia data called by the display screen and makes processing according to the analysis result:
when the content corresponding to the multimedia data contains the environmental scene, go to step a 8; otherwise, go to step a 7;
step a7, the display screen displays the called multimedia data and the audio playing device plays the audio data contained in the multimedia data;
step a8, the controller commands the device corresponding to the environmental scene to start working and receives the data sent by the sensor related to the environment corresponding to the environmental scene; the device corresponding to the environment scene is at least one of a light-emitting device, a smoke releasing device, a blowing device, a heating device or a cooling device; correspondingly, the sensor related to the environment corresponding to the environment scene is at least one of an illumination intensity sensor, a wind speed sensor, a temperature sensor or a humidity sensor;
step a9, the controller makes a judgment on the current environment construction situation of the user according to the received data of the sensors related to the environment:
when the data of the sensors related to the environment are matched with the environmental data corresponding to the environmental scene, the controller does not process the data; otherwise, the controller commands the device corresponding to the environmental scene to adjust the working state, so that the data of the sensor corresponding to the environment after adjustment are all matched with the environmental data corresponding to the environmental scene.
In a further improvement, in the network-based control method of the interactive multimedia presentation system, the step of transferring from the step a2 to the step a3 further includes:
step a21, the audio acquisition device acquires external voice data and sends the voice data to the audio recognition device;
step a22, when the audio recognition device judges that the voice data is consistent with the control instruction pre-stored by the audio recognition device, the audio recognition device sends the control instruction to the controller, and the step a23 is switched to; otherwise, the audio recognition device does not perform any processing, and proceeds to step a 24;
a step a23 in which the controller instructs the device corresponding to the control command to execute the operation corresponding to the control command, and the process proceeds to a step a 24;
step a24, the gesture recognition device judges the gesture of the person appearing at the human-computer interaction device:
when the gesture of the person is consistent with the control instruction prestored in the gesture recognition device, the gesture recognition device sends the control instruction to the controller, and the step a25 is carried out; otherwise, the gesture recognition apparatus does not perform any processing, and proceeds to step a 26;
step a25, the controller commands the device corresponding to the control command to execute the action corresponding to the control command, and the process proceeds to step a 26;
and step a26, the controller commands the camera to start the shooting work and stores the shot data in the data memory.
In a further improvement, in the network-based control method of the interactive multimedia presentation system, the controller receives an external input instruction sent by the input device of the human-computer interaction device, and instructs a device corresponding to the external input instruction to execute an action corresponding to the external input instruction.
In another improvement, in the network-based control method of the interactive multimedia presentation system, step a9 is followed by:
a10, the blue tooth device of the man-machine interactive device receives the pairing communication request sent by the mobile terminal of the user;
step a11, after the human-computer interaction device establishes Bluetooth communication with a mobile terminal of a user, the human-computer interaction device receives data to be displayed sent by the mobile terminal;
step a12, the human-computer interaction equipment sends the data to be displayed to a controller through switch equipment;
step a13, the controller judges the validity of the data to be displayed:
when the data to be displayed is legal data, the controller randomly orders the display screen in an idle state to display the data to be displayed; otherwise, the controller does not process and does not feed back any information to the user's mobile terminal.
Compared with the prior art, the invention has the advantages that:
firstly, the interactive multimedia display system is provided with the control device with the balancing weight and the operating rod, and the displacement detection device sends displacement detection data aiming at the movement of the balancing weight to the controller for processing, so that the controller orders the display screen to display corresponding multimedia data according to the displacement condition of the balancing weight, and the control experience effect of an ordinary user on the multimedia display system is realized;
secondly, by arranging the interactive machine equipment, the displacement detection device, the controller and the human-computer interactive equipment establish data interaction based on a local area network, so that the whole multimedia display system is simpler in structure and more convenient to wire and maintain;
thirdly, through setting different execution devices (such as a light-emitting device, a smoke releasing device, a blowing device, a heating device and a refrigerating device) related to the environment and sensors (such as an illumination intensity sensor, an air speed sensor, a temperature sensor and a humidity sensor) for detecting environmental parameters, the controller can adjust the corresponding execution devices to work according to data sent by the sensors, so that the parameters of the current environment where the user is located meet the environment scene corresponding to the multimedia data displayed on the display screen, the on-site body-focusing experience effect of the user on the displayed multimedia data is met, the sensory experience of the user displayed by the multimedia display system is enriched, and the user is more pleased.
Drawings
FIG. 1 is a schematic diagram of an interactive multimedia presentation system according to an embodiment of the present invention;
FIG. 2 is a schematic view of an arrangement structure among a slide rail, an operation device and a displacement detection device according to an embodiment of the present invention;
FIG. 3 is an enlarged view of portion A of FIG. 2;
FIG. 4 is a top plan view of the arrangement shown in FIG. 2;
FIG. 5 is an exploded view of the arrangement of FIG. 2;
FIG. 6 is a flowchart illustrating a first network-based control method of the interactive multimedia presentation system according to an embodiment of the present invention;
fig. 7 is a flowchart illustrating a second network-based control method of the interactive multimedia presentation system according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the accompanying examples.
As shown in fig. 1 to 5, the embodiment provides an interactive multimedia presentation system, including:
a display device 101, the display device 101 having three display screens 1011;
a controller 102 connected to the display device 101;
an object stage having a slide rail 103 provided along a length direction thereof;
the control device 104 is slidably located in the slide rail 103, the control device 104 has a weight block 1041 and an operating rod 1042, the operating rod 1042 is disposed on the weight block 1041;
a displacement detecting device 105 connected to the controller 102, the displacement detecting device 105 being configured to detect a moving distance of the counterweight 1041; the displacement detecting device 105 is provided at one end of the slide rail 103; for example, in this embodiment, the displacement detection device 105 is a range finder capable of emitting infrared rays to the weight block 1041;
a switch device 106 having a lan switch 1061, one end of the lan switch 1061 being connected to the displacement detecting device 105, and the other end of the lan switch 1061 being connected to the controller 102;
a human-machine interaction device 107 having an input device 1071 for receiving a user instruction and a bluetooth device 1072 capable of connecting a mobile terminal of a user, the human-machine interaction device 107 being connected to the switch device 106; the user can establish communication connection with the human-computer interaction equipment through the mobile terminal with the Bluetooth function;
a data memory 108 connected to the display apparatus 101 and the controller 102, respectively, the data memory 108 having a first data storage area 1081 for storing environmental parameter data and a second data storage area 1082 for storing multimedia data; the second data storage area 1082 stores multimedia data; the media data is at least one of video data, audio data, image data and text data;
the projection device 109 is provided with an electric bracket 1091 for realizing 360-degree rotation and a projector 1092 positioned on the electric bracket 1091, the electric bracket 1091 and the projector 1092 are respectively connected with the controller 102, and the projector 1092 is connected with the data storage 108; the electric bracket 1091 can rotate within an angle range of 360 degrees under the control of the controller 102;
a light emitting device 110 having a light emitting driving chip and a plurality of LED lamps respectively emitting light of different colors, the light emitting driving chip being connected to the controller 102;
an audio playing device 111 respectively connected to the controller 102 and the data storage 108; the audio playing device 111 can play the audio data stored in the data storage 108;
the human body infrared sensor 112 is respectively connected with the controller 102 and the data memory 108, and the human body infrared sensor 112 is arranged on the human-computer interaction device 107; by arranging the human body infrared sensor 112, whether a person walks around the human-computer interaction device 107 can be detected, so that the controller 102 can command other devices to start working as required;
a gesture recognition device 113 connected to the controller 102; the gesture recognition device 113 is preferably arranged in close proximity to the human-computer interaction device 107 to recognize the gesture of the user and obtain a control instruction to be transmitted by the gesture of the user;
an illumination intensity sensor 114 respectively connected to the controller 102 and the data storage 108; the light intensity sensor 114 is used to detect the light intensity of the current environment where the user is located, so that the controller 102 can adjust the light intensity to a suitable range by controlling the relevant devices;
a temperature sensor 115 respectively connected with the controller 102 and the data memory 108; the temperature sensor 115 is used to detect the temperature condition of the current environment where the user is located, so that the controller 102 can adjust the temperature to a suitable range by controlling the relevant devices;
a humidity sensor 116 connected to the controller 102 and the data storage 108, respectively; the humidity sensor 116 is used to detect the humidity of the current environment where the user is located, so that the controller 102 can adjust the humidity to a suitable range by controlling the relevant devices;
a wind speed sensor 117 connected to the controller 102 and the data storage 108, respectively; the wind speed sensor 117 is used to detect the wind speed of the current environment where the user is located, so that the controller 102 can adjust the wind speed to a suitable range by controlling the relevant devices;
a smoke releasing device 118 having a smoke releasing unit capable of emitting smoke of different colors;
a blower 119 connected to the controller 102; the blower 119 can be activated or adjusted according to the instruction of the controller 102, so that the wind speed of the current environment where the user is located reaches a suitable range;
a heating device 120 connected to the controller 102; the heating device 120 can be activated or adjusted according to the instruction of the controller 102, so that the temperature of the current environment where the user is located reaches a suitable range;
a refrigeration device 121 connected to the controller 102; the refrigeration device 121 can be activated or adjusted according to the instruction of the controller 102, so that the temperature of the current environment where the user is located is reduced to a proper range;
a camera 122 connected to the controller 102 and the data storage 108, respectively;
the audio acquisition device 123 is connected with the controller 102 and used for acquiring a voice instruction sent by a user;
the audio recognition device 124 is respectively connected with the audio acquisition device 123, the controller 102 and the data memory 108; the audio recognition device 124 can recognize the instruction transmitted by the user through the voice according to the user voice instruction collected by the audio collection device 123, and send the instruction to the controller 102 for processing;
the mobile terminal of the user can receive the multimedia data of the data storage after being verified by the man-machine interaction equipment, and the content of the mobile terminal is displayed on the display screen.
The interactive multimedia display system is provided with the control device with the balancing weight and the operating rod, and the displacement detection device sends displacement detection data aiming at the movement of the balancing weight to the controller for processing, so that the controller orders the display screen to display corresponding multimedia data according to the displacement condition of the balancing weight, and the control experience effect of a common user on the multimedia display system is realized; in addition, through the arrangement of the interactive machine equipment, the displacement detection device, the controller and the human-computer interactive equipment establish data interaction based on a local area network, so that the whole multimedia display system is simpler in structure and more convenient to wire and maintain.
Referring to fig. 6, the embodiment provides a network-based control method of the interactive multimedia presentation system. Specifically, with reference to fig. 1 to 5, the network-based control method of the interactive multimedia presentation system includes the following steps:
step 1, the displacement detection device 105 detects the moving distance of the balancing weight 1041 in the control device 104, and sends the detected balancing weight displacement data to the controller 102;
step 2, the controller 102 makes a judgment according to the received displacement data of the balancing weight:
when the displacement data of the balancing weight reaches the preset displacement value, it indicates that the balancing weight 1041 has been moved to the position where the multimedia data should be played by the user at this time, the controller 102 commands the display screen 1011 corresponding to the preset displacement value to call the corresponding multimedia data in the data memory 108, and the procedure goes to step 3; otherwise, the controller 102 does not send commands to any of the display screens; each display screen corresponds to a preset displacement value, and each preset displacement value is in one-to-one correspondence with the multimedia data in the data storage 108;
step 3, the display screen 1011 displays the called multimedia data, and the audio playing device 111 plays the audio data contained in the multimedia data.
Moreover, the embodiment also provides another network-based control method for the interactive multimedia presentation system. Specifically, referring to fig. 7 in combination with fig. 1 to 5, the network-based control method of the interactive multimedia presentation system includes the following steps:
step a1, the human body infrared sensor 112 starts the detection work of the human body infrared signal;
step a2, when the human body infrared sensor 112 detects a human body infrared signal, it indicates that a person walks around at the human-computer interaction device 107, and the human body infrared sensor 112 sends the detection result to the controller 102; otherwise, the human body infrared sensor 112 does not send any information to the controller 102;
step a3, the controller 102 commands the displacement detecting device 105 to start detecting work;
step a4, the displacement detecting device 105 detects the moving distance of the counterweight block 1041 in the control device 104, and sends the detected displacement data of the counterweight block to the controller 102;
in step a5, the controller 102 makes a judgment according to the received counterweight displacement data:
when the displacement data of the balancing weight reaches the preset displacement value, which indicates that the balancing weight 1041 has been moved to the position where the multimedia data should be played by the user at this time, the controller 102 instructs the display screen 10111 corresponding to the preset displacement value to call the corresponding multimedia data in the data storage 108, and the step a6 is performed; otherwise, the controller 108 does not send commands to any of the display screens; each display screen corresponds to a preset displacement value, and each preset displacement value is in one-to-one correspondence with the multimedia data in the data storage 108;
in step a6, the controller 102 parses the multimedia data called for by the display screen 1011, and performs processing according to the parsing result:
when the content corresponding to the multimedia data contains the environmental scene, go to step a 8; otherwise, go to step a 7;
step a7, the display screen 1011 displays the called multimedia data, and the audio playing device 111 plays the audio data contained in the multimedia data;
step a8, the controller 102 commands the device corresponding to the environmental scene to start working and receives the data sent by the sensor related to the environment corresponding to the environmental scene; the device corresponding to the environmental scene is at least one of a light emitting device 110, a smoke releasing device 118, an air blowing device 119, a heating device 120 or a cooling device 121; correspondingly, the sensor related to the environment corresponding to the environmental scene is at least one of an illumination intensity sensor 114, a wind speed sensor 117, a temperature sensor 115 or a humidity sensor 116;
in step a9, the controller 102 makes a judgment on the current environment construction situation of the user according to the received data of the sensors related to the environment:
when the data of the sensors related to the environment are matched with the environmental data corresponding to the environmental scene, the controller does not process the data; otherwise, the controller 102 commands the device corresponding to the environmental scenario to adjust the operating status, so that the data of the sensor corresponding to the environment after adjustment matches the environmental data corresponding to the environmental scenario.
As for the step a9, assuming that the multimedia data is video data and contains a scene related to wind blowing by the analysis of the controller, the controller will command the blowing device to start blowing operation to blow wind, and if the controller determines that the current wind speed detected by the wind speed sensor reaches the wind speed value required by the wind blowing scene of the multimedia data, the controller will command the blowing device to maintain the current state; if the controller judges that the current wind speed detected by the wind speed sensor deviates from the range of the wind speed value required by the windy scene of the multimedia data, the controller commands the blowing device to reduce or increase the blowing power so that the wind speed detected by the wind speed sensor is within the range of the required wind speed value.
Through setting up different relevant final controlling element of environment (such as illuminator, smog release device, air-blast device, heating device and refrigerating plant) and the sensor (such as illumination intensity sensor, air velocity transducer, temperature sensor and humidity transducer) that detects the environmental parameter, can make the controller can be according to the above-mentioned final controlling element work that the data adjustment that this type of sensor sent corresponds, so that the parameter of the current environment that the user locates satisfies the environmental scene that the multimedia data that the display screen shows at present corresponds, the on-the-spot experience effect of cutting one's body of user to the multimedia data that demonstrate has been satisfied, the sense organ experience that multimedia presentation system demonstrates for the user has been enriched, more enjoyment.
Of course, as a link for realizing the interaction between the user and the interactive multimedia presentation system, the method for controlling the interactive multimedia presentation system based on the network further includes the following steps before the step a2 is transferred to the step a 3:
step a21, the audio acquisition device 123 acquires external voice data and sends the voice data to the audio recognition device 124;
step a22, when the audio recognition device 124 determines that the voice data is consistent with the control command pre-stored in the audio recognition device, the audio recognition device 124 sends the control command to the controller 102, and the process goes to step a 23; otherwise, the audio recognition device 124 does not perform any processing, and proceeds to step a 24;
step a23, the controller 102 instructs the device corresponding to the control command to execute the action corresponding to the control command, and the process proceeds to step a 24;
step a24, the gesture recognition device 113 determines the gesture of the person appearing at the human-computer interaction device 107:
when the gesture of the person is consistent with the control command pre-stored in the gesture recognition device, the gesture recognition device 113 sends the control command to the controller 102, and the process proceeds to step a 25; otherwise, the gesture recognition apparatus 113 does not perform any processing, and proceeds to step a 26;
step a25, the controller 102 commands the device corresponding to the control command to execute the action corresponding to the control command, and the process proceeds to step a 26;
in step a26, the controller 102 commands the camera 122 to start the image capture operation and saves the captured data in the data storage 108.
Of course, the controller 102 may also receive an external input instruction sent by the input device 1071 of the human-computer interaction device 107, and instruct a device corresponding to the external input instruction to perform an action corresponding to the external input instruction.
In order to further enhance the experience effect of the user, the network-based control method of the interactive multimedia presentation system of this embodiment further includes, after step a 9:
step a10, the bluetooth device 1072 of the human-computer interaction device 107 receives the pairing communication request sent by the mobile terminal of the user;
step a11, after the human-computer interaction device 107 establishes bluetooth communication with the mobile terminal of the user, the human-computer interaction device 107 receives the data to be displayed sent by the mobile terminal;
step a12, the human-computer interaction device 107 sends the data to be displayed to the controller 102 through the switch device 106;
in step a13, the controller 102 determines the validity of the data to be displayed:
when the data to be displayed is legal data, the controller 102 randomly commands the display screen 1011 in the idle state to display the data to be displayed; otherwise, the controller 102 disregards and does not feed back any information to the user's mobile terminal.
Claims (10)
1. An interactive multimedia presentation system comprising:
a display device (101);
a controller (102) connected to the display device (101);
an object stage having a slide rail (103) provided along a longitudinal direction thereof;
characterized in that the display device (101) has at least two display screens (1011), the interactive multimedia presentation system further comprising:
the control device (104) is slidably positioned in the slide rail (103), the control device (104) is provided with a balancing weight (1041) and an operating rod (1042), and the operating rod (1042) is arranged on the balancing weight (1041);
a displacement detection device (105) connected to the controller (102), wherein the displacement detection device (105) is used for detecting the moving distance of the counterweight block (1041); the displacement detection device (105) is arranged at one end part of the slide rail (103);
a switch device (106) having at least a local area network switch (1061), one end of the local area network switch (1061) being connected to the displacement detection device (105), the other end of the local area network switch (1061) being connected to the controller (102);
a human-machine interaction device (107) having an input device (1071) for receiving a user instruction, the human-machine interaction device (107) being connected to the switch device (106);
a data memory (108) connected to the display device (101) and the controller (102), respectively, the data memory (108) having a first data storage area (1081) for storing environmental parameter data and a second data storage area (1082) for storing multimedia data; the second data storage area (1082) stores multimedia data; the multimedia data is at least one of video data, audio data, image data and text data.
2. The interactive multimedia presentation system of claim 1, further comprising:
the projection equipment (109) is provided with an electric bracket (1091) for realizing 360-degree rotation and a projector (1092) positioned on the electric bracket (1091), the electric bracket (1091) and the projector (1092) are respectively connected with the controller (102), and the projector (1092) is connected with the data memory (108);
the light-emitting device (110) is provided with a light-emitting driving chip and a plurality of LED lamps which respectively emit light rays with different colors, and the light-emitting driving chip is connected with the controller (102);
the audio playing device (111) is respectively connected with the controller (102) and the data memory (108);
the human body infrared sensor (112) is respectively connected with the controller (102) and the data memory (108), and the human body infrared sensor (112) is arranged on the human-computer interaction device (107);
a gesture recognition device (113) connected to the controller (102);
the illumination intensity sensor (114) is respectively connected with the controller (102) and the data memory (108);
the temperature sensor (115) is respectively connected with the controller (102) and the data memory (108);
the humidity sensor (116) is respectively connected with the controller (102) and the data memory (108);
the wind speed sensor (117) is respectively connected with the controller (102) and the data memory (108);
a smoke release device (118) having a smoke release unit capable of emitting smoke of different colors;
a blower device (119) connected to the controller (102);
a heating device (120) connected to the controller (102);
a refrigeration device (121) connected to the controller (102);
the camera (122) is respectively connected with the controller (102) and the data memory (108);
the audio acquisition device (123) is connected with the controller (102) and is used for acquiring a voice instruction sent by a user;
the audio recognition device (124) is respectively connected with the audio acquisition device (123), the controller (102) and the data memory (108);
wherein the human-computer interaction device (107) has a Bluetooth means (1072) capable of connecting to a mobile terminal of a user.
3. The interactive multimedia presentation system according to claim 1, wherein the displacement detection device (105) is a distance meter capable of emitting infrared light towards the weight block (1041).
4. An interactive multimedia presentation system according to claim 1, wherein the manipulation means (104) are arranged on the human interaction device (107).
5. A network-based control method of the interactive multimedia presentation system of claim 1, comprising the steps of:
step 1, the displacement detection device detects the moving distance of a balancing weight in the control device and sends the detected balancing weight displacement data to a controller;
step 2, the controller makes a judgment according to the received balancing weight displacement data:
when the displacement data of the balancing weight block reaches a preset displacement value, the controller commands a display screen corresponding to the preset displacement value to call corresponding multimedia data in the data storage, and the step 3 is carried out; otherwise, the controller does not send the command to any display screen; each display screen corresponds to a preset displacement value, and each preset displacement value is in one-to-one correspondence with the multimedia data in the data storage;
and 3, displaying the called multimedia data by the display screen.
6. The network-based control method of the interactive multimedia presentation system according to claim 5, wherein the step 3 further comprises: and playing the audio data in the multimedia data.
7. A network-based control method of the interactive multimedia presentation system of claim 2, comprising the steps of:
a1, starting the detection work of the human body infrared sensor on the human body infrared signal;
a2, when the human body infrared sensor detects a human body infrared signal, the human body infrared sensor sends the detection result to the controller; otherwise, the human body infrared sensor does not send any information to the controller;
step a3, the controller commands the displacement detection device to start detection work;
a4, the displacement detection device detects the moving distance of the balancing weight in the control device and sends the detected balancing weight displacement data to the controller;
step a5, the controller makes a judgment according to the received counterweight displacement data:
when the displacement data of the balancing weight reaches a preset displacement value, the controller commands the display screen corresponding to the preset displacement value to call the corresponding multimedia data in the data memory, and the step a6 is carried out; otherwise, the controller does not send the command to any display screen; each display screen corresponds to a preset displacement value, and each preset displacement value is in one-to-one correspondence with the multimedia data in the data storage;
step a6, the controller analyzes the multimedia data called by the display screen and makes processing according to the analysis result:
when the content corresponding to the multimedia data contains the environmental scene, go to step a 8; otherwise, go to step a 7;
step a7, the display screen displays the called multimedia data and the audio playing device plays the audio data contained in the multimedia data;
step a8, the controller commands the device corresponding to the environmental scene to start working and receives the data sent by the sensor related to the environment corresponding to the environmental scene; the device corresponding to the environment scene is at least one of a light-emitting device, a smoke releasing device, a blowing device, a heating device or a cooling device; correspondingly, the sensor related to the environment corresponding to the environment scene is at least one of an illumination intensity sensor, a wind speed sensor, a temperature sensor or a humidity sensor;
step a9, the controller makes a judgment on the current environment construction situation of the user according to the received data of the sensors related to the environment:
when the data of the sensors related to the environment are matched with the environmental data corresponding to the environmental scene, the controller does not process the data; otherwise, the controller commands the device corresponding to the environmental scene to adjust the working state, so that the data of the sensor corresponding to the environment after adjustment are all matched with the environmental data corresponding to the environmental scene.
8. The network-based control method of an interactive multimedia presentation system according to claim 7, wherein the step of transferring from step a2 to step a3 further comprises:
step a21, the audio acquisition device acquires external voice data and sends the voice data to the audio recognition device;
step a22, when the audio recognition device judges that the voice data is consistent with the control instruction pre-stored by the audio recognition device, the audio recognition device sends the control instruction to the controller, and the step a23 is switched to; otherwise, the audio recognition device does not perform any processing, and proceeds to step a 24;
a step a23 in which the controller instructs the device corresponding to the control command to execute the operation corresponding to the control command, and the process proceeds to a step a 24;
step a24, the gesture recognition device judges the gesture of the person appearing at the human-computer interaction device:
when the gesture of the person is consistent with the control instruction prestored in the gesture recognition device, the gesture recognition device sends the control instruction to the controller, and the step a25 is carried out; otherwise, the gesture recognition apparatus does not perform any processing, and proceeds to step a 26;
step a25, the controller commands the device corresponding to the control command to execute the action corresponding to the control command, and the process proceeds to step a 26;
and step a26, the controller commands the camera to start the shooting work and stores the shot data in the data memory.
9. The network-based control method of an interactive multimedia presentation system according to claim 8, wherein the controller receives an external input command sent from the input device of the human-computer interaction device, and commands the device corresponding to the external input command to execute the action corresponding to the external input command.
10. The network-based control method of an interactive multimedia presentation system according to claim 9, wherein step a9 is followed by further comprising:
a10, the blue tooth device of the man-machine interactive device receives the pairing communication request sent by the mobile terminal of the user;
step a11, after the human-computer interaction device establishes Bluetooth communication with a mobile terminal of a user, the human-computer interaction device receives data to be displayed sent by the mobile terminal;
step a12, the human-computer interaction equipment sends the data to be displayed to a controller through switch equipment;
step a13, the controller judges the validity of the data to be displayed:
when the data to be displayed is legal data, the controller randomly orders the display screen in an idle state to display the data to be displayed; otherwise, the controller does not process and does not feed back any information to the user's mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010036483.6A CN111078036A (en) | 2020-01-14 | 2020-01-14 | Interactive multimedia display system and network-based control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010036483.6A CN111078036A (en) | 2020-01-14 | 2020-01-14 | Interactive multimedia display system and network-based control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111078036A true CN111078036A (en) | 2020-04-28 |
Family
ID=70323212
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010036483.6A Pending CN111078036A (en) | 2020-01-14 | 2020-01-14 | Interactive multimedia display system and network-based control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111078036A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112379777A (en) * | 2020-11-23 | 2021-02-19 | 南京科盈信息科技有限公司 | Digital exhibition room gesture recognition system based on target tracking |
| WO2023186036A1 (en) * | 2022-03-31 | 2023-10-05 | 周海涛 | Controller having displacement measurement devices, and displacement control method therefor |
-
2020
- 2020-01-14 CN CN202010036483.6A patent/CN111078036A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112379777A (en) * | 2020-11-23 | 2021-02-19 | 南京科盈信息科技有限公司 | Digital exhibition room gesture recognition system based on target tracking |
| WO2023186036A1 (en) * | 2022-03-31 | 2023-10-05 | 周海涛 | Controller having displacement measurement devices, and displacement control method therefor |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109076678B (en) | Illumination for video games | |
| CN103716953B (en) | Illuminator | |
| JP6749711B2 (en) | Communication robot and communication system | |
| CN111078036A (en) | Interactive multimedia display system and network-based control method thereof | |
| TWI547174B (en) | Video playback system for enhancing drama effect and related computer program product | |
| US9942967B2 (en) | Controlling lighting dynamics | |
| JPH11327753A (en) | Control method and program recording medium | |
| JP2009505207A (en) | Interactive entertainment system and method of operation thereof | |
| CN211827862U (en) | Multimedia interactive electronic sand table | |
| JP6148958B2 (en) | A communication karaoke system that allows remote control of lighting using a portable terminal | |
| KR20090110896A (en) | Signage system | |
| CN210924530U (en) | Interactive multimedia display system | |
| US20160323534A1 (en) | Functional module system | |
| WO2015021028A1 (en) | Social media fountain | |
| CN111176431A (en) | Screen projection control method of sound box and sound box | |
| JP2004303251A (en) | Control method | |
| CN114937296A (en) | Acousto-optic matching method, system, equipment and storage medium based on user identification | |
| US20130172081A1 (en) | Game device, game control method, and game control program, for controlling picture drawing game | |
| JPH0773978A (en) | Lighting presentation device | |
| KR20170069593A (en) | Lighting device system | |
| US11470708B2 (en) | Event staging system and event staging program | |
| JP6186423B2 (en) | Ferris wheel | |
| CN112052725A (en) | Interaction method and interaction system of intelligent glasses and intelligent shoes | |
| KR20140112596A (en) | Control system of object using smart device | |
| JP2004289779A (en) | Mobile body imaging method and mobile body imaging system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |