US20180152497A1 - Method and multi-media device for video communication - Google Patents
Method and multi-media device for video communication Download PDFInfo
- Publication number
- US20180152497A1 US20180152497A1 US15/879,399 US201815879399A US2018152497A1 US 20180152497 A1 US20180152497 A1 US 20180152497A1 US 201815879399 A US201815879399 A US 201815879399A US 2018152497 A1 US2018152497 A1 US 2018152497A1
- Authority
- US
- United States
- Prior art keywords
- image data
- mobile device
- voice data
- display device
- media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H04L65/602—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
- H04L67/303—Terminal profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/567—Multimedia conference systems
Definitions
- the subject matter herein generally relates to video collection and transmission.
- An internet medium player, a set-top box, and other multi-media device are equipped in many family. Users may want to make a video of their own. Most multi-media devices are not equipped with the units such as a camera and a microphone, to make and transmit a video communication. The user needs to add camera and microphone to the multi-media device via wires, or through BLUETOOTH, or through a wireless network.
- the multi-media device by this way required a camera with perfect angle and focus, a program, a wide radio frequency band or bands to make the audio and video with no distorting.
- FIG. 1 illustrates a diagrammatic view of an operating environment of one embodiment of a multi-media device, in accordance with the present disclosure
- FIG. 2 is a functional block diagram of a multi-media device according to one embodiment of the disclosure.
- FIG. 3 is another functional block diagram of a multi-media device according to one embodiment of the disclosure.
- FIG. 4 is a framework diagram of the transmission of voice data by a multi-media device in accordance with one embodiment of the disclosure.
- FIG. 5 is a framework diagram of the transmission of image data by a multi-media device in accordance with one embodiment of the disclosure
- FIG. 6 is a flowchart of processes of a multi-media device transmitting voice data and image data to a remote communication device, in accordance with one embodiment of the disclosure.
- FIG. 7 is a flowchart of processes of a multi-media device transmitting voice data and image data from a remote communication device to a mobile device and a display device, in accordance with one embodiment of the disclosure.
- references to “an” or “one” embodiment in this disclosure are not necessarily to the same embodiment, and such references mean “at least one.”
- module refers to logic embodied in computing or firmware, or to a collection of software instructions, written in a programming language, such as, Java, C, or assembly.
- One or more software instructions in the modules may be embedded in firmware, such as in an erasable programmable read only memory (EPROM).
- EPROM erasable programmable read only memory
- the modules described herein may be implemented as either software and/or computing modules and may be stored in any type of non-transitory computer-readable medium or other storage device. Some non-limiting examples of non-transitory computer-readable media include CDs, DVDs, BLU-RAY, flash memory, and hard disk drives.
- the term “comprising”, when utilized, means “including, but not necessarily limited to”; it specifically indicates open-ended inclusion or membership in a so-described combination, group, series and the like.
- Embodiments of a multi-media device and a method for video communication are described.
- FIG. 1 illustrates an operating environment of one embodiment of a multi-media device 20 .
- the multi-media device 20 is placed in a wireless network 111 (e.g 4G, WIFI), and communicates with a mobile device 10 and with a remote communication device 11 via the wireless network 111 .
- the multi-media device 20 is electrically connected by wires with a display device 30 .
- the multi-media device 20 can be electrically connected with the display device 30 via the wireless network 111 .
- the wireless network 111 can be the wireless local area network 111 (e.g WIFI), 3G/4G or the like.
- the mobile device 10 can be equipped with a wireless transmission function.
- the mobile device 10 can be a device such as tablet computer (e.g IPAD) or Smart Phone with a camera, a microphone, a loudspeaker, and other hardware.
- the mobile device 10 sends a command of connection to the multi-media device 20 .
- the multi-media device 20 establishes a communication with the mobile device 10 after receiving the command from the mobile device 10 .
- the multi-media device 20 sends a control command to the mobile device 10 to obtain the information about the hardware configuration of the camera, the microphone, the loudspeaker, and other hardware of the mobile device 10 , and completes a video communication process with the mobile device 10 according to the configuration information.
- the multi-media device 20 also communicates with the remote communication device 11 selected by the user.
- the remote communication device 11 can be another mobile device which has a camera, a microphone, and a loudspeaker.
- one multi-media device 20 can communicate with several mobile devices 10 to build a video communication with several users, and one mobile device 10 can communicate, synchronously, with several multi-media devices 20 .
- the video communication takes place in the situation of one multi-media device 20 , one mobile device 10 , and one remote communication device 11 .
- the multi-media device 20 controls the mobile device 10 to obtain voice data via the microphone and capture image data via the camera when the matching of the communication and the connection between the mobile device 10 and the multi-media device 20 are completed. Then the multi-media device 20 controls the mobile device 10 to send voice data and image data to the multi-media device 20 via the wireless network 111 .
- the data obtained by mobile device 10 cannot be directly played on the remote communication device 11 .
- the multi-media device 20 therefore transforms the data obtained by the mobile device 10 into data recognizable by the remote communication device 11 .
- the multi-media device 20 transforms the voice data obtained by the mobile device 10 into voice data appropriate for the information about the hardware configuration of the remote communication device 11 .
- the multi-media device 20 sends the transformed voice data to the remote communication device 11 , so that playback of the transformed voice data can occur on the remote communication device 11 .
- the multi-media device 20 transforms the image data obtained by the mobile device 10 into image data appropriate for the information about the hardware configuration of the remote communication device 11 and the display device 30 .
- the multi-media device 20 sends the transformed image data to the remote communication device 11 and the display device 30 to play.
- the multi-media device 20 receives voice data and image data of a user from a remote communication device 11 .
- the multi-media device 20 transforms the voice data received from the remote communication device 11 into voice data appropriate for the information about the hardware configuration of the loudspeaker of the mobile device 10 , and then sends the transformed voice data to the mobile device 10 to play.
- the multi-media device 20 transforms the image data received from the remote communication device 11 into image data appropriate for the information about the hardware configuration of the display device 30 . Then, the multi-media device 20 sends the transformed image data to the display device 30 to play.
- the multi-media device 20 obtains the configuration information of hardware of the mobile device, then processes the overall video data obtained by the mobile device and transforms the overall data into data recognizable by the remote communication device. Two-way remote video communication with a remote communication device is thus executed by the multi-media device 20 .
- FIG. 2 is a functional block diagram of a multi-media device 20 according to one embodiment of the disclosure.
- the multi-media device 20 includes a processor and a non-transitory storage system, wherein the non-transitory storage system is configured to store a controlling module 200 , an invoking module 202 , a communication module 204 , a transforming module 206 , and an application module 208 .
- the modules 200 - 208 are executed by the at least one processor.
- FIG. 3 is another functional block diagram of a multi-media device according to one embodiment of the disclosure.
- the multi-media device 20 includes a processor and a non-transitory storage system, wherein the non-transitory storage system is configured to store a controlling module 200 , an invoking module 202 , a communication module 204 , a transforming module 206 , an application module 208 , a processor 210 , and a memory 212 .
- the modules 200 - 208 are executed by the at least one processor.
- the multi-media device 20 includes a controlling module 200 , an invoking module 202 , a communication module 204 , a transforming module 206 , an application module 208 , a processor 210 , and a memory 212 .
- the controlling module 200 , the invoking module 202 , the communication module 204 , the transforming module 206 , and the application module 208 together have the same functions as the controlling module 200 , the invoking module 202 , the communication module 204 , the transforming module 206 , and the application module 208 illustrated in FIG. 2 .
- the memory 212 stores the software codes of each module and configuration information of the respective hardware of the mobile device 10 , the display device 30 , and the remote communication device 11 .
- the hardware of the mobile device 10 includes the microphone 104 , the loudspeaker 102 , and the camera 106 .
- the memory 212 also stores the overall video data received from the mobile device 10 .
- the processor 210 execute the software codes to achieve the functions of the modules.
- FIG. 4 shows the transmission of voice data by a multi-media device in accordance with one embodiment of the disclosure.
- FIG. 5 shows the transmission of image data by a multi-media device in accordance with one embodiment of the disclosure.
- the multi-media device 20 is electrically connected by wires with the display device 30 , and communicates with the mobile device 10 via the wireless network 111 .
- the multi-media device 20 communicates with the remote communication device 11 after communication between the multi-media device 20 and the mobile device 10 is established.
- the controlling module 200 connects with the mobile device 10 , the remote communication device 11 , and the display device 30 .
- the controlling module 200 sends control commands to the mobile device 10 , the display device 30 , and the remote communication device 11 to obtain information as to respective hardware configurations of the mobile device 10 , the display device 30 , and the remote communication device 11 .
- the configuration information of the mobile device 10 includes configuration information of the microphone, the camera, and the loudspeaker.
- the multi-media device 20 starts the process of the video communication when the configuration information of the all the devices is obtained. In the illustrated embodiment, the process of communication is shown in FIG. 4 and FIG. 5 .
- the invoking module 202 obtains the configuration information of the microphone 104 of the mobile device 10 , then sends invoking commands to the mobile device 10 to activate the microphone 104 of the mobile device 10 .
- the mobile device 10 sends the first voice data to the communication module 204 of the multi-media device 20 through a dispatcher 100 located in the application level of the mobile device 10 via the wireless network 111 .
- the communication module 204 of the multi-media device 20 receives the first voice data, then sends the first voice data to the transforming module 206 located in the drive level.
- the transforming module 206 decodes the first voice data according to the appropriate code form of the mobile device 10 , then encodes the first voice data into fifth voice data to be recognized by the remote communication device 11 according to the configuration information of the hardware of the remote communication device 11 .
- the transforming module 206 sends the fifth voice data to the application module 208 located in the application level.
- the application module 208 sends the fifth voice data wirelessly to the remote communication device 11 to play.
- the invoking module 202 when the invoking module 202 activates the microphone 104 of the mobile device 10 , the invoking module 202 also obtains the configuration information of the camera 106 of the mobile device 10 , and controls the camera 106 to capture first image data. After the first image data is obtained, the mobile device 10 sends the first image data through a dispatcher 100 which is located in the application level of the mobile device 10 to the communication module 204 of the multi-media device 20 via the wireless network 111 . The communication module 204 of the multi-media device 20 receives the first image data, then sends such data to the transforming module 206 located in the drive level.
- the transforming module 206 decodes such data according to the appropriate code form of the mobile device 10 , then encodes the first image data into fifth image data, to be recognized by the remote communication device 11 .
- the transforming module 206 sends the fifth image data to the application module 208 located in the application level.
- the application module 208 sends the fifth image data wirelessly to the remote communication device 11 to play.
- the transforming module 206 decodes the first image data according to the code form of the mobile device 10 , and also encodes the first image data into second image data recognizable by the display device 30 according to the configuration information of the hardware of the display device 30 .
- the transforming module 206 sends the second image data to the application module 208 located in the application level.
- the application module 208 sends the second image data to the display device 30 to play.
- the application module 208 sends the third voice data to the transforming module 206 after receiving the third voice data from the remote communication device 11 .
- the transforming module 206 decodes the third voice data according to the appropriate code form of the remote communication device 11 , then encodes the decoded third voice data into fourth voice data recognizable by the mobile device 10 according to the configuration information of the hardware of the mobile device 10 .
- the transforming module 206 sends the fourth voice data to the communication module 204 .
- the communication module 204 sends the fourth voice data to the dispatcher 100 of the mobile device 10 , and the dispatcher 100 plays the fourth voice via the loudspeaker 102 .
- the application module 208 sends the third image data to the transforming module 206 after receiving the third image data from the remote communication device 11 .
- the transforming module 206 decodes the third image data according to the appropriate code form of the remote communication device 11 , then encodes the decoded third image data into fourth image data recognizable by the display device 30 according to the configuration information of the hardware of the display device 30 .
- the transforming module 206 sends the fourth image data to the communication module 204 . Then the communication module 204 sends the fourth image data to the display device 30 to play.
- FIG. 6 is a flowchart of the processes of a multi-media device transmitting a voice data and image data to a remote communication device, in accordance with one embodiment of the disclosure.
- the processes show in FIG. 6 are executed in the environment showed in FIG. 1 , and executed with the function modules showed in FIG. 2 - FIG 3 .
- the multi-media device 20 communicates with the mobile device 10 , the display device 30 and the remote communication device 11 .
- the controlling module 200 sends control commands to the mobile device 10 , the display device 30 and the remote communication device 11 to obtain the configuration information of the hardware of the mobile device 10 , the display device 30 and the remote communication device 11 .
- the configuration information of the hardware of the mobile device 10 includes the configuration information of the microphone, the camera and the loudspeaker.
- the invoking module 202 invokes the configuration information of the microphone 104 of the mobile device 10 , then sends invoking commands to the mobile device to activate the microphone 104 of the mobile device 10 to obtain the first voice data.
- the invoking module 202 also invokes the configuration information of the camera of the mobile device 10 , and activates the camera 106 to capture the first image data.
- the mobile device 10 sends the voice data and the first image data through a dispatcher 100 located in the application level of the mobile device 10 to the communication module 204 of the multi-media device 20 via the wireless network 111 .
- the communication module 204 of the multi-media device 20 receives the first voice data and the first image data, then sends the first voice data and the first image data to the transforming module 206 located in the drive level.
- the transforming module 206 decodes the first voice data according to the appropriate code form of the mobile device 10 , then encodes the decoded first voice data into fifth voice data recognizable by the remote communication device 11 according to the configuration information of the hardware of the remote communication device 11 . Then the transforming module 206 sends the fifth voice data to the application module 208 located in the application level. The transforming module 206 decodes the first image data according to the appropriate code form of the mobile device 10 , then encodes the decoded first image data into fifth image data recognizable by remote communication device 11 according to the configuration information of the hardware of the remote communication device 11 . In addition, the transforming module 206 also encodes the decoded first image data into second image data recognizable by the display device 30 according to the configuration information of the hardware of the display device 30 .
- the application module 208 sends the fifth voice data and the fifth image data via the wireless network 111 to the remote communication device 11 to play, and sends the second image data to the display device 30 to play.
- FIG. 7 is a flowchart of processes of the multi-media device 20 transmitting the voice data and the image data from the remote communication device 11 to the mobile device 10 and the display device 30 , in accordance with one embodiment of the disclosure.
- the processes show in FIG. 7 are executed in the environment showed in FIG. 1 , and executed with the function modules showed in FIG. 2 - FIG 3 .
- the application module 208 sends the third voice data and the third image data to the transforming module 206 after receiving such data from the remote communication device 11 .
- the transforming module 206 decodes the third voice data according to the appropriate code form of the remote communication device 11 , then encodes the decoded third voice data into fourth voice data recognizable by the mobile device 10 according to the configuration information of the hardware of the mobile device 10 . Then the transforming module 206 sends the fourth voice data to the communication module 204 .
- the transforming module 206 also decodes the third image data according to the appropriate code form of the remote communication device 11 , then encodes the decoded third image data into fourth image data recognizable by the display device 30 according to the configuration information of the hardware of the display device 30 . Then the transforming module 206 sends the fourth image data to the communication module 204 .
- the communication module 204 sends the fourth voice data and the fourth image data to the dispatcher 100 of the mobile device 10 .
- the dispatcher 100 sends the fourth voice data to the loudspeaker 102 to play after the fourth voice data is received, and sends the fourth image data to the display device 30 to play.
- the multi-media device 20 with the video communication method can obtains the configuration information of the hardware of the microphone, the camera and the loudspeaker of the mobile device, and invokes the corresponding drive programs according to the configuration information of the hardware of the microphone and the camera to reach that the multi-media device 20 could obtain a voice data and a image data without a microphone and a camera. And the multi-media device 20 transforms the voice data and the image data into another voice data and another image data recognizable by a remote communication device 11 to make a remote video communication with the remote communication device 11 .
Abstract
Description
- The application is a continuation of U.S. application Ser. No. 14/983599, filed Dec. 30, 2015, which claims priority to Chinese Patent Application No. 201410851887.5 filed on Dec. 31, 2014, the contents of which are incorporated by reference herein.
- The subject matter herein generally relates to video collection and transmission.
- An internet medium player, a set-top box, and other multi-media device are equipped in many family. Users may want to make a video of their own. Most multi-media devices are not equipped with the units such as a camera and a microphone, to make and transmit a video communication. The user needs to add camera and microphone to the multi-media device via wires, or through BLUETOOTH, or through a wireless network. The multi-media device by this way required a camera with perfect angle and focus, a program, a wide radio frequency band or bands to make the audio and video with no distorting.
- Implementations of the present technology will now be described, by way of example only, with reference to the attached figures, wherein:
-
FIG. 1 illustrates a diagrammatic view of an operating environment of one embodiment of a multi-media device, in accordance with the present disclosure; -
FIG. 2 is a functional block diagram of a multi-media device according to one embodiment of the disclosure; -
FIG. 3 is another functional block diagram of a multi-media device according to one embodiment of the disclosure; -
FIG. 4 is a framework diagram of the transmission of voice data by a multi-media device in accordance with one embodiment of the disclosure; and -
FIG. 5 is a framework diagram of the transmission of image data by a multi-media device in accordance with one embodiment of the disclosure; -
FIG. 6 is a flowchart of processes of a multi-media device transmitting voice data and image data to a remote communication device, in accordance with one embodiment of the disclosure; and -
FIG. 7 is a flowchart of processes of a multi-media device transmitting voice data and image data from a remote communication device to a mobile device and a display device, in accordance with one embodiment of the disclosure. - It will be appreciated that for simplicity and clarity of illustration, where appropriate, reference numerals have been repeated among the different figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein can be practiced without these specific details. In other instances, methods, procedures, and components have not been described in detail so as not to obscure the related relevant feature being described. Also, the description is not to be considered as limiting the scope of the embodiments described herein. The drawings are not necessarily to scale and the proportions of certain parts may be exaggerated to better illustrate details and features of the present disclosure.
- It should be noted that references to “an” or “one” embodiment in this disclosure are not necessarily to the same embodiment, and such references mean “at least one.”
- In general, the word “module” as used hereinafter, refers to logic embodied in computing or firmware, or to a collection of software instructions, written in a programming language, such as, Java, C, or assembly. One or more software instructions in the modules may be embedded in firmware, such as in an erasable programmable read only memory (EPROM). The modules described herein may be implemented as either software and/or computing modules and may be stored in any type of non-transitory computer-readable medium or other storage device. Some non-limiting examples of non-transitory computer-readable media include CDs, DVDs, BLU-RAY, flash memory, and hard disk drives. The term “comprising”, when utilized, means “including, but not necessarily limited to”; it specifically indicates open-ended inclusion or membership in a so-described combination, group, series and the like.
- Embodiments of a multi-media device and a method for video communication are described.
-
FIG. 1 illustrates an operating environment of one embodiment of amulti-media device 20. In the illustrated embodiment, themulti-media device 20 is placed in a wireless network 111 (e.g 4G, WIFI), and communicates with amobile device 10 and with aremote communication device 11 via the wireless network 111. In addition, themulti-media device 20 is electrically connected by wires with adisplay device 30. In another embodiment, themulti-media device 20 can be electrically connected with thedisplay device 30 via the wireless network 111. In the illustrated embodiment, the wireless network 111 can be the wireless local area network 111 (e.g WIFI), 3G/4G or the like. Themobile device 10 can be equipped with a wireless transmission function. Themobile device 10 can be a device such as tablet computer (e.g IPAD) or Smart Phone with a camera, a microphone, a loudspeaker, and other hardware. - In the illustrated embodiment, the
mobile device 10 sends a command of connection to themulti-media device 20. Themulti-media device 20 establishes a communication with themobile device 10 after receiving the command from themobile device 10. Themulti-media device 20 sends a control command to themobile device 10 to obtain the information about the hardware configuration of the camera, the microphone, the loudspeaker, and other hardware of themobile device 10, and completes a video communication process with themobile device 10 according to the configuration information. Themulti-media device 20 also communicates with theremote communication device 11 selected by the user. - The
remote communication device 11 can be another mobile device which has a camera, a microphone, and a loudspeaker. In this way, onemulti-media device 20 can communicate with severalmobile devices 10 to build a video communication with several users, and onemobile device 10 can communicate, synchronously, with severalmulti-media devices 20. - In this embodiment of the present disclosure, the video communication takes place in the situation of one
multi-media device 20, onemobile device 10, and oneremote communication device 11. Themulti-media device 20 controls themobile device 10 to obtain voice data via the microphone and capture image data via the camera when the matching of the communication and the connection between themobile device 10 and themulti-media device 20 are completed. Then themulti-media device 20 controls themobile device 10 to send voice data and image data to themulti-media device 20 via the wireless network 111. - The data obtained by
mobile device 10 cannot be directly played on theremote communication device 11. Themulti-media device 20 therefore transforms the data obtained by themobile device 10 into data recognizable by theremote communication device 11. Themulti-media device 20 transforms the voice data obtained by themobile device 10 into voice data appropriate for the information about the hardware configuration of theremote communication device 11. Then themulti-media device 20 sends the transformed voice data to theremote communication device 11, so that playback of the transformed voice data can occur on theremote communication device 11. Themulti-media device 20 transforms the image data obtained by themobile device 10 into image data appropriate for the information about the hardware configuration of theremote communication device 11 and thedisplay device 30. Then themulti-media device 20 sends the transformed image data to theremote communication device 11 and thedisplay device 30 to play. - In the illustrated embodiment, after the
remote communication device 11 plays the transformed voice and image data received from themulti-media device 20, themulti-media device 20 receives voice data and image data of a user from aremote communication device 11. Themulti-media device 20 transforms the voice data received from theremote communication device 11 into voice data appropriate for the information about the hardware configuration of the loudspeaker of themobile device 10, and then sends the transformed voice data to themobile device 10 to play. Themulti-media device 20 transforms the image data received from theremote communication device 11 into image data appropriate for the information about the hardware configuration of thedisplay device 30. Then, themulti-media device 20 sends the transformed image data to thedisplay device 30 to play. Therefore, themulti-media device 20 obtains the configuration information of hardware of the mobile device, then processes the overall video data obtained by the mobile device and transforms the overall data into data recognizable by the remote communication device. Two-way remote video communication with a remote communication device is thus executed by themulti-media device 20. -
FIG. 2 is a functional block diagram of amulti-media device 20 according to one embodiment of the disclosure. In the illustrated embodiment, themulti-media device 20 includes a processor and a non-transitory storage system, wherein the non-transitory storage system is configured to store a controllingmodule 200, aninvoking module 202, acommunication module 204, a transformingmodule 206, and anapplication module 208. The modules 200-208 are executed by the at least one processor. -
FIG. 3 is another functional block diagram of a multi-media device according to one embodiment of the disclosure. In the illustrated embodiment, themulti-media device 20 includes a processor and a non-transitory storage system, wherein the non-transitory storage system is configured to store a controllingmodule 200, an invokingmodule 202, acommunication module 204, a transformingmodule 206, anapplication module 208, aprocessor 210, and amemory 212. The modules 200-208 are executed by the at least one processor. In the illustrated embodiment, themulti-media device 20 includes a controllingmodule 200, an invokingmodule 202, acommunication module 204, a transformingmodule 206, anapplication module 208, aprocessor 210, and amemory 212. The controllingmodule 200, the invokingmodule 202, thecommunication module 204, the transformingmodule 206, and theapplication module 208 together have the same functions as the controllingmodule 200, the invokingmodule 202, thecommunication module 204, the transformingmodule 206, and theapplication module 208 illustrated inFIG. 2 . Thememory 212 stores the software codes of each module and configuration information of the respective hardware of themobile device 10, thedisplay device 30, and theremote communication device 11. The hardware of themobile device 10 includes themicrophone 104, theloudspeaker 102, and thecamera 106. Thememory 212 also stores the overall video data received from themobile device 10. Theprocessor 210 execute the software codes to achieve the functions of the modules. -
FIG. 4 shows the transmission of voice data by a multi-media device in accordance with one embodiment of the disclosure.FIG. 5 shows the transmission of image data by a multi-media device in accordance with one embodiment of the disclosure. - In the illustrated embodiment, the
multi-media device 20 is electrically connected by wires with thedisplay device 30, and communicates with themobile device 10 via the wireless network 111. Themulti-media device 20 communicates with theremote communication device 11 after communication between themulti-media device 20 and themobile device 10 is established. When intercommunication between all devices is established, the controllingmodule 200 connects with themobile device 10, theremote communication device 11, and thedisplay device 30. Then the controllingmodule 200 sends control commands to themobile device 10, thedisplay device 30, and theremote communication device 11 to obtain information as to respective hardware configurations of themobile device 10, thedisplay device 30, and theremote communication device 11. The configuration information of themobile device 10 includes configuration information of the microphone, the camera, and the loudspeaker. Then themulti-media device 20 starts the process of the video communication when the configuration information of the all the devices is obtained. In the illustrated embodiment, the process of communication is shown inFIG. 4 andFIG. 5 . - Referring to
FIG. 4 , the invokingmodule 202 obtains the configuration information of themicrophone 104 of themobile device 10, then sends invoking commands to themobile device 10 to activate themicrophone 104 of themobile device 10. Themobile device 10 sends the first voice data to thecommunication module 204 of themulti-media device 20 through adispatcher 100 located in the application level of themobile device 10 via the wireless network 111. Thecommunication module 204 of themulti-media device 20 receives the first voice data, then sends the first voice data to the transformingmodule 206 located in the drive level. The transformingmodule 206 decodes the first voice data according to the appropriate code form of themobile device 10, then encodes the first voice data into fifth voice data to be recognized by theremote communication device 11 according to the configuration information of the hardware of theremote communication device 11. The transformingmodule 206 sends the fifth voice data to theapplication module 208 located in the application level. Theapplication module 208 sends the fifth voice data wirelessly to theremote communication device 11 to play. - Referring to
FIG. 5 , when the invokingmodule 202 activates themicrophone 104 of themobile device 10, the invokingmodule 202 also obtains the configuration information of thecamera 106 of themobile device 10, and controls thecamera 106 to capture first image data. After the first image data is obtained, themobile device 10 sends the first image data through adispatcher 100 which is located in the application level of themobile device 10 to thecommunication module 204 of themulti-media device 20 via the wireless network 111. Thecommunication module 204 of themulti-media device 20 receives the first image data, then sends such data to the transformingmodule 206 located in the drive level. The transformingmodule 206 decodes such data according to the appropriate code form of themobile device 10, then encodes the first image data into fifth image data, to be recognized by theremote communication device 11. The transformingmodule 206 sends the fifth image data to theapplication module 208 located in the application level. Theapplication module 208 sends the fifth image data wirelessly to theremote communication device 11 to play. - In addition, the transforming
module 206 decodes the first image data according to the code form of themobile device 10, and also encodes the first image data into second image data recognizable by thedisplay device 30 according to the configuration information of the hardware of thedisplay device 30. The transformingmodule 206 sends the second image data to theapplication module 208 located in the application level. Theapplication module 208 sends the second image data to thedisplay device 30 to play. - Referring to
FIG. 4 , theapplication module 208 sends the third voice data to the transformingmodule 206 after receiving the third voice data from theremote communication device 11. The transformingmodule 206 decodes the third voice data according to the appropriate code form of theremote communication device 11, then encodes the decoded third voice data into fourth voice data recognizable by themobile device 10 according to the configuration information of the hardware of themobile device 10. The transformingmodule 206 sends the fourth voice data to thecommunication module 204. Then thecommunication module 204 sends the fourth voice data to thedispatcher 100 of themobile device 10, and thedispatcher 100 plays the fourth voice via theloudspeaker 102. - Referring to
FIG. 5 , theapplication module 208 sends the third image data to the transformingmodule 206 after receiving the third image data from theremote communication device 11. The transformingmodule 206 decodes the third image data according to the appropriate code form of theremote communication device 11, then encodes the decoded third image data into fourth image data recognizable by thedisplay device 30 according to the configuration information of the hardware of thedisplay device 30. The transformingmodule 206 sends the fourth image data to thecommunication module 204. Then thecommunication module 204 sends the fourth image data to thedisplay device 30 to play. -
FIG. 6 is a flowchart of the processes of a multi-media device transmitting a voice data and image data to a remote communication device, in accordance with one embodiment of the disclosure. The processes show inFIG. 6 are executed in the environment showed inFIG. 1 , and executed with the function modules showed inFIG. 2 -FIG 3 . - At
block 600, themulti-media device 20 communicates with themobile device 10, thedisplay device 30 and theremote communication device 11. - At
block 602, the controllingmodule 200 sends control commands to themobile device 10, thedisplay device 30 and theremote communication device 11 to obtain the configuration information of the hardware of themobile device 10, thedisplay device 30 and theremote communication device 11. The configuration information of the hardware of themobile device 10 includes the configuration information of the microphone, the camera and the loudspeaker. - At
block 604, the invokingmodule 202 invokes the configuration information of themicrophone 104 of themobile device 10, then sends invoking commands to the mobile device to activate themicrophone 104 of themobile device 10 to obtain the first voice data. In addition, the invokingmodule 202 also invokes the configuration information of the camera of themobile device 10, and activates thecamera 106 to capture the first image data. After the first voice data and the first image data is obtained, themobile device 10 sends the voice data and the first image data through adispatcher 100 located in the application level of themobile device 10 to thecommunication module 204 of themulti-media device 20 via the wireless network 111. - At
block 606, thecommunication module 204 of themulti-media device 20 receives the first voice data and the first image data, then sends the first voice data and the first image data to the transformingmodule 206 located in the drive level. - At
block 608, the transformingmodule 206 decodes the first voice data according to the appropriate code form of themobile device 10, then encodes the decoded first voice data into fifth voice data recognizable by theremote communication device 11 according to the configuration information of the hardware of theremote communication device 11. Then the transformingmodule 206 sends the fifth voice data to theapplication module 208 located in the application level. The transformingmodule 206 decodes the first image data according to the appropriate code form of themobile device 10, then encodes the decoded first image data into fifth image data recognizable byremote communication device 11 according to the configuration information of the hardware of theremote communication device 11. In addition, the transformingmodule 206 also encodes the decoded first image data into second image data recognizable by thedisplay device 30 according to the configuration information of the hardware of thedisplay device 30. - At
block 610, theapplication module 208 sends the fifth voice data and the fifth image data via the wireless network 111 to theremote communication device 11 to play, and sends the second image data to thedisplay device 30 to play. -
FIG. 7 is a flowchart of processes of themulti-media device 20 transmitting the voice data and the image data from theremote communication device 11 to themobile device 10 and thedisplay device 30, in accordance with one embodiment of the disclosure. The processes show inFIG. 7 are executed in the environment showed inFIG. 1 , and executed with the function modules showed inFIG. 2 -FIG 3 . - At
block 700, theapplication module 208 sends the third voice data and the third image data to the transformingmodule 206 after receiving such data from theremote communication device 11. - At
block 702, the transformingmodule 206 decodes the third voice data according to the appropriate code form of theremote communication device 11, then encodes the decoded third voice data into fourth voice data recognizable by themobile device 10 according to the configuration information of the hardware of themobile device 10. Then the transformingmodule 206 sends the fourth voice data to thecommunication module 204. The transformingmodule 206 also decodes the third image data according to the appropriate code form of theremote communication device 11, then encodes the decoded third image data into fourth image data recognizable by thedisplay device 30 according to the configuration information of the hardware of thedisplay device 30. Then the transformingmodule 206 sends the fourth image data to thecommunication module 204. - At
block 704, thecommunication module 204 sends the fourth voice data and the fourth image data to thedispatcher 100 of themobile device 10. Thedispatcher 100 sends the fourth voice data to theloudspeaker 102 to play after the fourth voice data is received, and sends the fourth image data to thedisplay device 30 to play. - In the above-described embodiments of the present disclosure, the
multi-media device 20 with the video communication method can obtains the configuration information of the hardware of the microphone, the camera and the loudspeaker of the mobile device, and invokes the corresponding drive programs according to the configuration information of the hardware of the microphone and the camera to reach that themulti-media device 20 could obtain a voice data and a image data without a microphone and a camera. And themulti-media device 20 transforms the voice data and the image data into another voice data and another image data recognizable by aremote communication device 11 to make a remote video communication with theremote communication device 11.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/879,399 US20180152497A1 (en) | 2014-12-31 | 2018-01-24 | Method and multi-media device for video communication |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410851887.5 | 2014-12-31 | ||
CN201410851887.5A CN105812950A (en) | 2014-12-31 | 2014-12-31 | Multimedia device and video communication method |
US14/983,599 US9912715B2 (en) | 2014-12-31 | 2015-12-30 | Method and multi-media device for video communication |
US15/879,399 US20180152497A1 (en) | 2014-12-31 | 2018-01-24 | Method and multi-media device for video communication |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/983,599 Continuation US9912715B2 (en) | 2014-12-31 | 2015-12-30 | Method and multi-media device for video communication |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180152497A1 true US20180152497A1 (en) | 2018-05-31 |
Family
ID=56165726
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/983,599 Active 2036-05-12 US9912715B2 (en) | 2014-12-31 | 2015-12-30 | Method and multi-media device for video communication |
US15/879,399 Abandoned US20180152497A1 (en) | 2014-12-31 | 2018-01-24 | Method and multi-media device for video communication |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/983,599 Active 2036-05-12 US9912715B2 (en) | 2014-12-31 | 2015-12-30 | Method and multi-media device for video communication |
Country Status (3)
Country | Link |
---|---|
US (2) | US9912715B2 (en) |
CN (1) | CN105812950A (en) |
TW (1) | TWI578795B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107895583B (en) * | 2017-11-03 | 2020-01-14 | 深圳市沃特沃德股份有限公司 | Method for distributing system media source by vehicle-mounted system and vehicle-mounted system |
US11169772B2 (en) * | 2018-03-19 | 2021-11-09 | Gopro, Inc. | Image capture device control using mobile platform voice recognition |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040198435A1 (en) * | 2002-06-07 | 2004-10-07 | Gauld Craig Stephen | Camera integration on a mobile device |
US20130086618A1 (en) * | 2008-06-02 | 2013-04-04 | At&T Intellectual Property I, L.P. | Smart phone as remote control device |
US20130235196A1 (en) * | 2011-06-10 | 2013-09-12 | Digilife Technologies Co., Ltd. | Real-time multimedia signal transmission device |
US20140038527A1 (en) * | 2012-08-06 | 2014-02-06 | Shih-Yao Chen | Car A/V System for Wireless Communication |
US20150035987A1 (en) * | 2012-09-07 | 2015-02-05 | Jose Mario Fernandez | Method and apparatus for unlocking/locking a door and enabling two-way communications with a door security system via a smart phone |
US9031847B2 (en) * | 2011-11-15 | 2015-05-12 | Microsoft Technology Licensing, Llc | Voice-controlled camera operations |
US20150156551A1 (en) * | 2013-11-29 | 2015-06-04 | Kabushiki Kaisha Toshiba | Electronic device, image display method for use in the electronic device and storage medium for image display program |
US20150162007A1 (en) * | 2013-12-06 | 2015-06-11 | Vivint, Inc. | Voice control using multi-media rooms |
US20150358577A1 (en) * | 2014-06-04 | 2015-12-10 | Apple Inc. | Instant video communication connections |
US9432608B2 (en) * | 2012-03-29 | 2016-08-30 | Lg Electronics Inc. | Multimedia device connected to at least one electronic device and controling method thereof |
US9479737B2 (en) * | 2009-08-06 | 2016-10-25 | Echostar Technologies L.L.C. | Systems and methods for event programming via a remote media player |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002297496A (en) * | 2001-04-02 | 2002-10-11 | Hitachi Ltd | Media delivery system and multimedia conversion server |
US20110061078A1 (en) * | 2005-05-10 | 2011-03-10 | Reagan Inventions, Llc | System and method for controlling a plurality of electronic devices |
US8330789B2 (en) * | 2007-10-31 | 2012-12-11 | At&T Intellectual Property I, L.P. | Integrated devices for multimedia content delivery and video conferencing |
CN101453662B (en) * | 2007-12-03 | 2012-04-04 | 华为技术有限公司 | Stereo video communication terminal, system and method |
TWI458291B (en) * | 2009-06-22 | 2014-10-21 | Wistron Corp | Network control device with pictures and related method |
CN102104587A (en) * | 2009-12-16 | 2011-06-22 | 宏碁股份有限公司 | Multimedia transmission system and method |
EP2595382B1 (en) * | 2011-11-21 | 2019-01-09 | BlackBerry Limited | Methods and devices for encoding and decoding transform domain filters |
CN104350740B (en) * | 2012-03-19 | 2018-04-20 | 索尼移动通信株式会社 | Video conference is carried out using wireless peripheral video conference device |
CN103379304A (en) * | 2012-04-20 | 2013-10-30 | 宏碁股份有限公司 | Video conversation switching method and system |
CN103702061A (en) * | 2013-12-23 | 2014-04-02 | 上海网达软件股份有限公司 | Automatic adjustment method of resolution of video call of intelligent terminal |
US8843178B1 (en) * | 2014-01-28 | 2014-09-23 | Gigastone America Corp | Wireless hotspot device capable of sharing video picture |
US20150271228A1 (en) * | 2014-03-19 | 2015-09-24 | Cory Lam | System and Method for Delivering Adaptively Multi-Media Content Through a Network |
-
2014
- 2014-12-31 CN CN201410851887.5A patent/CN105812950A/en active Pending
-
2015
- 2015-01-12 TW TW104100872A patent/TWI578795B/en active
- 2015-12-30 US US14/983,599 patent/US9912715B2/en active Active
-
2018
- 2018-01-24 US US15/879,399 patent/US20180152497A1/en not_active Abandoned
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040198435A1 (en) * | 2002-06-07 | 2004-10-07 | Gauld Craig Stephen | Camera integration on a mobile device |
US20130086618A1 (en) * | 2008-06-02 | 2013-04-04 | At&T Intellectual Property I, L.P. | Smart phone as remote control device |
US9479737B2 (en) * | 2009-08-06 | 2016-10-25 | Echostar Technologies L.L.C. | Systems and methods for event programming via a remote media player |
US20130235196A1 (en) * | 2011-06-10 | 2013-09-12 | Digilife Technologies Co., Ltd. | Real-time multimedia signal transmission device |
US9031847B2 (en) * | 2011-11-15 | 2015-05-12 | Microsoft Technology Licensing, Llc | Voice-controlled camera operations |
US9432608B2 (en) * | 2012-03-29 | 2016-08-30 | Lg Electronics Inc. | Multimedia device connected to at least one electronic device and controling method thereof |
US20140038527A1 (en) * | 2012-08-06 | 2014-02-06 | Shih-Yao Chen | Car A/V System for Wireless Communication |
US20150035987A1 (en) * | 2012-09-07 | 2015-02-05 | Jose Mario Fernandez | Method and apparatus for unlocking/locking a door and enabling two-way communications with a door security system via a smart phone |
US20150156551A1 (en) * | 2013-11-29 | 2015-06-04 | Kabushiki Kaisha Toshiba | Electronic device, image display method for use in the electronic device and storage medium for image display program |
US20150162007A1 (en) * | 2013-12-06 | 2015-06-11 | Vivint, Inc. | Voice control using multi-media rooms |
US20150358577A1 (en) * | 2014-06-04 | 2015-12-10 | Apple Inc. | Instant video communication connections |
Also Published As
Publication number | Publication date |
---|---|
CN105812950A (en) | 2016-07-27 |
US9912715B2 (en) | 2018-03-06 |
TWI578795B (en) | 2017-04-11 |
TW201624998A (en) | 2016-07-01 |
US20160191593A1 (en) | 2016-06-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8793138B2 (en) | Method and apparatus for smart voice recognition | |
US11283641B2 (en) | Method, apparatus, device, system and storage medium for controlling smart home | |
US20090192801A1 (en) | System and method for controlling an electronic device with voice commands using a mobile phone | |
CN102883214A (en) | Multi-terminal mutual-transmission and mutual-control method and smart television terminal | |
US20150294646A1 (en) | Display apparatus and method for displaying screen images from multiple electronic devices | |
CN105025349A (en) | Encrypted screencasting | |
JP2015084513A (en) | Methods for content sharing utilizing compatibility notification to display forwarding function and associated devices | |
US20180152497A1 (en) | Method and multi-media device for video communication | |
KR101976355B1 (en) | Set-top box external-connection type AI speaker device, and AI speaker system using the same | |
US11930245B2 (en) | Mobile information terminal | |
JP2020511826A (en) | Electronic device and control method thereof | |
KR20200085595A (en) | Contents reproducing apparatus and method thereof | |
US9521235B2 (en) | Two-way mirroring system for sound data | |
CN102984568B (en) | A kind of remote controller controls the method and system of mobile terminal | |
KR102014774B1 (en) | Server and method for controlling voice recognition of device, and the device | |
US20210192686A1 (en) | Apparatus and method of controlling the same | |
CN105898320A (en) | Panorama video decoding method and device and terminal equipment based on Android platform | |
CN105700835B (en) | Speaker main unit for providing multi-streaming service and flow control method thereof | |
US9877073B2 (en) | Suspend mode of streaming for seamless user experience | |
US20180173592A1 (en) | Electronic apparatus, method for controlling thereof and display apparatus | |
CN111034206A (en) | Display apparatus and method of providing contents thereof | |
EP3435643A1 (en) | A system and method for control of an appliance by voice | |
CN103607640A (en) | Audio control method, device thereof and system thereof | |
US20210112301A1 (en) | Packetized content stream-enabled headphone system | |
JP2020061046A (en) | Voice operation apparatus, voice operation method, computer program, and voice operation system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: HON HAI PRECISION INDUSTRY CO., LTD., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:XIAO, XING-HUA;LU, CHI-MING;SIGNING DATES FROM 20151225 TO 20151228;REEL/FRAME:044722/0159 Owner name: HONG FU JIN PRECISION INDUSTRY (SHENZHEN) CO., LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:XIAO, XING-HUA;LU, CHI-MING;SIGNING DATES FROM 20151225 TO 20151228;REEL/FRAME:044722/0159 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |