WO2016062191A1 - Information publication method, information receiving method and apparatus, and information sharing system - Google Patents

Information publication method, information receiving method and apparatus, and information sharing system Download PDF

Info

Publication number
WO2016062191A1
WO2016062191A1 PCT/CN2015/091297 CN2015091297W WO2016062191A1 WO 2016062191 A1 WO2016062191 A1 WO 2016062191A1 CN 2015091297 W CN2015091297 W CN 2015091297W WO 2016062191 A1 WO2016062191 A1 WO 2016062191A1
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
information
parameter
gestures
posture
Prior art date
Application number
PCT/CN2015/091297
Other languages
French (fr)
Chinese (zh)
Inventor
刘海军
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016062191A1 publication Critical patent/WO2016062191A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to the field of communications, and in particular to an information publishing method, an information receiving method, an apparatus, and an information sharing system.
  • the development of digital multimedia and networks has enriched the entertainment experience in people's daily lives.
  • the current technology allows people to watch HDTV at home.
  • the source of TV programs may come from digital discs, cable TV, the Internet, etc., and can experience stereo, 5.1-channel, 7.1-channel and even more realistic sound effects, and people can Using PAD (tablet electronic devices), mobile phones to achieve these experiences, related technologies include, people can transfer the playback of digital content between different devices through the network, and control the playback of a device through remote control, gestures, such as control switching Channel, next channel show, etc.
  • the traditional method of controlling multiple devices is currently controlled by using the respective remote controllers of the devices, and these remote controllers are often not common to each other, and most of the remote controllers do not have network functions, such as a conventional television set. Audio; there are also some remote controls that support the network, such as loading and supporting interworking protocols on devices with computing and networking capabilities (such as cell phones, PADs, in this article, PAD refers to handheld multimedia consumer electronics devices, or devices such as tablets). Software to control another device.
  • the performance is: or people need to pick out the corresponding device in a bunch of remote controllers.
  • the remote control constantly changes the remote control as it controls different devices, or can only control the device by operating a PAD, a mobile phone, etc., or a simple gesture to control a single device.
  • it is often necessary to learn to use different manipulation tools. People prefer to use simpler, more natural modes of operation to control more devices in a smaller range.
  • Gesture control is a relatively new way: the camera on one device monitors the gesture and analyzes it, and finally converts it into control of the device; or the user uses the wearable device through the hands, arms, and body. Wearing similar devices such as rings, watches, vests, etc., recognizes user actions and also controls the device.
  • gestures For example, by adding a camera to a television, collecting and recognizing a person's gestures, and then following a predefined gesture and manipulation command correspondence, the gesture is manipulated to control the television.
  • the operations that have been implemented include changing channels, changing the volume, and so on.
  • the gesture recognition devices currently on the market and in the laboratory are each equipped with a camera, which often requires input of a "starting indication", such as a specific gesture, or other control commands.
  • a "starting indication” such as a specific gesture, or other control commands.
  • starting instruction When there are many such devices in the home and office scenes, such as TV, set-top box, player, air conditioner, and audio in the home, gesture recognition is supported, and the user controls these devices at the same time.
  • starting instruction is often switched, the experience is not friendly, or the "starting gesture” is likely to cause confusion in the recognition command input. Because these devices do not publish and share their own location information, recognized location information, and recognized gestures, they only process the recognized gesture commands.
  • UPN Universal Plug and Play
  • UPN Universal Plug and Play
  • the technology uses the network address and digital code as the identification of the device, which is a kind of machine identification.
  • the final control requires the user to select and operate according to the machine identification of the device.
  • the embodiments of the present invention provide an information publishing method, an information receiving method, a device, and an information sharing system, so as to at least solve the problem that different devices in the related art are confusing for gesture recognition information.
  • an information publishing method comprising: a first device recognizing a gesture and/or gesture information; the first device publishing the gesture and/or gesture information, wherein the gesture and The gesture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
  • the first device identifying the gesture and/or the gesture information includes: the first device capturing an image; the first device identifying the gesture and/or gesture according to the image, and determining the coordinate system, Wherein the origin of the coordinate system is a point in the image.
  • the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
  • the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
  • the coordinate system is established with reference to the location of the first device, or the coordinate system is established with reference to a location of the second device different from the first device.
  • the first device issues the gesture and/or posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
  • an information receiving method comprising: a second device receiving gestures and/or gesture information, wherein the gesture and/or posture information includes at least a coordinate system and an identified gesture and/or Or description parameters of the pose.
  • the method further includes: the second device identifying the corresponding meaning according to the coordinate system and the description parameter of the recognized gesture and/or posture.
  • the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
  • the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
  • the second device receives the gesture and/or posture information by at least one of the following modes: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
  • an information distribution apparatus which is located in a first device, and includes: a first identification module configured to recognize gestures and/or gesture information; a publishing module configured to issue the gesture and And/or posture information, wherein the gesture and/or posture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
  • an information receiving apparatus located in a second device, comprising: a receiving module, configured to receive gestures and/or gesture information, wherein the gesture and/or posture information is at least A description parameter including a coordinate system and recognized gestures and/or gestures.
  • the apparatus further includes: a second identification module, configured to identify a corresponding meaning according to the coordinate system and the description parameter of the recognized gesture and/or posture.
  • an information sharing system including the above information distribution apparatus, and the above information receiving apparatus.
  • an information publishing method including: a first device recognizing a gesture and/or posture information; the first device issuing the gesture and/or posture information, wherein the gesture And/or the gesture information includes at least a positional parameter and a description parameter of the recognized gesture and/or gesture.
  • the first device identifying the gesture and/or the gesture information comprises: the first device capturing an image; the first device identifying the gesture and/or gesture according to the image, and determining the location parameter.
  • the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
  • the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
  • the location parameter refers to a location setting of the first device, or the location parameter refers to a location setting different from a second device of the first device.
  • the first device issues the gesture and/or posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
  • an information receiving method comprising: receiving, by a second device, gestures and/or gesture information, wherein the gesture and/or posture information includes at least a position parameter and an identified gesture and/or Or description parameters of the pose.
  • the method further includes: the second device identifying the corresponding meaning according to the position parameter and the description parameter of the recognized gesture and/or posture.
  • the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
  • the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
  • the second device receives the gesture and/or posture information by at least one of the following modes: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
  • an information distribution apparatus located in the first device, comprising: a first identification module configured to recognize gestures and/or gesture information; a publishing module configured to issue the gesture and And/or posture information, wherein the gesture and/or posture information includes at least a position parameter and a description parameter of the recognized gesture and/or gesture.
  • an information receiving apparatus located in a second device, comprising: a receiving module, configured to receive gestures and/or gesture information, wherein the gesture and/or posture information includes at least Position parameters and description parameters of the recognized gestures and/or gestures.
  • the device further includes: a second identification module, configured to identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture and/or posture.
  • an information sharing system including the above information distribution apparatus, and the above information receiving apparatus.
  • the first device identifies the gesture and/or posture information by using the first device; the first device issues the gesture and/or posture information, wherein the gesture and/or posture information includes at least a coordinate system and an identifier
  • the manner of describing parameters of gestures and/or gestures solves the problem that different devices in the related art are confusing for gesture recognition information, improves user experience, saves resources, and is also described by gestures and/or gestures themselves. Parameters can also increase the flexibility of gesture and/or gesture recognition schemes.
  • FIG. 1 is a flowchart of an information distribution method according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing the structure of an information distribution apparatus according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of an information receiving method according to an embodiment of the present invention.
  • FIG. 4 is a block diagram showing the structure of an information receiving apparatus according to an embodiment of the present invention.
  • FIG. 5 is a structural block diagram of an information sharing system according to an embodiment of the present invention.
  • Figure 6 is a schematic illustration of a scene in accordance with a preferred embodiment of the present invention.
  • Figure 8 is a flow diagram of a method in accordance with a preferred embodiment of the present invention.
  • a gesture recognition apparatus can identify that the device includes its location and communication identification parameters, and issue the recognized gesture information; when the gesture is used, the controlled device issues a gesture that can be processed: for example, a gesture number, Gesture text describes information and digital graphic information.
  • gesture numbering and gesture text does not describe a rich gesture meaning, but various shapes, durations, moving directions, moving distances, arm pointing, previous or several gestures, etc. in the gesture information, etc. When these are combined, they can express more meaning. If the digital graphic information is used for description, after another device receives, it needs to continue to perform identification analysis, which imposes additional requirements on the computing power and overall computing resources of the device, and does not use the existing recognition result to identify again. It is actually a waste of resources.
  • gesture information it will make it easier and more convenient for users to control multiple devices, and assist in achieving coordinated gesture control, which will make people's entertainment life easier and more enjoyable. People do not need to learn more ways to use, but also reduce the cost of production and user consumption.
  • FIG. 1 is a flowchart of an information publishing method according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps (hereinafter also referred to as “/ "refers to the meaning of "and / or”):
  • Step S102 the first device recognizes gesture/posture information
  • Step S104 the first device issues the gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a description parameter of the recognized gesture/posture.
  • the positional parameters can be represented by a coordinate system.
  • the coordinate system types that can be selected by the coordinate system include, for example, Cartesian coordinates, spherical coordinates, and the like, and the coordinate origin position is selected at a point in the image or a point in any space, and the like.
  • the positional parameter can be selected from the default coordinate system. In this case, only the coordinates of the coordinate origin and the target coordinate parameters are passed. You can also select the common coordinate origin as the default parameter, and you only need to pass the coordinates of the target.
  • the first device releases the gesture/posture information that is recognized by the first device, where the information includes at least a position parameter (such as a coordinate system) and a description parameter of the gesture/posture, so that the first device can
  • the description parameter of the recognized gesture/posture itself is released and shared to other devices, instead of publishing the corresponding meaning of the first device according to the gesture/posture, thereby enabling the receiving device to recognize according to the first device.
  • the gesture/posture information autonomously determines the corresponding meaning of the gesture/posture, since the corresponding meanings are recognized based on the same gesture/posture information, which solves the problem that different devices in the related art are easily confused with the gesture recognition information, thereby improving the user experience. , saving resources, and also because of the release of the description parameters of the gesture / gesture itself, can also enhance the flexibility of the gesture / gesture recognition scheme.
  • the manner in which the first device recognizes the gesture/posture information is as follows: the first device captures an image; the first device identifies the gesture/posture according to the image, and determines the coordinate system, Wherein the origin of the coordinate system is a point in the image.
  • the captured image of the first device may be captured according to an image captured by the camera, or may be an action recognized by the wearable device, for example, the wearable device recognized according to the triaxial acceleration sensor of the wearable device. Run the route and pose and convert to an image.
  • the description parameter of the gesture/posture may include at least but not limited to at least one of: gesture/posture coordinates, gesture/posture category, gesture/posture shape, gesture/posture duration, gesture/posture movement Direction, gesture/posture movement distance, gesture/posture direction (eg, arm direction), latter gesture/posture category, sequential numbering, etc.
  • the gesture/posture category may include at least but not limited to one of the following: a hand, an arm, and a body.
  • the location parameter may refer to a location setting of the first device, or the location parameter may also refer to a location of another device, such as a location of the second device different from the first device. To set it up.
  • the first device may issue the gesture/posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query and response mode, and the like.
  • an information distribution device is also provided, which is located in the first device, and is configured to implement the above-mentioned embodiments and preferred embodiments, and has not been described again.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 2 is a structural block diagram of an information distribution apparatus according to an embodiment of the present invention. As shown in FIG. 2, the apparatus includes a first identification module 22 and a distribution module 24. The following describes each module in detail:
  • the first identification module 22 is configured to recognize the gesture/posture information; the publishing module 24 is connected to the first identification module 22 and configured to issue the gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a recognition Description parameters for gestures/postures.
  • FIG. 3 is a flowchart of a method for receiving information according to an embodiment of the present invention. As shown in FIG. 3, the method includes the following steps:
  • Step S302 The second device receives gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a description parameter of the recognized gesture/posture.
  • the positional parameters can be represented by a coordinate system.
  • the coordinate system types that can be selected by the coordinate system include, for example, Cartesian coordinates, spherical coordinates, and the like, and the coordinate origin position is selected at a point in the image or a point in any space, and the like.
  • the positional parameter can be selected from the default coordinate system. In this case, only the coordinates of the coordinate origin and the target coordinate parameters are passed. You can also select the common coordinate origin as the default parameter, and you only need to pass the coordinates of the target.
  • the second device receives the gesture/posture information issued by another device (for example, the first device), where the information includes at least the location parameter and the description parameter of the gesture/posture, so that the second device can enable the second device to Obtaining a description parameter of the gesture/posture itself recognized by the other device, and not receiving the corresponding meaning recognized by the other device according to the gesture/posture, thereby enabling the second device to autonomously determine the gesture/posture according to the gesture/posture information.
  • the corresponding meaning of the gesture or the gesture itself can be further transmitted to other devices or stored locally, and then the subsequent program or device autonomously determines the corresponding meaning, since the corresponding meaning is recognized based on the same gesture/posture information.
  • the invention solves the problem that the different devices in the related art are confusing for the gesture recognition information, improves the user experience, saves resources, and can also improve the flexibility of the gesture/posture recognition scheme by receiving the description parameters of the gesture/posture itself. .
  • the second device may identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture/posture.
  • the description parameter of the gesture/posture may include at least but not limited to at least one of: gesture/posture coordinates, gesture/posture category, gesture/posture shape, gesture/posture duration, gesture/posture movement Direction, gesture/posture movement distance, gesture/posture direction (eg, arm direction), latter gesture/posture category, sequential numbering, etc.
  • the gesture/posture category may include at least but not limited to one of the following: a hand, an arm, and a body.
  • the location parameter may refer to a location setting of the first device, or the location parameter may also refer to a location of another device, such as a location of the second device different from the first device. To set it up.
  • the first device may issue the gesture/posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query and response mode, and the like.
  • FIG. 4 is a structural block diagram of the information receiving device according to the embodiment of the present invention.
  • the device includes a receiving module 42, and each module is described in detail below:
  • the receiving module 42 is configured to receive gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a description parameter of the recognized gesture/posture.
  • the device may further include: a second identification module 44 connected to the receiving module 42 and configured to identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture/posture.
  • FIG. 5 is a structural block diagram of an information sharing system according to an embodiment of the present invention. As shown in FIG. 5, the system may include the information release as shown in FIG. The device 20, and the above-described information receiving device 40 shown in FIG.
  • a sufficient and extensible description, apparatus and method for delivering gesture recognition information is provided, and gesture recognition information is described in a sufficient and extensible manner and distributed to the device for other gestures.
  • the recognition device determines the gesture operation command, thereby making the processing of the gesture recognition simpler.
  • the method provided by the preferred embodiment is a gesture/posture identification information publishing method, including:
  • the first device issues gesture/posture recognition information, the gesture/posture recognition information including at least a coordinate system and a description parameter of the recognized gesture/posture.
  • the first device captures an image, recognizes a gesture/posture, and determines a coordinate system; the coordinate system origin may be a point in the image.
  • the gesture/posture recognition information includes at least one of the following parameters: gesture coordinates, gesture category (hand, arm, body), gesture shape, gesture duration, gesture movement direction, gesture movement distance, arm direction, previous gesture Category, sequential number.
  • the coordinate system may refer to the first device location, or the second device location.
  • gesture/posture identification information is released by means of broadcast, multicast, unicast, and query-response.
  • the gesture information can be fully and easily extended, so that the gesture recognition information can be transmitted between devices, making full use of calculation and recognition resources, simplifying gesture recognition processing, and finally It is convenient for people to use gestures to manipulate the controlled devices, which not only makes people's entertainment life easier and more enjoyable; it is easier to understand and easy to use when mastering such functions, and it also reduces the parties in the industry chain. the cost of.
  • Figure 6 is a schematic illustration of a scene in accordance with a preferred embodiment of the present invention, as shown in Figure 6, which illustrates the various devices and their interrelationships.
  • two devices are taken as an example, which are one gesture and device identification device and one television TV.
  • the gesture and device recognition device implements computer vision and image processing technology.
  • the gesture and device identification is equipped with a camera capable of recognizing gestures, recognition and discovery devices; the TV TV supports gesture control, but no camera is set to Recognizing the gesture, which is merely for convenience of description, in fact, similarly to the TV TV, a plurality of recognized devices such as a DVD player, a home storage server, and the like can be arranged, controlled (communicated) by the gesture and the device identification device.
  • Each device contains a control module that can control sending and receiving messages with other devices, as well as processing control commands or handing over control commands.
  • UPnP Universal Plug and Play
  • mDNS Multicast Domain Name System
  • DNS-SD Domain Name System-based services.
  • This type of technology is used in IP networks to respond to queries and provide function calls in a unicast and multicast query manner in accordance with a predefined message format.
  • UPnP technology specifies how media display devices (such as TV), servers (such as DVD players, home storage servers) respond to queries, and which calling functions are provided.
  • the gesture recognition control device includes a camera with image and video capture capabilities, and an infrared ranging module.
  • the device internally includes an image recognition unit, a data storage unit, a control unit, and a network service unit.
  • all gesture recognition control devices can identify devices within their visual range by implementing a camera and a ranging module to rotate and capture images in their three-dimensional space, and analyzing and searching for predefined label graphics in the captured images. And analyzing, where the predefined tags may be pre-stored in the image and graphics in the visual recognition and discovery control device, or may be received images and graphics sent from the discovered, identified device. After analyzing the image, the image recognition unit of the gesture recognition control device recognizes that there are several identifiers in the image, separately identifies the identifiers and stores the identified information, and then performs distance measurement on the device where the label is located, and stores the identifier information together.
  • the visual recognition and discovery control device receives feature images from devices such as a TV TV, a DVD player, and a home storage server, such as device photo data of various angles, and then takes device photo data from the captured device. The panoramic image is retrieved, and the position of the device is measured and recorded.
  • This embodiment can use techniques such as feature detection and matching in sophisticated computer vision techniques.
  • the message when the TV is turned on, the message is sent in a multicast manner, and the message may include:
  • the network address and unique identifier of the device
  • Subscribed gesture recognition information which is a list that can be described using similar techniques such as XML.
  • a subscription request For example, a subscription request:
  • gesture description key data data list of the preferred embodiment of this embodiment may be represented by XML.
  • the purpose of this list may be to subscribe to and exchange gesture data to one or more gesture recognition devices with cameras, wearable gesture recognition devices.
  • Coordinate system This is one of the mandatory contents for exchanging gesture information.
  • the exchange parties rely on this coordinate system to judge the gesture target and intention.
  • Gesture coordinates Give coordinate points to describe gestures, use a set of coordinate points to describe the outline of the gesture, or give the center coordinate point of the hand, and so on.
  • Gesture Category Gives the description of which position to act on, such as the hand, arm, body, etc.
  • Gesture shape Gives a description of the gesture switch, such as: a few fingers, a finger, a gesture, and so on.
  • Gesture duration Indicates the duration of the gesture action, which can be set to indicate the speed of the action, etc.; can be in seconds.
  • Gesture movement direction for example, up, down, left, right, front, back, and coordinate points indicate start point, end point, and so on.
  • Gesture movement distance indicates the movement distance of the gesture; it can be in centimeters.
  • Gesture direction (arm direction): mainly indicates the arm direction, which can be in angle and radians.
  • the previous gesture number identifies the number of the last gesture information recognized by the device, and the gesture information corresponding to the number may not be subscribed by the device.
  • Sequence number The number of the currently described gesture information in the identification device is set to search and other functions.
  • the gesture information is described by means of XML or the like, the method in the present invention is easy to expand, and it is easy to add new description information.
  • FIG. 8 is a flow chart of a method in accordance with a preferred embodiment of the present invention. As shown in FIG. 8, the method described in this embodiment uses two devices to describe: gesture recognition device 1, gesture controlled device 2. The gesture controlled device 2 may have no identifying component. The method comprises the following steps:
  • step S802 the gesture controlled device 2 subscribes to the gesture recognition device 1 for the gesture information.
  • Device 2 can provide one or more manifest lists.
  • step S804 the gesture recognition device 1 collects and recognizes the gesture information, and sends the gesture information to the gesture controlled device 2.
  • Device 1 sent a list of manifests.
  • Step S806 if the gesture recognition device 1 continues to collect and recognize the gesture information, the gesture information is continuously sent to the gesture controlled device 2.
  • Device 1 sent a list of manifests.
  • step S808 the gesture controlled device 2 can send a request for canceling the subscription gesture information to the gesture recognition device.
  • the device 1 After receiving such a request, the device 1 no longer recognizes the gesture for the device 2, and of course does not send the gesture information.
  • the television, the player, and the storage server are used as the controlled device, and the preferred embodiment is not limited to the device being controlled as the device mentioned in the embodiment, the computer, the sound, the speaker, and the projection.
  • Instruments, set-top boxes, and the like can all be used as controlled devices, and even other industrial devices such as automobiles, machine tools, ships, and the like can be manipulated by visual recognition and discovery control devices.
  • the camera of the visual recognition and discovery control device may be of various specifications, for example, may be a fixed focal length or a zoom distance, and the rotating space may be up, down, left, and right, or only support the left and right angles, and only one of the configurations is required.
  • the camera has the various capabilities described in the embodiments.
  • the ranging unit can use laser infrared ranging, or other wavelengths of light measurement, can use 3 cameras to calculate ranging, or use more cameras to calculate distance using weight adjustment.
  • the above process is an embodiment of the present invention, and is not limited to the embodiment, and is not intended to limit the execution of a specific process.
  • the present invention may also be implemented in a similar manner, such as indicating the name of the unit, each The type of message, etc., is nothing more than a naming form, a specific message content, and the like.
  • the above embodiments are network-related and can be applied to communication networks based on IEEE 802.3, IEEE 802.11b/g/n, POWELINE, CABLE, PSTN, 3GPP (3rd Generation Partnership Project), 3GPP2 networks, and the like.
  • the supported IP network, the operating system of each device can be applied to UNIX-like operating systems, WINDOWS-like operating systems, ANDROID-type operating systems, IOS operating systems, and consumer interfaces can be applied to JAVA language interfaces.
  • a software is provided that is configured to perform the technical solutions described in the above embodiments and preferred embodiments.
  • a storage medium in which the above software is stored, including but not limited to an optical disk, a floppy disk, a hard disk, an erasable memory, and the like.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the information distribution method, the information receiving method, the device, and the information sharing system provided by the embodiments of the present invention have the following beneficial effects: the problem that the different devices in the related art are easily confused with the gesture recognition information is solved, and the problem is improved.
  • the user experience saves resources and, in addition, the flexibility of gesture and/or gesture recognition schemes can be enhanced by the release of description parameters for gestures and/or gestures themselves.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An information publication method, an information receiving method and apparatus, and an information sharing system. The information publication method comprises: identifying, by a first device, gesture and/or posture information (S102); and publishing, by the first device, the gesture and/or posture information, wherein the gesture and/or posture information at least comprises a coordinate system and a description parameter of an identified gesture and/or posture (S104). The problem in the related art that different devices would easily confuse gesture identification information is solved, thereby improving the user experience and saving resources; in addition, since the description parameter of a gesture and/or posture itself is published, the flexibility of the solution for identifying a gesture and/or posture can also be improved.

Description

信息发布方法、信息接收方法、装置及信息共享系统Information distribution method, information receiving method, device and information sharing system 技术领域Technical field
本发明涉及通信领域,具体而言,涉及一种信息发布方法、信息接收方法、装置及信息共享系统。The present invention relates to the field of communications, and in particular to an information publishing method, an information receiving method, an apparatus, and an information sharing system.
背景技术Background technique
数字多媒体和网络的发展,丰富了人们日常生活中的娱乐体验。目前的技术让人们在家里能够观看高清电视,电视节目的来源可能来自数字光盘、有线电视、互联网等等,能够体验立体声、5.1声道、7.1声道乃至更逼真的声音效果,而且人们还能够使用PAD(平板电子设备)、手机来实现这些体验,相关技术还包括,人们能够通过网络在不同设备之间转移数字内容的播放,以及通过遥控器、手势控制一个设备的播放例如控制切换上一频道、下一频道节目等等。The development of digital multimedia and networks has enriched the entertainment experience in people's daily lives. The current technology allows people to watch HDTV at home. The source of TV programs may come from digital discs, cable TV, the Internet, etc., and can experience stereo, 5.1-channel, 7.1-channel and even more realistic sound effects, and people can Using PAD (tablet electronic devices), mobile phones to achieve these experiences, related technologies include, people can transfer the playback of digital content between different devices through the network, and control the playback of a device through remote control, gestures, such as control switching Channel, next channel show, etc.
传统的对多个设备的控制方法,当前常见的是,分别使用设备各自的遥控器进行控制,而这些遥控器往往是互不通用的,遥控器大多不具备网络功能,例如传统的电视机、音响;也有一些支持网络的遥控器,例如在具有计算和网络能力的设备(如手机、PAD,本文中,PAD是指手持式多媒体消费电子设备、或平板电脑这样的设备)上加载支持互通协议的软件,来控制另一设备。The traditional method of controlling multiple devices is currently controlled by using the respective remote controllers of the devices, and these remote controllers are often not common to each other, and most of the remote controllers do not have network functions, such as a conventional television set. Audio; there are also some remote controls that support the network, such as loading and supporting interworking protocols on devices with computing and networking capabilities (such as cell phones, PADs, in this article, PAD refers to handheld multimedia consumer electronics devices, or devices such as tablets). Software to control another device.
随着技术的发展,多个设备之间的内容播放共享、转移需求越来越多,上述操控方式显得并不够方便,表现有:或者人们需要在一堆遥控器中挑选出对应设备的那一个遥控器并随着控制不同的设备而不断地更换遥控器,或者只能由熟悉电脑基本操作的人们来操作PAD、手机等来控制设备,或者以简单的手势来控制单一的设备。为了使用不同设备往往要学习使用不同的操控工具。人们更希望使用更简单、更自然的操作方式来控制在较小范围内的更多设备。With the development of technology, there are more and more content sharing and transfer requirements between multiple devices. The above control methods are not convenient enough. The performance is: or people need to pick out the corresponding device in a bunch of remote controllers. The remote control constantly changes the remote control as it controls different devices, or can only control the device by operating a PAD, a mobile phone, etc., or a simple gesture to control a single device. In order to use different devices, it is often necessary to learn to use different manipulation tools. People prefer to use simpler, more natural modes of operation to control more devices in a smaller range.
手势控制是当前比较新颖的一种方式:一台设备上的摄像头监视手势动作并进行分析识别,最后转换成对该设备的控制;或者用户使用可穿戴设备,通过在手上、手臂上以及身体上穿戴类似指环、手表、背心等等类似的设备,识别用户动作,也实现对设备的控制。Gesture control is a relatively new way: the camera on one device monitors the gesture and analyzes it, and finally converts it into control of the device; or the user uses the wearable device through the hands, arms, and body. Wearing similar devices such as rings, watches, vests, etc., recognizes user actions and also controls the device.
相关技术和一些产品能够让人们使用手势来操控设备,例如,通过在电视机上增加一个摄像头,采集、识别人的手势,然后按照预先定义的手势与操控命令对应关系,达到手势操控电视机的效果,已经实现的操控包括更换频道、改变音量等。Related technologies and some products enable people to use gestures to manipulate devices. For example, by adding a camera to a television, collecting and recognizing a person's gestures, and then following a predefined gesture and manipulation command correspondence, the gesture is manipulated to control the television. The operations that have been implemented include changing channels, changing the volume, and so on.
当前市场上以及实验室研究的手势识别设备各自配置有摄像头,使用时往往需要输入一个“启动指示”,例如特定的手势,或其它控制指令。当家庭、办公场景里这样的设备较多时,例如家庭中电视、机顶盒、播放器、空调、音响等都支持手势识别,用户同时操控这些设备 时,经常切换“启动指示”这种体验并不友好,或者“启动手势”后,容易造成识别指令输入的混淆。因为这些设备之间对自己的位置信息、识别出的位置信息、识别出的手势并不发布、共享,只是各自处理识别出的手势指令。The gesture recognition devices currently on the market and in the laboratory are each equipped with a camera, which often requires input of a "starting indication", such as a specific gesture, or other control commands. When there are many such devices in the home and office scenes, such as TV, set-top box, player, air conditioner, and audio in the home, gesture recognition is supported, and the user controls these devices at the same time. When the "starting instruction" is often switched, the experience is not friendly, or the "starting gesture" is likely to cause confusion in the recognition command input. Because these devices do not publish and share their own location information, recognized location information, and recognized gestures, they only process the recognized gesture commands.
通过网络在不同设备之间传递控制信息,相关技术已能够实现设备之间的互相发现和控制,例如通用即插即用(UPnP)技术规定了设备之间如何发送、接收网络消息来实现发现和控制,该技术以网络地址及数字编码作为设备的标识,是一种机器标识,最终的控制需要用户根据设备的机器标识进行选择再操作。Through the network to transfer control information between different devices, related technologies have been able to achieve mutual discovery and control between devices, such as Universal Plug and Play (UPnP) technology, which stipulates how to send and receive network messages between devices to achieve discovery and Control, the technology uses the network address and digital code as the identification of the device, which is a kind of machine identification. The final control requires the user to select and operate according to the machine identification of the device.
针对相关技术中不同设备对于手势识别信息容易产生混淆的问题,目前尚未提出有效的解决方案。In view of the fact that different devices in the related art are confusing for gesture recognition information, an effective solution has not been proposed yet.
发明内容Summary of the invention
本发明实施例提供了一种信息发布方法、信息接收方法、装置及信息共享系统,以至少解决相关技术中不同设备对于手势识别信息容易产生混淆的问题。The embodiments of the present invention provide an information publishing method, an information receiving method, a device, and an information sharing system, so as to at least solve the problem that different devices in the related art are confusing for gesture recognition information.
根据本发明的一个实施例,提供了一种信息发布方法,包括:第一设备识别手势和/或姿势信息;所述第一设备发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。According to an embodiment of the present invention, there is provided an information publishing method, comprising: a first device recognizing a gesture and/or gesture information; the first device publishing the gesture and/or gesture information, wherein the gesture and The gesture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
本实施例中,第一设备识别手势和/或姿势信息包括:所述第一设备捕获图像;所述第一设备根据所述图像识别所述手势和/或姿势,并且确定所述坐标系,其中所述坐标系的原点是所述图像中的一个点。In this embodiment, the first device identifying the gesture and/or the gesture information includes: the first device capturing an image; the first device identifying the gesture and/or gesture according to the image, and determining the coordinate system, Wherein the origin of the coordinate system is a point in the image.
本实施例中,所述手势和/或姿势的描述参数至少包括以下之一:手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。In this embodiment, the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
本实施例中,所述手势和/或姿势类别至少包括以下之一:手、臂、身体。In this embodiment, the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
本实施例中,所述坐标系参照所述第一设备的位置设立,或者,所述坐标系参照不同于所述第一设备的第二设备的位置设立。In this embodiment, the coordinate system is established with reference to the location of the first device, or the coordinate system is established with reference to a location of the second device different from the first device.
本实施例中,所述第一设备通过以下方式至少之一发布所述手势和/或姿势信息:广播方式、多播方式、单播方式、查询及响应的方式。In this embodiment, the first device issues the gesture and/or posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
根据本发明的另一实施例,提供了一种信息接收方法,包括:第二设备接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。According to another embodiment of the present invention, there is provided an information receiving method, comprising: a second device receiving gestures and/or gesture information, wherein the gesture and/or posture information includes at least a coordinate system and an identified gesture and/or Or description parameters of the pose.
本实施例中,在第二设备接收手势和/或姿势信息之后,还包括:所述第二设备根据所述坐标系和识别的手势和/或姿势的描述参数识别相应的含义。In this embodiment, after the second device receives the gesture and/or the posture information, the method further includes: the second device identifying the corresponding meaning according to the coordinate system and the description parameter of the recognized gesture and/or posture.
本实施例中,所述手势和/或姿势的描述参数至少包括以下之一:手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。 In this embodiment, the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
本实施例中,所述手势和/或姿势类别至少包括以下之一:手、臂、身体。In this embodiment, the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
本实施例中,所述第二设备通过以下方式至少之一接收所述手势和/或姿势信息:广播方式、多播方式、单播方式、查询及响应的方式。In this embodiment, the second device receives the gesture and/or posture information by at least one of the following modes: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
根据本发明的再一实施例,提供了一种信息发布装置,位于第一设备中,包括:第一识别模块,设置为识别手势和/或姿势信息;发布模块,设置为发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。According to still another embodiment of the present invention, an information distribution apparatus is provided, which is located in a first device, and includes: a first identification module configured to recognize gestures and/or gesture information; a publishing module configured to issue the gesture and And/or posture information, wherein the gesture and/or posture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
根据本发明的再一实施例,还提供了一种信息接收装置,位于第二设备中,包括:接收模块,设置为接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。According to still another embodiment of the present invention, there is provided an information receiving apparatus, located in a second device, comprising: a receiving module, configured to receive gestures and/or gesture information, wherein the gesture and/or posture information is at least A description parameter including a coordinate system and recognized gestures and/or gestures.
本实施例中,所述装置还包括:第二识别模块,设置为根据所述坐标系和识别的手势和/或姿势的描述参数识别相应的含义。In this embodiment, the apparatus further includes: a second identification module, configured to identify a corresponding meaning according to the coordinate system and the description parameter of the recognized gesture and/or posture.
根据本发明的还一实施例,提供了一种信息共享系统,包括上述信息发布装置,以及上述信息接收装置。According to still another embodiment of the present invention, an information sharing system is provided, including the above information distribution apparatus, and the above information receiving apparatus.
根据本发明的一实施例,还提供了一种信息发布方法,包括:第一设备识别手势和/或姿势信息;所述第一设备发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。According to an embodiment of the present invention, an information publishing method is further provided, including: a first device recognizing a gesture and/or posture information; the first device issuing the gesture and/or posture information, wherein the gesture And/or the gesture information includes at least a positional parameter and a description parameter of the recognized gesture and/or gesture.
本实施例中,第一设备识别手势和/或姿势信息包括:所述第一设备捕获图像;所述第一设备根据所述图像识别所述手势和/或姿势,并且确定所述位置参数。In this embodiment, the first device identifying the gesture and/or the gesture information comprises: the first device capturing an image; the first device identifying the gesture and/or gesture according to the image, and determining the location parameter.
本实施例中,所述手势和/或姿势的描述参数至少包括以下之一:手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。In this embodiment, the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
本实施例中,所述手势和/或姿势类别至少包括以下之一:手、臂、身体。In this embodiment, the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
本实施例中,所述位置参数参照所述第一设备的位置设置,或者,所述位置参数参照不同于所述第一设备的第二设备的位置设置。In this embodiment, the location parameter refers to a location setting of the first device, or the location parameter refers to a location setting different from a second device of the first device.
本实施例中,所述第一设备通过以下方式至少之一发布所述手势和/或姿势信息:广播方式、多播方式、单播方式、查询及响应的方式。In this embodiment, the first device issues the gesture and/or posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
根据本发明的一实施例,还提供了一种信息接收方法,包括:第二设备接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。According to an embodiment of the present invention, there is further provided an information receiving method, comprising: receiving, by a second device, gestures and/or gesture information, wherein the gesture and/or posture information includes at least a position parameter and an identified gesture and/or Or description parameters of the pose.
本实施例中,在第二设备接收手势和/或姿势信息之后,还包括:所述第二设备根据所述位置参数和识别的手势和/或姿势的描述参数识别相应的含义。In this embodiment, after the second device receives the gesture and/or the posture information, the method further includes: the second device identifying the corresponding meaning according to the position parameter and the description parameter of the recognized gesture and/or posture.
本实施例中,所述手势和/或姿势的描述参数至少包括以下之一:手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。 In this embodiment, the description parameters of the gesture and/or gesture include at least one of: gesture and/or gesture coordinates, gesture and/or gesture category, gesture and/or gesture shape, gesture and/or gesture duration, Gesture and/or gesture movement direction, gesture and/or gesture movement distance, gesture and/or gesture direction, latter gesture and/or gesture category, sequential numbering.
本实施例中,所述手势和/或姿势类别至少包括以下之一:手、臂、身体。In this embodiment, the gesture and/or gesture category includes at least one of the following: a hand, an arm, and a body.
本实施例中,所述第二设备通过以下方式至少之一接收所述手势和/或姿势信息:广播方式、多播方式、单播方式、查询及响应的方式。In this embodiment, the second device receives the gesture and/or posture information by at least one of the following modes: a broadcast mode, a multicast mode, a unicast mode, a query, and a response manner.
根据本发明的一实施例,还提供了一种信息发布装置,位于第一设备中,包括:第一识别模块,设置为识别手势和/或姿势信息;发布模块,设置为发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。According to an embodiment of the present invention, there is further provided an information distribution apparatus, located in the first device, comprising: a first identification module configured to recognize gestures and/or gesture information; a publishing module configured to issue the gesture and And/or posture information, wherein the gesture and/or posture information includes at least a position parameter and a description parameter of the recognized gesture and/or gesture.
根据本发明的一实施例,还提供了一种信息接收装置,位于第二设备中,包括:接收模块,设置为接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。According to an embodiment of the present invention, there is further provided an information receiving apparatus, located in a second device, comprising: a receiving module, configured to receive gestures and/or gesture information, wherein the gesture and/or posture information includes at least Position parameters and description parameters of the recognized gestures and/or gestures.
本实施例中,所述装置还包括:第二识别模块,设置为根据所述位置参数和识别的手势和/或姿势的描述参数识别相应的含义。In this embodiment, the device further includes: a second identification module, configured to identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture and/or posture.
根据本发明的一实施例,还提供了一种信息共享系统,包括上述信息发布装置,以及上述信息接收装置。According to an embodiment of the present invention, an information sharing system is further provided, including the above information distribution apparatus, and the above information receiving apparatus.
通过本发明实施例,采用第一设备识别手势和/或姿势信息;所述第一设备发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数的方式,解决了相关技术中不同设备对于手势识别信息容易产生混淆的问题,提升了用户体验,节省了资源,此外由于发布的是手势和/或姿势本身的描述参数,还能够提升手势和/或姿势识别方案的灵活性。The first device identifies the gesture and/or posture information by using the first device; the first device issues the gesture and/or posture information, wherein the gesture and/or posture information includes at least a coordinate system and an identifier The manner of describing parameters of gestures and/or gestures solves the problem that different devices in the related art are confusing for gesture recognition information, improves user experience, saves resources, and is also described by gestures and/or gestures themselves. Parameters can also increase the flexibility of gesture and/or gesture recognition schemes.
附图说明DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是根据本发明实施例的信息发布方法的流程图;1 is a flowchart of an information distribution method according to an embodiment of the present invention;
图2是根据本发明实施例的信息发布装置的结构框图;2 is a block diagram showing the structure of an information distribution apparatus according to an embodiment of the present invention;
图3是根据本发明实施例的信息接收方法的流程图;FIG. 3 is a flowchart of an information receiving method according to an embodiment of the present invention; FIG.
图4是根据本发明实施例的信息接收装置的结构框图;4 is a block diagram showing the structure of an information receiving apparatus according to an embodiment of the present invention;
图5是根据本发明实施例的信息共享系统的结构框图;FIG. 5 is a structural block diagram of an information sharing system according to an embodiment of the present invention; FIG.
图6是根据本发明优选实施例的场景示意图;Figure 6 is a schematic illustration of a scene in accordance with a preferred embodiment of the present invention;
图7是根据本发明优选实施例的手势描述关键数据数据清单;7 is a list of gesture description key data data in accordance with a preferred embodiment of the present invention;
图8是根据本发明优选实施例的方法流程图。Figure 8 is a flow diagram of a method in accordance with a preferred embodiment of the present invention.
具体实施方式 detailed description
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
本实施例中,考虑到可以一种手势识别装置,能够识别设备包括其位置、通讯标识参数,并发布识别的手势信息;使用手势操控时,受控装置发布能够处理的手势:例如手势编号、手势文字描述信息和数字图形信息。In this embodiment, it is considered that a gesture recognition apparatus can identify that the device includes its location and communication identification parameters, and issue the recognized gesture information; when the gesture is used, the controlled device issues a gesture that can be processed: for example, a gesture number, Gesture text describes information and digital graphic information.
然而,仅用手势编号、手势文字描述信息并不能描述出丰富的手势含义,而手势信息中的多种形状、持续时间、移动方向、移动距离、手臂指向、前一个或若干个手势等上下文等等这些结合在一起,能够表示更多的含义。如果用数字图形信息来描述,则另一个设备接收后,要继续做识别分析,这对设备的计算能力、整体计算资源都提出的额外的要求,而不利用已有的识别结果再次进行识别,实际上也是对资源的一种浪费。However, using gesture numbering and gesture text to describe information does not describe a rich gesture meaning, but various shapes, durations, moving directions, moving distances, arm pointing, previous or several gestures, etc. in the gesture information, etc. When these are combined, they can express more meaning. If the digital graphic information is used for description, after another device receives, it needs to continue to perform identification analysis, which imposes additional requirements on the computing power and overall computing resources of the device, and does not use the existing recognition result to identify again. It is actually a waste of resources.
如果能够提供充分、可扩展地给出一种描述、传递手势信息的方法,会让用户操控多设备时更简单方便,并且辅助实现协同的手势控制,将使得人们的娱乐生活更轻松、更享受,人们不需要学习掌握更多的使用方法,还能够降低企业生产、用户消费的成本。If it can provide a sufficient and extensible way to describe and transmit gesture information, it will make it easier and more convenient for users to control multiple devices, and assist in achieving coordinated gesture control, which will make people's entertainment life easier and more enjoyable. People do not need to learn more ways to use, but also reduce the cost of production and user consumption.
基于上述思路,本实施例中提供了一种信息发布方法,图1是根据本发明实施例的信息发布方法的流程图,如图1所示,该方法包括如下步骤(下文中也用“/”指代“和/或”的含义):Based on the above idea, an information publishing method is provided in this embodiment. FIG. 1 is a flowchart of an information publishing method according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps (hereinafter also referred to as “/ "refers to the meaning of "and / or"):
步骤S102,第一设备识别手势/姿势信息;Step S102, the first device recognizes gesture/posture information;
步骤S104,所述第一设备发布所述手势/姿势信息,其中,所述手势/姿势信息至少包括位置参数和识别的手势/姿势的描述参数。其中位置参数可以用一个坐标系来表示。坐标系可以选取的坐标系类型包括如笛卡尔坐标、球坐标等等,坐标原点位置选取在在图像中的一个点或任意空间中的一个点等等。位置参数在传递上可以选用默认的坐标系统,这时就只需传递坐标原点和目标的坐标参数。也可以把公共的坐标原点选为默认的参数,这时就只需传递目标的坐标参数。Step S104, the first device issues the gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a description parameter of the recognized gesture/posture. The positional parameters can be represented by a coordinate system. The coordinate system types that can be selected by the coordinate system include, for example, Cartesian coordinates, spherical coordinates, and the like, and the coordinate origin position is selected at a point in the image or a point in any space, and the like. The positional parameter can be selected from the default coordinate system. In this case, only the coordinates of the coordinate origin and the target coordinate parameters are passed. You can also select the common coordinate origin as the default parameter, and you only need to pass the coordinates of the target.
本实施例通过上述步骤,第一设备将其识别出的手势/姿势信息进行发布,其中该信息中至少包括了位置参数(例如坐标系)及手势/姿势的描述参数,从而使得第一设备能够将其识别出的手势/姿势本身的描述参数发布出去,共享给其他设备,而并不是发布第一设备根据该手势/姿势识别出的对应含义,进而使得接收端设备能够根据第一设备识别出的手势/姿势信息自主判断该手势/姿势的对应含义,由于都是基于同一个手势/姿势信息识别对应含义,解决了相关技术中不同设备对于手势识别信息容易产生混淆的问题,提升了用户体验,节省了资源,此外由于发布的是手势/姿势本身的描述参数,还能够提升手势/姿势识别方案的灵活性。In this embodiment, the first device releases the gesture/posture information that is recognized by the first device, where the information includes at least a position parameter (such as a coordinate system) and a description parameter of the gesture/posture, so that the first device can The description parameter of the recognized gesture/posture itself is released and shared to other devices, instead of publishing the corresponding meaning of the first device according to the gesture/posture, thereby enabling the receiving device to recognize according to the first device. The gesture/posture information autonomously determines the corresponding meaning of the gesture/posture, since the corresponding meanings are recognized based on the same gesture/posture information, which solves the problem that different devices in the related art are easily confused with the gesture recognition information, thereby improving the user experience. , saving resources, and also because of the release of the description parameters of the gesture / gesture itself, can also enhance the flexibility of the gesture / gesture recognition scheme.
本实施例中,所述第一设备识别手势/姿势信息的方式如下:所述第一设备捕获图像;所述第一设备根据所述图像识别所述手势/姿势,并且确定所述坐标系,其中所述坐标系的原点是所述图像中的一个点。其中,所述第一设备捕获图像可以是根据摄像头拍摄的图像进行捕获,或者,也可以是根据可穿戴设备识别出的动作,例如根据可穿戴设备的三轴加速度传感器识别出的可穿戴设备的运行路线和姿态,转换成图像。 In this embodiment, the manner in which the first device recognizes the gesture/posture information is as follows: the first device captures an image; the first device identifies the gesture/posture according to the image, and determines the coordinate system, Wherein the origin of the coordinate system is a point in the image. The captured image of the first device may be captured according to an image captured by the camera, or may be an action recognized by the wearable device, for example, the wearable device recognized according to the triaxial acceleration sensor of the wearable device. Run the route and pose and convert to an image.
在本实施例中,所述手势/姿势的描述参数至少可以包括但不限于以下至少之一:手势/姿势坐标,手势/姿势类别,手势/姿势形状,手势/姿势持续时间,手势/姿势移动方向,手势/姿势移动距离,手势/姿势方向(例如,手臂方向),后一个手势/姿势类别,顺序编号等。其中,所述手势/姿势类别至少可以包括但不限于以下之一:手、臂、身体。In this embodiment, the description parameter of the gesture/posture may include at least but not limited to at least one of: gesture/posture coordinates, gesture/posture category, gesture/posture shape, gesture/posture duration, gesture/posture movement Direction, gesture/posture movement distance, gesture/posture direction (eg, arm direction), latter gesture/posture category, sequential numbering, etc. The gesture/posture category may include at least but not limited to one of the following: a hand, an arm, and a body.
在本实施例中,所述位置参数可以参照所述第一设备的位置设置,或者,所述位置参数也可以参照其他设备的位置,例如不同于所述第一设备的第二设备的位置,来设置。In this embodiment, the location parameter may refer to a location setting of the first device, or the location parameter may also refer to a location of another device, such as a location of the second device different from the first device. To set it up.
在本实施例中,所述第一设备可以通过以下方式至少之一发布所述手势/姿势信息:广播方式、多播方式、单播方式、查询及响应的方式等。In this embodiment, the first device may issue the gesture/posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query and response mode, and the like.
对应于上述信息发布方法,在本实施例中还提供了一种信息发布装置,位于第一设备中,该装置设置为实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。Corresponding to the above-mentioned information distribution method, in the embodiment, an information distribution device is also provided, which is located in the first device, and is configured to implement the above-mentioned embodiments and preferred embodiments, and has not been described again. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
图2是根据本发明实施例的信息发布装置的结构框图,如图2所示,该装置包括第一识别模块22和发布模块24,下面对各个模块进行详细说明:2 is a structural block diagram of an information distribution apparatus according to an embodiment of the present invention. As shown in FIG. 2, the apparatus includes a first identification module 22 and a distribution module 24. The following describes each module in detail:
第一识别模块22,设置为识别手势/姿势信息;发布模块24,与第一识别模块22相连,设置为发布所述手势/姿势信息,其中,所述手势/姿势信息至少包括位置参数和识别的手势/姿势的描述参数。The first identification module 22 is configured to recognize the gesture/posture information; the publishing module 24 is connected to the first identification module 22 and configured to issue the gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a recognition Description parameters for gestures/postures.
在本实施例中,还提供了一种信息接收方法,图3是根据本发明实施例的信息接收方法的流程图,如图3所示,该方法包括如下步骤:In this embodiment, a method for receiving information is also provided. FIG. 3 is a flowchart of a method for receiving information according to an embodiment of the present invention. As shown in FIG. 3, the method includes the following steps:
步骤S302,第二设备接收手势/姿势信息,其中,所述手势/姿势信息至少包括位置参数和识别的手势/姿势的描述参数。其中位置参数可以用一个坐标系来表示。坐标系可以选取的坐标系类型包括如笛卡尔坐标、球坐标等等,坐标原点位置选取在在图像中的一个点或任意空间中的一个点等等。位置参数在传递上可以选用默认的坐标系统,这时就只需传递坐标原点和目标的坐标参数。也可以把公共的坐标原点选为默认的参数,这时就只需传递目标的坐标参数。Step S302: The second device receives gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a description parameter of the recognized gesture/posture. The positional parameters can be represented by a coordinate system. The coordinate system types that can be selected by the coordinate system include, for example, Cartesian coordinates, spherical coordinates, and the like, and the coordinate origin position is selected at a point in the image or a point in any space, and the like. The positional parameter can be selected from the default coordinate system. In this case, only the coordinates of the coordinate origin and the target coordinate parameters are passed. You can also select the common coordinate origin as the default parameter, and you only need to pass the coordinates of the target.
本实施例通过上述步骤,第二设备接收其他设备(例如上述第一设备)发布的手势/姿势信息,其中该信息中至少包括了位置参数及手势/姿势的描述参数,从而使得第二设备能够获取到其他设备识别出的手势/姿势本身的描述参数,而并不是接收其他设备根据该手势/姿势识别出的对应含义,进而使得第二设备可以根据该手势/姿势信息自主判断该手势/姿势的对应含义或者也可以将该手势/姿势本身的描述参数再传递给其他设备或者存储于本地,再由后续程序或设备自主判断对应含义,由于都是基于同一个手势/姿势信息识别对应含义,解决了相关技术中不同设备对于手势识别信息容易产生混淆的问题,提升了用户体验,节省了资源,此外由于接收的是手势/姿势本身的描述参数,还能够提升手势/姿势识别方案的灵活性。In this embodiment, the second device receives the gesture/posture information issued by another device (for example, the first device), where the information includes at least the location parameter and the description parameter of the gesture/posture, so that the second device can enable the second device to Obtaining a description parameter of the gesture/posture itself recognized by the other device, and not receiving the corresponding meaning recognized by the other device according to the gesture/posture, thereby enabling the second device to autonomously determine the gesture/posture according to the gesture/posture information. The corresponding meaning of the gesture or the gesture itself can be further transmitted to other devices or stored locally, and then the subsequent program or device autonomously determines the corresponding meaning, since the corresponding meaning is recognized based on the same gesture/posture information. The invention solves the problem that the different devices in the related art are confusing for the gesture recognition information, improves the user experience, saves resources, and can also improve the flexibility of the gesture/posture recognition scheme by receiving the description parameters of the gesture/posture itself. .
在本实施例中,所述第二设备可以根据所述位置参数和识别的手势/姿势的描述参数识别相应的含义。 In this embodiment, the second device may identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture/posture.
在本实施例中,所述手势/姿势的描述参数至少可以包括但不限于以下至少之一:手势/姿势坐标,手势/姿势类别,手势/姿势形状,手势/姿势持续时间,手势/姿势移动方向,手势/姿势移动距离,手势/姿势方向(例如,手臂方向),后一个手势/姿势类别,顺序编号等。其中,所述手势/姿势类别至少可以包括但不限于以下之一:手、臂、身体。In this embodiment, the description parameter of the gesture/posture may include at least but not limited to at least one of: gesture/posture coordinates, gesture/posture category, gesture/posture shape, gesture/posture duration, gesture/posture movement Direction, gesture/posture movement distance, gesture/posture direction (eg, arm direction), latter gesture/posture category, sequential numbering, etc. The gesture/posture category may include at least but not limited to one of the following: a hand, an arm, and a body.
在本实施例中,所述位置参数可以参照所述第一设备的位置设置,或者,所述位置参数也可以参照其他设备的位置,例如不同于所述第一设备的第二设备的位置,来设置。In this embodiment, the location parameter may refer to a location setting of the first device, or the location parameter may also refer to a location of another device, such as a location of the second device different from the first device. To set it up.
在本实施例中,所述第一设备可以通过以下方式至少之一发布所述手势/姿势信息:广播方式、多播方式、单播方式、查询及响应的方式等。In this embodiment, the first device may issue the gesture/posture information in at least one of the following manners: a broadcast mode, a multicast mode, a unicast mode, a query and response mode, and the like.
对应于上述信息接收方法,在本实施例中还提供了一种信息接收装置,位于第二设备中,图4是根据本发明实施例的信息接收装置的结构框图,如图4所示,该装置包括接收模块42,下面对各个模块进行详细说明:Corresponding to the above information receiving method, in the embodiment, an information receiving device is also provided, which is located in the second device. FIG. 4 is a structural block diagram of the information receiving device according to the embodiment of the present invention. The device includes a receiving module 42, and each module is described in detail below:
接收模块42,设置为接收手势/姿势信息,其中,所述手势/姿势信息至少包括位置参数和识别的手势/姿势的描述参数。The receiving module 42 is configured to receive gesture/posture information, wherein the gesture/posture information includes at least a position parameter and a description parameter of the recognized gesture/posture.
本实施例中,所述装置还可以包括;第二识别模块44,与接收模块42相连,设置为根据所述位置参数和识别的手势/姿势的描述参数识别相应的含义。In this embodiment, the device may further include: a second identification module 44 connected to the receiving module 42 and configured to identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture/posture.
在本实施例中,还提供了一种信息共享系统,图5是根据本发明实施例的信息共享系统的结构框图,如图5所示,该系统可以包括上述如图2所示的信息发布装置20,以及上述如图4所示的信息接收装置40。In this embodiment, an information sharing system is also provided. FIG. 5 is a structural block diagram of an information sharing system according to an embodiment of the present invention. As shown in FIG. 5, the system may include the information release as shown in FIG. The device 20, and the above-described information receiving device 40 shown in FIG.
下面结合优选实施例进行说明,以下优选实施例结合了上述实施例及其优选实施方式。The following description is made in conjunction with the preferred embodiments, and the following preferred embodiments incorporate the above-described embodiments and preferred embodiments thereof.
在以下优选实施例中,提供了一种充分、可扩展的描述、传递手势识别信息发布的装置与方法,以一种充分、可扩展的方式描述手势识别信息,并发布给装置,供其它手势识别装置判断手势操作命令,从而使得手势识别的处理更简单。In the following preferred embodiments, a sufficient and extensible description, apparatus and method for delivering gesture recognition information is provided, and gesture recognition information is described in a sufficient and extensible manner and distributed to the device for other gestures. The recognition device determines the gesture operation command, thereby making the processing of the gesture recognition simpler.
本优选实施例提供的方法是一种手势/姿势识别信息发布方法,包括:The method provided by the preferred embodiment is a gesture/posture identification information publishing method, including:
第一设备发布手势/姿势识别信息,手势/姿势识别信息至少包括坐标系和识别的手势/姿势的描述参数。The first device issues gesture/posture recognition information, the gesture/posture recognition information including at least a coordinate system and a description parameter of the recognized gesture/posture.
进一步地,第一设备捕获图像,识别手势/姿势,确定坐标系;坐标系原点可以是图像中的一个点。Further, the first device captures an image, recognizes a gesture/posture, and determines a coordinate system; the coordinate system origin may be a point in the image.
进一步地,手势/姿势识别信息,至少包括如下参数之一:手势坐标,手势类别(手、臂、身体),手势形状,手势持续时间,手势移动方向,手势移动距离,手臂方向,前一个手势类别,顺序编号。Further, the gesture/posture recognition information includes at least one of the following parameters: gesture coordinates, gesture category (hand, arm, body), gesture shape, gesture duration, gesture movement direction, gesture movement distance, arm direction, previous gesture Category, sequential number.
进一步地,坐标系可以参照第一设备位置,或第二设备位置。Further, the coordinate system may refer to the first device location, or the second device location.
进一步地,发布手势/姿势识别信息,可以通过广播、多播、单播、查询-响应的方式。 Further, the gesture/posture identification information is released by means of broadcast, multicast, unicast, and query-response.
综上所述,采用本优选实施例的方法,可以充分、易扩展地描述手势信息,使得手势识别信息可以在设备之间传递,充分利用了计算、识别资源,简化了手势识别处理,最终有利于人们方便地使用手势操控被操控的设备,不但使得人们的娱乐生活更轻松、更享受;掌握这种功能、使用这类设备时也更容易理解、容易上手,还降低了产业链上各方的成本。In summary, with the method of the preferred embodiment, the gesture information can be fully and easily extended, so that the gesture recognition information can be transmitted between devices, making full use of calculation and recognition resources, simplifying gesture recognition processing, and finally It is convenient for people to use gestures to manipulate the controlled devices, which not only makes people's entertainment life easier and more enjoyable; it is easier to understand and easy to use when mastering such functions, and it also reduces the parties in the industry chain. the cost of.
下面将结合附图和实施例对本发明进行详细描述。The invention will now be described in detail in conjunction with the drawings and embodiments.
为了清楚起见,这里没有示出和描述设备的所有的常规特征。当然,应当理解,在任何实际设备的研制中,必需做出特定实现方式的决定以便实现研制者的特定目标,例如符合与应用及业务相关的约束,这些特定的目标随着不同的实现方式而变化,并且随着不同的研制者而变化。而且,应当理解,这种研制工作是复杂和耗时的,但是尽管如此,对于受到本发明公开内容启发的普通技术人员而言所进行的技术工作是常规的。For the sake of clarity, not all of the conventional features of the device are shown and described herein. Of course, it should be understood that in the development of any actual device, it is necessary to make a decision on a particular implementation in order to achieve the developer's specific goals, such as compliance with application and business-related constraints, which are achieved with different implementations. Change and change with different developers. Moreover, it should be understood that such development work is complex and time consuming, but nevertheless, the technical work performed by one of ordinary skill in the art in light of the present disclosure is conventional.
根据这里描述的主题,能够利用各种类型的操作系统、计算平台、计算机程序、和/或通用机器来制造、操作和/或执行各种部件、系统、装置、处理步骤和/或数据结构。此外,本领域的普通技术人员将会明白,也可以利用不太通用的装置,而不脱离这里公开的发明构思的范围和精神实质。其中,所包含的方法由计算机、装置或机器执行,并且该方法可以被存储为机器可读的指令,它们可以存储在确定的介质上,例如计算机存储装置,包括但不限于ROM(只读存贮器、FLASH存储器、转移装置等)、磁存储介质(例如,磁带、磁盘驱动器等)、光学存储介质(例如,CD-ROM、DVD-ROM、纸卡、纸带等)以及其他熟知类型的程序存储器。此外,应当认识到,该方法可以利用软件工具的选择由人类操作者执行,而不需要人或创造性的判断。Various components, systems, apparatuses, processing steps and/or data structures can be manufactured, manipulated, and/or executed in various types of operating systems, computing platforms, computer programs, and/or general purpose machines in accordance with the subject matter described herein. In addition, it will be apparent to those skilled in the art that <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; Wherein, the methods included are performed by a computer, device or machine, and the method can be stored as machine readable instructions, which can be stored on a defined medium, such as a computer storage device, including but not limited to ROM (read only memory) Storage, FLASH memory, transfer device, etc.), magnetic storage media (eg, magnetic tape, disk drive, etc.), optical storage media (eg, CD-ROM, DVD-ROM, paper cards, paper tape, etc.) and other well-known types Program memory. Moreover, it should be appreciated that the method can be performed by a human operator using the choice of software tools without the need for human or creative judgment.
图6是根据本发明优选实施例的场景示意图,如图6所示,该图中示意了各装置及其相互关系。Figure 6 is a schematic illustration of a scene in accordance with a preferred embodiment of the present invention, as shown in Figure 6, which illustrates the various devices and their interrelationships.
在图6中,以有2个设备为例进行说明,分别是1个手势与设备识别装置和一个电视机TV。手势与设备识别装置实现了计算机视觉与图像处理技术,在这一实施例中,手势与设备识别装配有摄像头,能够识别手势、识别和发现设备;电视机TV支持手势控制,但没有摄像头设置为识别手势,这是仅为说明上的方便,事实上与电视TV相似地,可以布置多个被识别设备如DVD播放机和家庭存储服务器等,由手势与设备识别装置控制(通讯)。In FIG. 6, two devices are taken as an example, which are one gesture and device identification device and one television TV. The gesture and device recognition device implements computer vision and image processing technology. In this embodiment, the gesture and device identification is equipped with a camera capable of recognizing gestures, recognition and discovery devices; the TV TV supports gesture control, but no camera is set to Recognizing the gesture, which is merely for convenience of description, in fact, similarly to the TV TV, a plurality of recognized devices such as a DVD player, a home storage server, and the like can be arranged, controlled (communicated) by the gesture and the device identification device.
2个设备上都有网络接口,例如支持IEEE 802.11b/g/n,或者支持IEEE 802.3,从而可以连接到IP网络。各个设备内包含有一控制模块,能控制与其它设备发送、接收消息,以及处理操控指令、或转交操控指令。There are network interfaces on both devices, such as IEEE 802.11b/g/n or IEEE 802.3, so that you can connect to an IP network. Each device contains a control module that can control sending and receiving messages with other devices, as well as processing control commands or handing over control commands.
这种设备在网络上的互相发现、连接、发送与接收消息能力,可以使用现有的通用即插即用(UPnP)技术实现,也可以使用多播域名系统(mDNS)和基于域名系统的服务发现(DNS-SD)技术实现,这一类技术用在IP网络中,以单播、多播查询方式,按照预先定义的报文格式响应查询、提供功能调用。例如,UPnP技术规定了媒体显示设备(如TV)、服务器(如DVD播放器、家庭存储服务器)如何响应查询、提供哪些调用功能。The ability of such devices to discover, connect, send, and receive messages on the network can be achieved using existing Universal Plug and Play (UPnP) technology, or by using Multicast Domain Name System (mDNS) and Domain Name System-based services. Discovery (DNS-SD) technology implementation. This type of technology is used in IP networks to respond to queries and provide function calls in a unicast and multicast query manner in accordance with a predefined message format. For example, UPnP technology specifies how media display devices (such as TV), servers (such as DVD players, home storage servers) respond to queries, and which calling functions are provided.
手势识别控制装置包含有一个具有图像、视频采集能力的摄像头,以及红外测距模块。该装置内部包括图像识别单元、数据存储单元、控制单元、网络服务单元。 The gesture recognition control device includes a camera with image and video capture capabilities, and an infrared ranging module. The device internally includes an image recognition unit, a data storage unit, a control unit, and a network service unit.
在本优选实施例中,所有手势识别控制装置可以识别其视觉范围内的设备,实现方法是摄像头、测距模块在其三维空间内旋转采集图像,在采集的图像中分析查找预定义的标签图形并进行分析,这里,预定义的标签可以预先存储在视觉识别与发现控制装置中的图像、图形,也可以是接收到的来自被发现、被识别设备发送的图像、图形。手势识别控制装置的图像识别单元对图像进行分析后,识别出图像中有若干标识,对标识分别进行识别并存储识别出的信息,然后对标签所在的设备进行距离测量,和标识信息一起存储。In the preferred embodiment, all gesture recognition control devices can identify devices within their visual range by implementing a camera and a ranging module to rotate and capture images in their three-dimensional space, and analyzing and searching for predefined label graphics in the captured images. And analyzing, where the predefined tags may be pre-stored in the image and graphics in the visual recognition and discovery control device, or may be received images and graphics sent from the discovered, identified device. After analyzing the image, the image recognition unit of the gesture recognition control device recognizes that there are several identifiers in the image, separately identifies the identifiers and stores the identified information, and then performs distance measurement on the device where the label is located, and stores the identifier information together.
另一实施例是,视觉识别与发现控制装置接收到来自电视机TV、DVD播放机和家庭存储服务器等设备发来的特征图像如各角度的设备照片数据等,然后把设备照片数据从捕获的全景图像中检索出来,测量、记录设备的位置。这一实施例可以使用成熟的计算机视觉技术中的特征检测与匹配等技术。In another embodiment, the visual recognition and discovery control device receives feature images from devices such as a TV TV, a DVD player, and a home storage server, such as device photo data of various angles, and then takes device photo data from the captured device. The panoramic image is retrieved, and the position of the device is measured and recorded. This embodiment can use techniques such as feature detection and matching in sophisticated computer vision techniques.
在这一实施例中,电视机TV开机时,以多播方式发送报文,报文中可以包括:In this embodiment, when the TV is turned on, the message is sent in a multicast manner, and the message may include:
本装置网络地址、惟一标识;The network address and unique identifier of the device;
订阅的手势识别信息,这是一个清单,可以使用XML等类似技术进行描述。例如订阅请求:Subscribed gesture recognition information, which is a list that can be described using similar techniques such as XML. For example, a subscription request:
<?xml version="1.0"encoding="UTF-8"?><? Xml version="1.0"encoding="UTF-8"? >
<GestureListDescriptionSub<GestureListDescriptionSub
xmlns="…"Xmlns="..."
xmlns:xsd="…">Xmlns:xsd="...">
 <BackgroupSize Required/><BackgroupSize Required/>
<GestureType“hand”“Arm”/><GestureType "hand" "Arm"/>
<GestureShape“five fingers open”“no finger open”/><GestureShape "five fingers open" "no finger open"/>
<GestureDuration Min=1/><GestureDuration Min=1/>
<GestureDirection Required/><GestureDirection Requirements/>
<ArmDirection Required/><ArmDirection Requirements/>
</GestureListDescriptionSub></GestureListDescriptionSub>
订阅结果的例子:Examples of subscription results:
<?xml version="1.0"encoding="UTF-8"?><? Xml version="1.0"encoding="UTF-8"? >
<GestureListDescription<GestureListDescription
xmlns="…"Xmlns="..."
xmlns:xsd="…">Xmlns:xsd="...">
 <BackgroupSize x=1024 y=768/> <BackgroupSize x=1024 y=768/>
<CoodinationOriginPoint x=0y=0/><CoodinationOriginPoint x=0y=0/>
<GesturePosition><GesturePosition>
  <DescriptionDiscipline“2points”/><DescriptionDiscipline"2points"/>
  <Points“10,10,10”“10,100,500”/><Points"10,10,10""10,100,500"/>
<GestureType“hand”/><GestureType "hand"/>
<GestureShape“five fingers open”/><GestureShape“five fingers open”/>
<GestureDuration 3/><GestureDuration 3/>
<GestureDirection<GestureDirection
  <Point“10,10,10”“10,100,500”/><Point"10,10,10""10,100,500"/>
GestureDirection/>GestureDirection/>
<GestureMoved 150/><GestureMoved 150/>
<ArmDirection 30/><ArmDirection 30/>
<PrevGesture 90/><PrevGesture 90/>
<GestureSeq 91/><GestureSeq 91/>
</GestureListDescription></GestureListDescription>
图7是根据本发明优选实施例的手势描述关键数据数据清单,如图7所示,这一实施例中本优选实施例的手势描述关键数据数据清单中的数据可以用XML来表示。这个清单的用途可以是为向一个或多个带摄像头的手势识别设备、可穿戴的手势识别设备订阅、交换手势数据。7 is a list of gesture description key data data in accordance with a preferred embodiment of the present invention. As shown in FIG. 7, the data in the gesture description key data data list of the preferred embodiment of this embodiment may be represented by XML. The purpose of this list may be to subscribe to and exchange gesture data to one or more gesture recognition devices with cameras, wearable gesture recognition devices.
这些数据及含义说明如下:These data and meanings are as follows:
坐标系(原点):这是交换手势信息的必选内容之一,交换双方依赖这一坐标系进行手势目标、意图的判断。表示坐标系需要给出坐标系类型名称(如笛卡尔坐标、球坐标等等)、坐标原点位置在图像中的位置等。Coordinate system (origin): This is one of the mandatory contents for exchanging gesture information. The exchange parties rely on this coordinate system to judge the gesture target and intention. Indicates that the coordinate system needs to give the coordinate system type name (such as Cartesian coordinates, spherical coordinates, etc.), the position of the coordinate origin position in the image, and so on.
手势坐标:给出坐标点来描述手势,可用一组坐标点来描述出手势的轮廓,或给出手的中心坐标点,等等。Gesture coordinates: Give coordinate points to describe gestures, use a set of coordinate points to describe the outline of the gesture, or give the center coordinate point of the hand, and so on.
手势类别:给出这一描述是对哪个位置动作的,例如手、臂、身体等。Gesture Category: Gives the description of which position to act on, such as the hand, arm, body, etc.
手势形状:给出手势开关的描述,例如:伸出几根手指、伸出哪个手指、手势弯曲等等。Gesture shape: Gives a description of the gesture switch, such as: a few fingers, a finger, a gesture, and so on.
手势持续时间:指出手势动作持续时间,可设置为表示动作的快慢等;可以以秒为时间单位。 Gesture duration: Indicates the duration of the gesture action, which can be set to indicate the speed of the action, etc.; can be in seconds.
手势移动方向:例如上、下、左、右、前、后以及用坐标点表示起点、终点等。Gesture movement direction: for example, up, down, left, right, front, back, and coordinate points indicate start point, end point, and so on.
手势移动距离:表示手势移动距离;可以以厘米为单位。Gesture movement distance: indicates the movement distance of the gesture; it can be in centimeters.
手势方向(手臂方向):主要表示手臂方向,可以以角度、弧度为单位。Gesture direction (arm direction): mainly indicates the arm direction, which can be in angle and radians.
前一个手势编号:识别设备所识别出的上一个手势信息的编号,可能这一编号对应的手势信息未被设备订阅。The previous gesture number: identifies the number of the last gesture information recognized by the device, and the gesture information corresponding to the number may not be subscribed by the device.
顺序编号:当前描述的手势信息在识别设备中的编号,设置为检索等功能。Sequence number: The number of the currently described gesture information in the identification device is set to search and other functions.
由于采用了XML等方式描述手势信息,本发明中的方法易于扩展,容易添加新的描述信息。Since the gesture information is described by means of XML or the like, the method in the present invention is easy to expand, and it is easy to add new description information.
图8是根据本发明优选实施例的方法流程图,如图8所示,这一实施例所描述方法,使用了2个设备来描述:手势识别设备1,手势受控设备2。手势受控设备2可以没有识别部件。该方法包括如下步骤:8 is a flow chart of a method in accordance with a preferred embodiment of the present invention. As shown in FIG. 8, the method described in this embodiment uses two devices to describe: gesture recognition device 1, gesture controlled device 2. The gesture controlled device 2 may have no identifying component. The method comprises the following steps:
步骤S802,手势受控设备2向手势识别设备1订阅手势信息。In step S802, the gesture controlled device 2 subscribes to the gesture recognition device 1 for the gesture information.
设备2可以提供一个或多个清单列表。Device 2 can provide one or more manifest lists.
步骤S804,手势识别设备1采集捕获、识别出了手势信息,发送手势信息给手势受控设备2。In step S804, the gesture recognition device 1 collects and recognizes the gesture information, and sends the gesture information to the gesture controlled device 2.
设备1发送了一个清单列表。 Device 1 sent a list of manifests.
步骤S806,如果手势识别设备1继续采集捕获、识别出了手势信息,则继续发送手势信息给手势受控设备2。Step S806, if the gesture recognition device 1 continues to collect and recognize the gesture information, the gesture information is continuously sent to the gesture controlled device 2.
设备1发送了一个清单列表。 Device 1 sent a list of manifests.
步骤S808,手势受控设备2可以向手势识别设备发送取消订阅手势信息请求。In step S808, the gesture controlled device 2 can send a request for canceling the subscription gesture information to the gesture recognition device.
设备1收到这样的请求后,就不再为设备2识别手势,当然也不发送手势信息。After receiving such a request, the device 1 no longer recognizes the gesture for the device 2, and of course does not send the gesture information.
上述实施例1中,电视机、播放机、存储服务器被作为被操控设备,而本优选实施例并不限定于被操控设备是像实施例中提到的这样设备,电脑、音响、音箱、投影仪、机顶盒等等都可以作为被操控设备,甚至工业上其它设备如汽车、机床、轮船等等都可以由视觉识别与发现控制装置来操控。In the above Embodiment 1, the television, the player, and the storage server are used as the controlled device, and the preferred embodiment is not limited to the device being controlled as the device mentioned in the embodiment, the computer, the sound, the speaker, and the projection. Instruments, set-top boxes, and the like can all be used as controlled devices, and even other industrial devices such as automobiles, machine tools, ships, and the like can be manipulated by visual recognition and discovery control devices.
上述实施例中,视觉识别与发现控制装置的摄像头可以是各种规格,例如可以是固定焦距或变焦距的,旋转空间可以是上下左右各个角度的,或只支持左右角度,只需要配置的一摄像头,具有实施例中描述的各种能力。测距单元可以使用激光红外线测距,也可以用其它波段的光测量,可以使用3摄像头计算测距,也可以使用更多摄像头用加权调整等方法计算测距。 In the above embodiment, the camera of the visual recognition and discovery control device may be of various specifications, for example, may be a fixed focal length or a zoom distance, and the rotating space may be up, down, left, and right, or only support the left and right angles, and only one of the configurations is required. The camera has the various capabilities described in the embodiments. The ranging unit can use laser infrared ranging, or other wavelengths of light measurement, can use 3 cameras to calculate ranging, or use more cameras to calculate distance using weight adjustment.
上述流程,是实现本发明的实施例,并不是限定只能用实施例来实现,也不是用来限定具体流程执行的方法,本发明还可以用类似的方式实现,比如表示单元的名字、各种消息的类型等,那不过是命名形式、具体的报文内容等有所不同。The above process is an embodiment of the present invention, and is not limited to the embodiment, and is not intended to limit the execution of a specific process. The present invention may also be implemented in a similar manner, such as indicating the name of the unit, each The type of message, etc., is nothing more than a naming form, a specific message content, and the like.
上述实施例,网络相关的,可适用于基于IEEE 802.3、IEEE 802.11b/g/n、POWELINE、CABLE、PSTN、3GPP(3rd Generation Partnership Project,第三代合作伙伴计划)网络、3GPP2网络等通讯网络所支持的IP网络,各装置的操作系统可适用于UNIX类操作系统、WINDOWS类操作系统、ANDROID类操作系统、IOS操作系统,对消费者接口可适用于JAVA语言接口等。The above embodiments are network-related and can be applied to communication networks based on IEEE 802.3, IEEE 802.11b/g/n, POWELINE, CABLE, PSTN, 3GPP (3rd Generation Partnership Project), 3GPP2 networks, and the like. The supported IP network, the operating system of each device can be applied to UNIX-like operating systems, WINDOWS-like operating systems, ANDROID-type operating systems, IOS operating systems, and consumer interfaces can be applied to JAVA language interfaces.
在另外一个实施例中,还提供了一种软件,该软件设置为执行上述实施例及优选实施例中描述的技术方案。In another embodiment, a software is provided that is configured to perform the technical solutions described in the above embodiments and preferred embodiments.
在另外一个实施例中,还提供了一种存储介质,该存储介质中存储有上述软件,该存储介质包括但不限于光盘、软盘、硬盘、可擦写存储器等。In another embodiment, a storage medium is also provided, in which the above software is stored, including but not limited to an optical disk, a floppy disk, a hard disk, an erasable memory, and the like.
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.
工业实用性Industrial applicability
如上所述,本发明实施例提供的一种信息发布方法、信息接收方法、装置及信息共享系统,具有以下有益效果:解决了相关技术中不同设备对于手势识别信息容易产生混淆的问题,提升了用户体验,节省了资源,此外由于发布的是手势和/或姿势本身的描述参数,还能够提升手势和/或姿势识别方案的灵活性。 As described above, the information distribution method, the information receiving method, the device, and the information sharing system provided by the embodiments of the present invention have the following beneficial effects: the problem that the different devices in the related art are easily confused with the gesture recognition information is solved, and the problem is improved. The user experience saves resources and, in addition, the flexibility of gesture and/or gesture recognition schemes can be enhanced by the release of description parameters for gestures and/or gestures themselves.

Claims (30)

  1. 一种信息发布方法,包括:A method for publishing information, including:
    第一设备识别手势和/或姿势信息;The first device identifies gestures and/or gesture information;
    所述第一设备发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。The first device issues the gesture and/or gesture information, wherein the gesture and/or gesture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
  2. 根据权利要求1所述的方法,其中,第一设备识别手势和/或姿势信息包括:The method of claim 1, wherein the identifying, by the first device, the gesture and/or gesture information comprises:
    所述第一设备捕获图像;The first device captures an image;
    所述第一设备根据所述图像识别所述手势和/或姿势,并且确定所述坐标系,其中所述坐标系的原点是所述图像中的一个点。The first device identifies the gesture and/or gesture based on the image and determines the coordinate system, wherein an origin of the coordinate system is a point in the image.
  3. 根据权利要求1所述的方法,其中,所述手势和/或姿势的描述参数至少包括以下之一:The method of claim 1 wherein the description parameter of the gesture and/or gesture comprises at least one of the following:
    手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。Gesture and/or posture coordinates, gesture and/or gesture categories, gesture and/or gesture shapes, gesture and/or gesture duration, gesture and/or gesture movement directions, gesture and/or gesture movement distance, gestures and/or gestures Direction, the last gesture and/or pose category, sequential numbering.
  4. 根据权利要求3所述的方法,其中,所述手势和/或姿势类别至少包括以下之一:The method of claim 3 wherein said gesture and/or gesture category comprises at least one of:
    手、臂、身体。Hands, arms, body.
  5. 根据权利要求1所述的方法,其中,The method of claim 1 wherein
    所述坐标系参照所述第一设备的位置设立,或者,所述坐标系参照不同于所述第一设备的第二设备的位置设立。The coordinate system is established with reference to the location of the first device, or the coordinate system is established with reference to a location of the second device different from the first device.
  6. 根据权利要求1所述的方法,其中,所述第一设备通过以下方式至少之一发布所述手势和/或姿势信息:The method of claim 1, wherein the first device issues the gesture and/or gesture information in at least one of:
    广播方式、多播方式、单播方式、查询及响应的方式。Broadcast mode, multicast mode, unicast mode, query and response mode.
  7. 一种信息接收方法,包括:A method for receiving information includes:
    第二设备接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。The second device receives gesture and/or gesture information, wherein the gesture and/or gesture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
  8. 根据权利要求7所述的方法,其中,在第二设备接收手势和/或姿势信息之后,还包括:The method of claim 7, wherein after the second device receives the gesture and/or gesture information, the method further comprises:
    所述第二设备根据所述坐标系和识别的手势和/或姿势的描述参数识别相应的含义。The second device identifies a corresponding meaning based on the coordinate system and the described parameters of the recognized gesture and/or gesture.
  9. 根据权利要求7所述的方法,其中,所述手势和/或姿势的描述参数至少包括以下之一:The method of claim 7, wherein the description parameter of the gesture and/or gesture comprises at least one of the following:
    手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。 Gesture and/or posture coordinates, gesture and/or gesture categories, gesture and/or gesture shapes, gesture and/or gesture duration, gesture and/or gesture movement directions, gesture and/or gesture movement distance, gestures and/or gestures Direction, the last gesture and/or pose category, sequential numbering.
  10. 根据权利要求9所述的方法,其中,所述手势和/或姿势类别至少包括以下之一:The method of claim 9 wherein said gesture and/or gesture category comprises at least one of:
    手、臂、身体。Hands, arms, body.
  11. 根据权利要求7所述的方法,其中,所述第二设备通过以下方式至少之一接收所述手势和/或姿势信息:The method of claim 7, wherein the second device receives the gesture and/or gesture information by at least one of:
    广播方式、多播方式、单播方式、查询及响应的方式。Broadcast mode, multicast mode, unicast mode, query and response mode.
  12. 一种信息发布装置,位于第一设备中,包括:An information distribution device is located in the first device, and includes:
    第一识别模块,设置为识别手势和/或姿势信息;a first identification module configured to recognize gestures and/or gesture information;
    发布模块,设置为发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。A publishing module is configured to publish the gesture and/or gesture information, wherein the gesture and/or gesture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
  13. 一种信息接收装置,位于第二设备中,包括:An information receiving device is located in the second device, and includes:
    接收模块,设置为接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括坐标系和识别的手势和/或姿势的描述参数。The receiving module is configured to receive gestures and/or gesture information, wherein the gesture and/or gesture information includes at least a coordinate system and a description parameter of the recognized gesture and/or gesture.
  14. 根据权利要求13所述的装置,其中,所述装置还包括:The device of claim 13 wherein said device further comprises:
    第二识别模块,设置为根据所述坐标系和识别的手势和/或姿势的描述参数识别相应的含义。The second identification module is configured to identify a corresponding meaning according to the coordinate system and the description parameters of the recognized gesture and/or gesture.
  15. 一种信息共享系统,包括如权利要求12所述的信息发布装置,以及如权利要求13或14所述的信息接收装置。An information sharing system comprising the information distribution apparatus according to claim 12, and the information receiving apparatus according to claim 13 or 14.
  16. 一种信息发布方法,包括:A method for publishing information, including:
    第一设备识别手势和/或姿势信息;The first device identifies gestures and/or gesture information;
    所述第一设备发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。The first device issues the gesture and/or gesture information, wherein the gesture and/or gesture information includes at least a position parameter and a description parameter of the recognized gesture and/or gesture.
  17. 根据权利要求16所述的方法,其中,第一设备识别手势和/或姿势信息包括:The method of claim 16 wherein the identifying, by the first device, the gesture and/or gesture information comprises:
    所述第一设备捕获图像;The first device captures an image;
    所述第一设备根据所述图像识别所述手势和/或姿势,并且确定所述位置参数。The first device identifies the gesture and/or gesture based on the image and determines the location parameter.
  18. 根据权利要求16所述的方法,其中,所述手势和/或姿势的描述参数至少包括以下之一:The method of claim 16 wherein the description parameters of the gesture and/or gesture comprise at least one of the following:
    手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。Gesture and/or posture coordinates, gesture and/or gesture categories, gesture and/or gesture shapes, gesture and/or gesture duration, gesture and/or gesture movement directions, gesture and/or gesture movement distance, gestures and/or gestures Direction, the last gesture and/or pose category, sequential numbering.
  19. 根据权利要求18所述的方法,其中,所述手势和/或姿势类别至少包括以下之一:The method of claim 18, wherein the gesture and/or gesture category comprises at least one of the following:
    手、臂、身体。 Hands, arms, body.
  20. 根据权利要求16所述的方法,其中,The method of claim 16 wherein
    所述位置参数参照所述第一设备的位置设置,或者,所述位置参数参照不同于所述第一设备的第二设备的位置设置。The location parameter refers to a location setting of the first device, or the location parameter refers to a location setting different from a second device of the first device.
  21. 根据权利要求16所述的方法,其中,所述第一设备通过以下方式至少之一发布所述手势和/或姿势信息:The method of claim 16, wherein the first device issues the gesture and/or gesture information in at least one of:
    广播方式、多播方式、单播方式、查询及响应的方式。Broadcast mode, multicast mode, unicast mode, query and response mode.
  22. 一种信息接收方法,包括:A method for receiving information includes:
    第二设备接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。The second device receives gesture and/or gesture information, wherein the gesture and/or gesture information includes at least a positional parameter and a description parameter of the identified gesture and/or gesture.
  23. 根据权利要求22所述的方法,其中,在第二设备接收手势和/或姿势信息之后,还包括:The method of claim 22, wherein after the second device receives the gesture and/or gesture information, the method further comprises:
    所述第二设备根据所述位置参数和识别的手势和/或姿势的描述参数识别相应的含义。The second device identifies a corresponding meaning based on the positional parameter and the described parameter of the recognized gesture and/or gesture.
  24. 根据权利要求22所述的方法,其中,所述手势和/或姿势的描述参数至少包括以下之一:The method of claim 22, wherein the description parameter of the gesture and/or gesture comprises at least one of the following:
    手势和/或姿势坐标,手势和/或姿势类别,手势和/或姿势形状,手势和/或姿势持续时间,手势和/或姿势移动方向,手势和/或姿势移动距离,手势和/或姿势方向,后一个手势和/或姿势类别,顺序编号。Gesture and/or posture coordinates, gesture and/or gesture categories, gesture and/or gesture shapes, gesture and/or gesture duration, gesture and/or gesture movement directions, gesture and/or gesture movement distance, gestures and/or gestures Direction, the last gesture and/or pose category, sequential numbering.
  25. 根据权利要求24所述的方法,其中,所述手势和/或姿势类别至少包括以下之一:The method of claim 24 wherein said gesture and/or gesture category comprises at least one of:
    手、臂、身体。Hands, arms, body.
  26. 根据权利要求22所述的方法,其中,所述第二设备通过以下方式至少之一接收所述手势和/或姿势信息:The method of claim 22, wherein the second device receives the gesture and/or gesture information by at least one of:
    广播方式、多播方式、单播方式、查询及响应的方式。Broadcast mode, multicast mode, unicast mode, query and response mode.
  27. 一种信息发布装置,位于第一设备中,包括:An information distribution device is located in the first device, and includes:
    第一识别模块,设置为识别手势和/或姿势信息;a first identification module configured to recognize gestures and/or gesture information;
    发布模块,设置为发布所述手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。A publishing module is configured to publish the gesture and/or gesture information, wherein the gesture and/or gesture information includes at least a position parameter and a description parameter of the recognized gesture and/or gesture.
  28. 一种信息接收装置,位于第二设备中,包括:An information receiving device is located in the second device, and includes:
    接收模块,设置为接收手势和/或姿势信息,其中,所述手势和/或姿势信息至少包括位置参数和识别的手势和/或姿势的描述参数。The receiving module is configured to receive gestures and/or gesture information, wherein the gesture and/or gesture information includes at least a position parameter and a description parameter of the recognized gesture and/or gesture.
  29. 根据权利要求28所述的装置,其中,所述装置还包括:The device of claim 28, wherein the device further comprises:
    第二识别模块,设置为根据所述位置参数和识别的手势和/或姿势的描述参数识别相应的含义。 The second identification module is configured to identify a corresponding meaning according to the position parameter and the description parameter of the recognized gesture and/or posture.
  30. 一种信息共享系统,包括如权利要求27所述的信息发布装置,以及如权利要求28或29所述的信息接收装置。 An information sharing system comprising the information distribution apparatus according to claim 27, and the information receiving apparatus according to claim 28 or 29.
PCT/CN2015/091297 2014-10-21 2015-09-30 Information publication method, information receiving method and apparatus, and information sharing system WO2016062191A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410564057.4 2014-10-21
CN201410564057.4A CN105589550A (en) 2014-10-21 2014-10-21 Information publishing method, information receiving method, information publishing device, information receiving device and information sharing system

Publications (1)

Publication Number Publication Date
WO2016062191A1 true WO2016062191A1 (en) 2016-04-28

Family

ID=55760275

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/091297 WO2016062191A1 (en) 2014-10-21 2015-09-30 Information publication method, information receiving method and apparatus, and information sharing system

Country Status (2)

Country Link
CN (1) CN105589550A (en)
WO (1) WO2016062191A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105630142A (en) * 2014-11-07 2016-06-01 中兴通讯股份有限公司 Method and device for publishing and transferring identification information, and information identification system
CN108920076B (en) * 2018-06-27 2021-03-02 清远墨墨教育科技有限公司 User gesture operation recognition method and recognition system
CN109445568A (en) * 2018-08-30 2019-03-08 丝路视觉科技股份有限公司 Projection objects control method, device and host
CN113918010A (en) * 2021-09-13 2022-01-11 海信视像科技股份有限公司 Display apparatus and control method of display apparatus

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102177513A (en) * 2008-09-03 2011-09-07 奥布隆工业有限公司 Control system for navigating a principal dimension of a data space
CN103246345A (en) * 2012-02-01 2013-08-14 扬州永利宁科技有限公司 Touch free control of electronic systems and associated methods
CN103959287A (en) * 2011-10-25 2014-07-30 谷歌公司 Gesture-based search
CN104102335A (en) * 2013-04-15 2014-10-15 中兴通讯股份有限公司 Gesture control method, device and system
CN104866084A (en) * 2014-02-25 2015-08-26 中兴通讯股份有限公司 Methods, device and system for gesture recognition
CN104866083A (en) * 2014-02-25 2015-08-26 中兴通讯股份有限公司 Methods, devices and system for gesture recognition

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100169842A1 (en) * 2008-12-31 2010-07-01 Microsoft Corporation Control Function Gestures
EP2666070A4 (en) * 2011-01-19 2016-10-12 Hewlett Packard Development Co Method and system for multimodal and gestural control
CN102984592B (en) * 2012-12-05 2018-10-19 中兴通讯股份有限公司 A kind of digital media content plays the methods, devices and systems of transfer
US9210376B2 (en) * 2013-03-15 2015-12-08 Infocus Corporation Multimedia output and display device selection

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102177513A (en) * 2008-09-03 2011-09-07 奥布隆工业有限公司 Control system for navigating a principal dimension of a data space
CN103959287A (en) * 2011-10-25 2014-07-30 谷歌公司 Gesture-based search
CN103246345A (en) * 2012-02-01 2013-08-14 扬州永利宁科技有限公司 Touch free control of electronic systems and associated methods
CN104102335A (en) * 2013-04-15 2014-10-15 中兴通讯股份有限公司 Gesture control method, device and system
CN104866084A (en) * 2014-02-25 2015-08-26 中兴通讯股份有限公司 Methods, device and system for gesture recognition
CN104866083A (en) * 2014-02-25 2015-08-26 中兴通讯股份有限公司 Methods, devices and system for gesture recognition

Also Published As

Publication number Publication date
CN105589550A (en) 2016-05-18

Similar Documents

Publication Publication Date Title
JP6374052B2 (en) Method, apparatus and system for transferring digital media content playback
WO2015127786A1 (en) Hand gesture recognition method, device, system, and computer storage medium
US10013067B2 (en) Gesture control method, apparatus and system
CN104866084B (en) Gesture recognition method, device and system
EP2833242A1 (en) Method for transferring playing of digital media contents and playing device and system
WO2016062191A1 (en) Information publication method, information receiving method and apparatus, and information sharing system
CN105023575B (en) Audio recognition method, device and system
US9733888B2 (en) Method for rendering data in a network and associated mobile device
CN114125482A (en) Live broadcast and microphone connection processing method, electronic equipment and storage medium
US20150334456A1 (en) Method, device and System for Switching Back Transferred-For-Play Digital Media Content
US20160117553A1 (en) Method, device and system for realizing visual identification
CN106358064A (en) Method and equipment for controlling television
CN115243085A (en) Display device and device interconnection method
WO2016070827A1 (en) Method and apparatus for issuing and transmitting recognition information, and information recognition system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15852468

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15852468

Country of ref document: EP

Kind code of ref document: A1