CN106817611B - Screen positioning method and device - Google Patents
Screen positioning method and device Download PDFInfo
- Publication number
- CN106817611B CN106817611B CN201611093477.4A CN201611093477A CN106817611B CN 106817611 B CN106817611 B CN 106817611B CN 201611093477 A CN201611093477 A CN 201611093477A CN 106817611 B CN106817611 B CN 106817611B
- Authority
- CN
- China
- Prior art keywords
- equipment
- value
- background image
- screen
- rgb value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 239000000284 extract Substances 0.000 claims description 8
- 238000010586 diagram Methods 0.000 description 14
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000003993 interaction Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4781—Games
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Controls And Circuits For Display Device (AREA)
- Projection Apparatus (AREA)
Abstract
The invention discloses a screen positioning method and equipment, and aims to solve the problem that when the distance between two pieces of equipment is very short, the equipment with a smaller screen size cannot obtain a clear image of the equipment with a larger screen size through a camera, so that the corresponding position of the equipment with a smaller screen size in the screen of the equipment with a larger screen size cannot be determined. The method comprises the following steps: the method comprises the steps that a first device receives a target RGB value sent by a second device, wherein the target RGB value is the RGB value of the center point of a preview image of a background image displayed by the first device and acquired by the second device through a camera, the background image is divided into a plurality of regions, the number of pixel points contained in each region is not more than a preset value, the RGB values of the pixel points in the same region are the same, and the RGB values of the pixel points in different regions are different; and the first equipment determines the projection position of the second equipment in the screen of the first equipment according to the position of the set pixel point in the area corresponding to the target RGB value in the background image.
Description
Technical Field
The invention relates to the field of man-machine interaction, in particular to a screen positioning method and screen positioning equipment.
Background
With the popularity and popularity of modern intelligent electronic devices, interactions between devices are becoming more and more prevalent in the home or small area setting. The screen interaction is the most intuitive and simple interaction mode among devices, and in many application scenarios, for example, a user performs corresponding operations on a game in a television through operations on a picture of the game displayed in a television screen acquired by a mobile phone. After the television determines to obtain the relative position of the mobile phone in the television screen, corresponding operation can be performed according to the operation of the user on the content displayed in the television screen obtained by the mobile phone.
In the prior art, a screen positioning method based on image recognition is generally adopted, and the basic principle of the method is that a camera of a mobile phone acquires a real-time picture of a television screen, and the corresponding position of the mobile phone in the television screen is determined by utilizing an image recognition and matching algorithm.
However, the above method needs to obtain clear image information to realize the recognition and matching of the image, and further determine the corresponding position of the mobile phone in the television screen. When the distance between the mobile phone and the television is very short (less than 10cm), the camera of the mobile phone cannot focus due to the physical and optical characteristics of the camera, so that a clear image of the television screen cannot be obtained.
Disclosure of Invention
The embodiment of the invention provides a screen positioning method and equipment, and solves the problem that when the distance between two pieces of equipment is very short (less than 10cm), the equipment with a smaller screen size cannot obtain a clear image of the equipment with the larger screen size through a camera, so that the corresponding position of the equipment with the smaller screen size in the equipment screen with the larger screen size cannot be determined.
The embodiment of the invention provides the following specific technical scheme:
in a first aspect, an embodiment of the present invention provides a screen positioning method, including:
the method comprises the steps that a first device receives a target RGB value sent by a second device, wherein the target RGB value is the RGB value of a central point of a preview image of a background image displayed by the first device and acquired by the second device through a camera, the background image is divided into a plurality of regions, the number of pixel points contained in each region is not more than a preset value, the RGB values of the pixel points in the same region are the same, and the RGB values of the pixel points in different regions are different;
and the first equipment determines a region corresponding to the target RGB value in the background image according to the target RGB value, and determines the projection position of the second equipment in the screen of the first equipment according to the position of a set pixel point in the determined region.
In a second aspect, an embodiment of the present invention provides a screen positioning method, including:
the second equipment acquires a preview image of a background image displayed by the first equipment through the camera, wherein the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, and the RGB values of the pixel points in different areas are different;
the second equipment extracts the RGB value of the center point of the preview image as a target RGB value;
and the second device sends the target RGB value to the first device, so that the first device determines the projection position of the second device in the screen of the first device according to the target RGB value.
In a third aspect, an embodiment of the present invention provides an apparatus, including:
the receiving module is used for receiving a target RGB value sent by second equipment, wherein the target RGB value is the RGB value of a central point of a preview image of a background image displayed by the second equipment through a camera, the background image is divided into a plurality of regions, the number of pixel points contained in each region is not more than a preset value, the RGB values of the pixel points in the same region are the same, and the RGB values of the pixel points in different regions are different;
and the processing module is used for determining a region corresponding to the target RGB value in the background image according to the target RGB value, and determining the projection position of the second equipment in the screen of the equipment according to the position of a set pixel point in the determined region.
In a fourth aspect, an embodiment of the present invention provides an apparatus, including:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a preview image of a background image displayed by first equipment through a camera, the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, and the RGB values of the pixel points in different areas are different;
the processing module is used for extracting the RGB value of the center point of the preview image as a target RGB value;
and the sending module is used for sending the target RGB value to the first equipment so that the first equipment determines the projection position of the equipment in the screen of the first equipment according to the target RGB value.
Based on the above technical solution, in the embodiment of the present invention, a first device determines, according to a target RGB value sent by a second device, a region corresponding to the RGB value in a background image displayed by the first device, and determines, according to a position of a set pixel point in the determined region, a projection position of the second device in a screen of the first device, where the target RGB value is an RGB value of a center point of a preview image of the background image displayed by the first device, the background image is divided into a plurality of regions, a number of pixel points included in each region is not greater than a preset value, RGB values of pixel points in the same region are the same, RGB values of pixel points in different regions are different, so that a distance between the first device and the second device is very short (less than 10 centimeters), and when the second device cannot obtain a clear image of the screen of the first device through a camera, the first device can determine the projection position of the second device in the screen of the first device according to the target RGB value, and the first device and the second device do not need to add other hardware for acquiring the position information.
Drawings
Fig. 1 is a flowchart of a method for a first device to determine a projection position of a second device in a screen of the first device according to a first embodiment of the present invention;
FIG. 2 is a flowchart of a method for a first device to determine a projection position of a second device on a screen of the first device according to a second embodiment of the present invention;
fig. 3 is a flowchart of a method for determining a projection position of a smart phone in a smart tv screen by a smart tv according to a first embodiment of the present invention;
fig. 4 is a schematic diagram of a background image displayed by the smart tv according to the first embodiment of the present invention;
fig. 5 is a schematic diagram illustrating a positioning effect of a smart phone in a smart tv screen according to a first embodiment of the present invention;
FIG. 6 is a diagram illustrating a table tennis game based on a close-range multi-screen positioning method according to a second embodiment of the present invention;
FIG. 7 is a schematic structural diagram of an apparatus according to a third embodiment of the present invention;
FIG. 8 is a schematic structural diagram of an apparatus according to a fourth embodiment of the present invention;
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to solve the problem that when the distance between two devices is very short (less than 10cm), the device with the smaller screen size cannot obtain a clear image of the device with the larger screen size through a camera, so that the corresponding position of the device with the smaller screen size in the device screen with the larger screen size cannot be determined, the embodiment of the invention provides a screen positioning method and device.
In the embodiment of the present invention, under the condition that the distance between the first device and the second device satisfies that the second device can acquire the local image of the background image displayed by the first device through the camera of the second device, the first device can determine the projection position of the second device in the screen of the first device according to the screen positioning method provided by the embodiment of the present invention, wherein the method for the second device to acquire the local image of the background image displayed by the first device through the camera of the second device does not include the second device acquiring the local image of the background image displayed by the first device through a digital zoom mode. The closer the distance between the first device and the second device is, the higher the accuracy of the projection position of the second device in the screen of the first device determined by the screen positioning method provided by the embodiment of the invention is.
Preferably, under the condition that the distance between the first device and the second device is less than 10cm and the first device cannot acquire a clear image of the screen of the first device through the camera, the first device can determine the projection position of the second device in the screen of the first device according to the screen positioning method provided by the embodiment of the invention.
In the embodiment of the invention, the first device is a device with a larger screen size, such as an intelligent television, a personal computer and the like, and the second device is a mobile terminal with a smaller screen size, such as a mobile phone, a tablet computer and the like.
In a first embodiment, a flowchart of a method for a first device to determine a projection position of a second device in a screen of the first device is shown in fig. 1, and includes the following steps:
step 101: the method comprises the steps that first equipment receives a target RGB value sent by second equipment, wherein the target RGB value is the RGB value of the center point of a preview image of a background image displayed by the first equipment and acquired by the second equipment through a camera, the background image is divided into a plurality of regions, the number of pixel points contained in each region is not larger than a preset value, the RGB values of the pixel points in the same region are the same, and the RGB values of the pixel points in different regions are different.
Specifically, the preview image refers to an image captured by the second device through the camera on the background image displayed by the first device, and the preview image is displayed in the second device screen.
In implementation, the number of pixel points included in each region in a background image displayed by the first device is not greater than a preset value, so that an error of a projection position of the second device in a screen of the first device, which is determined by the first device based on the background image, meets a set positioning error, wherein the positioning error is determined according to an empirical value or a simulation result. In the embodiment of the present invention, the shape of each region in the background image displayed by the first device is not limited.
Specifically, the number of pixel points included in each region in the background image displayed by the first device may be determined according to a set positioning error. For example, if the size of the screen of the second device is a (the length of the diagonal line of the screen), and the set positioning error is E, the first device determines that the length of the diagonal line of each region in the background image is less than or equal to E, and determines the number of pixel points included in each region according to the length of the diagonal line of each region and the size of the pixel points in the background image, wherein the size of the pixel points in the background image is determined by the first device according to the size and resolution of the screen of the first device, and the size of the set error E is determined according to an empirical value or a simulation result, if E is a/5; for another example, if the length of the screen of the second device is L, the width is W, the set positioning error E1 in the horizontal direction is E1, and the set error in the vertical direction is E2, the first device determines that the size (length) of each region in the background image in the horizontal direction is less than or equal to E1, the size (width) of each region in the vertical direction is less than or equal to E2, and determines the number of pixels included in each region according to the size of each region and the size of pixels in the background image, where the size of pixels in the background image is determined by the first device according to the size and resolution of the screen of the first device, E1 and E2 may be the same or different, and the sizes of the positioning errors E1 and E2 are determined according to an empirical value or a simulation result.
In implementation, the larger the difference between the RGB values of adjacent areas in the background image displayed on the screen of the first device is, i.e. the larger the difference between the RGB values of adjacent areas is, the smaller the error of the projection position of the second device in the screen of the first device determined by the first device based on the background image is.
In an implementation, the first device and the second device establish a wireless connection, which includes but is not limited to one of the following connection modes: bluetooth connection, Wireless Fidelity (WiFi) connection, and the like.
In implementation, after the first device receives the target RGB value sent by the second device, it determines that the target RGB value is in front of the corresponding region in the background image, and compensates the target RGB value. Specifically, the first device displays a pure background image, that is, the RGB values of all the pixels in the background image are set values; the second equipment acquires a preview image of the background image through the camera, extracts an RGB value of a central point of the preview image as a calibration RGB value, and sends the calibration RGB value to the first equipment; the first device determines a difference between the RGB values of the background image and the calibration RGB values as a compensation value, and stores the compensation value. After receiving the target RGB value sent by the second device, the first device compensates the target RGB value according to the compensation value, and determines the projection position of the second device in the screen of the first device according to the compensated target RGB value, so that the positioning accuracy is further improved.
In implementation, after the second device extracts the RGB value of the center point of the preview image of the background image displayed by the first device as the target RGB value, the second device compensates the target RGB value before sending the target RGB value to the first device, and sends the compensated target RGB value to the first device. Specifically, the first device displays a pure background image, that is, the RGB values of all the pixels in the background image are set values; the second equipment collects an image on the background image through the camera, extracts an RGB value of a central point of the collected image as a calibration RGB value, determines a difference value between the calibration RGB value and the RGB value of the background image as a compensation value with the first equipment, and stores the compensation value. After the second device obtains the target RGB value, the target RGB value is compensated according to the compensation value, the compensated target RGB value is sent to the first device, and the first device determines the projection position of the second device in the screen of the first device according to the compensated target RGB value, so that the positioning accuracy is further improved.
Preferably, the RGB values of the regions in the background image displayed in the screen of the first device satisfy the following condition: in the horizontal direction, any one value of the R value, the G value and the B value of any two adjacent areas meets a set first functional relation; and in the vertical direction, any one value except the value meeting the first functional relation in the RGB values of any two adjacent areas meets the set second functional relation.
Step 102: and the first equipment determines a region corresponding to the target RGB value in the background image according to the target RGB value, and determines the projection position of the second equipment in the screen of the first equipment according to the position of a set pixel point in the determined region.
The set pixel point may be any one pixel point in an area corresponding to a target RGB value in a background image displayed in the first device.
Preferably, the first device determines, according to the target RGB value and the first number relationship and the second functional relationship that the RGB values of the regions in the background image satisfy, that the region in the background image having the smallest difference between the RGB value and the target RGB value is the region corresponding to the target RGB value, that is, determines the region in the background image having the same color as or the closest color to the color represented by the target RGB value as the region corresponding to the target RGB value, and determines the projection position of the second device in the screen of the first device according to the position of the set pixel point in the region.
In implementation, if the RGB values of each region in the background image displayed on the screen of the first device and the positions of the pixels in the region cannot be represented by a functional relationship, the first device stores the RGB values of each region in the background image, determines the region with the minimum difference between the RGB values and the target RGB values in the background image as the region corresponding to the target RGB values by searching the RGB values of each region, that is, determines the region with the same color or closest color to the color represented by the target RGB values in the background image as the region corresponding to the target RGB values, and determines the projection position of the second device in the screen of the first device according to the positions of the set pixels in the region.
Specifically, the first device determines a position of a set pixel point in a region corresponding to a target RGB value in the background image as a projection position of a set position of the second device in a screen of the first device, and determines a projection position of the second device in the screen of the first device according to the projection position of the set position of the second device and configuration information of the second device, such as a position of a camera of the second device, or a position of a center of the second device, where the configuration information at least includes a screen direction of the second device and a size of the second device.
In an implementation, a first device receives configuration information of a second device, wherein the configuration information at least comprises a screen direction of the second device and a size of the second device, and displays a projection image of the second device in a screen of the first device according to the configuration information and a projection position of the second device in the screen of the first device, wherein the size of the second device is a screen size of the second device or an actual size of the second device. Specifically, when the screen size of the second device is smaller than the actual size of the second device, the first device may estimate the size of the second device by the screen size of the second device, such as adding a set value to the size of the screen of the second device as the size of the second device, or taking the screen size of the second device as the size of the second device.
In implementation, the size of the projection image displayed on the second device in the screen of the first device is the same as the size of the second device or is enlarged/reduced according to a set ratio of the size of the second device, wherein the size of the second device is determined by the first device according to the configuration information of the second device.
In implementation, the first device may display the image at a projection position of the second device on a screen of the first device according to preset graphic information, wherein the graphic information at least comprises a shape and a size and is stored in the first device or the second device. For example, after the first device determines the projection position of the second device in the screen of the first device, the information of the pentagram-shaped graph stored in the first device or sent by the second device is used for displaying the pentagram-shaped graph at the projection position of the second device in the screen of the first device, and the movement of the image in the screen of the first device is controlled according to the movement of the second device.
In a second embodiment, a flowchart of a method for a first device to determine a projection position of a second device in a screen of the first device is shown in fig. 2, and includes the following steps:
step 201: the second device obtains a preview image of a background image displayed by the first device through the camera, wherein the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, and the RGB values of the pixel points in different areas are different.
Preferably, the RGB values of the regions in the background image displayed in the screen of the first device satisfy the following condition: in the horizontal direction, any one value of the R value, the G value and the B value of the RGB values of any two adjacent areas meets a set first functional relation; and in the vertical direction, any one value except the value satisfying the first functional relation in the RGB values of any two phase regions satisfies the set second functional relation.
In the implementation, the method for compensating the target RGB value by the first device or the second device refers to the description in the first embodiment, and repeated descriptions are omitted.
Step 202: the second device extracts the RGB value of the center point of the preview image as a target RGB value.
Step 203: the second device sends the target RGB value to the first device, so that the first device determines the projection position of the second device in the screen of the first device according to the target RGB value.
In an implementation, the first device and the second device establish a wireless connection, which includes but is not limited to one of the following connection modes: bluetooth connection, WiFi connection, etc.
In implementation, when the RGB value of the center point of the preview image of the background image displayed on the screen of the first device is changed, the second device sends the currently obtained RGB value to the first device; or the second device sends the acquired RGB value of the center point of the preview image of the background image displayed on the screen of each frame of the first device to the first device.
Specifically, the second device acquires a preview image of a background image displayed on a screen of the first device at intervals of a set duration, extracts an RGB value of a center point of the preview image, and sends the RGB value to the first device when it is determined that the currently acquired RGB value changes.
In implementation, the method for determining the projection position of the second device in the screen of the first device by the first device according to the target RGB value sent by the second device is described in the first embodiment, and repeated descriptions are omitted.
In implementation, the second device sends configuration information of the second device to the first device, wherein the configuration information at least comprises a screen direction of the second device and a size of the second device, and the first device displays a projection image of the second device in a screen of the first device according to the configuration information and a projection position of the second device in the screen of the first device.
The screen positioning method provided by the embodiment of the invention is explained in detail below by two specific embodiments, taking a smart phone as a first device and a smart phone as a second device.
In a first specific embodiment, a flow of a method for determining a projection position of a smart phone in a screen of a smart television by a smart television is shown in fig. 3, where a distance between the smart television and the smart phone is less than 10cm, and the method includes the following steps:
step 301: the intelligent television displays a background image in a screen, wherein the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, and the RGB values of the pixel points in different areas are different.
In implementation, before the smart television displays a background image divided into a plurality of regions with different RGB values in a screen, a pure background image is displayed, that is, the RGB values of all pixel points in the background image are set values, so as to determine a difference value between the RGB value of the background image displayed in the smart television screen acquired by the smart phone and an actual RGB value of the background image, so as to compensate for a target RGB value.
Preferably, if the length of the diagonal line of the screen of the smart phone is P and the set positioning error is P/5, the smart television determines that the length of the diagonal line of each region in the background image is less than or equal to P/5, and determines the number of pixel points included in each region according to the size of the diagonal line of each region and the size of the pixel points in the background image, wherein the size of the pixel points in the background image is determined by the smart television according to the size and the resolution of the screen of the smart television.
Preferably, the RGB values of the regions in the background image displayed in the smart tv screen satisfy the following conditions: in the horizontal direction, any one value of the R value, the G value and the B value of the RGB values of any two adjacent areas meets a set first functional relation; and in the vertical direction, any one value except the value meeting the first functional relation in the RGB values of any two adjacent areas meets the set second functional relation.
Specifically, the RGB values of the regions in the background image satisfy the following conditions: in the horizontal direction, the difference between the R values of the RGB values of any two adjacent regions is a constant value, and in the vertical direction, the difference between the G values of the RGB values of any two adjacent regions is a constant value. For example, the background image displayed on the screen of the smart tv shown in fig. 4 is divided into 256 × 256 rectangular regions, each region includes pixels having a number not greater than a preset value, the RGB values of the pixels in the same region are the same, the G values of the RGB values of the regions in the same row are the same, the R values of the RGB values of the regions in the same column are the same, the RGB values of the regions in the first row are (200, 0), (201,200,0), (202,200,0), …, (255,200,0), and the RGB values of the regions in the first column are (200, 0), (200,201,0), (200,202,0), …, (200,255, 0).
Step 302: the smart phone acquires a real-time picture of a background image displayed by the smart television through a camera of the smart phone.
Step 303: the intelligent mobile phone extracts the RGB value of the central point of the acquired picture as a target RGB value, and sends the target RGB value and the configuration information of the intelligent mobile phone to the intelligent television, wherein the configuration information of the intelligent mobile phone comprises the size information of the intelligent mobile phone and the display screen of the intelligent mobile phone, and the like.
Specifically, the smart phone and the smart television set establish a wireless connection, and the wireless connection includes but is not limited to one of the following connection modes: bluetooth connection, WiFi connection, etc.
Specifically, the picture acquired by the smartphone is generally rectangular, and the central point of the picture is the intersection of the diagonal lines of the rectangle.
Step 304: the intelligent television determines a region corresponding to the target RGB value in the background image according to the target RGB value, and determines the projection position of the intelligent mobile phone in the screen of the intelligent television according to the position of the set pixel point in the determined region.
Specifically, the smart television determines a region corresponding to a target RGB value through a matching algorithm according to the target RGB value and RGB values of regions of a background image, and determines a projection position of the smart phone in a screen of the smart television according to a position of a set pixel point in the determined region, where the matching algorithm is to determine a region corresponding to the target RGB value in the background image according to an inverse function of a function satisfied by the RGB values of the regions of the background image of the smart television.
Step 305: the smart television determines the size of the smart phone according to the configuration information of the smart phone, displays the projection position of the smart phone in the screen of the smart television, and displays the projection image of the smart phone in the screen of the smart television, wherein the size of the projection image of the smart phone is the same as the size of the smart phone.
Specifically, the actual size of the smart phone generally differs from the screen size of the smart phone by a small amount, and therefore, the smart television can use the screen size of the smart phone as the size of the smart phone.
In implementation, the smart tv represents a projected image of the smartphone for further operation of multi-screen interaction through a shadow effect, which is shown in fig. 5.
A second embodiment, a method for determining a projection position of a smart phone in a smart tv screen based on the smart tv of the first embodiment, a schematic diagram of a ping-pong game based on a short-distance multi-screen interaction is shown in fig. 6, in which a projection image of the smart phone in the tv screen corresponds to a ping-pong bat, when the projection image of the smart phone in the tv screen hits an edge of a virtual ping-pong ball at a certain speed and angle, the ping-pong ball moves in a direction without being blocked by the projection image of the smart phone, and the specific moving direction and linear moving distance are determined by the tv according to the speed and angle when the projection image of the smart phone hits the edge of the virtual ping-pong ball, wherein the projection image of the smart phone in the tv screen is determined according to the method described in the first embodiment.
Specifically, the mobile phone P1 and the mobile phone P2 are suspended above or attached to a television screen, and are connected to the television through bluetooth or WiFi respectively, the television displays a virtual table tennis ball on a background image of the screen, the mobile phone P1 is moved so that a projection image of the mobile phone P1 touches the edge of the virtual table tennis ball at a certain speed and angle, the television determines the movement direction and the linear movement distance of the table tennis ball according to the speed and angle when the projection image of the mobile phone P1 touches the edge of the virtual table tennis ball, and the table tennis ball is linearly moved from the position B1 to the position B2; the mobile phone P2 moves from the position A1 to the position A2, so that the projected image of the mobile phone P2 touches the edge of a virtual table tennis ball at a certain speed and angle, the television determines the motion direction and the distance of linear motion when the table tennis ball rebounds according to the speed and angle when the projected image of the mobile phone P2 touches the edge of the table tennis ball at the position B2, the mobile phones P1 and P2 repeat the operations, when one of the projected image of the mobile phone P1 and the projected image of the mobile phone P2 does not touch the table tennis ball, the other mobile phone scores a score, and the table tennis game is played on the television through the mobile phones. The background image displayed by the television is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, the RGB values of the pixel points in different areas are different, and the projection images of the mobile phone P1 and the mobile phone P2 in the television screen are determined by the television based on the method described in the first embodiment.
Based on the same inventive concept, a third embodiment of the present invention provides an apparatus, and specific implementation of the apparatus may refer to the description of the first embodiment, and repeated descriptions are omitted, as shown in fig. 7, the apparatus mainly includes:
a receiving module 701, configured to receive a target RGB value sent by a second device, where the target RGB value is an RGB value of a central point of a preview image of a background image displayed by the second device through a camera, the background image is divided into multiple regions, the number of pixels included in each region is not greater than a preset value, the RGB values of pixels in the same region are the same, and the RGB values of pixels in different regions are different;
a processing module 702, configured to determine, according to the target RGB value, a region corresponding to the target RGB value in the background image, and determine, according to a position of a set pixel point in the determined region, a projection position of the second device in a screen of the device.
In an optional implementation manner, the receiving module 701 is further configured to: receiving configuration information of the second device, wherein the configuration information at least comprises a screen direction of the second device and a size of the second device;
the processing module 702 is further configured to: and displaying a projection image of the second equipment in the screen of the equipment according to the configuration information and the projection position of the second equipment in the screen of the equipment.
Based on the same inventive concept, a fourth embodiment of the present invention provides an apparatus, and specific implementation of the apparatus may refer to the description of the second embodiment, and repeated descriptions are omitted, as shown in fig. 8, the apparatus mainly includes:
the acquisition module 801 is configured to acquire an image on a background image displayed by first equipment through a camera, where the background image is divided into different regions, the number of pixels included in each region is not greater than a preset value, RGB values of pixels in the same region are the same, and RGB values of pixels in different regions are different;
a processing module 802, configured to extract an RGB value of a center point of the preview image as a target RGB value;
a sending module 803, configured to send the target RGB value to the first device, so that the first device determines, according to the target RGB value, a projection position of the device in a screen of the first device.
In an optional implementation manner, the sending module 803 is specifically configured to: when the RGB value of the central point of the acquired preview image of the background image changes, the currently acquired RGB value is sent to the first device;
or sending the acquired RGB value of the center point of the preview image of each frame of the background image to the first device.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A method for screen positioning, the method comprising:
the method comprises the steps that a first device receives a target RGB value sent by a second device, wherein the target RGB value is the RGB value of the center point of a preview image of a local background image displayed by the first device, which is acquired by the second device through a camera in a non-digital zooming mode, the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, the RGB values of the pixel points in different areas are different, the size of the first device is larger than that of the second device, and the distance between the first device and the second device meets the condition that the second device can only acquire the local background image displayed by the first device through the camera in the non-digital zooming mode;
and the first equipment determines a region corresponding to the target RGB value in the background image according to the target RGB value, and determines the projection position of the second equipment in the screen of the first equipment according to the position of a set pixel point in the determined region.
2. The method of claim 1, wherein the RGB values of the regions in the background image satisfy the following condition:
in the horizontal direction, any one value of the R value, the G value and the B value of the RGB values of any two adjacent areas meets a set first functional relation; and in the vertical direction, any one value except the value meeting the first functional relation in the RGB values of any two adjacent areas meets the set second functional relation.
3. The method of claim 1 or 2, wherein the method further comprises:
the first device receives configuration information of the second device, wherein the configuration information at least comprises a screen direction of the second device and a size of the second device;
and the first equipment displays a projection image of the second equipment in the screen of the first equipment according to the configuration information and the projection position of the second equipment in the screen of the first equipment.
4. A method for screen positioning, the method comprising:
the method comprises the steps that a second device obtains a local preview image of a background image displayed by a first device in a non-digital zooming mode through a camera, wherein the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, the RGB values of the pixel points in different areas are different, the size of the first device is larger than that of the second device, and the distance between the first device and the second device meets the condition that the second device can only obtain the local background image displayed by the first device in the non-digital zooming mode through the camera;
the second equipment extracts the RGB value of the center point of the preview image as a target RGB value;
and the second device sends the target RGB value to the first device, so that the first device determines the projection position of the second device in the screen of the first device according to the target RGB value.
5. The method of claim 4, wherein the RGB values of the regions in the background image satisfy the following condition:
in the horizontal direction, any one value of the R value, the G value and the B value of the RGB values of any two adjacent areas meets a set first functional relation; and in the vertical direction, any one value except the value meeting the first functional relation in the RGB values of any two phase regions meets the set second functional relation.
6. The method of claim 5, wherein the second device sending the RGB values to the first device specifically comprises:
when the RGB value of the central point of the acquired preview image of the background image changes, the second device sends the currently acquired RGB value to the first device;
or the second device sends the acquired RGB values of the center point of the preview image of each frame of the background image to the first device.
7. An apparatus, characterized in that the apparatus comprises:
the receiving module is used for receiving a target RGB value sent by second equipment, wherein the target RGB value is the RGB value of a central point of a preview image of a local background image displayed by the second equipment, which is acquired by the second equipment through a camera in a non-digital zooming mode, the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, the RGB values of the pixel points in different areas are different, the size of the first equipment is larger than that of the second equipment, and the distance between the first equipment and the second equipment meets the condition that the second equipment can only acquire the local background image displayed by the first equipment through the camera in the non-digital zooming mode;
and the processing module is used for determining a region corresponding to the target RGB value in the background image according to the target RGB value, and determining the projection position of the second equipment in the screen of the equipment according to the position of a set pixel point in the determined region.
8. The device of claim 7, wherein the receiving module is further to:
receiving configuration information of the second device, wherein the configuration information at least comprises a screen direction of the second device and a size of the second device;
the processing module is further configured to: and displaying a projection image of the second equipment in the screen of the equipment according to the configuration information and the projection position of the second equipment in the screen of the equipment.
9. An apparatus, characterized in that the apparatus comprises:
the acquisition module is used for acquiring a preview image of a local background image displayed by first equipment in a non-digital zooming mode through a camera, wherein the background image is divided into a plurality of areas, the number of pixel points contained in each area is not more than a preset value, the RGB values of the pixel points in the same area are the same, the RGB values of the pixel points in different areas are different, the size of the first equipment is larger than that of second equipment, and the distance between the first equipment and the second equipment meets the condition that the second equipment can only acquire the local background image displayed by the first equipment in the non-digital zooming mode through the camera;
the processing module is used for extracting the RGB value of the center point of the preview image as a target RGB value;
and the sending module is used for sending the target RGB value to the first equipment so that the first equipment determines the projection position of the equipment in the screen of the first equipment according to the target RGB value.
10. The device of claim 9, wherein the sending module is specifically configured to:
when the RGB value of the central point of the acquired preview image of the background image changes, the currently acquired RGB value is sent to the first device;
or sending the acquired RGB value of the center point of the preview image of each frame of the background image to the first device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611093477.4A CN106817611B (en) | 2016-12-01 | 2016-12-01 | Screen positioning method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611093477.4A CN106817611B (en) | 2016-12-01 | 2016-12-01 | Screen positioning method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106817611A CN106817611A (en) | 2017-06-09 |
| CN106817611B true CN106817611B (en) | 2020-06-02 |
Family
ID=59106867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611093477.4A Active CN106817611B (en) | 2016-12-01 | 2016-12-01 | Screen positioning method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106817611B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1533180A (en) * | 2003-03-19 | 2004-09-29 | 松下电器产业株式会社 | Remote control device and method based on video frequency picture detection |
| CN101408813A (en) * | 2007-10-10 | 2009-04-15 | 夏普株式会社 | Display system and method for detecting pointed position |
| KR20120077451A (en) * | 2010-12-30 | 2012-07-10 | 엘지디스플레이 주식회사 | Three dimension image display device |
| CN102918476A (en) * | 2010-02-05 | 2013-02-06 | 索尼电脑娱乐公司 | Controller for interfacing with a computing program using position, orientation, or motion |
| CN103852066A (en) * | 2012-11-28 | 2014-06-11 | 联想(北京)有限公司 | Equipment positioning method, control method, electronic equipment and system |
| CN105573605A (en) * | 2014-10-10 | 2016-05-11 | 广州杰赛科技股份有限公司 | Interactive game method of mobile phone and computer |
-
2016
- 2016-12-01 CN CN201611093477.4A patent/CN106817611B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1533180A (en) * | 2003-03-19 | 2004-09-29 | 松下电器产业株式会社 | Remote control device and method based on video frequency picture detection |
| CN101408813A (en) * | 2007-10-10 | 2009-04-15 | 夏普株式会社 | Display system and method for detecting pointed position |
| CN102918476A (en) * | 2010-02-05 | 2013-02-06 | 索尼电脑娱乐公司 | Controller for interfacing with a computing program using position, orientation, or motion |
| KR20120077451A (en) * | 2010-12-30 | 2012-07-10 | 엘지디스플레이 주식회사 | Three dimension image display device |
| CN103852066A (en) * | 2012-11-28 | 2014-06-11 | 联想(北京)有限公司 | Equipment positioning method, control method, electronic equipment and system |
| CN105573605A (en) * | 2014-10-10 | 2016-05-11 | 广州杰赛科技股份有限公司 | Interactive game method of mobile phone and computer |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106817611A (en) | 2017-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110215690B (en) | Visual angle switching method and device in game scene and electronic equipment | |
| US20180232135A1 (en) | Method for window displaying on a mobile terminal and mobile terminal | |
| US9973677B2 (en) | Refocusable images | |
| US9934823B1 (en) | Direction indicators for panoramic images | |
| JP2012523630A (en) | Improved handheld screen detection pointer | |
| US9824723B1 (en) | Direction indicators for panoramic images | |
| US20170039753A1 (en) | Method, apparatus and non-transitory computer-readable storage medium for uninstalling an application | |
| CN111309203B (en) | Method and device for acquiring positioning information of mouse cursor | |
| US20150121301A1 (en) | Information processing method and electronic device | |
| CN112954193B (en) | Shooting method, shooting device, electronic equipment and medium | |
| EP4191513A1 (en) | Image processing method and apparatus, device and storage medium | |
| WO2017185642A1 (en) | Video content display switching method, apparatus, and mobile playback terminal thereof | |
| JP2019179382A (en) | Information processing program, information processing method and information processing system | |
| CN112221128B (en) | Map adjusting method and related device | |
| CN108905203A (en) | Information processing method, device, storage medium and electronic device | |
| CN110007838B (en) | Processing method, device and equipment for erasing control | |
| CN111325201A (en) | Image processing method and device, movable equipment, unmanned aerial vehicle remote controller and system | |
| EP2918072B1 (en) | Method and apparatus for capturing and displaying an image | |
| CN114240754A (en) | Screen projection processing method and device, electronic equipment and computer readable storage medium | |
| CN110928509A (en) | Display control method, display control device, storage medium, and communication terminal | |
| EP3799415A2 (en) | Method and device for processing videos, and medium | |
| US20170169572A1 (en) | Method and electronic device for panoramic video-based region identification | |
| CN106817611B (en) | Screen positioning method and device | |
| CN112672057B (en) | Shooting method and device | |
| US20210125339A1 (en) | Method and device for segmenting image, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Visual Technology Co., Ltd. Address before: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |