CN110673737B - Display content adjusting method and device based on intelligent home operating system - Google Patents
Display content adjusting method and device based on intelligent home operating system Download PDFInfo
- Publication number
- CN110673737B CN110673737B CN201910944554.XA CN201910944554A CN110673737B CN 110673737 B CN110673737 B CN 110673737B CN 201910944554 A CN201910944554 A CN 201910944554A CN 110673737 B CN110673737 B CN 110673737B
- Authority
- CN
- China
- Prior art keywords
- display
- display state
- viewing
- screen
- adjusting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a method and a device for adjusting display content based on an intelligent home operating system, comprising the steps of obtaining image data, wherein the image data is used for indicating images in front of a screen; under the condition that the image data indicates that the watching object exists in front of the screen, the display state of the display content is adjusted to the target display state, wherein the determining factor of the target display state comprises the current watching distance between the watching object and the screen, the problem that the adjustment efficiency of the display content is low in the related art is solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Description
Technical Field
The invention relates to the field of communication, in particular to a method and a device for adjusting display content based on an intelligent home operating system.
Background
In the related art, some smart home devices often realize information interaction with users through screens, when users operate the devices, adjustment of screen display can be realized only by actively operating the screens or operating keys, for example, when users are at a position far away from the screens, viewing effects are poor, if the users want to adjust the screen display state, the users also need to approach the screens to manually touch the screens or click the keys to adjust, so that the adjustment efficiency of display content is greatly reduced, and the adjustment is very inconvenient.
Disclosure of Invention
The embodiment of the invention provides a method and a device for adjusting display content based on an intelligent home operating system, which are used for at least solving the problem of low adjustment efficiency of the display content in the related technology.
According to one embodiment of the invention, there is provided a method for adjusting display content based on an intelligent home operating system, including:
acquiring image data, wherein the image data is used for indicating an image in front of a screen;
and adjusting the display state of the display content to a target display state under the condition that the image data indicates that a viewing object exists in front of the screen, wherein the determining factors of the target display state comprise: a current viewing distance between the viewing object and the screen.
Optionally, adjusting the display state of the display content to a target display state, where the target display state is determined according to the current viewing distance between the viewing object and the screen, includes: and adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
Optionally, adjusting the display state of the display content to the target display state according to the target display parameter includes: and adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and the display parameter.
Optionally, before adjusting the display state of the display content to the target display state, the method further includes:
determining identity information of the viewing object;
adjusting the display state of the display content to a target display state comprises the following steps:
and adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object.
Optionally, the mapping relation is determined by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
Optionally, before the mapping relationship between the viewing distance and the display parameter is determined according to the historical viewing data of the viewing object, the method further includes: and determining the historical viewing data of the viewing object from at least one on-screen terminal in the smart home.
According to another embodiment of the present invention, there is also provided an apparatus for adjusting display content based on an intelligent home operating system, including:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring image data, wherein the image data is used for indicating images in front of a screen;
the adjusting module is used for adjusting the display state of the display content to a target display state under the condition that the image data indicates that a viewing object exists in front of the screen, wherein the determining factors of the target display state comprise: a current viewing distance between the viewing object and the screen.
Optionally, the adjusting module includes: the first adjusting unit is used for adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current mapping relation between the watching distance and the first mapping relation, and the first mapping relation is used for indicating the mapping relation between the watching distance and the display parameter.
Optionally, the first adjusting unit includes: and the first adjustment subunit is used for adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and the display parameter.
Optionally, the method further comprises: the first determining module is used for determining identity information of the watching object before adjusting the display state of the display content to a target display state;
the adjustment module further includes: and the second adjusting unit is used for adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object.
Optionally, the method further comprises: a second determining module, configured to determine the mapping relationship by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
Optionally, the method further comprises: and the third determining module is used for determining the historical viewing data of the viewing object from at least one on-screen terminal in the smart home before determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
According to still another embodiment of the present invention, there is further provided an intelligent home system, which is characterized by including the device for adjusting display content based on the intelligent home operating system according to any one of the above embodiments.
According to a further embodiment of the invention, there is also provided a computer-readable storage medium having stored therein a computer program, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
According to a further embodiment of the application, there is also provided an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
According to the embodiment of the application, the image data is acquired, wherein the image data is used for indicating the image in front of the screen; when the image data indicates that the viewing object exists in front of the screen, the display state of the display content is adjusted to the target display state, wherein the target display state is determined according to the current viewing distance between the viewing object and the screen, namely, the display state of the display content can be adjusted according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
Fig. 1 is a block diagram of a hardware structure of a mobile terminal based on a method for adjusting display contents of an intelligent home operating system according to an embodiment of the present application;
fig. 2 is a flowchart of a method for adjusting display content based on an intelligent home operating system according to an embodiment of the present application;
fig. 3 is a block diagram of a device for adjusting display content based on an intelligent home operating system according to an embodiment of the present application;
fig. 4 is a flowchart of a method for adjusting display content based on an intelligent home operating system according to an alternative embodiment of the present application.
Detailed Description
The application will be described in detail hereinafter with reference to the drawings in conjunction with embodiments. It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.
Example 1
The method embodiment provided by the first embodiment of the application can be executed in the intelligent home equipment or the similar computing device. Taking the operation on the smart home device as an example, fig. 1 is a block diagram of a hardware structure of a mobile terminal according to an embodiment of the present application, which is based on a method for adjusting display content of a smart home operating system. As shown in fig. 1, the smart home device 10 may include one or more (only one is shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a microprocessor MCU, a programmable logic device FPGA, or the like) and a memory 104 for storing data, and optionally, a transmission device 106 for communication functions and an input-output device 108. It will be appreciated by those skilled in the art that the structure shown in fig. 1 is merely illustrative, and is not limited to the structure of the smart home device described above. For example, the smart home device 10 may also include more or fewer components than shown in fig. 1, or have a different configuration than shown in fig. 1.
The memory 104 may be used to store computer programs, such as software programs and modules of application software, such as computer programs corresponding to a method for adjusting display content based on an operating system of a smart home in an embodiment of the present invention, and the processor 102 executes the computer programs stored in the memory 104 to perform various functional applications and data processing, that is, implement the above-mentioned methods. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely located with respect to the processor 102, which may be connected to the smart home device 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission means 106 is arranged to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the smart home device 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, simply referred to as NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet wirelessly.
In this embodiment, a method for adjusting display content of an intelligent home device is provided, and fig. 2 is a flowchart of a method for adjusting display content based on an intelligent home operating system according to an embodiment of the present invention, as shown in fig. 2, where the flowchart includes the following steps:
step S202, obtaining image data, wherein the image data is used for indicating images in front of a screen;
step S204, in the case where the image data indicates that the viewing object exists in front of the screen, adjusting the display state of the display content to the target display state, wherein the determining factors of the target display state include: the current viewing distance between the viewing object and the screen.
Through the steps, the image data are acquired, wherein the image data are used for indicating the images in front of the screen; in the case that the image data indicates that a viewing object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the determining factors of the target display state include: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content can be achieved.
Alternatively, the main body of execution of the above steps may be smart home devices, but is not limited thereto.
It should be noted that, acquiring image data may refer to acquiring image data through a camera set on the smart home device, for example, acquiring an image in a certain area in front of a screen. The collected image data can be processed by a processor arranged in the intelligent household equipment, so that whether a watching object is arranged in front of a screen or not is identified, for example, whether an object with human body characteristics appears in the image data is identified, and if the watching object is identified in the image data, the intelligent household equipment can adjust the display state of the display content according to the current watching distance between the watching object and the screen. In an alternative embodiment, the collected image data may also be sent to the server for processing, that is, the server identifies whether the image data has a viewing object, then the server sends the identification result to the smart home device, and the smart home device adjusts the display state of the display content according to the current viewing distance between the viewing object and the screen.
It should be further noted that, adjusting the display state of the display content to the target display state may refer to adjusting the saliency of the display content, where the saliency of the display content after adjustment may be higher than the saliency of the display content before adjustment; in addition, the greater the current viewing distance, the greater the level of prominence of the adjusted display content.
It should be noted that the target display state of the display content may also be determined according to the viewing time of the user (i.e., the viewing object) or the viewing time and the viewing distance.
In an alternative embodiment, the adjustment means may be: adjusting the display proportion of all or part of the display content and/or adjusting the display color parameters of all or part of the display content, etc., wherein the display color parameters may include color saturation, brightness, contrast, etc. The following examples are given: in an alternative embodiment, the display proportion of a web page, a text, a word, an image or a video may be adjusted; for example, the display proportion of a certain webpage is adjusted, or the size of the display area occupied by the video displayed in the local area of the certain webpage can be adjusted, for example, the display area occupied by the video is enlarged; for another example, the text in the display area is resized. Display color parameters such as display brightness of a web page, a text, a word, an image or a video can be adjusted. The foregoing adjustment manners are only examples, and any adjustment manner capable of adjusting the significance level of the display content should be included in the protection scope of the present invention, and will not be described herein.
It is also to be noted that the viewing distance between the viewing object and the screen can be determined by: for example, a processor in the smart home device analyzes the collected image data, compares the size variation difference of the partial images of the human body in the collected image data to determine the viewing distance, and can compare the size variation difference of the face images in the collected image data to determine the viewing distance; or the collected image data can be sent to a server for analysis, the size change difference of the human body partial images in the collected image data is compared by the server to determine the watching distance, for example, the size change difference of the human face images in the collected image data can be compared to determine the watching distance, and then the watching distance is sent to the intelligent household equipment, and in addition, the distance between the watching object and the screen, namely the watching distance, can be measured according to the infrared sensor.
In an alternative embodiment, adjusting the display state of the display content to a target display state, wherein the target display state is determined according to a viewing distance between the viewing object and the screen, includes: and adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
It should be noted that, the target parameter may be set by the smart home device itself, or may be set by the server and then sent to the smart home device. The target parameter may be a specific adjustment parameter directly corresponding to the target display state, for example, a display ratio of 110%, a display brightness of 80%, or the like.
In an alternative embodiment, adjusting the display state of the display content to the target display state according to the target display parameter includes: and adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and the display parameter.
It should be noted that the specified display content may be a specified type of display content, such as a web page, text, image, or video. The first mapping relationship may be preset, for example, may be set according to an optimal viewing effect of human eyes.
In an alternative embodiment, before adjusting the display state of the display content to the target display state, the method further includes: determining identity information of a viewing object;
adjusting the display state of the display content to a target display state includes: and adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object.
In an alternative embodiment, the mapping relationship is determined by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
It should be noted that, the historical viewing data of the viewing object may include a historical viewing distance of the viewing object and a historical display parameter corresponding to the historical viewing distance, or may include a historical viewing distance of the viewing object, a historical display parameter corresponding to the historical viewing distance, and an adjustment object (i.e., display content) corresponding to the historical display parameter. In addition, the identity of the viewing object in front of the screen can be determined first, and then the historical viewing data of the viewing object can be determined according to the identity of the viewing object.
In an alternative embodiment, before said determining the mapping relationship between the viewing distance and the display parameter according to the historical viewing data of the viewing object, the method further comprises: and determining the historical viewing data of the viewing object from at least one on-screen terminal in the smart home.
In this embodiment, an adjusting device for display content based on an intelligent home operating system is further provided, and the device is used for implementing the foregoing embodiments and preferred embodiments, which have been described and will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 3 is a block diagram of a device for adjusting display content based on an operating system of an intelligent home according to an embodiment of the present invention, as shown in fig. 3, the device includes:
an acquisition module 31, configured to acquire image data, where the image data is used to indicate an image in front of a screen;
an adjustment module 33, configured to adjust a display state of the display content to a target display state when the image data indicates that the viewing object exists in front of the screen, where a determining factor of the target display state includes: is the current viewing distance between the viewing object and the screen.
By the module, the image data is acquired, wherein the image data is used for indicating the image in front of the screen; in the case that the image data indicates that a viewing object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the determining factors of the target display state include: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content can be achieved.
In one embodiment, the adjustment module includes: the first adjusting unit is used for adjusting the display state of the display content to the target display state according to the target display parameter, wherein the target display parameter is determined according to the current viewing distance and the first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
In one embodiment, the first adjusting unit includes: the first adjusting subunit is configured to adjust the display state of the specified display content to the target display state according to the target display parameter, where the first mapping relationship is further configured to indicate a mapping relationship between the display content and the viewing distance and the display parameter.
In one embodiment, the apparatus further comprises: the first determining module is used for determining identity information of a watching object before adjusting the display state of the display content to a target display state;
the adjustment module further includes: and a second adjusting unit for adjusting the display state of the display content to a target display state corresponding to the identity information of the viewing object.
In one embodiment, the method further comprises: a second determining module, configured to determine a mapping relationship by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
In one embodiment, the method further comprises: and the third determining module is used for determining the historical viewing data of the viewing object from at least one terminal with a screen in the smart home before determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
By the module and the unit, the image data are acquired, wherein the image data are used for indicating images in front of a screen; when the image data indicates that the viewing object exists in front of the screen, the display state of the display content is adjusted to the target display state, wherein the target display state is determined according to the current viewing distance between the viewing object and the screen, namely, the display state of the display content can be adjusted according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, the above modules may be located in different processors in any combination.
Alternative embodiments
Embodiments of the present invention are further explained below in conjunction with specific scenarios:
the embodiment of the invention provides a method for adjusting the display content display proportion according to the historical behaviors of operating terminal display screens by different users and the real-time position distance value between the user and the display screens. According to the embodiment of the invention, the screen display content of the terminals such as a computer, an intelligent television and a mobile phone can be reduced and enlarged according to the habits of the video screens of different users and the real-time screen watching distance, so that the users can have good comfortable experience effect when watching the screen content, the hands of the users are liberated, and the autonomous control of the display content is realized.
The device mentioned in the embodiment of the invention mainly refers to a device for realizing information output through a screen, such as a smart television, a notebook computer, a tablet personal computer, a mobile phone and the like. These devices may store the usage data of the present device on their own memories and process the usage data by their own processors; the devices can also upload the usage data of the devices to the cloud server for storage and processing through the router, and can also accept the control of the cloud server. These devices serve as core devices of the intelligent home system and take on the main information output work in the whole system.
The following exemplary provides a method for adjusting display content, and fig. 4 is a flowchart of a method for adjusting display content based on an intelligent home operating system according to an alternative embodiment of the present invention, as shown in fig. 4, mainly including the following steps:
step 1, when intelligent home equipment is in a starting state, acquiring real-time image data in front of a screen, and uploading the real-time image data to a cloud server for storage and processing; the camera installed on the intelligent home equipment can acquire image data of a screen used by a user, whether the user is watched, identity information of the user is watched and the like can be determined in front of the screen through the acquired image, and it is noted that real-time image data in front of the screen can be acquired through an independent camera;
step 2, after receiving the image data before the screen, the cloud server judges whether the user watches the screen of the intelligent household equipment according to the image data, and if so, the next step is executed; if not, ending the flow;
it should be noted that, for all smart home devices, when a user views a screen content or inputs information or instructions through the screen, for example, touches the screen, the user is located in a certain area in front of the screen. "presence of user view" may refer to the presence of a user in an area in front of the screen, and may also refer to the presence of a user in an area in front of the screen and the eyes of the user are looking at the screen of the terminal device.
In an alternative embodiment, the judgment of whether the user is using/watching the screen content before the screen can be achieved by detecting whether the human body features exist in the area before the screen in the image data. The human body detection method which can be used in the embodiment of the invention comprises the following steps: methods based on human body contour shapes and methods based on human body features.
In an alternative embodiment, since the eyes of the user change with the viewing screen area when the user views the screen, the eye image of the user can be captured, and then the position change of the pupil and/or the iris in the eye image is analyzed to determine whether the eyes of the user watch the screen of the smart home device, so as to determine whether the user in the current image is operating the screen.
Step 3, determining identity information of a user using a screen, and acquiring user history screen use data of the intelligent home equipment corresponding to the user identity from history screen use data of a plurality of intelligent home equipment terminals of a plurality of user identities in a stored family according to the determined user identity information, wherein the use data comprises distance data and display data;
It should be noted that the identity information of the user currently viewing/using the screen may be obtained by: it is determined that there is a human body feature before the screen is detected, image information of the detected human body is further extracted, and the image information is compared with an identity image in family member information stored in advance in the system to determine identity information of a user currently viewing/using the screen.
In the embodiment of the invention, the user capable of operating the screen using the intelligent home equipment can comprise a plurality of user identities, and a group of screen using data is formed by the users with different user identities; meanwhile, the screen of the intelligent home equipment which can be operated and used by the user with the same user identity in the intelligent home can also comprise a plurality of screens, so that a certain user can form a plurality of groups of screen use data for the use of the screens of different intelligent home equipment.
When the intelligent family system is built, the system can collect information of all family members, including identity information, authority information, image information and the like. When the intelligent home system is built, the system can uniformly collect the front whole-body photos of all the home members and/or the face photos of the home members, and the like, after the intelligent home system is used, the image information of the user can be perfected according to personal photos or videos which are uploaded by the user at irregular intervals, and the intelligent home system comprises not only the front whole-body photos but also the back photos, the side photos, the upper body front photos and the like of the user, so that the image information can be photo combinations comprising different states of the user.
After the intelligent home system is established, the system can also collect and record the service condition data of the intelligent home equipment of the family members in real time. All intelligent home devices are provided with a user identity recognition function, so that the display proportion of different users to the screen display content of different intelligent home devices can be identified. The content that the screen displays to the user output may include text, graphics, video, and any combination thereof.
In this way, the system can record the display proportion of the content displayed by the different intelligent home devices operated by the user.
Specifically, for example, the display data of the screen may be as follows table 1:
| device name | User identity | Long service life | Display category | Display scale |
| Computer with a computer program | User 1 | 10：00-10：30 | Text of | 110％ |
| Computer with a computer program | User 1 | 10：31-10：40 | Text of | 90％ |
| Television set | User 2 | 10：00-10：15 | Video frequency | 120％ |
| Computer with a computer program | User 2 | 11：02-11：10 | Web page | 100％ |
TABLE 1
In an alternative embodiment, the display data of the user operation screen may also be stored in other storage forms, for example, stored separately according to the user identity and stored separately according to the name of the smart device, as shown in the following tables 2 and 3.
| User identity | Device name | Long service life | Display category | Display scale |
| User 1 | Computer with a computer program | 10：00-10：30 | Text of | 110％ |
| User 1 | Television set | 10：00-10：15 | Video frequency | 120％ |
| User 1 | Computer with a computer program | 11：02-11：10 | Web page | 100％ |
Table 2: (taking user 1 as an example)
| Device name | User identity | Long service life | Display category | Display scale |
| Computer with a computer program | User 1 | 10：00-10：30 | Text of | 110％ |
| Computer with a computer program | User 2 | 10：00-10：15 | Video frequency | 100％ |
| Computer with a computer program | User 3 | 11：02-11：10 | Web page | 90％ |
Table 3: (taking a computer as an example)
In an alternative embodiment, for the distance data of the screen, the distance data can be detected by an infrared sensor arranged on the smart home device, the infrared sensor can emit infrared rays, and the distance between the user and the screen is determined according to the time of emitting the infrared rays and the time difference of receiving the infrared rays reflected by the human body by utilizing the characteristic of low refractive index of the infrared rays. Of course, for the equipment which is not provided with the infrared sensor in the system, the image acquisition can be carried out through a camera arranged on the equipment, and the determination of the watching distance can be realized by comparing the size change difference of the human face in the acquired image.
The system records the user's screen viewing distance in terms of time periods as shown in table 4 below: (likewise, the screen viewing distance data may be stored in the form of screen display data, or stored in terms of user identity, or stored in terms of smart terminal device name)
| User identity | Device name | Long service life | Viewing distance |
| User 1 | Computer with a computer program | 10：00-10：30 | 25-30cm |
| User 1 | Computer with a computer program | 10：31-10：40 | 20-25cm |
| User 2 | Television set | 10：00-10：15 | 200cm-220cm |
| User 2 | Computer with a computer program | 11：02-11：10 | 28-30cm |
TABLE 4 Table 4
Thus, the display data and the distance data of the screen can form the screen use data of the user according to the identity information of the user.
In the above tables 1 and 4, for convenience of description of the embodiments, the same time node is exemplified, which cannot be used to limit the protection content of the scheme, and in practical application, the time nodes and the time intervals in the tables 1 and 4 may not be identical, and the time periods for maintaining the same viewing distance and the same display scale may not be identical for the user.
After the identity information of the user is determined, historical use data of the user on the screen can be obtained according to the identity information of the user, and for the historical data, only data in a period of time closest to the current time node can be selected for consideration of the data calculation load of the system, for example, 5 days, 1 week, half month and the like.
Step 4, according to the acquired display data and distance data of the same user identity, determining the mapping relation between the screen display proportion and the using distance of the intelligent terminal currently operated by the user identity, and generating a mapping relation table;
Taking the exemplary data in tables 1 and 2 as an example, user 1 is at 10: when the computer equipment is used in a ratio of 00-10:30, the using distance is 25-30cm, and the display proportion of the text content is 110%. Then the mapping between the content display scale and the distance used when the user 1 uses the computer can be expressed as (25-30 cm, 110%). Similarly, for the user 2, taking the data listed in table 1 and table 2 as examples, it can be uniquely determined that the mapping relationship (28-30 cm, 100%) exists between the distance and the display ratio when the user 2 outputs the web page content to the computer screen. By the same method, the system determines the mapping relationship between the viewing distances and the display proportions of all users in the smart family members for all screen devices to generate a mapping relationship table.
Step 5, obtaining the watching distance of the user with the user identity from the screen;
an infrared sensor or a camera may be used to obtain the distance between the user's current and viewing screen. Different smart home devices are different from one user to another due to the difference in the size of the equipped screen, so that the same user has different usage behaviors for different smart home devices, for example, a smart tv typically has a larger display screen, so that the user may not need a too large display scale when viewing content through the screen. Notebook computers, because of their portability, typically have a relatively small display screen, and users may need to enlarge the display scale of the displayed content while viewing the content through their screen.
Therefore, the display proportion of the display content which is suitable for the user at present can be rapidly determined through monitoring the real-time distance between the user and the watching screen and then according to the relation between the distance in the historical use data of the user and the display proportion. In the intelligent home operating system, the intelligent home equipment can upload current operation data of the equipment in real time, and the system can obtain the name, display content, operation state and the like of the equipment according to the uploaded data.
Step 6, obtaining the category of the display content, and generating an adjustment control instruction of the screen display content according to a mapping relation table of the display content and the distance;
after the system acquires the real-time viewing distance between the user and the screen, the system also needs to determine the category of the content which the user needs to output through the screen, namely the category of the content displayed on the screen, and generally can divide the display content into: text content, video animation content, picture content, web page content. The category of the display content can be directly determined by the format of the display content currently displayed by the intelligent terminal equipment, such as video files, picture files and the like.
After the category of the display content is confirmed, the display proportion of the display content currently required by the user can be determined according to the generated mapping relation table of the user watching distance and the display content, so that a display proportion adjustment control instruction of the screen display content is generated. After receiving the control instruction, the intelligent household equipment controls and adjusts the display proportion of the display screen.
For example, still taking the user data exemplified in tables 1 and 2 as an example, by performing step 5, it is determined that the viewing distance of the user 1 from the computer screen is 26cm, and at the same time, by performing step 6, it is determined that the type of display content to be output in the computer screen used by the user 1 is a text content type, and then it is clearly determined that the display ratio of the current display content of the user 1 should be 110% according to the map table generated in step 4. Thus, the system generates a control command for adjusting the display proportion of the current display content displayed on the screen of the computer 1 to 110%.
And 7, receiving a control instruction issued by the server through the home gateway by the screen, adjusting the display proportion of the display content and outputting the display content.
In an alternative embodiment, the cloud server in the smart home system can issue the control instruction to the smart home device in the smart home only through the home gateway, and the smart home device controls and adjusts the display proportion of the screen display content after receiving the control instruction. The home gateway may be a router device.
The above description mainly uses the user who views or uses the screen currently as a user identity as an example, and when a plurality of users are identified before the current screen, the display content can be controlled and adjusted by default according to the display proportion corresponding to the user identity of the user closer to the screen, and the display content can also be controlled and adjusted according to the display proportion corresponding to the user identity of the user farther from the screen; the display content can be controlled and adjusted according to the real proportion corresponding to the user identity with smaller or larger display content proportion.
In an optional embodiment, a mapping relation between a user watching distance and a display proportion of screen display content is determined according to recorded historical usage data of different user identity users for different terminals to form a mapping relation table, then the screen display content can be controlled to adapt to the user watching/using different terminal screens with different user identities according to the determined mapping relation, and the display proportion of the display content can be adjusted according to the user identity and the user distance.
In an alternative embodiment, for the formation of the mapping relationship, the mapping relationship table is obtained by determining the corresponding relationship between the screen viewing distance and the display proportion of the display content according to the correlation between the user information and the data acquisition time according to the respectively acquired user screen viewing distance data and the display content data of the screen.
By the control method for screen display, the system can control and adjust the display proportion of the screen display content according to the distance of the user's habit of watching the screen, and the user can separate from a keyboard, a mouse, a case or a screen to realize the control of display, so that the fluency of the whole screen use process of the user is ensured. The control of different users, different terminal screen sizes and different playing proportions of different display contents can be realized on the terminal according to the historical screen use habits of different users.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
Example 2
Embodiments of the present invention also provide a computer readable storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
Alternatively, in the present embodiment, the above-described computer-readable storage medium may be configured to store a computer program for executing the steps of:
S1, acquiring image data, wherein the image data is used for indicating an image in front of a screen;
and S2, adjusting the display state of the display content to a target display state when the image data indicates that the viewing object exists in front of the screen, wherein the target display state is determined according to the current viewing distance between the viewing object and the screen.
Through the steps, the image data are acquired, wherein the image data are used for indicating the images in front of the screen; in the case that the image data indicates that a viewing object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the determining factors of the target display state include: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content can be achieved.
Optionally, the computer readable storage medium is further arranged to store a computer program for performing the steps of:
s1, adjusting the display state of the display content to a target display state according to target display parameters, wherein the target display parameters are determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameters.
Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
Embodiments of the invention also provide an electronic device comprising a memory, the memory 104 of fig. 1 being an example of a memory in the electronic device, the memory having stored therein a computer program, and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, where the transmission device is connected to the processor, and the input/output device is connected to the processor.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
S1, acquiring image data, wherein the image data is used for indicating an image in front of a screen;
and S2, adjusting the display state of the display content to a target display state when the image data indicates that the viewing object exists in front of the screen, wherein the target display state is determined according to the current viewing distance between the viewing object and the screen.
Through the steps, the image data are acquired, wherein the image data are used for indicating the images in front of the screen; in the case that the image data indicates that a viewing object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the determining factors of the target display state include: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content can be achieved.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
s1, adjusting the display state of the display content to a target display state according to target display parameters, wherein the target display parameters are determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameters.
Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
It will be appreciated by those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may alternatively be implemented in program code executable by computing devices, so that they may be stored in a memory device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than that shown or described, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps within them may be fabricated into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (13)
1. The method for adjusting the display content based on the intelligent home operating system is characterized by comprising the following steps of:
acquiring image data, wherein the image data is used for indicating an image in front of a screen;
and adjusting the display state of the display content to a target display state under the condition that the image data indicates that a viewing object exists in front of the screen, wherein the determining factors of the target display state comprise: a current viewing distance between the viewing object and the screen;
before adjusting the display state of the display content to the target display state, the method further comprises the following steps:
determining that a human feature exists before the screen is detected; extracting image information of the detected human body characteristics, and comparing the image information with identity images in family member information stored in the system in advance; determining identity information of the watched object according to the comparison result; acquiring historical viewing data corresponding to the viewing object based on the identity information, so as to determine the mapping relation between the viewing distance and the display parameter through the historical viewing data; determining an adjustment parameter for adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object according to the mapping relation;
Wherein after determining, according to the mapping relationship, an adjustment parameter for adjusting the display state of the display content to a target display state corresponding to the identity information of the viewing object, the method further includes:
determining a content category corresponding to the display content; determining the display proportion of the display content according to the mapping relation table of the content category and the viewing distance; and updating the adjustment parameters by using the display proportion to generate a control instruction for adjusting the display content.
2. The method of claim 1, wherein adjusting the display state of the display content to a target display state comprises:
and adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
3. The method of claim 2, wherein adjusting the display state of the display content to the target display state according to the target display parameter comprises:
and adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and the display parameter.
4. The method of claim 1, further comprising, prior to adjusting the display state of the display content to a target display state:
and under the condition that the identity information of the watching object is determined, determining to adjust the display state of the display content to a target display state corresponding to the identity information of the watching object.
5. The method of claim 1, wherein prior to said determining the mapping of the viewing distance to display parameters based on historical viewing data of the viewing object, the method further comprises:
and determining the historical viewing data of the viewing object from at least one on-screen terminal in the smart home.
6. An adjusting device based on intelligent house operating system's display content, characterized by comprising:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring image data, wherein the image data is used for indicating images in front of a screen;
the adjusting module is used for adjusting the display state of the display content to a target display state under the condition that the image data indicates that a viewing object exists in front of the screen, wherein the determining factors of the target display state comprise: a current viewing distance between the viewing object and the screen;
The apparatus further comprises: the first determining module is used for determining that human body characteristics exist before the screen is detected; extracting image information of the detected human body characteristics, and comparing the image information with identity images in family member information stored in the system in advance; determining identity information of the watched object according to the comparison result;
the apparatus further comprises: the second determining module is used for acquiring historical viewing data corresponding to the viewing object based on the identity information so as to determine the mapping relation between the viewing distance and the display parameter through the historical viewing data; determining an adjustment parameter for adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object according to the mapping relation;
the second determination module further includes: an updating unit, configured to determine a content category corresponding to the display content; determining the display proportion of the display content according to the mapping relation table of the content category and the viewing distance; and updating the adjustment parameters by using the display proportion to generate a control instruction for adjusting the display content.
7. The apparatus of claim 6, wherein the adjustment module comprises:
The first adjusting unit is used for adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current mapping relation between the watching distance and the first mapping relation, and the first mapping relation is used for indicating the mapping relation between the watching distance and the display parameter.
8. The apparatus of claim 7, wherein the first adjustment unit comprises:
and the first adjustment subunit is used for adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and the display parameter.
9. The apparatus of claim 6, wherein the adjustment module further comprises:
and the second adjusting unit is used for determining and adjusting the display state of the display content to a target display state corresponding to the identity information of the viewing object under the condition that the identity information of the viewing object is determined.
10. The apparatus as recited in claim 6, further comprising:
and the third determining module is used for determining the historical viewing data of the viewing object from at least one screen terminal in the smart home before determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
11. A smart home system comprising the smart home operating system-based display content adjustment device according to any one of claims 6 to 10.
12. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program, wherein the computer program is arranged to execute the method of any of the claims 1 to 5 when run.
13. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to run the computer program to perform the method of any of the claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910944554.XA CN110673737B (en) | 2019-09-30 | 2019-09-30 | Display content adjusting method and device based on intelligent home operating system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910944554.XA CN110673737B (en) | 2019-09-30 | 2019-09-30 | Display content adjusting method and device based on intelligent home operating system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110673737A CN110673737A (en) | 2020-01-10 |
| CN110673737B true CN110673737B (en) | 2023-09-15 |
Family
ID=69078759
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910944554.XA Active CN110673737B (en) | 2019-09-30 | 2019-09-30 | Display content adjusting method and device based on intelligent home operating system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110673737B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114691256A (en) * | 2020-12-30 | 2022-07-01 | 星络智能科技有限公司 | Interface configuration method, intelligent panel and computer readable storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001028271A1 (en) * | 1999-10-12 | 2001-04-19 | Taskin Sakarya | Location system for mobile telephones and method of presentation of position |
| EP1280343A2 (en) * | 2001-07-24 | 2003-01-29 | GRUNDIG Aktiengesellschaft | Method and device for operating an electronic navigation system on a display screen |
| CN102216977A (en) * | 2011-06-24 | 2011-10-12 | 华为终端有限公司 | A method for automatically adjusting screen display and a device thereof |
| CN102984588A (en) * | 2011-09-02 | 2013-03-20 | 索尼公司 | Personalized television viewing mode adjustments responsive to facial recognition |
| EP3038061A1 (en) * | 2014-12-23 | 2016-06-29 | Orange | Apparatus and method to display augmented reality data |
| CN107145219A (en) * | 2016-03-01 | 2017-09-08 | 腾讯科技（深圳）有限公司 | A kind of method for showing adjustment and display adjusting apparatus |
| CN107888985A (en) * | 2017-11-28 | 2018-04-06 | 四川长虹电器股份有限公司 | Intelligent television commending system and method based on multi-user |
| CN109358831A (en) * | 2018-10-30 | 2019-02-19 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer readable storage medium |
| CN109683703A (en) * | 2018-10-30 | 2019-04-26 | 努比亚技术有限公司 | A kind of display control method, terminal and computer readable storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4380146B2 (en) * | 2002-11-21 | 2009-12-09 | 日産自動車株式会社 | Map image display device and map image display program |
-
2019
- 2019-09-30 CN CN201910944554.XA patent/CN110673737B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001028271A1 (en) * | 1999-10-12 | 2001-04-19 | Taskin Sakarya | Location system for mobile telephones and method of presentation of position |
| EP1280343A2 (en) * | 2001-07-24 | 2003-01-29 | GRUNDIG Aktiengesellschaft | Method and device for operating an electronic navigation system on a display screen |
| CN102216977A (en) * | 2011-06-24 | 2011-10-12 | 华为终端有限公司 | A method for automatically adjusting screen display and a device thereof |
| CN102984588A (en) * | 2011-09-02 | 2013-03-20 | 索尼公司 | Personalized television viewing mode adjustments responsive to facial recognition |
| EP3038061A1 (en) * | 2014-12-23 | 2016-06-29 | Orange | Apparatus and method to display augmented reality data |
| CN107145219A (en) * | 2016-03-01 | 2017-09-08 | 腾讯科技（深圳）有限公司 | A kind of method for showing adjustment and display adjusting apparatus |
| CN107888985A (en) * | 2017-11-28 | 2018-04-06 | 四川长虹电器股份有限公司 | Intelligent television commending system and method based on multi-user |
| CN109358831A (en) * | 2018-10-30 | 2019-02-19 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer readable storage medium |
| CN109683703A (en) * | 2018-10-30 | 2019-04-26 | 努比亚技术有限公司 | A kind of display control method, terminal and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110673737A (en) | 2020-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3579544B1 (en) | Electronic device for providing quality-customized image and method of controlling the same | |
| WO2019120029A1 (en) | Intelligent screen brightness adjustment method and apparatus, and storage medium and mobile terminal | |
| US9894415B2 (en) | System and method for media experience data | |
| CN110110118B (en) | Dressing recommendation method and device, storage medium and mobile terminal | |
| US11503205B2 (en) | Photographing method and device, and related electronic apparatus | |
| US9798382B2 (en) | Systems and methods of eye tracking data analysis | |
| JP2017211970A (en) | Care information acquisition method, care information sharing method, and electronic device for those methods | |
| KR101725884B1 (en) | Automatic processing of images | |
| CN105574910A (en) | Electronic Device and Method for Providing Filter in Electronic Device | |
| US11115684B2 (en) | System, method, and program for distributing live video | |
| US20140223474A1 (en) | Interactive media systems | |
| US9799099B2 (en) | Systems and methods for automatic image editing | |
| CN107480265B (en) | Data recommendation method, device, equipment and storage medium | |
| US20180330491A1 (en) | Method for synthesizing image and an electronic device using the same | |
| CN108200337B (en) | Photographing processing method, device, terminal and storage medium | |
| CN103546803A (en) | Image processing method, client side and image processing system | |
| US9325754B2 (en) | Information processing device and information processing method | |
| EP3123352B1 (en) | Data sharing method and electronic device thereof | |
| CN112532885B (en) | Anti-shake method and device and electronic equipment | |
| CN113010126A (en) | Display control method, display control device, electronic device, and medium | |
| CN112733619A (en) | Pose adjusting method and device for acquisition equipment, electronic equipment and storage medium | |
| CN110673737B (en) | Display content adjusting method and device based on intelligent home operating system | |
| KR20160016574A (en) | Method and device for providing image | |
| CN103699589A (en) | Information push method and information push device | |
| CN115392332A (en) | AI model deployment method, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |