CN110673737A - Display content adjusting method and device based on smart home operating system - Google Patents
Display content adjusting method and device based on smart home operating system Download PDFInfo
- Publication number
- CN110673737A CN110673737A CN201910944554.XA CN201910944554A CN110673737A CN 110673737 A CN110673737 A CN 110673737A CN 201910944554 A CN201910944554 A CN 201910944554A CN 110673737 A CN110673737 A CN 110673737A
- Authority
- CN
- China
- Prior art keywords
- display
- display state
- viewing
- screen
- adjusting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method and a device for adjusting display content based on an intelligent home operating system, which comprises the steps of obtaining image data, wherein the image data is used for indicating an image in front of a screen; under the condition that the image data indicates that the watching object exists in front of the screen, the display state of the display content is adjusted to the target display state, wherein the determination factor of the target display state comprises the current watching distance between the watching object and the screen, the problem that the adjustment efficiency of the display content in the related technology is low is solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Description
Technical Field
The invention relates to the field of communication, in particular to a method and a device for adjusting display content based on an intelligent home operating system.
Background
In the related art, some smart home devices often implement information interaction with users through screens, and when a user operates the devices, the user needs to actively operate the screens or operate keys to adjust screen display.
Disclosure of Invention
The embodiment of the invention provides a method and a device for adjusting display content based on an intelligent home operating system, which are used for at least solving the problem of low adjustment efficiency of the display content in the related art.
According to an embodiment of the invention, a method for adjusting display content based on an intelligent home operating system is provided, which includes:
acquiring image data, wherein the image data is used for indicating an image in front of a screen;
in a case where the image data indicates that a viewing object exists in front of the screen, adjusting a display state of the display content to a target display state, wherein a determination factor of the target display state includes: a current viewing distance between the viewing object and the screen.
Optionally, adjusting the display state of the display content to a target display state, where the target display state is determined according to a current viewing distance between the viewing object and the screen, includes: and adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
Optionally, adjusting the display state of the display content to a target display state according to the target display parameter includes: and adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and display parameter.
Optionally, before adjusting the display state of the display content to the target display state, the method further includes:
determining identity information of the viewing object;
adjusting the display state of the display content to a target display state, including:
and adjusting the display state of the display content to a target display state corresponding to the identity information of the viewing object.
Optionally, the mapping relationship is determined by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
Optionally, before the determining the mapping relationship between the viewing distance and the display parameter according to the historical viewing data of the viewing object, the method further includes: and determining the historical viewing data of the viewing object from at least one terminal with a screen in the smart home.
According to another embodiment of the present invention, there is also provided an apparatus for adjusting display content based on a smart home operating system, including:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring image data, and the image data is used for indicating an image in front of a screen;
an adjusting module, configured to adjust a display state of the display content to a target display state when the image data indicates that a viewing object exists in front of the screen, where a determination factor of the target display state includes: a current viewing distance between the viewing object and the screen.
Optionally, the adjusting module includes: the first adjusting unit is configured to adjust the display state of the display content to a target display state according to a target display parameter, where the target display parameter is determined according to the current viewing distance and a first mapping relationship, and the first mapping relationship is used to indicate a mapping relationship between the viewing distance and the display parameter.
Optionally, the first adjusting unit includes: the first adjusting subunit is configured to adjust the display state of the designated display content to the target display state according to a target display parameter, where the first mapping relationship is further configured to indicate a mapping relationship between the display content and the viewing distance and display parameter.
Optionally, the method further comprises: a first determining module, configured to determine identity information of the viewing object before adjusting the display state of the display content to a target display state;
the adjustment module further comprises: and the second adjusting unit is used for adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object.
Optionally, the method further comprises: a second determining module, configured to determine the mapping relationship by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
Optionally, the method further comprises: and the third determining module is used for determining the historical viewing data of the viewing object from at least one screen-equipped terminal in the smart home before determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
According to another embodiment of the invention, the smart home system is characterized by comprising any one of the above adjusting devices for display content based on the smart home operating system.
According to a further embodiment of the present invention, a computer-readable storage medium is also provided, in which a computer program is stored, wherein the computer program is configured to carry out the steps of any of the above-described method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
According to the embodiment of the invention, the image data is acquired, wherein the image data is used for indicating the image in front of the screen; in the case that the image data indicates that the viewing object exists in front of the screen, the display state of the display content is adjusted to a target display state, wherein the target display state is determined according to the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted according to the current viewing distance between the viewing object and the screen, and therefore, the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware structure of a mobile terminal according to an embodiment of the present invention, wherein the mobile terminal is based on a method for adjusting display content of a smart home operating system;
fig. 2 is a flowchart of a method for adjusting display content based on an intelligent home operating system according to an embodiment of the present invention;
fig. 3 is a block diagram of a device for adjusting display content based on an operating system of a smart home according to an embodiment of the present invention;
fig. 4 is a flowchart of a method for adjusting display content based on an operating system of a smart home according to an alternative embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
Example 1
The method provided by the first embodiment of the application can be executed in smart home equipment or similar operation devices. Taking an example of the method running on the smart home device, fig. 1 is a block diagram of a hardware structure of a mobile terminal of an adjusting method of display content based on a smart home operating system according to an embodiment of the present invention. As shown in fig. 1, the smart home device 10 may include one or more processors 102 (only one is shown in fig. 1) (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally, the smart home device may further include a transmission device 106 for communication function and an input/output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration, and does not limit the structure of the smart home device. For example, the smart home device 10 may also include more or fewer components than shown in fig. 1, or have a different configuration than shown in fig. 1.
The memory 104 may be configured to store a computer program, for example, a software program and a module of an application software, such as a computer program corresponding to the method for adjusting display content based on the smart home operating system in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely located from the processor 102, and these remote memories may be connected to the smart home devices 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the smart home device 10. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In this embodiment, a method for adjusting display content running on a smart home device is provided, and fig. 2 is a flowchart of a method for adjusting display content based on a smart home operating system according to an embodiment of the present invention, and as shown in fig. 2, the flowchart includes the following steps:
step S202, image data is obtained, wherein the image data is used for indicating an image in front of a screen;
step S204, under the condition that the image data indicates that the watching object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the determination factors of the target display state comprise: the current viewing distance between the viewing object and the screen.
Through the steps, image data are obtained, wherein the image data are used for indicating images in front of a screen; in the case where the image data indicates that the viewing object exists in front of the screen, adjusting a display state of the display content to a target display state, wherein a determination factor of the target display state includes: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Optionally, the executing subject of the above steps may be a smart home device, etc., but is not limited thereto.
It should be noted that, acquiring the image data may refer to acquiring the image data through a camera arranged on the smart home device, for example, acquiring an image in a certain area in front of a screen. The collected image data can be processed by a processor arranged in the intelligent home device, so that whether a watching object is arranged in front of the screen or not is identified, for example, whether an object with human body characteristics appears in the image data or not is identified, and if the watching object is identified to be arranged in the image data, the intelligent home device can adjust the display state of the display content according to the current watching distance between the watching object and the screen. In an optional implementation manner, the acquired image data may also be sent to a server for processing, that is, the server identifies whether the image data has a viewing object, then the server sends the identification result to the smart home device, and the smart home device adjusts the display state of the display content according to the current viewing distance between the viewing object and the screen.
It should be further noted that, adjusting the display state of the display content to the target display state may refer to adjusting the degree of saliency of the display content, where the degree of saliency of the display content after adjustment may be higher than the degree of saliency of the display content before adjustment; in addition, the larger the current viewing distance, the higher the degree of prominence of the adjusted display content.
It should be noted that the target display state of the display content may also be determined according to the viewing time or the viewing time and the viewing distance of the user (i.e., the viewing object).
In an alternative embodiment, the adjustment mode may be: adjusting the display scale of all or part of the display content and/or adjusting the display color parameters of all or part of the display content, wherein the display color parameters may include color saturation, brightness, contrast, and the like. The following are exemplified: in an alternative embodiment, the display scale of a webpage, a text, a character, an image or a video can be adjusted; for example, the display scale of a certain web page is adjusted, or the size of a display area occupied by a video displayed in a local area of a certain web page may be adjusted, for example, the display area occupied by the video is increased; as another example, the size of the text in the display area is adjusted. And the display color parameters such as the display brightness of a webpage, a text, a character, an image or a video can be adjusted. The above adjustment methods are only examples, and any adjustment method capable of adjusting the degree of significance of the display content should be included in the protection scope of the present invention, and will not be described herein again.
It should be further noted that the viewing distance between the viewing object and the screen can be determined by: for example, a processor in the smart home device analyzes the acquired image data, compares size change differences of local images of a human body in the acquired image data to determine a viewing distance, and for example, may compare size change differences of facial images in the acquired image data to determine a viewing distance; or the collected image data can also be sent to a server for analysis, the server compares the size change difference of the human body local image in the collected image data to determine the viewing distance, for example, the size change difference of the human face image in the collected image data can be compared to determine the viewing distance, and then the viewing distance is sent to the intelligent home equipment, and in addition, the distance between the viewing object and the screen, namely the viewing distance, can also be measured according to the infrared sensor.
In an alternative embodiment, adjusting a display state of the display content to a target display state, wherein the target display state is determined according to a viewing distance between the viewing object and the screen, includes: and adjusting the display state of the display content to a target display state according to the target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
It should be noted that the target parameter may be set by the smart home device itself, or may be set by the server and then sent to the smart home device. The target parameter may be a direct specific adjustment parameter corresponding to the target display state, such as a display ratio of 110%, a display brightness of 80%, and the like.
In an optional embodiment, adjusting the display state of the display content to the target display state according to the target display parameter includes: and adjusting the display state of the designated display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and the display parameter.
It should be noted that the specific display content may be a specific type of display content, such as a web page, text, image, or video. The first mapping relationship may also be preset, and for example, the first mapping relationship may be set according to the best viewing effect of human eyes.
In an optional implementation manner, before adjusting the display state of the display content to the target display state, the method further includes: determining identity information of a viewing object;
adjusting the display state of the display content to a target display state, comprising: and adjusting the display state of the display content to a target display state corresponding to the identity information of the viewing object.
In an alternative embodiment, the mapping relationship is determined by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
It should be noted that the historical viewing data of the viewing object may include the historical viewing distance of the viewing object and the historical display parameter corresponding to the historical viewing distance, or may include the historical viewing distance of the viewing object, the historical display parameter corresponding to the historical viewing distance, and the adjustment object (i.e., the display content) corresponding to the historical display parameter. In addition, the identity of the viewing object in front of the screen can be determined, and then the historical viewing data of the viewing object can be determined according to the identity of the viewing object.
In an optional embodiment, before the determining the mapping relationship between the viewing distance and the display parameter according to the historical viewing data of the viewing object, the method further includes: and determining the historical viewing data of the viewing object from at least one terminal with a screen in the smart home.
The present embodiment further provides a device for adjusting display content based on an operating system of a smart home, where the device is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated after the description is given. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 3 is a block diagram of a structure of an apparatus for adjusting display content based on a smart home operating system according to an embodiment of the present invention, as shown in fig. 3, the apparatus includes:
an obtaining module 31, configured to obtain image data, where the image data is used to indicate an image in front of a screen;
an adjusting module 33, configured to adjust a display state of the display content to a target display state when the image data indicates that the viewing object exists in front of the screen, where a determination factor of the target display state includes: is the current viewing distance between the viewing object and the screen.
By the module, image data are acquired, wherein the image data are used for indicating an image in front of a screen; in the case where the image data indicates that the viewing object exists in front of the screen, adjusting a display state of the display content to a target display state, wherein a determination factor of the target display state includes: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
In one embodiment, an adjustment module, comprising: the display device comprises a first adjusting unit and a second adjusting unit, wherein the first adjusting unit is used for adjusting the display state of the display content to a target display state according to a target display parameter, the target display parameter is determined according to a current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
In one embodiment, the first adjusting unit includes: and the first adjusting subunit is used for adjusting the display state of the designated display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation among the display content, the viewing distance and the display parameter.
In one embodiment, the apparatus further comprises: the first determining module is used for determining the identity information of the watching object before adjusting the display state of the display content to the target display state;
the adjustment module further comprises: and the second adjusting unit is used for adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object.
In one embodiment, further comprising: a second determining module, configured to determine the mapping relationship by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
In one embodiment, further comprising: and the third determining module is used for determining the historical viewing data of the viewing object from at least one screen-equipped terminal in the smart home before determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
By the module and the unit, image data are obtained, wherein the image data are used for indicating an image in front of a screen; in the case that the image data indicates that the viewing object exists in front of the screen, the display state of the display content is adjusted to a target display state, wherein the target display state is determined according to the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted according to the current viewing distance between the viewing object and the screen, and therefore, the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Alternative embodiments
The following further explains the embodiments of the present invention with reference to specific scenarios:
the embodiment of the invention provides a method for adjusting the display proportion of display contents according to the historical behaviors of display screens of different user operation terminals and the real-time position distance value between a user and the display screens. According to the embodiment of the invention, the screen display contents of the terminals such as the computer, the smart television and the mobile phone can be reduced and amplified according to the habits of the screen viewing of different users and the real-time screen viewing distance, so that a good and comfortable experience effect can be ensured when the users use the viewing screen contents, the hands of the users are liberated, and the independent control of the display contents is realized.
The equipment mentioned in the embodiment of the invention mainly refers to equipment for realizing information output through a screen, such as an intelligent television, a notebook computer, a tablet computer, a mobile phone and the like. The devices can store the usage data of the device on the memory of the devices and process the usage data through the processors of the devices; the devices can upload the use data of the devices to the cloud server through the router for storage and processing, and can also receive control of the cloud server. These devices are the core devices of the smart home system, and are responsible for the main information output work in the whole system.
Fig. 4 is a flowchart of a method for adjusting display content based on a smart home operating system according to an optional embodiment of the present invention, and as shown in fig. 4, the method mainly includes the following steps:
step 1, when the intelligent household equipment is in a starting state, acquiring real-time image data in front of a screen, and uploading the real-time image data to a cloud server for storage and processing; the method comprises the steps that image data of a screen used by a user can be obtained through a camera installed on the intelligent home device, whether the identity information of the user and the identity information of the user exist in front of the screen or not can be determined through the obtained image, and it needs to be stated that real-time image data in front of the screen can also be collected through an independent camera;
step 2, after receiving the image data in front of the screen, the cloud server judges whether a user watches the image data in front of the screen of the intelligent household equipment or not according to the image data, and if yes, the next step is executed; if not, ending the flow;
it should be noted that, for all smart home devices, when a user views screen content or inputs information or instructions through a screen, for example, when touching the screen, the smart home devices are located in a certain area in front of the screen. The "presence of user viewing" may refer to the presence of a user in an area in front of the screen, and may also refer to the presence of a user in an area in front of the screen and the eyes of the user looking at the screen of the terminal device.
In an optional embodiment, the determination of whether the user uses/watches the screen content in front of the screen may be implemented by detecting whether the human body features exist in the area in front of the screen in the image data. The human body detection method used in the embodiment of the invention comprises the following steps: a method based on human body contour shape and a method based on human body features.
In an optional embodiment, since eyes of a user change with different screen viewing regions when the user views a screen, it may be determined whether the user's eyes watch the screen of the smart home device by capturing an image of the eyes of the user and then analyzing a change in positions of pupils and/or irises in the image of the eyes, so as to determine whether the user's eyes watch the screen of the smart home device, thereby determining whether the user existing in the current image is operating the screen.
Step 3, identity information of a user using the screen is determined, and user historical screen use data of the corresponding user identity on the intelligent household equipment is obtained from historical screen use data of a plurality of intelligent household equipment terminals and a plurality of user identities in a family according to the determined user identity information, wherein the use data comprises distance data and display data;
it should be noted that the identity information of the user who is currently viewing/using the screen can be obtained by: and when the human body characteristics exist in front of the screen, further extracting the image information of the detected human body, and comparing the image information with the identity image in the family member information stored in the system in advance to determine the identity information of the user who watches/uses the screen currently.
In the embodiment of the invention, the user capable of operating the screen of the intelligent household equipment can comprise a plurality of user identities, and users with different user identities form a group of screen use data; meanwhile, the screens of the intelligent household equipment, which can be operated and used by the user with the same user identity in the intelligent home, can also comprise a plurality of screens, so that a certain user can form a plurality of groups of screen use data for the use of the screens of different intelligent household equipment.
When the intelligent family system is established, the system can acquire information of all family members, including identity information, authority information, image information and the like. When the intelligent home system is established, the system can uniformly collect front whole-body photos of all the family members and/or facial photos of the family members, and the like.
After the intelligent home system is established, the system can also collect and record the service condition data of the intelligent home equipment of the family members in real time. The intelligent home equipment is provided with a user identity recognition function, so that the display proportion of different users to the screen display contents of different intelligent home equipment can be identified. The content that the screen displays output to the user may include text, graphics, video, and any combination thereof.
Therefore, the system can record the display proportion of the content displayed by the user operating different intelligent household devices.
Specifically, for example, the display data of the screen may be as follows in table 1:
| device name | User identity | Length of use | Display categories | Display scale |
| Computer with a display | User 1 | 10：00-10：30 | Text | 110％ |
| Computer with a display | User 1 | 10：31-10：40 | Text | 90％ |
| Television receiver | User 2 | 10：00-10：15 | Video | 120％ |
| Computer with a display | User 2 | 11：02-11：10 | Web page | 100％ |
TABLE 1
In an alternative embodiment, the display data of the user operation screen may also be stored in other storage forms, for example, separately stored according to the user identity and separately stored according to the name of the smart device, as shown in the following tables 2 and 3.
| User identity | Device name | Length of use | Display categories | Display scale |
| User 1 | Computer with a display | 10：00-10：30 | Text | 110％ |
| User 1 | Television receiver | 10：00-10：15 | Video | 120％ |
| User 1 | Computer with a display | 11：02-11：10 | Web page | 100％ |
Table 2: (take user 1 as an example)
| Device name | User identity | Length of use | Display categories | Display scale |
| Computer with a display | User 1 | 10：00-10：30 | Text | 110％ |
| Computer with a display | User 2 | 10：00-10：15 | Video | 100％ |
| Computer with a display | User 3 | 11：02-11：10 | Web page | 90％ |
Table 3: (taking a computer as an example)
In an optional implementation mode, for the screen viewing distance data, the distance data can be detected through an infrared sensor arranged on the intelligent household equipment, the infrared sensor can emit infrared rays, and the distance between a user and a screen is determined according to the time for emitting the infrared rays and the time difference for receiving the infrared rays reflected by the human body by utilizing the characteristic of low refractive index of the infrared rays. Of course, for the device without the infrared sensor in the system, the image acquisition can be performed through the camera arranged on the device, and the determination of the viewing distance can be realized by comparing the size change difference of the human face in the acquired image.
The system will record the user's screen viewing distance in terms of time periods, as shown in table 4 below: (similarly, the screen viewing distance data may be stored in the form of reference to screen display data, or stored according to the user identity, or stored according to the name of the intelligent terminal device)
| User identity | Device name | Length of use | Viewing distance |
| User 1 | Computer with a display | 10：00-10：30 | 25-30cm |
| User 1 | Computer with a display | 10：31-10：40 | 20-25cm |
| User 2 | Television receiver | 10：00-10：15 | 200cm-220cm |
| User 2 | Computer with a display | 11：02-11：10 | 28-30cm |
TABLE 4
Thus, the display data and the distance data of the screen can constitute the screen use data of the user according to the identity information of the user.
In the above tables 1 and 4, for convenience of embodiment description, examples are made according to the same time node, which cannot be used to define the scheme protection content, and in practical applications, the time nodes and time intervals in tables 1 and 4 may not be completely the same, and it is unlikely that the time periods for users to maintain the same viewing distance and the same display scale are the same.
After the identity information of the user is determined, historical use data of the user on the screen can be obtained according to the identity information of the user, and for the historical data, data within a period of time closest to the current time node can be selected only in consideration of the data operation load of the system, for example, 5 days, 1 week or half a month and the like.
Step 4, determining a mapping relation between the screen display proportion and the use distance of the intelligent terminal currently operated by the user identity according to the acquired display data and the distance data of the same user identity, and generating a mapping relation table;
taking the example data in tables 1 and 2 as an example, user 1 is at 10: when the computer equipment is used at a speed of 00-10:30, the using distance is 25-30cm, and the display proportion of the text content is 110%. Then the mapping relationship between the content display scale and the use distance when the user 1 uses the computer can be expressed as (25-30cm, 110%). Similarly, for the user 2, still taking the data illustrated in table 1 and table 2 as an example, it can be uniquely determined that there is a mapping relationship (28-30cm, 100%) between the distance and the display scale when the user 2 outputs the web page content to the computer screen. In the same way, the system determines the mapping relationship between the viewing distance and the display scale of all the users in the intelligent family members for all the screen devices to generate a mapping relationship table.
Step 5, obtaining the watching distance from the current user of the user identity to the screen;
an infrared sensor or a camera can be used to obtain the distance between the user and the watching screen. For a user, different smart home devices have different screen sizes, and therefore, the same user may use different smart home devices differently, for example, a smart tv generally has a larger display screen, and thus the user may not need a large display scale when viewing content through the screen. However, since the notebook computer generally has a relatively small display screen due to the requirement of portability, a user may need to enlarge a display scale of the displayed content when viewing the content through the screen.
Therefore, the display proportion of the display content suitable for the user at present can be quickly determined by monitoring the real-time distance between the user and the watching screen and according to the relation between the distance in the historical use data of the user and the display proportion. In the intelligent home operation system, the intelligent home equipment can upload the current operation data of the equipment in real time, and the system can acquire the name, display content, operation state and the like of the equipment according to the uploaded data.
Step 6, acquiring the category of the display content, and generating an adjustment control instruction of the screen display content according to the mapping relation table of the display content and the distance;
after the system obtains the real-time viewing distance between the user and the screen, it is further required to determine the category of the content that the user needs to output through the screen, that is, the category of the content displayed on the screen, and generally, the display content can be divided into: text content, video animation content, picture content, web page content. The type of the displayed content can be directly determined by the format of the currently displayed content of the intelligent terminal equipment, such as a video file, a picture file and the like.
After the category of the display content is confirmed, the display proportion of the content which is required to be displayed by the user currently can be determined according to the generated mapping relation table of the user viewing distance and the display content, so that a display proportion adjusting control instruction of the screen display content is generated. After the intelligent household equipment receives the control instruction, the display scale of the display screen is controlled and adjusted.
For example, still taking the user data as exemplified in tables 1 and 2 as an example, by executing step 5 to determine that the viewing distance from the user 1 to the computer screen is 26cm, and at the same time, by executing step 6 to determine that the type of the display content to be output in the computer screen used by the user 1 is the text content type, then according to the mapping relationship table generated in step 4, it can be clearly determined that the display ratio of the current display content of the user 1 should be 110%. Thus, the system generates a control command for adjusting the display scale of the current display content displayed on the screen of the computer 1 to 110%.
And 7, the screen receives a control instruction issued by the server through the home gateway, and adjusts and outputs the display proportion of the display content.
In an optional implementation manner, the cloud server in the smart home system can issue the control command to the smart home devices in the smart home only through the home gateway, and the smart home devices control and adjust the display ratio of the screen display content after receiving the control command. The home gateway may be a router device.
The above mainly takes the user who is currently watching or using the screen as one user identity as an example, when a plurality of users are identified before the current screen, the display content can be controlled and adjusted by default according to the display proportion corresponding to the user identity of the user who is closer to the screen, and the display content can be controlled and adjusted according to the display proportion corresponding to the user identity of the user who is farther from the screen; the display content can be controlled and adjusted according to the actual proportion corresponding to the user identity with the smaller or larger display content proportion.
In an optional implementation manner, according to the recorded historical screen usage data of the users with different user identities for different terminals, a mapping relation between the viewing distance of the user and the display proportion of the screen display content is determined, a mapping relation table is formed, then according to the determined mapping relation, the screen display content can be controlled to adapt to the users with different user identities to view/use different terminal screens, and the display proportion of the display content can be changed and adjusted according to the user identities and the user distances.
In an optional embodiment, for the formation of the mapping relationship, the corresponding relationship between the screen viewing distance and the display scale of the display content may be determined according to the correlation between the user information and the data acquisition time, based on the acquired user screen viewing distance data and the acquired display content data of the screen, respectively, so as to obtain the mapping relationship table.
By the screen display control method provided by the embodiment of the invention, the system can control and adjust the display proportion of the screen display content according to the habit viewing screen distance of the user, the user can separate from a keyboard, a mouse, a case or a screen to realize the control of the display, and the fluency of the whole screen using process of the user is ensured. The control of different users, different terminal screen sizes and different play proportions of different display contents can be realized on the terminal according to the historical screen use habits of different users.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Example 2
Embodiments of the present invention also provide a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to perform the steps of any of the above-mentioned method embodiments when executed.
Alternatively, in the present embodiment, the above-mentioned computer-readable storage medium may be configured to store a computer program for executing the steps of:
s1, acquiring image data, wherein the image data is used for indicating an image in front of a screen;
s2, in a case where the image data indicates that the viewing object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the target display state is determined according to a current viewing distance between the viewing object and the screen.
Through the steps, image data are obtained, wherein the image data are used for indicating images in front of a screen; in the case where the image data indicates that the viewing object exists in front of the screen, adjusting a display state of the display content to a target display state, wherein a determination factor of the target display state includes: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Optionally, the computer-readable storage medium is further arranged to store a computer program for performing the steps of:
and S1, adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention also provide an electronic device comprising a memory and a processor, the memory 104 in fig. 1 being taken as an example of a type of memory in the electronic device, the memory having stored therein a computer program, the processor being configured to execute the computer program to perform the steps in any of the above-described method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring image data, wherein the image data is used for indicating an image in front of a screen;
s2, in a case where the image data indicates that the viewing object exists in front of the screen, adjusting the display state of the display content to a target display state, wherein the target display state is determined according to a current viewing distance between the viewing object and the screen.
Through the steps, image data are obtained, wherein the image data are used for indicating images in front of a screen; in the case where the image data indicates that the viewing object exists in front of the screen, adjusting a display state of the display content to a target display state, wherein a determination factor of the target display state includes: the current viewing distance between the viewing object and the screen, that is, the display state of the display content can be adjusted at least according to the current viewing distance between the viewing object and the screen, so that the problem of low adjustment efficiency of the display content in the related art can be solved, and the effect of improving the adjustment efficiency of the display content is achieved.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
and S1, adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (15)
1. A method for adjusting display content based on an intelligent home operating system is characterized by comprising the following steps:
acquiring image data, wherein the image data is used for indicating an image in front of a screen;
in a case where the image data indicates that a viewing object exists in front of the screen, adjusting a display state of the display content to a target display state, wherein a determination factor of the target display state includes: a current viewing distance between the viewing object and the screen.
2. The method of claim 1, wherein adjusting the display state of the display content to a target display state comprises:
and adjusting the display state of the display content to a target display state according to a target display parameter, wherein the target display parameter is determined according to the current viewing distance and a first mapping relation, and the first mapping relation is used for indicating the mapping relation between the viewing distance and the display parameter.
3. The method of claim 2, wherein adjusting the display state of the display content to a target display state according to a target display parameter comprises:
and adjusting the display state of the appointed display content to the target display state according to the target display parameter, wherein the first mapping relation is also used for indicating the mapping relation between the display content and the viewing distance and display parameter.
4. The method of claim 1, further comprising, prior to adjusting the display state of the display content to a target display state:
determining identity information of the viewing object;
adjusting the display state of the display content to a target display state, including:
and adjusting the display state of the display content to a target display state corresponding to the identity information of the viewing object.
5. The method according to any one of claims 2 to 4, wherein the mapping relationship is determined by:
and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
6. The method of claim 5, wherein prior to said determining a mapping of said viewing distance to a display parameter from historical viewing data of said viewing object, said method further comprises:
and determining the historical viewing data of the viewing object from at least one terminal with a screen in the smart home.
7. The utility model provides an adjusting device of display content based on intelligence house operating system which characterized in that includes:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring image data, and the image data is used for indicating an image in front of a screen;
an adjusting module, configured to adjust a display state of the display content to a target display state when the image data indicates that a viewing object exists in front of the screen, where a determination factor of the target display state includes: a current viewing distance between the viewing object and the screen.
8. The apparatus of claim 7, wherein the adjustment module comprises:
the first adjusting unit is configured to adjust the display state of the display content to a target display state according to a target display parameter, where the target display parameter is determined according to the current viewing distance and a first mapping relationship, and the first mapping relationship is used to indicate a mapping relationship between the viewing distance and the display parameter.
9. The apparatus of claim 8, wherein the first adjusting unit comprises:
the first adjusting subunit is configured to adjust the display state of the designated display content to the target display state according to a target display parameter, where the first mapping relationship is further configured to indicate a mapping relationship between the display content and the viewing distance and display parameter.
10. The apparatus of claim 7, further comprising:
a first determining module, configured to determine identity information of the viewing object before adjusting the display state of the display content to a target display state;
the adjustment module further comprises:
and the second adjusting unit is used for adjusting the display state of the display content to a target display state corresponding to the identity information of the watching object.
11. The apparatus of any one of claims 7 to 10, further comprising:
a second determining module, configured to determine the mapping relationship by: and determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
12. The apparatus of claim 11, further comprising:
and the third determining module is used for determining the historical viewing data of the viewing object from at least one terminal with a screen in the smart home before determining the mapping relation between the viewing distance and the display parameter according to the historical viewing data of the viewing object.
13. An intelligent home system, characterized by comprising the display content adjusting device based on the intelligent home operating system according to any one of claims 7 to 12.
14. A computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to carry out the method of any one of claims 1 to 6 when executed.
15. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910944554.XA CN110673737B (en) | 2019-09-30 | 2019-09-30 | Display content adjusting method and device based on intelligent home operating system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910944554.XA CN110673737B (en) | 2019-09-30 | 2019-09-30 | Display content adjusting method and device based on intelligent home operating system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110673737A true CN110673737A (en) | 2020-01-10 |
| CN110673737B CN110673737B (en) | 2023-09-15 |
Family
ID=69078759
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910944554.XA Active CN110673737B (en) | 2019-09-30 | 2019-09-30 | Display content adjusting method and device based on intelligent home operating system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110673737B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114691256A (en) * | 2020-12-30 | 2022-07-01 | 星络智能科技有限公司 | Interface configuration method, intelligent panel and computer readable storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001028271A1 (en) * | 1999-10-12 | 2001-04-19 | Taskin Sakarya | Location system for mobile telephones and method of presentation of position |
| EP1280343A2 (en) * | 2001-07-24 | 2003-01-29 | GRUNDIG Aktiengesellschaft | Method and device for operating an electronic navigation system on a display screen |
| US20040102897A1 (en) * | 2002-11-21 | 2004-05-27 | Nissan Motor Co., Ltd. | Map image display apparatus, map image display program, and map image display method |
| CN102216977A (en) * | 2011-06-24 | 2011-10-12 | 华为终端有限公司 | A method for automatically adjusting screen display and a device thereof |
| CN102984588A (en) * | 2011-09-02 | 2013-03-20 | 索尼公司 | Personalized television viewing mode adjustments responsive to facial recognition |
| EP3038061A1 (en) * | 2014-12-23 | 2016-06-29 | Orange | Apparatus and method to display augmented reality data |
| CN107145219A (en) * | 2016-03-01 | 2017-09-08 | 腾讯科技（深圳）有限公司 | A kind of method for showing adjustment and display adjusting apparatus |
| CN107888985A (en) * | 2017-11-28 | 2018-04-06 | 四川长虹电器股份有限公司 | Intelligent television commending system and method based on multi-user |
| CN109358831A (en) * | 2018-10-30 | 2019-02-19 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer readable storage medium |
| CN109683703A (en) * | 2018-10-30 | 2019-04-26 | 努比亚技术有限公司 | A kind of display control method, terminal and computer readable storage medium |
-
2019
- 2019-09-30 CN CN201910944554.XA patent/CN110673737B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001028271A1 (en) * | 1999-10-12 | 2001-04-19 | Taskin Sakarya | Location system for mobile telephones and method of presentation of position |
| EP1280343A2 (en) * | 2001-07-24 | 2003-01-29 | GRUNDIG Aktiengesellschaft | Method and device for operating an electronic navigation system on a display screen |
| US20040102897A1 (en) * | 2002-11-21 | 2004-05-27 | Nissan Motor Co., Ltd. | Map image display apparatus, map image display program, and map image display method |
| CN102216977A (en) * | 2011-06-24 | 2011-10-12 | 华为终端有限公司 | A method for automatically adjusting screen display and a device thereof |
| CN102984588A (en) * | 2011-09-02 | 2013-03-20 | 索尼公司 | Personalized television viewing mode adjustments responsive to facial recognition |
| EP3038061A1 (en) * | 2014-12-23 | 2016-06-29 | Orange | Apparatus and method to display augmented reality data |
| CN107145219A (en) * | 2016-03-01 | 2017-09-08 | 腾讯科技（深圳）有限公司 | A kind of method for showing adjustment and display adjusting apparatus |
| CN107888985A (en) * | 2017-11-28 | 2018-04-06 | 四川长虹电器股份有限公司 | Intelligent television commending system and method based on multi-user |
| CN109358831A (en) * | 2018-10-30 | 2019-02-19 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer readable storage medium |
| CN109683703A (en) * | 2018-10-30 | 2019-04-26 | 努比亚技术有限公司 | A kind of display control method, terminal and computer readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114691256A (en) * | 2020-12-30 | 2022-07-01 | 星络智能科技有限公司 | Interface configuration method, intelligent panel and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110673737B (en) | 2023-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109922355B (en) | Live virtual image broadcasting method, live virtual image broadcasting device and electronic equipment | |
| US9894415B2 (en) | System and method for media experience data | |
| JP2017211970A (en) | Care information acquisition method, care information sharing method, and electronic device for those methods | |
| CN105574910A (en) | Electronic Device and Method for Providing Filter in Electronic Device | |
| CN104202718A (en) | Method and device for providing information for user | |
| TWI594203B (en) | Systems, machine readable storage mediums and methods for collaborative media gathering | |
| US20140223474A1 (en) | Interactive media systems | |
| CN108200337B (en) | Photographing processing method, device, terminal and storage medium | |
| CN109783686A (en) | Behavioral data processing method, device, terminal device and storage medium | |
| CN108781262B (en) | Method for synthesizing image and electronic device using the same | |
| CN103546803A (en) | Image processing method, client side and image processing system | |
| EP3328041A1 (en) | Clothes matching recommendation method and smart terminal | |
| CN108876751A (en) | Image processing method, device, storage medium and terminal | |
| JP2020119156A (en) | Avatar creating system, avatar creating device, server device, avatar creating method and program | |
| US20220179713A1 (en) | Ai processing method and apparatus | |
| CN105007415B (en) | A kind of image preview method and apparatus | |
| CN112492297A (en) | Video processing method and related equipment | |
| CN103699589A (en) | Information push method and information push device | |
| CN110673737B (en) | Display content adjusting method and device based on intelligent home operating system | |
| CN110062183A (en) | Obtain method, apparatus, server, storage medium and the system of feed data | |
| CN109769130A (en) | Remote controler customized setting method and system based on rating big data | |
| CN105979331A (en) | Smart television data recommend method and device | |
| CN105635171A (en) | Shared equipment with management and control function based on identity recognition and management and control method thereof | |
| CN107786896A (en) | Method for pushing, device, terminal device and the storage medium of information | |
| CN112804273B (en) | Multimedia content recommendation and interaction system and method under ubiquitous scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |