CN115516868A - Capability-based content presentation in multiple devices - Google Patents

Abstract

A method, system (130) and user device (140) for capability-based content presentation are disclosed that eliminate the need for human intervention to set and retrieve previous user contexts to enable users to enjoy a seamless continuity experience. The present invention provides a content classification mechanism, an easy-to-synchronize storage mechanism, a user device (140) capability publishing mechanism, a pattern discovery mechanism, and a capability-based heterogeneous user information presentation mechanism to provide seamless continuous multi-device experience. The method comprises the following steps: determining (S121) new resource consumption information of the user in the current user mode; classifying (S122) the consumption information into classified consumption information; storing (S123) the classified resource consumption information in a local memory; detecting (S124) whether a target user device is present, whether a cloud database is present, or a combination thereof; monitoring (S125) for a request to switch from the current user mode to a new user mode; synchronizing (S126) the categorized resource consumption information onto the target user equipment.

Description

Capability-based content presentation in multiple devices

Related Application Cross Reference

This application claims the benefit of the Indian Patent Application No. IN202031018775, titled "CAPABILITY BASED CONTENT RENDERING IN MULTI-DEVICE", filed on May 1, 2020, all of which The contents are incorporated by reference in this application.

technical field

The present invention relates generally to content presentation in multiple communication devices, and more particularly to a method, system and user equipment for capability-based content presentation.

Background technique

The emergence of smartphone technology and the Internet of Things (IoT), interconnection, cloud infrastructure, health business models, etc. have led to users now having multiple user devices (or communication devices) that perform multiple functions. In order to achieve seamless User experience, current user information must be maintained and updated in real time on all such user devices. Specifically, in order to meet the increasing demands brought about by the growth of mobile phone capabilities and mobility, navigation devices, embedded devices, wearable fitness devices, etc. are developed, which provide a large number of features and functions in addition to core applications .

With the increasing popularity of wireless networks and broadband access, users often expect seamless mobility from their electronic devices. Thus, as users' reliance on multiple devices intensifies, so does the need for simpler mechanisms for interacting with electronic devices, and cumbersome interfaces that prevent quick, focused interaction between one or more user devices become a significant concern. Yet the growing need for mechanisms to use technology in an intuitive way remains largely unmet.

Existing systems fail to provide user experience over time, across multiple users, and across multiple devices (mobile, wearable, and web-based) and applications (social channels, consumer apps, third-party apps) , user health apps, etc.) for seamless continuity and full integration.

Furthermore, these existing systems are not structurally centralized, independent fully integrated systems for storing different types of user-related information and for sharing such different user-related information with multiple user devices through multiple channels. Existing systems may also place limitations on the types of content that can be stored but may not fully support dynamic data that can be manually or automatically modified by the system in response to external events.

Users communicate using various devices such as mobile phones, computers, tablets, laptops, consume media using various applications such as Gmail, Skype, WhatsApp, Google Hangouts, Facebook, Music App's, YouTube, Instagram, Twitter, and use fitness Several wearable devices such as smart watches track their fitness levels. However, these applications (even if present on a single device or used by the same user) end up competing with each other rather than complementing each other because they are based on different underlying communication services and mostly employ different types of protocols. In addition, heterogeneous data processing is difficult and the operation cost is high. Therefore, transferring contextual information from one user device/application to another similar type of user device/application is a difficult job. Therefore, these applications do not provide a truly seamless end-user experience.

Additionally, with the increase in electronic device connectivity and various means of human information collection, it is imperative to maintain data integrity, high levels of synchronization and security, low bandwidth utilization, and information that is easy for users to classify and visualize. In addition, it requires less effort to maintain interoperability between devices with different capabilities (for example, health vital signs data collected from a smartphone is not in a compatible format and cannot be used by a fitness monitoring device).

The problem associated with state-of-the-art techniques is that users can enjoy a seamless and continuous experience only through human intervention to set and retrieve previous contexts. In this regard, please refer to Figure 1, where the user is listening to music on his TV/music system at home while reading email at work. Suddenly, he intends to drive to the office, which facilitates seamless continuity with multiple devices. While driving to the office, the user wants to continue listening to the music they are listening to at home and continue reading unfinished emails at home. The user gets into the car with his smartphone and tablet. Devices available today include smartphones, tablets, and in-vehicle infotainment systems. In this scenario, to continue reading the previous email, the user needs to turn on the tablet, log in to his email account, open the relevant email and continue reading, and to continue listening to the same music, the user needs to connect the smartphone with the The car's infotainment system connects, searches for favorite music, and plays it. Therefore, in this scenario, the user can experience seamless continuity only through human intervention.

A truly seamless user experience should be about rendering content on an appropriately supporting user device, such as playing music on an in-vehicle infotainment device or checking email on a smartphone or laptop without user intervention. Users only need to request this transition process by selecting the appropriate mode, such as the car mode in the above example, whose input source can be gestures, audio assistants, or touch, etc., to enjoy a seamless and continuous experience, free from manual intervention settings and retrieve the previous context.

Therefore, it is necessary to eliminate the need for manual intervention to set and retrieve previous user context so that users can enjoy a seamless continuous experience. In particular, there is a need to provide capability based content presentation in multiple communication devices/user devices.

The above requirements for capability-based content presentation are just to outline some of the shortcomings of traditional systems/mechanisms/techniques and are not exhaustive. Other problems/disadvantages of conventional systems/mechanisms/techniques, and corresponding advantages of the various non-limiting embodiments described herein, will become more apparent upon reading the following description.

Contents of the invention

This Summary is provided to introduce concepts related to methods, systems, and user equipment for capability-based content presentation and are further described in the Detailed Description below. This Summary is not intended to identify essential features of the claimed subject matter, nor is it intended to be used to determine or limit the scope of the claimed subject matter.

It is an object of the present invention to provide a seamless user experience across multiple communication devices and project data appropriately based on user interaction with said communication devices.

Another object of the present invention is to support classification and isolation of data content, synchronization based on device capabilities, and presentation of heterogeneous user information based on capabilities, so as to provide seamless and continuous multi-device experience.

Yet another object of the present invention is to achieve easy synchronization and interoperability between multiple connected communication devices.

In particular, the present invention provides a method, system and user equipment for capability-based content presentation, thereby requiring no manual intervention to set and retrieve previous user context, so that users can enjoy a seamless continuous experience.

According to a first aspect of the present invention there is provided a method for capability based content presentation in a plurality of user equipments. The method comprises the step of at least one source user device determining new information related to one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof, based on user activity in the current user mode. resource consumption information; the source user equipment classifies the new resource consumption information into one or more classified resource consumption information; the source user equipment stores the classified resource consumption information in a local memory; the source user equipment Detecting whether there is one or more target user equipments, whether there is a cloud database, or a combination thereof; the source user equipment monitors a request to switch from the current user mode to a new user mode; Synchronize the categorized resource consumption information to the one or more target user equipments for the content types that match the content types.

In a first possible implementation manner of the method according to the first aspect, the multiple user equipments include at least one source user equipment and at least one target user equipment.

In a second possible implementation manner of the method according to the first aspect, the step of the source user equipment classifying the new resource consumption information into one or more classified resource consumption information further includes the following steps: The source user equipment converts the new resource consumption information into JavaScript Object Notation (JavaScript ObjectNotation, JSON) format information, wherein the JSON format information includes DeviceID and contentType; the source user equipment reads from the JSON format information Get the DeviceID and the contentType; the source user device creates a data structure for the contentType in the JSON format information.

In a third possible implementation of the method according to the first aspect, the contentType includes a content type of health vital signs data (Health-vitals, HV), an audio data (Audio data, AD) content type, a video data (Video data, VD) content type, reader data (Reader data, RD) content type, etc.

In a fourth possible implementation manner of the method according to the first aspect, the step of the source user equipment detecting whether there is a cloud database further includes the following step: the source user equipment synchronizes the classified resource consumption information to on the cloud database.

In a fifth possible implementation manner of the method according to the first aspect, the step of the source user equipment monitoring a request to switch from the current user mode to a new user mode further includes the following steps: the source user equipment sending a broadcast event to the one or more target user equipments connected to the source user equipment; the source user equipment receiving a capability announcement message from each target user equipment, wherein the capability announcement message includes all target equipment capabilities , for example, audio, video, text, health vitals data, or a combination thereof.

In a sixth possible implementation manner of the method according to the first aspect, the source user equipment synchronizes the categorized resource consumption information to the one or the step on multiple target user equipments further includes the following step: when there is no new resource consumption information in the target user equipment, the source user equipment synchronizes the classified resource consumption information to the target user equipment according to the contentType on the device.

In a seventh possible implementation manner of the method according to the first aspect, the source user equipment synchronizes the classified resource consumption information to the one The step on one or more target user equipments further includes the following steps: when there is new resource consumption information in the target user equipment, the source user equipment determines the Timestamps related to the new resource consumption information; the source user equipment selects the new resource consumption information with the latest timestamp, wherein the user equipment with the latest timestamp in the new resource consumption information is the source user equipment; the source user equipment Synchronize classified resource consumption information with the latest time stamp to the target user equipment according to the contentType.

According to a second aspect of the present invention there is provided a system for capability based content presentation in a plurality of user equipments. The system includes: at least one source user equipment; at least one target user equipment; and a cloud database. The source user equipment is configured to: determine new resource consumption information related to one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof according to user activities in a current user mode; Classifying the new resource consumption information into one or more classified resource consumption information; storing the classified resource consumption information in a local memory; detecting whether the one or more target user equipments and the cloud database exist or a combination thereof; monitoring a request to switch from the current user mode to a new user mode; synchronizing the categorized resource consumption information to the one or more target users based on a content type matching that of the source device on the device.

In a first possible implementation manner of the system according to the second aspect, in order to classify the new resource consumption information into one or more classified resource consumption information, the source user equipment is further configured to: classify the The new resource consumption information is converted into JavaScript Object Notation (JavaScript Object Notation, JSON) format information, wherein the JSON format information includes DeviceID and contentType; read the DeviceID and the contentType from the JSON format information; The contentType in the JSON format information creates a data structure.

In a second possible implementation of the system according to the second aspect, the contentType includes a content type of health vital signs data (Health-vitals, HV), an audio data (Audio data, AD) content type, a video data (Video data, VD) content type, reader data (Reader data, RD) content type, etc.

In a third possible implementation of the system according to the second aspect, when detecting whether the cloud database exists, the source user equipment is further configured to: synchronize the classified resource consumption information to the cloud on the database.

In a fourth possible implementation manner of the system according to the second aspect, in order to monitor the request to switch from the current user mode to the new user mode, the source user equipment is further configured to: sending a broadcast event to the one or more target user equipments of the source user equipment; receiving a capability announcement message from each target user equipment, wherein the capability announcement message includes all target equipment capabilities, e.g., audio, video, Text, health vitals data, or a combination thereof.

In a fifth possible implementation of the system according to the second aspect, in order to synchronize the categorized resource consumption information to the one or more targets according to the content type matching the content type of the source device On the user equipment, the source user equipment is further configured to: when there is no new resource consumption information in the target user equipment, synchronize the classified resource consumption information to the target user equipment according to the contentType.

In a sixth possible implementation of the system according to the second aspect, in order to synchronize the classified resource consumption information to the one or more targets according to the content type matching the content type of the source device On the user equipment, the source user equipment is further configured to: when there is new resource consumption information in the target user equipment, determine information related to the new resource consumption information recorded by the source user equipment and the target user equipment Timestamp; select new resource consumption information with the latest timestamp, wherein the user equipment with the latest timestamp in the new resource consumption information is the source user equipment; according to the contentType, synchronize the classified resource consumption information with the latest timestamp to on the target user device.

According to a third aspect of the present invention there is provided a user equipment for capability based content presentation. The user equipment includes: a determination module; a content classifier; a local storage module; a detection module; a monitoring module; The determining module is configured to determine new resource consumption information related to one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof according to user activities in a current user mode. The content classifier is used to classify the new resource consumption information into one or more classified resource consumption information. The local storage module is used to store the classified resource consumption information. The detection module is used to detect whether there is one or more target user equipments, whether there is a cloud database or a combination thereof. The monitoring module is used for monitoring a request for switching from the current user mode to a new user mode. The data router is configured to synchronize the classified resource consumption information to the one or more target user equipments according to the content type matching the content type of the source equipment.

In a first possible implementation manner of the user equipment according to the third aspect, the content classifier is further configured to: convert the new resource consumption information into JavaScript Object Notation (JavaScript Object Notation, JSON) format information , wherein, the JSON format information includes DeviceID and contentType; read the DeviceID and the contentType from the JSON format information; create a data structure for the contentType in the JSON format information.

In a second possible implementation manner of the user equipment according to the third aspect, the contentType includes a content type of health vital signs data (Health-vitals, HV), an audio data (Audio data, AD) content type, a video Data (Video data, VD) content type, reader data (Reader data, RD) content type, etc.

In a third possible implementation manner of the user equipment according to the third aspect, the data router is further configured to: when the detection module detects whether the cloud database exists, synchronize the classified resource consumption information to the cloud database.

In a fourth possible implementation manner of the user equipment according to the third aspect, the monitoring module is further configured to: send a broadcast event to the one or more target user equipments connected to the source user equipment; A capability announcement message is received from each target user equipment, wherein the capability announcement message includes all target equipment capabilities, such as audio, video, text, health vital sign data, or a combination thereof.

In a fifth possible implementation manner of the user equipment according to the third aspect, the data router is further configured to: when there is no new resource consumption information in the target user equipment, classify the The resource consumption information is synchronized to the target user equipment.

In a sixth possible implementation manner of the user equipment according to the third aspect, the user equipment further includes a conflict resolution program, and the conflict resolution program is configured to: when there is new resource consumption information in the target user equipment , determine the timestamps related to the new resource consumption information recorded by the source user equipment and the target user equipment; select the new resource consumption information with the latest timestamp, where the new resource consumption information has the latest timestamp The user equipment is the source user equipment; the data router is further configured to synchronize classified resource consumption information with the latest timestamp to the target user equipment according to the contentType.

Other aspects, advantages and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the accompanying drawings, discloses exemplary embodiments of the invention.

Description of drawings

The detailed description is described with reference to the accompanying drawings. In the individual figures, one or more digits of a reference number identify the figure in which the reference number first appears. The same numbers are used throughout the drawings to refer to like features and components.

Figure 1 shows an overview block diagram of content presentation as a use case scenario of the prior art of the present invention;

Fig. 2 shows a block diagram of content classification and capability-based synchronization and presentation provided by an embodiment of the present invention;

Figure 3 shows a block diagram of how data from different user devices is structured and stored in a standard format that facilitates interoperability between different devices provided by an aspect of the present invention;

FIG. 4 shows a sequence diagram describing various events for implementing capability-based content presentation provided by an aspect of the present invention;

Fig. 5 shows a use case scenario block diagram of continuity with capability-based content presentation provided by another aspect of the present invention;

FIG. 6 shows a flow chart of a capability-based content presentation process flow in a multi-device scenario provided by another aspect of the present invention;

Fig. 7 shows a block diagram of data synchronization between the device and internal components of the device, wherein the internal components of the device are responsible for user data capture, data classification and data storage;

FIG. 8 shows a flowchart describing the detailed flow of content classification and data synchronization provided by another embodiment of the present invention;

Fig. 9 shows a flowchart of capability-based content presentation provided by another aspect of the present invention;

Figure 10 shows a flow diagram of continuity with capability-based content presentation provided by another aspect of the present invention;

Fig. 11 shows a componentized block diagram of content classification, capability-based synchronization and continuity-based presentation provided by another embodiment of the present invention;

Fig. 12 shows a flowchart of a capability-based content presentation method provided by another aspect of the present invention;

Fig. 13 shows a block diagram of a capability-based content presentation system provided by another aspect of the present invention;

Fig. 14 shows a block diagram of a capability-based content presentation user equipment provided by another embodiment of the present invention.

It is to be understood that the drawings are for the purpose of illustrating the concepts of the present invention and may not be drawn to scale.

detailed description

The technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some but not all of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall belong to the protection scope of the present invention.

The invention can be implemented in various ways as a process, an apparatus, a system, a composition of matter, a computer readable medium (eg, a computer readable storage medium) or a computer network where program instructions are transmitted over optical or electronic communication links. In this specification, these implementations, or any other form that the invention may take, may be referred to as techniques. In general, the order of steps of disclosed processes may be altered within the scope of the invention.

A detailed description of one or more embodiments of the invention along with accompanying figures that illustrate the principles of the invention are provided below. Although the invention is described in conjunction with these embodiments, the invention is not limited to any embodiment. The scope of the invention is limited only by the claims and the invention encompasses numerous alternatives, modifications and equivalents. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details. For the purpose of clarity, technical material that is known in the technical fields related to the invention has not been described in detail so that the invention will not be unnecessarily obscured.

In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, modules, units and/or circuits have not been described in detail so as not to obscure the present invention.

Although the embodiments of the present invention are not limited thereto, discussions using terms such as processing, computing, determining, establishing, analyzing, inspecting, etc. may refer to the operation and/or process of a computer, computing platform, computing system, or other electronic computing device, which Operations and/or processes manipulate and/or transform data represented as physical (e.g., electronic) quantities within computer registers and/or memory into other data similarly represented as computer registers and/or memory Or other information that can store instructions to perform operations and/or processes A physical quantity within a non-transitory storage medium.

Although the embodiments of the present invention are not limited in this respect, the term "plurality" as used herein may include "two or more". The term "plurality" may be used throughout the specification to describe two or more components, devices, elements, units, parameters and the like. The method embodiments described herein are not limited to a specific order or sequence unless explicitly stated. Furthermore, some of the described method embodiments, or elements thereof, may occur or be performed concurrently at the same point in time.

In the present invention, "content classification" refers to classifying different user data according to the type of content, so the data is easy to synchronize, maintain, and store in a processable format on various supporting devices.

In the present invention, "storage isolation" refers to the process of storing user data in a non-corruptible manner, easily retrievable, and only available to those devices capable of handling that type of data.

In the present invention, "capability-based presentation" refers to presenting specific content to a device capable of processing the specific content type.

In the present invention, "seamless cooperative processing" refers to smooth cooperation between devices, which involves classification of content, so that each device can communicate with each other and uniformly process data.

In the present invention, "infotainment" refers to in-vehicle systems that provide entertainment and information to passengers or drivers through audio/video interfaces, keypads, touch screens, and/or other types of services.

In this invention, "user profile" refers to a login profile in which user data and user state context is maintained and then synchronized between devices logged in using the same profile.

In this invention, "seamless continuity" refers to the smooth continuous transition of operations from one component to another so that no congestion or delay is encountered.

In the present invention, "interoperability" refers to the capability exhibited when different devices, applications or components communicate in a coordinated manner without any effort from the user.

In the present invention, "predefined modes" refer to certain user modes that define the user operating environment according to the devices present, the different capabilities involved (eg, audio/video, text, etc.).

In the present invention, the "capability announcement method" refers to a method in which various devices involved in a multi-device environment will announce their capabilities to achieve synchronization of content types (eg, audio, video, text, location, etc.).

The present invention discloses a method, system and user equipment for capability-based content presentation. Although aspects have been described with respect to capability-based content presentation in multiple communication devices, the invention can be implemented in any number of different computing systems, environments, and/or configurations. Embodiments are described in the context of the following exemplary systems, devices/nodes/apparatus and methods.

In the following, embodiments of the invention are explained with the aid of exemplary figures and one or more examples. However, for better understanding of the present invention, these exemplary figures and examples are provided for the purpose of illustration and should not be construed as limiting the scope of the present invention.

The present invention provides a content classification mechanism, an easy-to-synchronize storage mechanism, a user equipment capability announcement mechanism, a mode discovery mechanism and a capability-based heterogeneous user information presentation mechanism to provide seamless and continuous multi-device experience.

The problem associated with state-of-the-art techniques is that users can enjoy a seamless and continuous experience only through human intervention to set and retrieve previous contexts. Therefore, it is necessary to eliminate the need for manual intervention to set and retrieve previous user context so that users can enjoy a seamless continuous experience. In particular, there is a need to provide capability-based content presentation in multiple communication devices.

In today's context, with technological advancements in the fields of the Internet of Things, interconnection, cloud infrastructure, and the medical field, various devices that capture human information from the health business model have emerged. Each user device is capable of collecting and processing certain types of information about the user. However, the centralized use of such datasets and the processing of interdependent relationships and the full potential of obtaining useful information for users remain to be explored.

Figure 1 shows a user who was previously listening to music on the TV/music system at home while reading email at work suddenly intends to drive to the office. For a seamless user experience, the invention provides for rendering content on appropriate supporting devices (playing music on an infotainment device, checking email on a smartphone) in new scenarios without user intervention.

Specifically, in order to provide a seamless user experience across multiple communication devices, and to project data appropriately based on user engagement in said communication devices, the present invention discloses the following:

1. Content classification and storage isolation;

2. Synchronization based on device capabilities;

3. Capability-based presentation (based on device capabilities or pre-defined modes such as car mode, laptop mode, theater mode, etc.).

Content classification and storage segregation: One aspect of the invention describes a way of data classification and storage in which data is easily synchronized and maintained across multiple user devices in a processable format. User data content can be categorized in a variety of formats such as (but not limited to) text (email, e-readers, e-notes, etc.), audio (music), video (movies, games, pictures, etc.) from multiple electronic user devices ), health vitals data (data from heart monitors, blood pressure monitors, fitness smartbands/smartwatches, doctor appointment and medical history apps, etc.). These electronic user devices operate independently and only process available data. For example, a heart monitoring device records a user's heartbeat without regard to user status (whether the user is idle, running, etc.). User state information is often captured by smartphones, fitness wearables, and other devices.

By processing user data collected from various devices, it is possible to realize an ideal method of utilizing such user data collected by multiple user devices to obtain better results. However, heterogeneous data processing is difficult and the operation cost is high. Therefore, for seamless transactions and processing, data/content classification and secure storage protocols need to be embedded in each user device. The benefit of centralizing information is that it facilitates accurate results. Notably, by considering user state from fitness wearables and processing heartbeat data from heart monitors, useful user health observations in different scenarios can be obtained and monitored.

In order to achieve seamless collaborative processing, there should be a standard way of organizing data that can be communicated between different devices and processed uniformly. This is achieved through data classification. In the present invention, user information data is classified according to technical fields, as follows:

For example, data from fitness watches, health monitors can be classified into the category of health-vital (HV) data. Likewise, music can be categorized as an audio category, and map inputs (latitude, longitude) can be categorized as a location category.

To convey the type of data or content, a user information byte mentioning the content type is encapsulated in the header of the transaction packet along with the device ID. Based on published IDs, content is securely classified and stored separately. Furthermore, as shown in Figure 2, a unique encryption algorithm can be applied when storing content in the context database.

Specifically, Figure 2 illustrates the manner in which data is categorized and stored in a manner that is easily synchronized and maintained on each supporting user device in a processable format. These user devices operate independently and only process available data. For example, a heart monitoring device records a person's heartbeat regardless of user status, ie, whether the user is idle, sleeping, running, etc. User state information is usually captured by other user devices such as smartphones, fit-bits, etc. The benefit of centralizing information is that it facilitates accurate results. The standard data organization, which can be communicated between different devices and processed uniformly, can be categorized as follows:

1. Health vital signs data content – HV;

2. Audio content data – AD;

3. Video data – VD;

4. Reader (ebooks, emails, SMS, contacts, etc.) data – RD.

Figure 3 shows how data acquired from multiple user devices is stored and maintained in a user context database. The user data in JSON format includes the byte information of DeviceID and content type, and the content is classified and stored separately according to the byte information. When storing content in the storage database, unique encryption algorithms can be applied. As shown in Figure 3, the health vital signs data is generated in the heart monitoring device in JSON format, encapsulated with a header containing “T:HV” (Type – HV), encrypted using the AES-256 algorithm and stored in the database. This type-by-type approach simplifies the interoperability process between heterogeneous user equipment.

Synchronization Based on Device Capabilities: Another aspect of the invention discloses synchronizing categorized organized user data based on the capabilities of the devices to be synchronized. As mentioned above, content classification prepares data for storage and synchronization in an interoperable format. Since various devices can be utilized, the range of viewing data collections between different supported devices according to the data format is expanded. For example, a smartphone has the ability to capture and understand pedometers (Steps-HV), play music files (AD), compose emails (RD), etc. However, fitness wearables only have the ability to capture and understand HV data (heartbeat, steps, etc.).

In order to synchronize content (user data or user information) captured by a user equipment to one or more target user equipment, the capabilities of the target user equipment should be obtained. After receiving the broadcast change event from the user configuration file, the target user equipment announces its capability immediately, that is, the target user equipment broadcasts a capability announcement to the user equipment that has captured user data.

User profiles are login profiles where user data and user state context is maintained and then synchronized between devices logged in using the same profile. This synchronization can also occur with the user profile when the user manually requests a mode change (the mode could be car mode, theater mode, etc.). It is worth noting that user mode and user profiles are different features and the two terms are not used interchangeably. A user profile is a user login profile, while a user mode change is a multi-device environment change, for example, switching from home mode to car mode or theater mode, etc. It is worth noting that said user mode changes are always made for the same user profile.

Consider the scenario depicted in Figure 1, where a user is jogging while listening to music on a smartphone. In addition to music context, smartphones can also capture step counts. When the user returns home from a jog, the user profile in the phone broadcasts a change event to all connected devices. Upon receiving a change broadcast event, each connected device advertises its capabilities as follows:

Table 1: List of devices and their capabilities

<u>Device</u> <u>Ability</u> smart phone All (text, audio, video, health vitals data, reader, etc.) heart monitor HV (Health Vital Signs Data - Heartbeat) Fitness smart bracelet/smart watch HV (Health Vital Signs Data - Steps) speaker AD (audio, music) tablet All (text, audio, video, health vitals data, reader, etc.) smart tv VD (Video) e-book RD (reader mode)

After receiving the capability information of each user device, the appropriate data is synchronized to the target user device, that is, in the above scenario, the step number health vital sign data is synchronized to the fitness wearable device, and the music context is synchronized to the Infotainment equipment and more.

Continuity with capability-based content presentation: As noted above, a user profile will maintain user contextual information from the various communication devices associated with the user. Once all available user devices advertise their capabilities, the corresponding context can be requested from the user profile. Sync content across supported devices based on data type. Challenges arise when multiple such supporting devices are online at the same time. The rendering of content depends on the available active devices and the priority of the preferred output device.

Figure 5 illustrates the challenges of presenting user content when multiple enabled devices are online at the same time. The rendering of content depends on the available active devices and the priority of the preferred output device. For example, in a multi-device continuity scenario, a user who is at home writing an email while listening to music pauses and decides to get into the car. In this case, music continuity should be routed to available audio equipment, while emails are routed to text renderers (laptops, smartphones, etc.). For audio presentation in the car, the appropriate option needs to be selected from the available equipment. Among in-vehicle infotainment devices, smartphones and laptops, infotainment devices are the top choice. Select the most suitable equipment from the priority list. After confirming the priority device, the corresponding content in the user context is rendered on the target device. The user device priority list is as follows:

Table 1: User equipment priority list in various modes

Therefore, in the present invention, the user context can be retrieved from the user profile, and after selecting the user (target) device for continuity, the corresponding content in the user context will be presented on the preferred user (target) device.

Since content classification prepares data stored and synchronized in an interoperable format, the synchronization of classified data depends on the capabilities of the target device. For example, a smartphone is capable of storing text, audio, video, health vitals data, and contact data, so the smartphone will synchronize all these corresponding data in the user profile. Likewise, a fitness watch that supports HV data will only sync the HV data in the user profile, or an infotainment device that supports audio and contact data will only sync the HV data in the user profile. Figure 4 illustrates a "Broadcast First, Capabilities Announcement Approach", where a device announces its capabilities immediately after receiving a broadcast change event from a user profile.

FIG. 6 shows a capability-based content presentation processing flow in a multi-device scenario provided by another aspect of the present invention. Scenario 1 describes how users engage in multi-device activities such as smartphones, health vitals, and more. Various content such as AD, VD, RD, etc. will be classified according to content type and stored securely. When a sync event fires or a user mode changes, a broadcast change event in the user profile is announced so that all connected user devices advertise their capabilities and only sync what is able to from the user profile. Scenario 2 describes the workflow after synchronization has occurred.

Fig. 7 shows a block diagram of data synchronization between the device and internal components of the device, wherein the internal components of the device are responsible for user data capture, data classification and data storage.

1. A source device is a device where a user performs certain activities and collects input data based on user activities;

2. This input data is taken by a "content classifier" for data classification. "Parser" to help Content Classifier parse User Data;

3. After the data is classified, it is updated in the local device memory;

4. If more user devices are connected to the source device, their local storage also needs to be updated with the latest classified user data. These User Devices are referred to as "Sync Devices";

5. The "data router" of the source device sends the updated data, and the data router of the synchronization device receives the data;

6. If a conflict is found while updating the local memory of the sync device, the "Conflict Resolver" will resolve the conflict. After the conflict is resolved, the local memory of the sync device is also updated with the latest classified user data;

7. These devices can also sync content from the cloud and vice versa, depending on which component has the latest user information;

8. When a specific device is selected as the highest priority device (see Figure 10 for more details), the "Content Renderer" is responsible for displaying the output (video, audio, text, etc.).

Fig. 8 shows a flowchart of how to classify and store user content.

1. In this scenario, when a user is engaged in a multi-device activity, where each device is logged in with the same user profile, each source device captures new user data in its original format. This raw user data is first sent as input data to a content classifier for classification. Content classifier converts raw user data (or input data) into JSON format where DeviceID and contentType are mentioned. Specifically, the content classifier converts raw user data into JSON format, where the data is stored as key-value pairs. Keys are created by the content classifier itself and values are retrieved from the raw data. Two of these keys are DeviceID and ContentType;

2. Then, the content classifier sends various classified data such as location data, audio data, and video data generated thereby to the local memory to update the user database;

3. Further, it is then determined whether the current user equipment (where the local storage is updated) is connected to the cloud or other user equipment, so that an update of the cloud DB/local DB is also initiated in the connected equipment. Current User Device means the device that captured the Raw Data and User Device means any device that the User is operating and logged in with a specific User Profile;

4. If a conflict occurs while updating data of the same content type from multiple user devices, the conflict resolver resolves the conflict using the latest timestamp of the data change, and then the synchronization module finally updates the resolved data change to the connected device ( synchronization device) cloud DB/local device DB. It is worth noting that there is a synchronization module in each user device as well as on the cloud. Once the resolver resolves the conflict and specifies the data to be synced, the sync module fetches that data and updates the data into the user device database for that particular user profile. The latest timestamp takes into account the update of the latest record change for that particular content type. Assume that a user uses two user devices at the same time, for example, a mobile phone and a fitness bracelet. Since both user devices capture the user's heart rate (HV data), both user devices will update their databases with the respective data, which was originally captured by the user's activity on the corresponding device. Since the two user devices are also connected to each other and logged in with the same user profile, the two user devices only start synchronizing with each other for matching content types. There may be conflicts as to which data should be reflected in the user DB when the two devices start to synchronize. In such scenarios, the resolver module located in the user device or in the cloud to resolve the conflict will compare the two types of data (i.e., the user device's own data and the data received from the synchronizing user device) and consider poked data. The latest data is sent to the synchronization module, which will eventually update the database. The latest data is finally reflected in both connected user devices.

Figure 9 shows a flow diagram of what occurs during a synchronization process in the case where there are multiple supporting user devices with similar content types.

1. Whenever the local DB changes due to user participation in multi-device activity, or when the user requests a mode change (car mode, theater mode, etc.), the user profile emits a broadcast event. As soon as the user profile is updated with the latest data, the user profile creates an event (broadcast event) which is passed through the data router to the cloud/other synchronization devices;

2. All connected user devices, upon receiving this event via the data router, start publishing their capabilities to the user profile;

3. For synchronization with the target device, only content that the target device can read (understand) is retrieved from the source device user profile. The synchronization module synchronizes the content according to the content type;

4. Finally, the changes are synced to the database of all connected user devices.

Figure 10 shows a flow diagram of what happens after synchronization of all connected user devices and/or the cloud and how the content is thereafter rendered to one or more target devices. Synchronization refers to updating the databases of multiple user devices and maintaining the same latest data, while presentation refers to displaying the results on the relevant output user devices, which can be audio, video, text or pictures, etc.

1. If for a certain capability such as audio, video, text, etc., many devices are online at the same time and have similar capabilities, select the most suitable device from the priority list;

2. Once the highest priority device is found and the device is available for rendering, user content can be rendered onto that device and the user can continue with their multi-device activity.

Figure 11 shows a block diagram of content classification, capability-based synchronization and continuity-based presentation. It can be stated as follows:

1. When raw data is captured from user activities in the source device, the raw data is provided as input data to the content classifier, and the content classifier converts the raw data into classified data with the help of the parser, and then stores the classified data to the user in the local storage of the device. (See Figure 7 for more details on internal device descriptions);

2. When local memory changes or user mode changes are detected, the synchronization module is called to initiate synchronization. Check if other user devices or cloud are connected. Synchronization is only initiated on the device for content that the user's device is able to store. These devices are synchronous devices.

3. The data router routes the corresponding data content to the synchronization device.

4. At the same time, if multiple user devices modify the same data, conflicts may arise, which are resolved by the context conflict resolver. The corresponding changes are reflected in all synchronized device memories.

5. Afterwards, the content renderer of the user equipment will select a user equipment with higher priority from the device priority table, and play corresponding content on the user equipment.

Fig. 12 shows a flowchart of a method for capability-based content presentation provided by another aspect of the present invention. The method comprises the steps of:

At least one source user device (131) determines (S121) new resources related to one or more other sensors, one or more functions of said one or more other sensors, or a combination thereof, based on user activity in a current user mode consumption information;

The source user equipment (131) classifies (S122) the new resource consumption information into one or more classified resource consumption information;

The source user equipment (131) stores (S123) the categorized resource consumption information in a local memory;

The source user equipment (131) detects (S124) whether there is one or more target user equipment (132), whether there is a cloud database (133) or a combination thereof;

Said source user equipment (131) monitors (S125) a request to switch from said current user mode to a new user mode;

The source user device (131) synchronizes (S126) the categorized resource consumption information to the one or more target user devices (132) according to the content type matching the content type of the source device.

The step of the source user equipment (131) classifying (S122) the new resource consumption information into one or more classified resource consumption information further includes the following steps:

The source user equipment (131) converts the new resource consumption information into JavaScript Object Notation (JavaScript Object Notation, JSON) format information, wherein the JSON format information includes DeviceID and contentType;

The source user equipment (131) reads the DeviceID and the contentType from the JSON format information;

The source user equipment (131) creates a data structure for the contentType in the JSON format information.

The step of the source user equipment (131) detecting (S124) whether there is a cloud database (133) also includes the following steps:

The source user equipment (131) synchronizes the classified resource consumption information to the cloud database (133).

Said step of said source user equipment (131) monitoring (S125) a request to switch from said current user mode to a new user mode further comprises the steps of:

said source user equipment (131) sending a broadcast event to said one or more target user equipment (132) connected to said source user equipment (131);

The source user equipment (131) receives a capability announcement message from each target user equipment (132), wherein the capability announcement message includes all target equipment capabilities, such as audio, video, text, health vital sign data or a combination thereof .

The step of synchronizing (S126) the categorized resource consumption information to the one or more target user equipments (132) by the source user equipment (131) according to the content type matching the content type of the source equipment is further Include the following steps:

When there is no new resource consumption information in the target user equipment (132), the source user equipment (131) synchronizes the classified resource consumption information to the target user equipment (132) according to the contentType.

The step of synchronizing (S126) the categorized resource consumption information to the one or more target user equipments (132) by the source user equipment (131) according to the content type matching the content type of the source equipment is further Include the following steps:

When there is new resource consumption information in the target user equipment (132), the source user equipment (131) determines the new resource recorded with the source user equipment (131) and the target user equipment (132) Timestamps related to consumption information;

The source user equipment (131) selects new resource consumption information with the latest time stamp, wherein the user equipment with the latest time stamp of the new resource consumption information is the source user equipment (131);

The source user equipment (131) synchronizes the classified resource consumption information with the latest time stamp to the target user equipment (132) according to the contentType.

The plurality of user equipments includes at least one source user equipment (131) and at least one target user equipment (132). The contentType includes health vital signs data (Health-vitals, HV) content type, audio data (Audio data, AD) content type, video data (Video data, VD) content type, reader data (Readerdata, RD) content type Wait.

Fig. 13 shows a block diagram of a system for capability-based content presentation provided by another aspect of the present invention. The system comprises: at least one source user equipment (131); at least one target user equipment (132); and a cloud database (133).

The source user equipment (131) is configured to: determine (S121) correlation with one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof based on user activity in a current user mode new resource consumption information; classify (S122) the new resource consumption information into one or more classified resource consumption information; store (S123) the classified resource consumption information in the local memory; detect (S124) whether the said one or more target user devices (132), whether there is said cloud database (133) or a combination thereof; monitor (S125) a request to switch from said current user mode to a new user mode; The content type matching the content type synchronizes (S126) the categorized resource consumption information to the one or more target user devices (132).

In the system (130), in order to classify (S122) the new resource consumption information into one or more classified resource consumption information, the source user equipment (131) is further configured to: classify the new resource consumption information Convert to JavaScript Object Notation (JavaScript Object Notation, JSON) format information, wherein, the JSON format information includes DeviceID and contentType; Read the DeviceID and the contentType from the JSON format information; be the JSON format The contentType in the message creates the data structure. In the system (130), when detecting (S124) whether the cloud database (133) exists, the source user equipment (131) is further configured to: synchronize the classified resource consumption information to the cloud database (133) on.

In said system (130), in order to monitor (S125) said request to switch from said current user mode to said new user mode, said source user equipment (131) is further configured to: The one or more target user equipment (132) of the user equipment (131) sends a broadcast event; receives a capability announcement message from each target user equipment (132), wherein the capability announcement message includes all target equipment capabilities, such as , audio, video, text, health vital sign data, or a combination thereof.

In said system (130), in order to synchronize (S126) said categorized resource consumption information to said one or more target user devices (132) according to a content type matching with said source device's content type, The source user equipment (131) is further configured to: when there is no new resource consumption information in the target user equipment (132), synchronize the classified resource consumption information to the target user equipment (132) according to the contentType superior.

In said system (130), in order to synchronize (S126) said categorized resource consumption information to said one or more target user devices (132) according to a content type matching with said source device's content type, The source user equipment (131) is further configured to: determine the information recorded with the source user equipment (131) and the target user equipment (132) when there is new resource consumption information in the target user equipment (132) The timestamp related to the new resource consumption information; select the new resource consumption information with the latest timestamp, wherein the user equipment with the latest timestamp in the new resource consumption information is the source user equipment (131); according to the contentType, set The categorized resource consumption information with the latest time stamp is synchronized to the target user equipment (132).

Fig. 14 shows a block diagram of a user equipment for capability-based content presentation provided by another embodiment of the present invention. The user equipment includes: a determination module (141); a content classifier (142); a local storage module (143); a detection module (144); a monitoring module (145); a data router (146); a conflict resolution program (147) . The determining module (141) is configured to determine (S121) new information related to one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof according to user activities in the current user mode. Resource consumption information. The content classifier (142) is configured to classify (S122) the new resource consumption information into one or more classified resource consumption information. The local storage module (143) is used for storing (S123) the classified resource consumption information. The detecting module (144) is used for detecting (S124) whether there is one or more target user equipments (132), whether there is a cloud database (133) or a combination thereof. The monitoring module (145) is configured to monitor (S125) a request to switch from the current user mode to a new user mode. The data router (146) is configured to synchronize (S126) the categorized resource consumption information to the one or more target user devices (132) according to the content type matching the content type of the source device.

The content classifier (142) is further configured to: convert the new resource consumption information into JavaScript Object Notation (JavaScript Object Notation, JSON) format information, wherein the JSON format information includes DeviceID and contentType; from the Read the DeviceID and the contentType in the JSON format information; create a data structure for the contentType in the JSON format information. The data router (146) is further configured to: when the detection module (144) detects whether the cloud database (133) exists, synchronize the classified resource consumption information to the cloud database (133).

The monitoring module (145) is further configured to: send a broadcast event to the one or more target user equipment (132) connected to the source user equipment (131); receive a capability from each target user equipment (132) An announcement message, wherein the capability announcement message includes all target device capabilities, for example, audio, video, text, health vital sign data or a combination thereof. The data router (146) is further configured to: when there is no new resource consumption information in the target user equipment (132), synchronize the classified resource consumption information to the target user equipment (132) according to the contentType .

The conflict resolution program (147) is configured to: when there is new resource consumption information in the target user equipment (132), determine the The time stamp related to the new resource consumption information; selecting the new resource consumption information with the latest time stamp, wherein the user equipment whose new resource consumption information has the latest time stamp is the source user equipment (131). The data router (146) is further configured to synchronize classified resource consumption information with the latest time stamp to the target user equipment (132) according to the contentType.

Yet another embodiment of the present invention is a computer-readable medium, the computer-readable medium includes a computer program, and when the computer program is executed by a computer, the computer executes the above-mentioned method steps (S121- S126).

The invention is applied in the fields of smart home, smart office, automobile, hospital and the like. The present invention utilizes the capabilities of various user equipment and prioritizes similarly supporting user equipment when they are simultaneously available to ensure that the user does not have to worry about how to continue his activities when the scene changes.

The technical effect provided by the present invention is the seamless direct presentation of multiple variable user data into compatible user equipment. Furthermore, such user data can be used uniformly to infer useful observations about users. Some non-limiting advantages and future implementations of the present invention are as follows:

1. Helps securely store and componentize user information (content) based on metadata;

2. Helps to share bandwidth while synchronizing a large amount of user data to supported target devices;

3. Helps achieve seamless continuity and intelligent content presentation based on superior device capability priorities;

4. Provides easy synchronization and interoperability between multiple connected user devices.

Those skilled in the art can understand that any known or new algorithm can be used to implement the present invention. However, it should be noted that no matter what known or new algorithm is used, the present invention provides a method, system and user equipment for capability-based content presentation to achieve the above-mentioned benefits and technical progress.

Those skilled in the art can appreciate that, in combination with the examples described in the embodiments disclosed in this specification, units and algorithm steps can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether the functions are performed by hardware or by software depends on the specific application and design constraints of the technical solution. Those skilled in the art may implement the described functionality for each particular application using different methods, but such implementation should not be considered as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-mentioned systems, devices, and units can refer to the corresponding processes in the above-mentioned method embodiments, which will not be repeated herein.

In the several embodiments provided in this application, it should be understood that the disclosed device, method or system may be implemented in other ways. For example, the described device embodiments are merely exemplary. For example, unit division is only logical function division, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not implemented. Furthermore, shown or discussed mutual couplings or direct couplings or communicative connections may be achieved through some interfaces. The direct coupling or communication connection between devices or units may be implemented electronically, mechanically or otherwise.

When these functions are implemented in the form of software function units and sold or used as independent products, these functions can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention, or the contribution to the prior art, or a part of the technical solution, can be realized in the form of software products. The computer software product is stored in a storage medium and includes several instructions for instructing a computer node (which may be a personal computer, a server or a network node) to execute all or part of the steps of the method described in the embodiments of the present invention. The above-mentioned storage medium includes: any medium that can store program codes, such as a USB flash drive, a removable hard disk, a read-only memory (read-only memory, ROM), a random access memory (random access memory, RAM), a magnetic disk or an optical disk.

Devices communicating with each other need not be in continuous communication unless expressly specified otherwise. In addition, devices that are in communication with each other may communicate directly or indirectly through one or more intermediaries.

Where a single device or item is described herein, it is obvious that more than one device/item (whether or not they cooperate) may be used instead of a single device/item. Similarly, where more than one device or article is described herein (whether or not they cooperate), it is obvious that a single device/item may be used instead of more than one device or article, or a different number of devices/articles may be used instead number of devices or programs indicated. Alternatively, the functions and/or features of a device may be performed by one or more other devices not expressly described as having such functions/features. Therefore, other embodiments of the invention need not involve the device itself.

Finally, the language used in this specification has been chosen primarily for readability and instruction rather than to delineate or limit the inventive subject matter. Accordingly, the scope of the invention is not to be limited by this detailed description, but rather by any claims that issue from this application. Accordingly, the disclosure of the embodiments of the present invention is intended to be illustrative, and not intended to limit the scope of the present invention, which is set forth in the claims.

With respect to the use of substantially any plural and/or singular term herein, one skilled in the art can switch from plural to singular and/or from singular to plural depending on the context and/or application. For the sake of clarity, various singular/plural permutations may be explicitly set forth herein.

Although the method, system, and user device implementations for capability-based content presentation have been described in specific language of structural features and/or methods, it is to be understood that the appended claims are not necessarily limited to the specific features or methods described. method. Rather, these specific features and methods are disclosed as examples of implementations for capability-based content presentation in a plurality of communication devices.

Claims (23)

1. A method for capability-based content presentation in multiple user equipment, characterized in that the method comprises the following steps: At least one source user device (131) determines (S121) new resources related to one or more other sensors, one or more functions of said one or more other sensors, or a combination thereof, based on user activity in a current user mode consumption information; The source user equipment (131) classifies (S122) the new resource consumption information into one or more classified resource consumption information; The source user equipment (131) stores (S123) the categorized resource consumption information in a local memory; The source user equipment (131) detects (S124) whether there is one or more target user equipment (132), whether there is a cloud database (133) or a combination thereof; Said source user equipment (131) monitors (S125) a request to switch from said current user mode to a new user mode; The source user device (131) synchronizes (S126) the categorized resource consumption information to the one or more target user devices (132) according to the content type matching the content type of the source device. 2. The method according to claim 1, wherein the plurality of user equipments comprises at least one source user equipment (131) and at least one target user equipment (132). 3. The method according to claim 1, characterized in that the step of the source user equipment (131) classifying (S122) the new resource consumption information into one or more classified resource consumption information further comprises the following steps: The source user equipment (131) converts the new resource consumption information into JavaScript Object Notation (JavaScript Object Notation, JSON) format information, wherein the JSON format information includes DeviceID and contentType; The source user equipment (131) reads the DeviceID and the contentType from the JSON format information; The source user equipment (131) creates a data structure for the contentType in the JSON format information. 4. The method according to claim 3, wherein the contentType includes a healthy vital sign data (Health-vitals, HV) content type, an audio data (Audio data, AD) content type, a video data (Videodata, VD ) content type, reader data (Reader data, RD) content type, etc. 5. The method according to claim 1, wherein the step of detecting (S124) whether there is a cloud database (133) in the source user equipment (131) further comprises the following steps: The source user equipment (131) synchronizes the classified resource consumption information to the cloud database (133). 6. The method according to claim 1, characterized in that the step of the source user equipment (131) monitoring (S125) a request to switch from the current user mode to a new user mode further comprises the following steps: said source user equipment (131) sending a broadcast event to said one or more target user equipment (132) connected to said source user equipment (131); The source user equipment (131) receives a capability announcement message from each target user equipment (132), wherein the capability announcement message includes all target equipment capabilities, such as audio, video, text, health vital sign data or a combination thereof . 7. The method according to claim 1, characterized in that, the source user equipment (131) synchronizes (S126) the categorized resource consumption information to the The step on the one or more target user equipments (132) also includes the following steps: When there is no new resource consumption information in the target user equipment (132), the source user equipment (131) synchronizes the classified resource consumption information to the target user equipment (132) according to the contentType. 8. The method according to claim 1, characterized in that, the source user equipment (131) synchronizes (S126) the categorized resource consumption information to the The step on the one or more target user equipments (132) also includes the following steps: When there is new resource consumption information in the target user equipment (132), the source user equipment (131) determines the new resource recorded with the source user equipment (131) and the target user equipment (132) Timestamps related to consumption information; The source user equipment (131) selects new resource consumption information with the latest time stamp, wherein the user equipment with the latest time stamp of the new resource consumption information is the source user equipment (131); The source user equipment (131) synchronizes the classified resource consumption information with the latest time stamp to the target user equipment (132) according to the contentType. 9. A system (130) for capability-based content presentation in a plurality of user equipment, characterized in that the system comprises: at least one source user equipment (131); at least one target user equipment (132); cloud database(133), Wherein, the source user equipment (131) is used for: determining (S121) new resource consumption information related to one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof, based on user activity in the current user mode; Classifying (S122) the new resource consumption information into one or more classified resource consumption information; storing (S123) the categorized resource consumption information in a local memory; Detecting (S124) whether there is said one or more target user equipments (132), said cloud database (133) or a combination thereof; monitoring (S125) a request to switch from said current user mode to a new user mode; The categorized resource consumption information is synchronized (S126) to the one or more target user devices (132) according to the content type matching the content type of the source device. 10. The system (130) according to claim 9, characterized in that, in order to classify (S122) the new resource consumption information into one or more classified resource consumption information, the source user equipment (131) further uses At: converting the new resource consumption information into JavaScript Object Notation (JavaScript ObjectNotation, JSON) format information, wherein the JSON format information includes DeviceID and contentType; Read the DeviceID and the contentType from the JSON format information; A data structure is created for the contentType in the JSON format information. 11. system (130) according to claim 10, is characterized in that, described contentType comprises healthy vital sign data (Health-vitals, HV) content type, audio data (Audio data, AD) content type, video data ( Video data (VD) content type, reader data (Reader data, RD) content type, etc. 12. The system (130) according to claim 9, characterized in that, when detecting (S124) whether the cloud database (133) exists, the source user equipment (131) is also used for: The classified resource consumption information is synchronized to the cloud database (133). 13. The system (130) according to claim 9, characterized in that, in order to monitor (S125) the request to switch from the current user mode to the new user mode, the source user equipment (131) also Used for: sending a broadcast event to said one or more target user equipment (132) connected to said source user equipment (131); A capability announcement message is received from each target user device (132), wherein the capability announcement message includes all target device capabilities, such as audio, video, text, health vitals data, or a combination thereof. 14. The system (130) according to claim 9, characterized in that in order to synchronize (S126) the categorized resource consumption information to the one or more On a target user equipment (132), the source user equipment (131) is also used for: When there is no new resource consumption information in the target user equipment (132), the classified resource consumption information is synchronized to the target user equipment (132) according to the contentType. 15. The system (130) according to claim 9, characterized in that, in order to synchronize (S126) the categorized resource consumption information to the one or more On a target user equipment (132), the source user equipment (131) is also used for: When there is new resource consumption information in the target user equipment (132), determining time stamps related to the new resource consumption information recorded by the source user equipment (131) and the target user equipment (132); selecting new resource consumption information with the latest time stamp, wherein the user equipment with the latest time stamp of the new resource consumption information is the source user equipment (131); The classified resource consumption information with the latest time stamp is synchronized to the target user equipment (132) according to the contentType. 16. A user equipment (131, 132, 140) for capability-based content presentation, characterized in that the user equipment comprises: A determining module (141), configured to determine (S121) new resources related to one or more other sensors, one or more functions of the one or more other sensors, or a combination thereof according to user activities in the current user mode consumption information; A content classifier (142), configured to classify (S122) the new resource consumption information into one or more classified resource consumption information; A local storage module (143), configured to store (S123) the classified resource consumption information; A detection module (144), configured to detect (S124) whether there is one or more target user equipment (132), whether there is a cloud database (133) or a combination thereof; A monitoring module (145), configured to monitor (S125) a request to switch from the current user mode to a new user mode; A data router (146), configured to synchronize (S126) the classified resource consumption information to the one or more target user equipments (132) according to the content type matching the content type of the source equipment. 17. The user equipment (131, 132, 140) according to claim 16, characterized in that the content classifier (142) is further used for: converting the new resource consumption information into JavaScript Object Notation (JavaScript ObjectNotation, JSON) format information, wherein the JSON format information includes DeviceID and contentType; Read the DeviceID and the contentType from the JSON format information; A data structure is created for the contentType in the JSON format information. 18. The user equipment (131, 132, 140) according to claim 17, characterized in that, the contentType includes a health vital sign data (Health-vitals, HV) content type, an audio data (Audio data, AD) content type, video data (Video data, VD) content type, reader data (Reader data, RD) content type, etc. 19. The user equipment (131, 132, 140) according to claim 16, characterized in that, the data router (146) is further used for: When the detection module (144) detects whether the cloud database (133) exists, the classified resource consumption information is synchronized to the cloud database (133). 20. The user equipment (131, 132, 140) according to claim 16, characterized in that the monitoring module (145) is further configured to: sending a broadcast event to said one or more target user equipment (132) connected to said source user equipment (131); A capability announcement message is received from each target user device (132), wherein the capability announcement message includes all target device capabilities, such as audio, video, text, health vitals data, or a combination thereof. 21. The user equipment (131, 132, 140) according to claim 16, characterized in that, the data router (146) is further used for: When there is no new resource consumption information in the target user equipment (132), the classified resource consumption information is synchronized to the target user equipment (132) according to the contentType. 22. The user equipment (131, 132, 140) according to claim 16, further comprising a conflict resolution program (147), the conflict resolution program (147) being used for: When there is new resource consumption information in the target user equipment (132), determining time stamps related to the new resource consumption information recorded by the source user equipment (131) and the target user equipment (132); selecting new resource consumption information with the latest time stamp, wherein the user equipment with the latest time stamp of the new resource consumption information is the source user equipment (131); The data router (146) is further configured to synchronize classified resource consumption information with the latest time stamp to the target user equipment (132) according to the contentType. 23. A computer-readable medium, characterized by comprising a computer program, which, when executed by a computer, causes the computer to execute the method according to any one of claims 1-8.

Images