mlCAF: Multi-Level Cross-Domain Semantic Context Fusioning for Behavior Identification

The emerging research on automatic identification of user’s contexts from the cross-domain environment in ubiquitous and pervasive computing systems has proved to be successful. Monitoring the diversified user’s contexts and behaviors can help in controlling lifestyle associated to chronic diseases using context-aware applications. However, availability of cross-domain heterogeneous contexts provides a challenging opportunity for their fusion to obtain abstract information for further analysis. This work demonstrates extension of our previous work from a single domain (i.e., physical activity) to multiple domains (physical activity, nutrition and clinical) for context-awareness. We propose multi-level Context-aware Framework (mlCAF), which fuses the multi-level cross-domain contexts in order to arbitrate richer behavioral contexts. This work explicitly focuses on key challenges linked to multi-level context modeling, reasoning and fusioning based on the mlCAF open-source ontology. More specifically, it addresses the interpretation of contexts from three different domains, their fusioning conforming to richer contextual information. This paper contributes in terms of ontology evolution with additional domains, context definitions, rules and inclusion of semantic queries. For the framework evaluation, multi-level cross-domain contexts collected from 20 users were used to ascertain abstract contexts, which served as basis for behavior modeling and lifestyle identification. The experimental results indicate a context recognition average accuracy of around 92.65% for the collected cross-domain contexts.


Introduction
Context-awareness (CA) is considered to be an essential element in the ubiquitous and pervasive computing systems [1] and is widely recognized by the research community. It is treated as a key technology for situation awareness applications such as [2,3]. Dey et al. [4] defined the context as "context is any information that can be used to characterize the situation of an entity". In the last two decades, significant work has been performed by developing CA prototypes, middleware, The rest of the paper is organized as follows: Section 2 presents the related work. Section 3 introduces short descriptions of the Mining Minds platform, the evolved ontology illustrated with examples and the extended architecture. Section 4 provides insights into ontology-based context reasoning, and usage of semantic rules. Section 5 discussed mlCAF with example scenarios for Vertical Fusioning and Horizontal Fusioning techniques. Section 6 introduces the details of experimental results and evaluation along with behavioral rule definitions. Finally, main conclusions are drawn jointly with future steps in Section 7.

Related Work
Nowadays, the most dominant context information consumers are mobile applications, which engage different capabilities of sensors in the shape of context [11]. Sensor-equipped smart devices are widely used for providing health monitoring services [17]. These devices provide intelligence for recognizing daily life activities performed by users like standing, walking, driving etc. Context-aware (CA) systems from an Internet of Things (IoT) perspective were also surveyed [5] as for how CA can play its role in aggregating contextual information rather than processing whole sensory data. The work [18] introduced details of context-aware systems and their role in developing applications for end users. The recent advancements in IoT identify that context-awareness has become an inevitable part of IoT applications. All the information related to sensors not only, from a specific domain but also from heterogeneous domains, comes under the definition of context-awareness.
The heterogeneous domains handle dynamic contexts in a smart environment, to represent daily life activities correctly and assist people well-being with technologies [19]. The cross-domain context management can also play the vital role in knowledge integration from different sources in even recommender systems [20]. The initial efforts on cross-domain context management in Feel@Home environment [21] addressed context producer-consumer patterns for intra-domain and cross-domain in home/office environment by using indoor applications and executing mobile applications on mobile devices. However, this framework supported distributed administration and processing of contexts. The challenges linked to the cross-domain context management were also addressed by [22], in which authors identified context patterns in the multi-domain environment and proposed iCROSS context management infrastructure. Lin et al. [23] developed a unified approach for mutual tagging of heterogeneous domains constituted by the people, their associated events at certain locations by integrating based on feature similarity and cross-domain relations.
Context act as a key binding element for integrating information at different levels [9] in multi-domains. For instance, context information can be a valuable input taken as a parameter for executing context-aware algorithms at different levels of healthcare tracking and monitoring applications. Events that occur in an environment can be recognized by identifying relevant actions and also by correlating sequences of actions [11] using fusioning across cross-domains. In [8], Khattak et al. discussed context representation and fusioning as an integral part of any context-aware system. It increases understandability, confidence and reduces redundancy. Contextual Information encompasses basic elements for situation awareness semantically [24]. The obtained contextual information can play substantial roles at different fusion levels by providing convincing clues with contextual spectrum which ranges from sensory data to human-provided information. Alti et al. [10] with their methodological centralized reasoning approach, showed the importance of context recognition and fusion regardless of its source. A three-layered context-aware system infrastructure with inference functionality was proposed in [12], but was unable to prove its deployment for real-world personalized user context identification.
Amongst different context modeling approaches such as: (1) key-value pairs; (2) model-oriented; (3) logic-based; (4) ontologies [25], we are motivated for choosing ontology in context modeling and reasoning. Some of the prominent work using ontologies as a based model is discussed, which includes SOCAM, CoBrA, COSAR, etc. SOCAM [26] is a Service-oriented Context-Aware Middleware that works on server-based architecture style with underlying ontology. This provides context-aware services in smart home and vehicle environment. It supports information sensing, semantic representation, and reasoning of context using SOCAM ontology by modeling person, activities along with locations leaving out nutrition contextual aspects. At the same time, CoBrA [27] is also an agent-based centralized middleware architecture connecting context modeling, reasoning, knowledge sharing through context brokers in an intelligent meeting room for places, agents and events only. COSAR [28] recognizes human activities and reasons context-awareness through hybrid reasoning techniques, i.e., ontological/statistical using mobile network services. However, it also focuses only on performed activities and their location in an activity recognition system.
In order to increase the ontological expressiveness and query answering, Web Ontology Language (OWL) and Semantic Web Rule Language (SWRL) can be integrated to execute knowledge-base system. OWL can be used for problem-solving modeling in terms of ontological development and SWRL may be applied for effective knowledge inference. Using these technologies, Chi et al. [29] constructed a system of chronic kidney disease dietary consultation and proved its effectiveness. In pervasive environments knowledge-driven approaches [30] provide an opportunity to knowledge engineers and domain experts for specifying domain models for capturing and reasoning over recognized activities. Using knowledge driven techniques, ontologies have proven their abilities in describing a service at a certain point of time in the form of abstract context. These abstract contexts assemble and desegregate knowledge relevant to the current situation, the work by Smirnov et al. [31] proposes a classification methodology related to their use in Decision Support Systems based on the fusion of context-based information. OWL knowledge-based systems and SWRL can infer new knowledge regarding habit associations of users in a smart home environment [32].
We have adopted context fusioning techniques in context-awareness with the support of the proposed framework called Multi-level Context-aware Framework (mlCAF). In order to obtain real-time abstract and richer context in cross-domains, fusioning can be incorporated to infer the abstract contexts in health and wellness domains. Moreover, our proposed framework enables CA platforms to provide better context to adopt behavior and life style.

Preliminaries on the Mining Minds Platform
Mining Minds, an innovative platform based on concepts of the digital health and wellness paradigm, provides personalized healthcare and wellness support. It is mainly the collection of innovative services, tools, and techniques applied collectively to monitor human's daily life data, generated from heterogeneous sources. To provide innovative services and utilize different tools, the Mining Minds platform architecture [33] is divided into five distinct layers: Data Curation Layer, Information Curation Layer (ICL), Knowledge Curation Layer, Service Curation Layer and Supporting Layer [34]. In a nutshell, Data Curation Layer is in charge of acquisition, processing and persisting the asynchronous, real time, multimodal sensory data obtained through heterogeneous sources like SNS, smart phone, Kinect, wearable biomedical devices etc. This processed sensory data is used by ICL [35] to model Low-level Context (LLC), and infer High-level Context (HLC). Health and wellness knowledge is maintained through domain experts or knowledge engineers in Knowledge Curation Layer, which contains rules used to determine personal contexts and behavior. Service Curation Layer caters users with personalized situation aware recommendations based on determined context and knowledge from Knowledge Curation Layer. Finally supporting layer is responsible for advanced analytics, feedback, privacy and security for the Mining Minds platform.
Mining Minds supports automatic behavior identification through inferring multimodal human context using heterogeneous sensory data. These contexts are identified at two granular layers namely Low-level Context Awareness (LLCA) and High-level Context Awareness (HLCA). LLCA comprises of physical activities, emotions, and location, which are obtained through machine learning classification techniques. These are applied over sensory data obtained through several devices, such as smart watches, smart phones or Kinect video devices [34]. Also, food items taken during meals are processed through user's specific tagged meal images, which are collected using the smart phone camera. This study also handles contexts for people with two different chronic diseases, diabetes and hypertension, by capturing blood glucose levels, blood pressure, and helps in determining health conditions with the help of clinical health contexts. This work portrays more comprehensive state of the user in which dietary habits are attached to physical activities and health conditions for better identification of human behavior using sensing modalities in the Mining Minds platform.
Mining Minds seamlessly supports people's lifestyles by intelligently fusing human's daily physical activities and nutrition information along with emotion and location. Behavioral patterns can be derived using diverse HLCs, modeled through inferring over LLCA. ICL layer utilizes the Mining Minds Context Ontology (MMCO), which is considered as conceptual backbone for modeling, representing, and inferring HLCs from LLCs. Existing framework [13] lack capability to capture ontological nutrition, health state LLCs and corresponding HLCs. Nutrition is, as important as, physical activities, these are considered most fundamental parts for human health and well-being. Any of unhealthy behavior relating to physical activity or diet may lead to chronic diseases and premature mortality. However, by managing the physical activities patterns and practical dietary risk for chronic diseases can be reduced.

Role of Physical Activities and Nutrition in Diabetes Management
There is a strong relationship between physical activity, dietary habits, and diabetes for people suffering from some chronic disease. Usually, exercises are recommended to all those people who suffer from diabetes as a part of a glycemic control and overall health [15]. In daily life activities, all such individuals are encouraged to decrease the sedentary activities and advised to get involved in healthy activities. These activities are performed by adapting behavior-change strategies, and technology-based strategies which enable people to promote the adoption and maintenance of physical activities. These physical activities help in blood glucose management and overall health maintenance for individuals with diabetes and prediabetes. There is an association between physical activities and the management of glycemia in the individuals having intermediate hyperglycemia or prediabetes [36]. This study provides a strong evidence regarding how an improvement in physical activities can result in lowering diabetes and cardiovascular risks. This lifestyle modification helps individuals in reversion to normoglycemia health conditions. Han et al. [37] proposed a layered healthcare framework for recognizing user's activities, identifying and providing unhealthy activity patterns to the caregiver. This study claims the possibility of predicting lifestyle diseases associated with an emotional state such as depression; chronic disease like diabetes using sensory data. It is mainly managed by monitoring long-term disease influenced activities such as like frequent eating, frequent drinking, sleeping disorder, less physical activities, etc. Our previous work handled only physical activities, whereas the presented work includes nutrition and chronic disease domains modeled in the ontology. Ontologies model domain-specific concepts and provide reasoning facilities, for this we evolved our previous ontology, only which handled physical activity contexts.

Mining Minds Context Ontology Evolution
In the context modeling world, ontologies outweigh non-semantic models in terms of knowledge sharing, flexibility, reusability, abstraction and validation [17]. Ontologies are, therefore, extensible, expressive, possess decoupling nature, as knowledge and code can co-exist. Additionally and more specifically ontologies enable derivation of new information based on hierarchical structure from existing underlying concepts using class and properties inheritances. Ontologies are evolvable as they provide rich quality and expandable abstract model by including new concepts along with existing ones with handling support of inconsistencies. Besides semantic modeling, ontologies are also supported with the bunch of reasoners, which can be inherently applied for inference and reasoning tasks. Finally, inferring context using ontologies have several implementation benefits in the application development architecture, as these possess resilience and evolving features. These features make ontologies extendable and adaptation of ontology by the architecture itself. Keeping all the above mentioned facts and benefits, we extended our previous ontology by incorporating all associated contextual features for the study under consideration. The open-source Mining Minds Context Ontology (MMCO) [38] models daily life contexts, used for human behavior identification which is inevitable for the provision of personalized health and wellness services. A comparative ontological metrics analysis is presented in Table 1, as how ontology evolution has resulted in an increase in ontology metrics, and axioms. Existing work [6] used around 45 classes to model physical activity contexts but in order to add concepts pertaining to nutrition and chronic disease, the classes count raised to 225 along with associated properties and expressivity which is discussed further in this section in detail. In Mining Minds, human context is understood as any information characterizing the physical, nutritional, emotional, health and social situation of a person leading towards the better identification of human behavior. In the development of OWL2 ontologies, Classes act as a source of an abstraction mechanism for organizing resources with similar characteristics. Furthermore, individuals, also called instances, are members of the OWL Classes and can be related to others using properties. In Mining Minds, the subClassOf constraint is used for designing, assigning classes and individuals for LLC, and HLC. These HLCs are further categorized as Physical Activity High-level Contexts (PA-HLCs), Nutrition High-level Contexts (N-HLCs) and Clinical High-level Contexts (C-HLCs) classes. The main concept of MMCO ontology is the HighLevelContext class, which has three subclasses as PhysicalActivityContext, NutritionContext and ClinicalContext defining the different high-level contexts in the domains of physical activity, nutrition and clinical. The Location, Emotion, Activity, Food, BloodPressure, BloodGlucose, and WaterIntake classes have been described to model the different Low-level Contexts (LLCs). These classes are related to the class HighLevelContext, with the help of object properties hasLocation, hasEmotion, hasActivity [13], hasFood, hasBloodPressure and hasBloodGlucose.
The scalable MMCO comprehensively models contexts at different abstraction levels. PA-HLC are modeled based on the LLCs belonging to the categories Activity, Location, and Emotion. PA-HLC includes contexts for sedentary and active physical activities such as OfficeWork, HouseWork, Amusement, Gardening, Commuting, Sleeping, Exercising, and Inactivity discussed in detail by Villalonga et al. [6]. The N-HLC are modeled based on LLCs of the category Food which is described in a 57 food-item list and further categorized into 10 broader groups. This categorization and major nutrient identifications are performed in accordance with guidance and suggestions provided by United States Department of Agriculture (http://www.usda.gov/wps/portal/usda/usdahome) on daily food consumptions. Specifically, the different recognized Foods are categorized using 10 disjoint subclasses of the Food class, namely Grain, Meat, SeaFood, Eggs, MilkAndDairyProducts, Legumes, Nuts, Fruits, Vegetable, and Snacks. The identified 57 food items are members of these classes, as can be visualized in MMCO [38]. N-HLC models major food nutrient like Carbohydrates, Protein, and Fats which can be determined using LLCs belonging to the category Food. The C-HLCs are modeled based on LLCs comprising of 6 LLCs categories for BloodGlucose, 5 LLCs for BloodPressure and 3 LLCs for WaterIntake. Table 2 shows these underlying LLCs and describes the value ranges for each LLC. These LLCs are assigned based on the BloodGlucose values obtained through smart glucose meter, BloodPressure values captured through smart blood pressure monitor, and accumulated water intake values obtained through smart cup. Finally C-HLC reflects four major health states for diabetic patients, such as normal, moderate, high risk and very high risk health state.
The PhysicalActivityContext comprises of eight disjoint subclasses as discussed in our previous work [6]. However, the new NutritionContext and ClinicalContext classes are further divided into disjoint subclasses. The NutritionContext class, which represent N-HLCs has three disjoint subclasses decided based on major nutrient in food items, they are named as Carbohydrates, Protein, and Fats. The ClinicalContext class, which represents C-HLC class, is further subdivided as NormalHealthState, ModerateHealthState, HighRiskHealthState, and VeryHighRiskHealthState also shown in Figure 2 as a partial part of MMCO. Each NutritionContext and ClinicalContext subclasses are defined through complement classes, existential and universal axioms. These axioms constitute the necessary conditions required for equivalent anonymous class definitions. The equivalent anonymous classes for these NutritionContext and ClinicalContext subclasses have been described in Protégé and are shown in Figure 3. Table 2. Low-level Context labels assigned based on ranges of values.

Low-Level Context Labels Value Ranges
Blood Glucose [39] (mg/dL)   In order to explain equivalent Class concepts, the N-HLC is modeled via the Fats class, Figure 3a, is considered as being equivalent to the anonymous class with certain constraints like NutritionContext and (hasActivity some Eating) and (hasLocation some (Home or Office or Restaurant)) and (hasActivity only (eating) and (hasLocation only (Home or Office or Restaurant)) and (hasEmotion only (Happiness or Disgust or Boredom or Anger or Neutral)) and (hasFood only (Beef or ChickenSnack or FriedFood or Ham or HamBurger or IceCream or Mackerel or Milk or Peanut or Pork)). This assures that to become instance of the defined class Fats, an individual of the NutritionContext class must have an object property of type hasActivity, which has to be associated with an instance of the Eating class, and this object property must take as only value an instance of the Eating class. Moreover, the instance of the NutritionContext class must also meet the condition for having a property of type hasLocation relating to an instance of the Home or Office or Restaurant class and only to an instance of the Home or Office or Restaurant class. The instance referring the NutritionContext class has an object property of type hasEmotion, this property must also relate to an instance of the Happiness class, the Disgust class, the Boredom class, the Anger class, or the Neutral class. Finally, the property of type hasFood, must relate to an instance of the Beef class, the ChickenSnack class, the FriedFood class, the Ham class, the HamBurger class, the IceCream class, the Mackerel class, the Milk class, the Peanut class, or the Pork class. In the definition and for inferring of Fats class the hasFood object property and hasActivity some Eating axioms are mandatory due to existential and universal restrictions on the involved object properties in addition to hasLocation and hasEmotion object properties. Similar class concept equivalence definitions are formulated for other N-HLCs, Carbohydrates and Protein classes and C-HLC subclasses i.e., NormalHealthState, ModerateHealthState, HighRiskHealthState, and VeryHighRiskHealthState.

High-Level Context Awareness in a Nutshell
In Mining Minds, the core technologies devised for the inference and modeling of the user's context constitutes the Information Curation Layer, which is further subdivided to Low-level Context Awareness (LLCA) and High-Level Context Awareness (HLCA) as mentioned in Figure 4. The sensory data obtained through user is converted to Low-level Context (LLC) using machine learning approaches and it also becomes the basis for inferring in order to obtain High-Level Contexts (HLC) of three types i.e., Physical Activity High-Level Context (PA-HLC), Nutrition High-Level Context (N-HLC) and Clinical High-Level Context (C-HLC). The components drawn in by bold lines are the architectural perspective contributions to the existing work in order to improve context recognition and better behavioral modeling using nutritional and clinical information. LLCs contain seven main context categories Activities, Locations, Emotions, Food, BloodSugar, BloodPressure, and WaterIntake, which are recognized through respective recognizers. Activity LLC is identified from the body actions and mobility, positioning systems helps in identifying Location LLC, Emotion LLC is obtained from the user sentiments detected through voice recognizing systems [35]. Food LLC is obtained using labels of food items sent by users by capturing pictures of meals by using smart-phone. BloodSugar values are taken using a smart glucose meter, which communicates with the Mining Minds platform using API, BloodPressure is measured using the smart blood pressure monitor, and WaterIntake notifier gets input from the smart cup.

Context Reasoning
The main purpose of context reasoning is to check the consistency of contexts as well as deducing high-level implicit context information from low-level explicit contexts. In this study, ontology-based reasoning is performed with additional assistance for user-defined SWRL rules and SPARQL/SQWRL queries.

Ontology Based Reasoning
In Ontology-based reasoning, inferring is done based on ontological constraint-based rules exploiting transitive property, subClassOf , subPropertyOf, disjointWith and inverseOf properties. However, inclusion of complex rules increases the expressibility of ontological model, which enhances the ability of handling the multi-level context assertions.

SWRL Based Reasoning/SQWRL Based Retrieval
SWRL rules, an extension to OWL-DL is one of semantic rule representation for representing knowledge. These rules are designed to obtain the desired outcome based on already stored facts meeting several conditions and adds more power to OWL capabilities for deductive reasoning. Integration of SWRL to ontological based inferring systems have shown their importance for context-aware applications [41]. Ontological models have limitations for handling complex rules as in our case fusing multi-level cross-domain contexts, which are discussed in subsequent sections. SWRL adds flexibility in fusing Multilevel contexts thus resulting in inferring of additional contexts using already asserted facts. SQL like querying is human understandable, an introduction of Semantic Query-Enhanced Web Rule Language (SQWRL) on top of SWRL provides SQL-like operators for querying and extracting semantic information. SQWRL uses SQWRL Query API (https://github.com/ protegeproject/swrlapi/wiki/SQWRLQueryAPI) interface for executing the queries and accessing the results in a two-dimensional table.

Multi-Level Cross-Domain Context Fusioning
In the Mining Minds, we ideally focused on a solution catering contexts from multiple domains, as a proof of concept, we considered PA-HLC, N-HLC and C-HLC such that these are handled separately on one-level, fused together on another level and finally more concrete and abstract multi-level cross-domain contexts are obtained suggesting human behavior and lifestyle. This has helped in increasing the ability to apply our proposed solution to multi-domains, which initially was only composed of physical activity domain.
In Figure 5, a summarized overview is provided how the overall mechanism of mlCAF utilizing vertical fusioning and horizontal fusioning are performed at different levels, particularly with time constraints and reasoning periodicity. This horizontal fusioning is achieved using SWRLAPI (https://github.com/protegeproject/swrlapi) which works on top of OWL-based SWRL and SQWRL [42] query language discussed in the implementation Section 6. SQWRL uses SWRL's conjunctive semantic structure as its formal underpinning by providing novel set operators used to perform closure operations such as negation, additionally with counting, and aggregation.

Vertical Fusioning: Context Inferring in the Mining Minds
The MMCO is utilized to infer PA-HLC, N-HLC and C-HLC in a vertical fusioning manner utilizing ontological reasoning (Level-II). Using Pellet reasoner, an instance of the PhysicalActivityContext class, i.e., an unclassified PA-HLC, can be determined to be associated with one of the eight PhysicalActivityContext subclasses as mentioned in [13]. An instance of the NutritionContext class can be determined to be a member of one of the three NutritionContext subclasses: Fats, Carbohydrates, and Protein. Similarly, an instance of the ClinicalContext class, can be determined to be a member of one of the four ClinicalContext subclasses: NormalHealthState, ModerateHealthState, HighRiskHealthState, and VeryHighRiskHealthState. The instances of the Food class are asserted through the hasFood property, whereas instances of the BloodGlucose and BloodPressure classes are asserted using hasBloodGlucose and BloodPressure properties respectively. Reasoning in OWL is based on the Open World Assumption (OWA), which means that an assumption cannot be made for something if it does not exist until its nonexistence is declared explicitly. Following is an example discussed in order to illustrate the modeling principles and the inference logic through MMCO in the Protégé tool as shown in Figure 6. Figure 6a shows an instance of the NutritionContext class for which the object property hasActivity has been asserted to take the value act_eating, hasEmotion object property has been asserted to take the value emo_happiness, hasFood property has been asserted to take the value food_fried_food, hasLocation property has been asserted to take the value loc_restaurant and hasUser property has been asserted to take the value Bob; where act_eating is an instance of the Eating class, emo_happiness is an instance of the Happiness class food_fried_food is an instance of the Fried_Food class and loc_restaurant is an instance of the Restaurant class. Due to the OWA, the instance of the NutritionContext class has been asserted the type (hasActivity only act_eating) and the type (hasEmotion only emo_happiness) and (hasFood only food_fried_food) and the type (hasLocation only loc_restaurant) and the type (hasUser only Bob). The reasoner is used to automatically classify this instance of the NutritionContext class. The instance complies with the Fats class definition; therefore, it is classified as being a member of the Fats class. The Context Reasoner infers Fats using vertical fusioning as LLC belongs to nutrition domain i.e., Food name and Activity Eating comes from physical activity domain as shown in Figure 6a. Similarly, vertical fusioning infers Carbohydrates and Protein. These contexts are concurrent, due to their overlapping temporal properties, we considered them as they are handled through vertical fusioning inferring. This process is scalable as we can fuse as many concurrent contexts depending on ontological modeling and service requirements.
An example scenario is plotted in Figure 7 explaining how vertical fusioning works on concurrent contexts i.e., Level-II fusioning as discussed previously in Section 5.1. These overlapping contexts are vertically fused to obtain abstract context form, using ontological based reasoning. Different vertically fused contexts are plotted based on overlapping low-level Activity, Emotion, Location and Food contexts.

Horizontal Fusioning: Context Inferencing in the Mining Minds
The SWRL rules have been designed over and above with MMCO constraint-based rules, by keeping temporal characteristics of concurrent low-level contexts, inferred PA-HLC and N-HLC in view. SWRL combines these atomic dynamic contexts to provide a complete picture of highly interrelated atomic low-level contexts, PA-HLC and N-HLC. The general form of SWRL rule looks like as mentioned below.
where α i symbolizes atomic low-level contexts (i.e., Activity, Location, Emotion, Food and clinical contexts), PA-HLCs, N-HLCs, C-HLCs and properties connecting these contexts whereas β i represents outcomes of α i in abstracted way named as behavioral contexts. These α i , β i can be of the form C(x), P(x,y), etc., where C represents OWL concept description and P represents OWL property, and x, y are termed as Datalog variables. On both sides of arrows, these are connected using conjunctions. The resulting behavioral contexts are then utilized for lifestyle identification. The contexts obtained using vertical fusioning do not provide enough evidence to establish human behavior as long as they belong to user's context at the point of time as shown in the example scenario, Figure 8. In order to get better picture, a mechanism is devised for fusing vertically fused contexts to a more abstract form, such that it can result into better behavior modeling. In this case, the time window will appear bigger rather than in seconds as in the case of VF. We obtained higher abstraction (Level-III, see Figure 5) for contexts spanning even more than a day, by fusing several vertically fused contexts using defined SWRL/SQWRL rules and queries. In order to prove the HF concept, considering these inferred PA-HLC, N-HLC and C-HLC along the time-line, they are reasoned at different point of time, means horizontally along with the timeline. With the introduction of SWRL/SQWRL rules additionally, as mentioned in Table 3 more multi-level contexts are obtained explained in next sections.
Using SWRL rules, retrieval through SQWRL, horizontal fusioning of cross-domain contexts from different levels is accomplished.    Figure 8. Illustration scenario explaining Horizontal Fusioning.

Implementation Details
The following sections discuss in detail about the implementation test environment, which was constructed using Semantic Web APIs. Furthermore the evaluation for results and introduction of advanced queries along with detailed description are presented.

Test Environment
All experiments were performed on a single machine under 64bit Enterprise edition of Microsoft Windows 7 on the top of AMD A10-5800K APU with 12 GB of RAM. Java engine was executed with Eclipse IDE Luna that ran using JRE 1.8.0_45-b15 64-bit version.

Semantic Web APIs Usage Details
The implementation [14] of HLCA in mlCAF is performed in Maven (https://maven.apache.org/) based project management with Java along with available open source library, Apache Jena v2.11.2 (https://jena.apache.org/). The component High-Level Context Builder receives unstructured low-level information, namely locations, activities, emotions, food, BloodGlucose, and BloodPressure. The Context Mapper maps received low-level information in the form of the label for Activity, Location, Emotions, Food, BloodGlucose, and BloodPressure along with meta-data comprising of Start-time, user-info, etc., using semantic web framework including RDFS [43], OWL2 [44], and OWL-API (http://owlapi. sourceforge.net/). It transforms this information into ontological triple format. The Physical Activity Context Synchronizer takes concurrent low-Level contexts like Activity, Location and Emotion valid at the same moment in time. Similarly, Nutrition Context Synchronizer processes whenever food low-level context has arrived. Nutrition context synchronizer takes the "Eating" activity low-level context along with Food low-level context in addition to emotion and location. The synchronized LLCs are obtained by SPARQL queries [45] using Union operators capable of combining two or more SELECT statements as mentioned in Figure 9 labeled as Block 1 and Block 2. Block 1 retrieves results pertaining to underlying cross-domain LLCs whereas Block 2 structure is designed to retrieve nutrition LLCs. The obtained synchronized LLCs are remodeled to unclassified HLCs depending on the concurrent LLCs. These different synchronized LLCs can be visualized in Figure 10  Notifier or Nutrition Context Notifier makes the newly inferred HLCs Figure 11 to the Mining Minds or any third party entity for behavior analysis and recommendation generation.

Experimental Results
The evaluation has consisted in the collection of around 141,872 Low-Level Contexts and 36,276 recognized High-Level Contexts belonging to 20 different adult volunteers in real environment using MM platform involving mlCAF framework. In example scenario, we considered user's LLC, PA-HLC and N-HLC spanning over-a-week as a case study to explain and provide enough evidence for vertical fusioning and horizontal fusioning, so that we can validate sedentary and active behaviors. The graphical representation mentioned in Figure 12 shows the HLCs inferred for different users with vertically fused PA-HLC and N-HLC. This representation gives intuition how vertical fusion helps in reducing huge volume of low-level contexts to PA-HLC and N-HLC. So instead of communicating all HLCs with third party entities, only whenever the change occurs, the respective vertically fused HLCs are delivered thus reducing network communication amongst entities. Out of 36,276 HLCs, only 4144 PA-HLC, N-HLC, and C-HLC were communicated behavior modeling APIs as shown in Figure 12.
Heatmap confusion matrix representation shown in Figure 13 provides accuracies for recognized HLCs (i.e., PA-HLCs, N-HLCs and C-HLCs). Around 7.35% HLCs were not classified by the reasoner whereas 92.65% HLCs were realized correctly. It is evident that good accuracy results were achieved using cross-domain context fusioning, however, some missing LLCs lead to the declined accuracies for HLCs especially for N-HLCs. For a collected dataset, we evaluated how HLCA correctly inferred high-level contexts based on low-level contexts for the 15-s sliding window. We used the precision and recall measures to evaluate HLCA in mlCAF as shown in Figure 14 to address our performance challenges. The high inferring accuracy proved that HLCs are rarely misclassified but the problem arises when missing LLC leads to wrongly recognized HLC.
• Precision: Number of HLC correctly inferred by mlCAF divided by the total number of HLC defined in MMCO. • Recall: Number of HLC correctly answered by the mlCAF divided by the total number of mlCAF in the dataset.
Uncertainty exists in ontological reasoning which leads to ambiguous results. By carefully analyzing Unidentified PA-HLC and N-HLC, it was realized that Unclassified HLCs are inferred to Unidentified PA-HLC and N-HLC with some missing or wrongly identified low-level contexts as shown in Figure 15.

SQWRL based advanced Queries
In context-awareness for user personalization, SWRL/SQWRL queries were designed to aid horizontal fusioning to obtain human behavior. As mentioned in Table 3 the antecedent of each SWRL/SQWRL represents a conjunction (or union) of the user, LLC, PA-HLC, N-HLC and associated properties. These rules are constructed as per logic flow described in Figure 5. Daily physical activities, food intake and eating patterns can also have substantial effects on human health. Food intake frequency can induce healthy benefits and influences of the timing of meals and frequency on health may be large [46]. Healthy eating can be judged by identifying meal frequency and has a deep relationship with physical activities. In order to observe nutrition intake quantity meal frequency is also determined and queried. In this study, we presented SQWRL related to query constructions for behavior context based on user sedentary behaviors and also considered identification of meal frequency.

Conclusions and Future Work
This paper has presented the ontology-based modeling and cross-domain context fusioning, associated implementation using multi-level Context-aware Framework mlCAF, methods for transforming Low-Level Contexts (LLCs) into Physical Activity High-Level Context (PA-HLC), Nutrition High-Level Context (N-HLC) and Clinical High-Level Context (C-HLC). These PA-HLC, N-HLC and C-HLC are transformed using ontological based inference resulting in the vertical fusioning for cross-domain low-level contexts. In this work, the Mining Minds Context Ontology (MMCO) was extended to cater cross-domain contexts from physical activity, nutrition and clinical domains in order to identify major nutritional patterns and behaviors for users. It is pertinent to mention that a broader picture of human behavior modeling and lifestyle determination is obtained by using SWRL/SQWRL additionally as a horizontal fusioning, which keeps on creating associations amongst PA-HLC, N-HLC, C-HLC, and even LLCs at different levels. The main motivation behind this work lies in correctly identifying user's daily life contexts, behavior identification, as lifestyle, which lead to better community care and wellness. So the key direction that underpins our ongoing research in the Mining Minds involves real-time human behavior modeling and lifestyle prediction using cross-domain contexts. In this regard, experimental results indicate a context recognition average accuracy of around 92.65% for the inferred cross-domain contexts at different fusioning levels. Moreover, investigations are still underway for the identification for more efficient context fusioning mechanism through semantic technologies. it is confirmed that there is still a need for relevant data within in the referred time, which is to be used in the Mining Minds with MMCO for more accurate PA-HLC, N-HLC and C-HLC contexts situation analysis. In addition, creation and execution of more SWRL/SQWRL rules will have a significant impact on the overall platform in terms of better behavioral modeling and lifestyle identification. In future, we are planning to extend SWRL/SQWRL for lifestyle modeling and perform prediction analysis using inductive reasoning by applying data-driven approaches on gathered dataset i.e., A-Box assertions in the Jena Triple-store Database.

BP
Blood Pressure BG Blood Glucose VF Vertical Fusioning HF Horizontal Fusioning