Abstract
Smart learning environments (SLEs) extend conventional Learning Management Systems by adapting content delivery to the cognitive profile, prior knowledge, and behavioral patterns of individual learners. Although the technical realization of such systems is increasingly well documented, their empirical evaluation remains comparatively underdeveloped, and assessment efforts frequently rely on subjective impressions rather than reproducible measurement. This paper addresses that gap by proposing a results-based, tri-pivotal evaluation framework that unifies pedagogical, technological-usability, and learning analytics dimensions into a single, database-grounded measurement model. The framework is instantiated on OSEME, an ontology-driven adaptive platform that integrates a Felder–Silverman learning style profiler, a domain-knowledge assessment in Music History, and real-time analytics visualization within a modular PHP/MySQL architecture. To operationalize the framework, we specify formal use cases, a structured user testing protocol with task-level success criteria, and a set of case-study designs, including a controlled A/B retention experiment and a System Usability Scale (SUS) assessment. Use cases, user tests, and case studies are presented in tabular form to support replication. The contribution is methodological: a transferable evaluation blueprint that converts platform telemetry into actionable evidence of pedagogical effectiveness, technical performance, and usability.