Vision & Standards
The Fragmentation Problem
The field of user experience evaluation is characterized by a rich diversity of tools, methodologies, and frameworks. While this diversity reflects innovation and specialization, it also creates significant challenges. Researchers and practitioners face fragmentation that makes it difficult to:
- Compare results across different evaluation methods and tools
- Integrate findings from multiple evaluation approaches
- Share data and workflows between research teams
- Build upon existing evaluation results in new studies
- Ensure methodological consistency and rigor
- Sustain tools and methodologies over time
This fragmentation limits the cumulative progress of the field and creates barriers to collaboration, reproducibility, and the advancement of UX evaluation knowledge.
Our Vision
S-UXE's envisions an ecosystem where diverse UX evaluation tools and methodologies work together seamlessly, where standards provide common ground without constraining innovation, and where the community collectively sustains and evolves the evaluation infrastructure. This vision is built on the principle that interoperability and standardization should enhance, not replace, the specialized capabilities that make individual tools valuable.
Standards Alignment
The S-UXE's ecosystem is explicitly aligned with established international standards and widely recognized frameworks in human-computer interaction and user experience evaluation:
ISO 9241-210: Human-Centered Design
The ecosystem supports the human-centered design process outlined in ISO 9241-210, which emphasizes understanding users, their contexts, and their goals throughout the design and evaluation lifecycle. Our framework enables evaluation activities that align with the iterative, user-focused approach central to human-centered design.
ISO 9241-210:2019 specifies requirements and recommendations for human-centered design principles and activities throughout the lifecycle of computer-based interactive systems.
ISO 9241-11: Usability
The ecosystem provides structures for capturing and sharing usability metrics that align with the ISO 9241-11 definition of usability: the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use.
ISO 9241-11:2018 defines usability and provides guidance on specifying and measuring usability as part of the human-centered design process.
WCAG 2.2: Web Content Accessibility Guidelines
For web-based interfaces and digital products, the ecosystem incorporates evaluation criteria aligned with WCAG 2.2 at the AA level. This ensures that accessibility evaluation is integrated into the broader UX evaluation framework, recognizing that usability and accessibility are inseparable.
WCAG 2.2 provides guidelines for making web content more accessible to people with disabilities, organized around four principles: perceivable, operable, understandable, and robust.
Nielsen's Usability Heuristics
The ecosystem recognizes Nielsen's ten usability heuristics as a foundational framework for heuristic evaluation. These principles—from visibility of system status to help and documentation—provide a common vocabulary and evaluation lens that the ecosystem supports through interoperable evaluation data structures.
Jakob Nielsen's usability heuristics provide a set of general principles for interaction design, widely used in heuristic evaluation methods.
The UX Honeycomb
The ecosystem embraces the multidimensional view of user experience represented by the UX Honeycomb, recognizing that effective design must be useful, usable, desirable, findable, accessible, credible, and valuable. Evaluation frameworks within the ecosystem can assess and integrate findings across these dimensions.
Peter Morville's UX Honeycomb model provides a framework for understanding the multiple facets that contribute to positive user experiences.
Standards in Practice
Rather than imposing rigid compliance requirements, the S-UXE's ecosystem provides mappings, data schemas, and integration patterns that allow tools and methodologies to align with these standards while maintaining their unique approaches. This enables researchers to choose appropriate evaluation methods while ensuring that results can be understood, compared, and built upon within a standards-aware ecosystem.