Overview
This project investigates the efficiency of navigating through the browse menu and search bar on two major e-learning platforms: Udemy and Skillshare. Using a comparative analysis approach, we evaluated which platform offers a better user experience in course discovery. The study was conducted with 20 participants, analyzing their interactions with each platform to measure time efficiency and usability. The findings contribute to Human-Computer Interaction (HCI) by offering insights into information architecture and navigation design in digital learning environments.
Comparing Navigation Efficiency in E-Learning Platforms
Year
Dec 2022
A Comparative Analysis of Udemy and Skillshare
Team/
Aashay Shirsawad
Bhakti Moghe
Eve Martina Lange Yuanxi Jiang
Research & Methodology
Objectives
-
Assess how well-defined the Categories/Browse sections of Udemy and Skillshare are.
-
Compare the efficiency of the search bar on both platforms.
-
Analyze time on task as a key usability metric.
-
Collect participant feedback through pre- and post-task interviews.
Research Questions
-
Does the browse menu navigation differ in efficiency between Udemy and Skillshare?
-
How does search bar navigation compare between the two platforms?
Methodology
-
Participant Recruitment: 20 participants recruited through personal networks.
-
Task Design: Each participant was assigned a task to find a specific course (e.g., Italian Cooking for Beginners) using both the browse menu and search bar.
Data Collection
-
Time on Task (seconds) was recorded.
-
Pre-task interview captured demographic data (age, experience with platforms).
-
Post-task interview gathered qualitative insights on user perceptions.
Data Analysis
-
Paired Samples T-test & Wilcoxon Rank Test were used for statistical validation.
-
Box plots and descriptive statistics visualized navigation efficiency differences.
-
Qualitative feedback was categorized to identify patterns in user behavior and satisfaction.
Findings & Analysis
Participant Demographics
-
Age Range: 19-52 years (Mean: 25.5, Median: 24).
-
Platform Experience: 14 participants had no experience with Udemy, 17 had no experience with Skillshare.
-
Device Usage: 80% of participants used a desktop for e-learning, while 20% preferred mobile.
​
​
​
​
​
​
​
​
​
​
​
Browse Menu Navigation
-
Key Result: Skillshare's browse menu was significantly less efficient than Udemy's.
-
Statistical Test: Wilcoxon Rank Test → p < 0.001 (Skillshare took longer than Udemy).
-
User Feedback:
-
Udemy's categories were more structured & intuitive.
-
Skillshare's menu was less organized, making discovery harder.
-
Some filters in Skillshare only appeared after search, confusing users.
-
Users preferred visual cues and grouping for easier navigation.
-
Search Bar Navigation
-
Key Result: No significant difference in efficiency between Udemy and Skillshare.
-
Statistical Test: Paired Samples T-test → p = 0.372 (no major difference).
-
User Feedback:
-
Skillshare's search bar was less visible on the landing page.
-
Despite visibility issues, search performance was comparable.
-
Users expected predictive search suggestions to improve efficiency.
-
Key Takeaways
-
Information architecture matters: A well-organized browse menu improves usability.
-
Search visibility affects perception: Even if search performance is similar, UI placement can impact user satisfaction.
-
Consistency in filters is crucial: Users expect filtering options to be uniform across navigation methods.
-
Enhancing search recommendations: AI-powered search predictions could improve efficiency.
​
Impact & Future Considerations
​Key Contributions
-
Provides usability insights for UX designers improving e-learning navigation.
-
Highlights the role of structured information architecture in course discovery.
-
Offers a data-driven comparison that can inform future platform design choices.
-
Demonstrates quantitative and qualitative UX research methodologies.
Future Research Directions
-
Investigate mobile vs. desktop navigation differences.
-
Explore the impact of AI-driven recommendations on search efficiency.
-
Conduct longitudinal studies to measure user learning retention based on navigation methods.
-
Analyze behavioral patterns when users interact with different navigation styles.
-
Investigate the effect of personalized learning paths on engagement.
Design Recommendations for E-Learning Platforms
-
Based on our findings, we propose several design recommendations to improve course navigation efficiency:
-
Refine Browse Menu Structures: Categorization should be intuitive and well-defined to help users find relevant courses faster.
-
Improve Search Bar Visibility: Ensure the search bar is prominent on the landing page and incorporates predictive text.
-
Introduce Smart Filtering Options: Users benefit from consistent and visible filters across both browsing and searching methods.
-
Enhance Visual Navigation Aids: Including icons, grouping, and color differentiation improves usability.
-
Incorporate AI-Driven Personalization: Adaptive navigation systems that suggest relevant courses based on past behavior.