My main quest at Kaplan: increase engagement and usage of the LMS platform to increase the learning outcome in students.  

In this project, I solved for engagement, usage and efficacy by creating a practice experience for students that was juxtaposed at relevant touch points in the student journey. 

By blending the principles and practices of UX, product design, instructional design and learning sciences, I was able to create a measurable behavior change in the usage and efficacy of the platform. 

I, also, helped retire a clunky legacy system and built out a brand new LMS platform, with a focus on: Streamlining the overall IA, simplifying the flows, building components for flexibility and modularity.

www.kaptest.com
 

Principle Prototype of the Practice Experience

Practice Experience can be broken down in to the following modular tasks: quiz creation, quiz experience and quiz review and content review. Below is an interaction based prototype I created for this project. This prototype was made using Principle for mac. 

This is a responsive projects, see samples of screens and interaction in the gallery at the bottom. 

 

 
 

 

BEHIND-THE-SCENE

Every project is moulded by its design, development, team and organizational influences. While executing a traditional agile workflow for the delivery process, I kept the design strategy recursive and iterative by way of concept prototyping, continuous user feedback, A/B testing and data analysis. 

 

 
White boarding: Participatory design exercise with internal teams. 

White boarding: Participatory design exercise with internal teams. 

Harvesting Internal Knowledge

First off,  I leveraged internal knowledge into a user flow. I used participatory design exercises with tutors, trainers, learning science professionals and students of Kaplan. These were short 30 mins sessions with pizza and beer incentives.  This exercise created inclusion in my design process and helped me collect hypothesis to design and test. This process kept me from reinventing the wheel and saved time. 

 
 

High-level user flow

High-level user flow

Userflow

An immediate outcome to the participatory design exercise was this high level user flow that aimed to accomplish a few goals: aggregating requirements gathered from different teams and people, give developers an idea of how information will be organized (so they can begin POC work), do usability analysis to determine the UX foundation for the project. Key learnings:

Task Flow

The quiz experience for optimum learning must entail three major tasks - quiz creation, quiz experience and quiz review.

Quiz Creation

Student's will create quizzes to learn subject matter that serves the specific need of that time - the quiz creation experience must entail a high degree of customization to match user expectation.

Since, the quiz creation task is not contributing to the actual learning in students, this task must be designed for simplicity and ease-of-use. 

Quiz Review

The best learning outcomes are achieved when students review the quiz after submitting it. UX must create a habit loop of quiz creation, quiz taking and review for students to build a high learning outcome.

Increased amount of time spent reviewing a quiz is a measurable criteria for success for this project.

 
 
Responsive web user journey/screen flow.

Responsive web user journey/screen flow.

Responsive Web Design

 

I uncovered that Test prep contains a diverse range of content. For example, there are 65 different question type that require unique layouts for content display and interaction types. 

I hypothesized that users will find it hard to interact with test prep content on mobile screen as it can be very exhaustive and lengthy making small screen device usage cumbersome.

For example, passage based questions that require users to refer to a passage while answering questions would be cumbersome on the mobile screen. Quantitative data analysis revealed that quiz taking was not a traditional user behavior on mobile devices and saw only 10% of traffic when I tested a mock feature on the live site.

I worked with content teams to create a separate pool of content the application would use to serve questions for student using it on mobile devices. I wrote the content guidelines along with the content editors to incorporate mobile best practices and established tagging and taxonomy standards.  

 

Screenshot of a testing session conducted using Lookback (my primary testing tool)

Screenshot of a testing session conducted using Lookback (my primary testing tool)

Prototyping & User Testing

I iteratively enhanced prototypes and performed qualitative testing with the user. The testing followed a traditional process of test planning, participant recruitment, test execution and team/org share out. 

My team/org share out consist recommendations for improvement that undergo a round of scoping with product managers and engineers. 

An insight from the testing session

The quizzes use adaptive technology to deliver questions to the students, in which, a student's response to a particular question would determine the level of difficult of the next question. For example, if a student answers an easy Biology question, correctly, the next question served by the adaptive engine would have a relatively higher difficulty. This allows the technology to estimate the student's ability and further downstream in the student journey, it offers accurate recommendations. 

Design implication of this was to constrain back and forth navigation between questions, so that the user cannot switch answers to the questions they have already interacted with.

What I found: Answer switching was a very common user behavior and was directly proportional to the student's self-confidence. Thus, there was a need to educate the student on what it meant to practice using an adaptive quiz. 

Next steps: I worked around informational messaging to educate users on what to expect from the adaptive practice experience. I, also, started delegating and overlooking discovery projects  on how to help students internalize the adaptive form of learning. 

For more insights, get in touch with me: swatibahuguna@gmail.com

 

 
 

Reusable tab component: Screenshot of the living style guide component contributed by this project. 

Reusable tab component: Screenshot of the living style guide component contributed by this project. 

Components Library

I also helped build out the look and feel of visual components, creating a systematic and living Style Guide that improved workflow and served as a toolkit for consistent, clean UI across the digital experience.

 

 

UI & INTERACTION SAMPLES GALLERY

More available upon request. Please email swatibahuguna@gmail.com

 

Motion Sample: Question Review

Motion Sample: Question Review

Motion Sample: Hints and Bookmarking features

Motion Sample: Hints and Bookmarking features

Quiz Creation Screens

05 KAPE_HOMEPAGE_MOBILE_ALLREVIEWED@2x.png
02_SELECT TOPIC SMALL@2x.png
04 CUSTOMIZE- LEARN OFF SMALL@2x.png
05-Mobile Pagination.png

Quiz Experience Screens

Small-Major-375 Passage expand@2x.png
Small-Major-375 Timer Hide@2x.png
-time.gif
Small-Major-375 Pause@2x.png

Quiz Review & Performance Screens

IR 04 Non-PBQ-Small-375 incorrect@2x.png
IR 05 Non-PBQ Small 375 correct@2x.png
IR 13 PBQ Small Explanation@2x.png
REPORTING_MOBILE_CARS_EXP@2x.png

Error & Empty States Screens

NXT Error@2x.png
01 KAPE_HOMEPAGE_NEW USER@2x.png