STEAMbassadors

This was a research project centered solely on evaluating the usability of the website for STEAMbassadors- a program for Chicago youth to be able to become mentors/ mentees in STEAM subjects. We concentrated on refining the application process and enhancing overall user experience. We aimed to pinpoint usability issues, gather extensive data through testing, and offer actionable recommendations to improve user satisfaction and system efficiency.

Role

UX Research

Time

January 2024 - March 2024

“No research without action,

no action without research." 

- Kurt Lewin

What’s The Objective?

To identify pain points and areas for improvement within the platform to enhance user satisfaction and efficiency by gathering comprehensive data through usability testing, evaluating user interactions, and providing actionable insights for system enhancement.

Research Process

l. Heuristic Evaluation

We assessed the usability of the application and Gig selection process and identified navigation pain points, redundancy in functionalities, and UI challenges.

  • Visibility of System Status

    Severity Level: 4

    After submitting the application, there was no confirmation message or follow-up information provided. Without prior knowledge that an email confirmation would be sent, users might be left uncertain about whether their submission was successful.

  • System & Real World Match

    Severity Level: 3

    The language used throughout the application is clear and accessible, making it easy to understand without being overly simplified. However, some program descriptions were overly lengthy, leading to a loss of engagement.

  • User Control & Freedom

    Severity Level: 4

    The absence of a clearly recognizable back button creates a navigation inconsistency. Users may struggle to return to previous sections, as this differs from standard design conventions found on similar platforms.

  • Consistency & Standards

    Severity Level: 3

    The application uses multiple colors without an apparent organizational pattern, which initially caused confusion. However, aside from this, the overall visual consistency was maintained.

  • Error Prevention

    Severity Level: 3

    The application does not provide a confirmation prompt before submission, which could lead to accidental submissions and there is no option to edit the application post-submission. The “Closed Gigs” section is easily overlooked when scanning the available options. Lastly, STEAMville is not mentioned once in Gigboard- leading to confusion when the user is asked to navigate to it.

  • Error Recognition & Recovery

    Severity Level: 0

    No error messages have been encountered. A “Steps to Get Started” list is present on the Home/Gigboard page, providing users with guidance on navigating the platform.

  • Recognition & Recall

    Severity Level: 3

    Seemingly clear instructions are provided upon first signing into the Gigboard page, guiding users on how to proceed. However, continuing through is confusing and lacks a way for the user to find more information easily.

  • Flexibility & Efficiency of Use

    Severity Level: 3

    The “Explore Gigs” page feels redundant, as it directs users to the same gigs page while displaying an identical message at the top. The “Home” button should directly lead to the Gigboard page rather than the unnecessary intermediary screen. Users expecting to return to the Gigboard page via the Home button may find the current setup unintuitive. Having to make 2 accounts across 3 websites is inefficient.

  • Aesthetics & Minimalism

    Severity Level: 3

    Cleaner UI and consistency in wording could be improved for clarity and ease through the process and aid in usability, efficiency, and professionalism.

ll. Cognitive Walkthrough

Step I: Access STEAMbassadors Website

Step II: “Apply Now” & Fill Out the Form.

Step III: Access the Gig Board Link

Realistic action a user will take

Visible action control

Strong link between the control and the action

Appropriate feedback

Realistic action a user will take

The user must fill out the form to complete their profile before accessing and viewing relevant Gigs

Visible action control

Visible action control

We assessed the usability of the application and Gig selection process and identified navigation pain points, redundancy in functionalities, and UI challenges.

The user must log in to access the Gig boards

Visible action control

A direct link is provided in the email

Strong link between the control and the action

Logging in is consistent with nearly all platforms

Appropriate feedback

Takes the user to the Gig boards

Step V: Click “Explore Gigs”

Step VI: Select a Gig

Step VII: Return to Gigs Page

Realistic action a user will take

it is the primary way to view available gigs

Visible action control

There are two clearly labeled options on the homepage

Strong link between the control and the action

the wording indicates users will be taken to a list of gigs

Appropriate feedback

Both options direct users to the list of open gigs.

Realistic action a user will take

User must select a gig to participate

Visible action control

There is a clearly labeled “View” button

Strong link between the control and the action

Clicking “View” indicates an intent to get more details

Appropriate feedback

Clicking “View” opens the gig’s description

Realistic action a user will take

A user may want to explore other gigs after reviewing one

Visible action control

The back button is inconsistent with standard platform navigation

Strong link between the control and the action

Many useres are not familiar with or know how to navigate the “breadcrumb trail

Appropriate feedback

If the user can navigate back

The website has two buttons to get to the application

Strong link between the control and the action

The application buttons are not consistent in text but both clearly indicate clicking will allow the user to apply

Appropriate feedback

The user is not informed to expect a confirmation/ next steps email- they are given no information after submission

Realistic action a user will take

It is common for platforms to have access links in their confirmation emails

There is nothing to inform the user to expect an email that is pertinent to continuing

Strong link between the control and the action

The email clearly states the link grants access to the Gig board

Appropriate feedback

The user is not informed to expect a confirmation/ next steps email- they are given no information after submission

Step IV: Log In.

Realistic action a user will take

lll. Interviews

As a group, we focused on researching students with an interest in STEAM topics and mentorship. Our goals were to understand the needs, wants, and reasonings of prospective STEAMbassadors.

Screener Questions

  • Residency

    Do you live within the Chicagoland area?

  • Student Status

    Are you a high school or college student? 

  • Age

    Are you between the ages of 18 and 24?

  • Intrest

    How interested are you in STEAM?

Usability Testing

It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.

IV. Data Synthesis

My group interviewed a total of nine people. The interview questions were designed to explore the participants' levels of interest and experiences within the STEAM fields and mentorship. We also questioned them on their job application expectations and experiences.

Then we grouped relevant responses across all participants and created an affinity map and spectrum diagram to find patterns and themes among our data then created user personas based on them.

Analysis

Usability

The usability of STEAMbassadors is impacted negatively by issues with navigation and functionality:

  • Navigation: Moving through the site is frustrating and inefficient because of the lack of a back button.

  • Editing: Being Unable to edit the profile or application, results in frustration if the user needs to update their information.

  • UI: The interface lacks organization and clarity, making it harder for users to efficiently complete tasks.

Engagement

While there is a strong interest in STEAM-related opportunities, engagement with the mentorship component varied among users. Additionally, confusion and challenges within the application process contributed to negative sentiment.

Conclusion

STEAMbassadors has a strong foundation but usability issues, engagement challenges, and accessibility concerns create friction in the user experience. Addressing these concerns—through improved navigation, UI refinement, and better communication—will significantly enhance the platform’s effectiveness and user satisfaction.