UX Tea Break: The paradox of usability benchmarking

Subscribe to my channel: bit.ly/2NBKaOe
I answer the question, "How do I go about using a summative usability test to benchmark UX?"
Want to see other questions I've answered? Try the video finder: www.notion.so/userfocus/UX-Te...
- My Udemy class: uxtraining.net/index-udemy.html
- My book, 'Think Like a UX Researcher': uxresearchbook.com
_______________________________________________________________________________________________
I can bring live, instructor-led training to you via Zoom. All you have to do is provide the delegates:
- BCS Foundation Certificate in User Experience bit.ly/2XQTaTA
- Introduction to User Experience bit.ly/2NAeHMd
- User Research Fundamentals bit.ly/2LBfh9Q
- Design ethnography: Take control of customer visits and interviews bit.ly/2RYfqFy
- Usability testing: Take control of testing your product with users bit.ly/30el89e
- How to design and implement web surveys bit.ly/2YBEQeF
- Improving your impact as a user researcher bit.ly/2XQU5U2
Contact me about UX training: bit.ly/2XqtXjk
_______________________________________________________________________________________________
Let's connect:
- Twitter: / userfocus
- Facebook: / userfocus
- LinkedIn: / davidtravis
- Instagram: / uxresearchbook
--
Spanish captions (when present) provided by the LabX of Sperientia [studio+lab]® (México)

Пікірлер: 20

  • @chinskazupka666
    @chinskazupka6664 жыл бұрын

    This channel is pure UX gold. Thank you so much for sharing with us! It's priceless knowledge !

  • @DavidTravis

    @DavidTravis

    4 жыл бұрын

    "Pure UX gold"! I love it! Thanks.

  • @osoperezoso2608
    @osoperezoso26084 жыл бұрын

    Anyone else loves when David laughs? It's good to see the humor in a subject that people take so seriously at times.

  • @geoffwilsoncomedy
    @geoffwilsoncomedy4 жыл бұрын

    Hehe that was the most 'heated' one you've had yet! That fiery passion on the topic came through haha.

  • @DavidTravis

    @DavidTravis

    4 жыл бұрын

    Truth!

  • @samssalman
    @samssalman4 жыл бұрын

    Great content and an interesting take on the issue. What I usually do is to try to provide a combination of both quantitative UX data AND qualitative research. Especially for important tasks or actions related to solving critical or severe pain points. I have a question, for a future video perhaps. based on your recommendation regarding the 2 questions to ask in a field study; could you tell us about a time when you had UX project that you really loved or were passionate about? what was it about? again thank you for the great content

  • @DavidTravis

    @DavidTravis

    4 жыл бұрын

    I agree, I think that's the best solution, combining both types of method. And thanks for the question -- I'll add that to my list!

  • @katwinerl1622
    @katwinerl16225 ай бұрын

    Love your channel and book "Think Like a UX Researcher"! I'm a UXR myself and often find myself in discussions with management who are allergic to qualitative research findings. They would rather have me make up a quantitative score on the spot than listen to my qualitative findings. How do you get management to take qualitative research seriously?

  • @DavidTravis

    @DavidTravis

    5 ай бұрын

    In my experience, the reason people don't take qualitative research seriously is because they think it's all focus groups. Get them to observe a usability test, even if it's for just 20 minutes. This will change their preconceptions because it has so much face validity.

  • @alecxisct
    @alecxisct4 жыл бұрын

    Thank you for sharing this video, I would like to know in wich company scenario will be better to run a quantitative usability testing? considering these paradoxes that you mention

  • @DavidTravis

    @DavidTravis

    4 жыл бұрын

    Well, it depends. If it's a low UX maturity organisation then running a quantitative study *might* give them the usability testing bug which *might* encourage them to run small sample qualitative studies. But then again, it might not. If it's a high UX maturity organisation then they know better what to do with the data - but the data won't be as good as they can get from their data analytics and A/B testing. That's the nature of paradoxes I'm afraid.

  • @marciaelisabetesanto
    @marciaelisabetesanto4 жыл бұрын

    Thank you for creating this channel. These videos are very useful. I have one question and hope you answer it here or in a next video: What sources of really good UX research content do you recommend? Thanks again for your channel 😊

  • @DavidTravis

    @DavidTravis

    4 жыл бұрын

    I wrote a blog post on this a while back. You'll find it here: www.userfocus.co.uk/articles/ux-reading-list.html

  • @marciaelisabetesanto

    @marciaelisabetesanto

    4 жыл бұрын

    @@DavidTravis great! Thank you very much 😊

  • @MohamedEmadPG
    @MohamedEmadPG4 жыл бұрын

    Hello! Thanks a lot for all what you share with us. My question is: What is the difference between the quantitative product metrics that UX designer is keen to collect and the ones product manager is doing ?

  • @DavidTravis

    @DavidTravis

    4 жыл бұрын

    Thanks for your question. I'm not sure there is a difference (or at least, I'm not sure there should be a difference). The UX designer and the product manager have the same goal -- to create a successful product that works for users.

  • @suziross
    @suziross3 жыл бұрын

    Interesting point about maturity level and the need for qual/quant. If I'm primarily a quantitative researcher (psych PhD) with some qualitative experience, what in which maturity level of organisation can I best use my skillset? What's the best use for quantitative skills in user research?

  • @DavidTravis

    @DavidTravis

    3 жыл бұрын

    There's no simple answer to your question. Summative usability testing is a quantitative method, but I've only seen it used in high maturity companies. Surveys are a quantitative method but when used for user research it tends to be in low maturity organisations. A/B testing is a quantitative method that I've seen used in both low and high maturity organisations. So -- it depends.

  • @panteranna
    @panteranna3 жыл бұрын

    If other methods (like a/b testing, analytics) are more effective, in which instances is using usability benchmarking worth it?

  • @DavidTravis

    @DavidTravis

    3 жыл бұрын

    Good question! Remember that with a/b testing and web analytics, we don't know what tasks people are doing. That means (for example) we can't answer the question, "What percentage of people can successfully find the product they want and complete checkout?" In contrast, usability benchmarking is focussed on specific tasks, so we can calculate success rate.