the way the northstar metric was broken down was expert level.

Hi Dianna, what you have done with these videos is phenomenal! I came back to your channel to drop this comment, as your videos were certainly very helpful in my interviews with Meta and I was able to crack the Meta PM interview. Thanks a million to you, and please continue to guide and inspire others like me! Power to you :)

Thanks Dianna for this. Had watched multiple metrics video but did not find them useful in terms of structure and thinking. The framework presented by you is concise and clear and can be used for any industry. I am more confident now on solving metrics questions.

I love how you come up with the north star metric and how you breakdown it down.

finally a content that is valuable, real case and comprehensive. thank you Dianna

I can’t thank you enough for all of your tips and for you taking the time to teach and prepare me for the FB interviews! I’m so excited to say that I got a FB offer and I certainly credit it to you. Thank you for your personal sessions with me and creating relevant and real content that can’t be copied. I love your authenticity and your passion to help others excel.

@diannayau

2 жыл бұрын

this made my day! so happy you got the offer! Thanks for all the support and stories like yours keeps me doing what I do and it also inspires others they too can make it!

@ritikadhiman7459

2 жыл бұрын

Hi, I am preparing for FB interview as well. Would you mind doing a mock interview? Wish you a happy new year :)

The most clarified explanation on success metrics & goals! well done & thank you👌👏🙌

Such a clear and simple video without any noise. Thank you !

@diannayau

3 жыл бұрын

Glad you found it helpful! Will be doing another video with more examples

Amazing content. I'm a PM and have been practising for upcoming PM interviews so your videos helped me to brush up with my interview foundations. :) Legit one of the best content here on YT... Thanks Dianna -- appreciate it loads!

@Dianna, you're the best. This is one of the best explanations I've seen with practical application.

Tradeoffs and Countermetrics sounded a bit confusing to me at first. If I am correct Tradeoffs are basically metrics which ratios of various features - ex: Online vs offline payments, Mobile vs Web Bookings and how we would optimize between them depending on the product strategy; Similarly Counter Metrics are basically Quality Metrics (i.e. how do you measure the qualtiy of service, product on your platform - which is measured by ratings, reviews)

Absolute masterclass... For free! Thanks so much Diana, really helps a PM like me a lot ❤

@diannayau

11 ай бұрын

So happy to hear it’s helping you!

@Billoybong2

11 ай бұрын

@@diannayau Hey you replied! 😊 One thing that really helped me is your tendency to talk slowly and PAUSE. You might not realize it, but it helps give us time to understand difficult concepts that you teach us. Never lose this please! Hehe

@diannayau

10 ай бұрын

🤩 love the feedback! There were times I thought I spoke too slowly so would actively edit out pauses 😂 but this is helpful!

@Billoybong2

10 ай бұрын

@@diannayau I was working at a global bank, and was one of 20 people who received training in Hong Kong for a week. One of the trainers was a British military negotiator turned consultant (he negotiated with African warlords and stuff, legit). His session was on public speaking. His main advice, over and over again, was pause, pause, PAUSE. I did this and people understood my explanations way more. I hope this helps you somehow! 😇

Thanks a lot Dianna! The formula break down of the total nights booked was amazing & really helpful to cover all the factors impacting the north star metric.

@diannayau

10 ай бұрын

This is the structured thinking interviewers would like to see vs. just listing a bunch of random metrics

Wonderful breakdown of the north star metric. Well recommended video!

This is perfect - Thank you!!! I have an interview next week for a PM role.

Great explanation. This is so much more helpful than mock interviews that rattle off lots of buzzwords.

@diannayau

Жыл бұрын

So happy to hear you’re finding it useful!

Great video. give me a insight about product success metric, please keep going making great product video!!!!

I really like the fact that you focused on one specific example and walked through your framework. Very informative!

@diannayau

3 жыл бұрын

thank you! glad the example is helpful to show how to use the framework

I don't usually comment on videos but this video here was too good to not comment. Thank you. You are a star...

@diannayau

3 жыл бұрын

Thank you for the support Abba! Keep watching, I’m launching a new success metrics video next week ;)

amazingly great video !!

Great video Dianna, thank you for sharing!

Thank you for your awesome content. May I ask you one question? In the video, you mentioned about hosts with few property listings vs those who have many properties as tradeoff. I don't get trade off of what. Is it for trade-off of showing listing (giving priority for example) and how is it connected to the success metric itself. Thanks in advance.

Great! Helped me in one of my problems

Brilliant! Thanks!

Incredibly useful

Super awesome video with an even more awesome explanation. One question why do we need to observe tradeoffs and counter metrics?

Wonderful video!! Thank you. One follow up question is the video’s title says Goals and Success Metrics. I didn’t see the Goal setting or how to define goals. I loved it the way you defined and broke the North Star metric. By success metric, are your referring to the North Star metric? Many thanks for great videos and replies. !!

Definitely a different way of approaching the question. Could you please help me understand how to think of trade off metrics? How are they different from counter metrics?

Very good explanation. Thanks!

@diannayau

3 жыл бұрын

Glad it’s helpful!

Thank you Diana for sharing your knowledge and experience. I am searching for Data Scientist positions and product sense questions are hard for me. Your videos are very educational.

@diannayau

3 жыл бұрын

Thanks Kun Ma! Here's the product sense video if you haven't seen it already. kzread.info/dash/bejne/aoWtxNl9es6Wdc4.html

@diannayau

3 жыл бұрын

@@kunma5146 you can book a session with me here superpeer.com/dyau

@kunma5146

3 жыл бұрын

@@diannayau Thanks

I believe the area to focus (like engagement, monetization, adoption, etc.... for AirBnB you have taken monetization) will depend on, in which PLC (product life cycle) stage the product is: introductory, growth, mature or decline and the metric under Radar for PM will be different in each PLC stage. So, we need to bring in PLC as a factor as well.

@mansi_b

Жыл бұрын

This framework is eligible for all stages. The value and north star is what changes in my opinion.

❤thank you for sharing

🤩Comment below: ✍what other products do you want me to set success metrics for? Struggling with product interviews? Book 1:1 COACHING @ superpeer.com/dyau

This is an incredible video! I have an upcoming interview with Google coming up, and am wondering more about tradeoffs. After you analyze some tradeoffs, are you supposed to pick one to optimize for and provide rationale?

The way is awesome but could you explain more about the methodology in terms of breaking down the north star metric?

Thanks, very helpful!!

Hi, Dianna. Given Airbnb also has experiences now, I wanted to dig into choosing # of nights booked v/s # of booking made as the NSM. I didn't get the rationale of why # of nights booked would be a better metric.

Can you please explain how you broke down the following: Number of nights booked per guest = # of active listings, views of those listings, confirmed bookings - cancelled bookings. What is the relationship between the # of active listings, views of those listings, confirmed - cancelled bookings? Do we multiply all of these?

thanks for your videos.they are really helpful. can you provide an example using this framework for a feature vs. product. like FB comments ?

thanks for really awesome content! I really like this framework! but admit I've never seen anything like this before. I've read (and used) north star metrics, but haven't seen anyone EXPLICITLY break them down (obviously its easy to see how IMPLICITLY they relate to other metrics, but I just havent seen a discussion of this). additionally I havent seen countermetrics discussed before. is this a common/well-known framework? are PMs in execution/analyics interviews looking SPECIFICALLY for such a breakdown of northstar and and countermetrics, or is this just ONE AWESOME way to look at these types of questions? can you point to some good sources to read more on this subject?

Thank you very much!

Hi Dianna. Your videos are always very helpful! Through calling out a north star metric at the start- i'm not sure how clear the prioritization is. Do you think it would be beneficial if I were to look at some NS contenders then elaborate why # of nights is the north star and then drive deeper as you did and break it down?

@diannayau

2 жыл бұрын

Either is fine whether you do some metrics first and then prioritize one or vice versa, here’s where I talk about it in the latest video kzread.info/dash/bejne/Yo6LpciFesubf8o.html

Hi Dianna, great content! Love the simplicity of the framework. Quick follow-up, if the question is set Goal for AirBnB, should we call-out a goal somewhere in the response? Is there a prioritization of metrics we should do?

@diannayau

2 жыл бұрын

Hey Vijaya, the key goal is # of nights booked, and we prioritized that by calling it out as the northstar. The other metrics are supporting metrics

@vijayabaliwada8622

2 жыл бұрын

@@diannayau Thanks Dianne, that makes sense! I always thought the reason for this question was to test if PM is able to set a SMART goal and struggled to come to a conclusion.

I liked your framework a lot! Thanks for sharing it. The only part that didn't click with me was the tradeoff portion. While valid, I wasn't sure about the point that you were trying to convey. How would you prioritize small hosts vs commercial hosts?

@diannayau

2 жыл бұрын

Hey Jose, thanks for the question! it was sharing a point of view that as Airbnb i i had to choose to prioritize one over the other, I'd choose small hosts bc that could lead to more supply in more places where there might not be commercial hotels. When designing products and figuring out how to make it successful, sometimes we want to establish a point of view of why we'd prioritize x vs. y.

@jgrimaldo011

2 жыл бұрын

@@diannayau Makes total sense, thanks.

Dianna, thank you for the video. At the end of the video you said "think about the tradeoffs and countermetrics so you avoid gaming your north star metric". Did I hear that right? What do you mean by "gaming the north star metric"? Could you give some examples? Thanks

@anjalikapoor-vf4se

3 ай бұрын

I think she means that there could be situations in which your north star metric is very high, but in reality it's causing negative effects, so you need to make sure you are measuring for those as well. For example, in this case, the north star metric is # nights booked. If the number of nights booked is increasing, but the cancellation rate due to bad quality listings is equally increasing, then that would be "gaming" your north star.

Hi Diana. This is such a fresh breath of air. Thanks for all the insights! two quick questions - is it OK to not explicitly speak about the product goal? also on what basis did you pick your counter metric (since counters could be many)?

@diannayau

2 жыл бұрын

Hi Surekha! Depends on what you mean by product goal-if you mean “adoption, engagement, retention” then yes you don’t need to call that out. But it’s important to cover product goals like “Airbnb’s goal is to help hosts find people who want to stay in their homes”

I love this framework - I find it to be a lot more logical & realistic then some of the metric frameworks. However, I do think there is a lack of discussion in this video about potential metrics & alternatives - their pros & cons. I wonder if this would be viewed negatively in an interview

super useful despite it would take sometime and practice to breakdown the northstar ;)

@dianna Yau Does the Northstar metric change when the product is new and has just been launched ( an acquisition metric) vs. when it is mature ( engagement metric ?

This was excellent Diana. Thank you so much. I am curious to know though when you chose the Northstar metric as number of nights that was for one booking. IF the number of nights was 4 but then there were 10 bookings of one night each, the commission earned likely could be higher? Would that change your decision if people are generally booking shorter stays but more frequently? Or would you keep the north star metric the same?

Great structure thank you! one follow-up question: when breaking down the northstar metrics, what's your suggestion on the breadth vs. depth? I tend to break down into too many layers and end up losing the big picture of the key levers.... any suggestion on this? Thanks!

@bhavyasingh6393

7 ай бұрын

A general rule of thumb would guide the PMs to chase after a breadth of 3 options and dive deep into each one till the depth that would serve for your product's KPIs is achieved.

love this ! however @5:01 when we talk about the north start metric, i completely agree. However , I was wondering if we should talk about different kinds of KPIs that we can look at and THEN say that "i will make this my north start metric for xyz reasons" thoughts ?

@diannayau

2 жыл бұрын

A common question I get all the time! You totally can talk about supporting metrics first and then north star-I talk about it more in my latest video

Total nights booked with 5 star review ( adding a quality metrics will enhance retention later )

@diannayau

2 жыл бұрын

Good call out! This would definitely be a solid supporting metric. Some might even ask why can't this be a northstar metric? Well for Northstar metrics- you'll want a balance between a) capturing value b) not being too granular that it doesn't capture most of the value. In this case, by putting the extra constraint of 5 stars, this metric will miss capturing the value given even to those who had 3 or 4 star experiences but still find value because they were able to find a place to stay. Another example is think about KZread videos- some might say the metric is "# of videos that received a comment or like." But ask yourself, how many times have you watched a video, found value in the video, but still didn't comment or like? In this case, watching the video for x amount of time can be a good teller of whether you're finding value

Hi Dianna, great content! i have one follow-up question. after you did a great breakdown of the north star, u talked about tradeoff and counter metrics from the supply side, is it ok that we think from the demand side and come up with some tradeoff and counter metrics?

@diannayau

Жыл бұрын

yess you can totally cover the demand side tradeoff & countermetrics too! (and you should!)

Great video. Do you have a master list of frameworks that you use? I imagine going into an interview memorizing 10 frameworks isn't as great as having 3 main frameworks that you can count on, and understanding when to use which framework for what type of question you're asked

Thanks Dianna..

Hi Diana, I have watched lots of videos. This one is the best. I have a follow up question. We need to measure the metric that matters the most. This metric is for the measuring the aga moment or the moment that users receives value from the product. How the "Metric that Matters The Most" is different than north star metric?

@diannayau

2 жыл бұрын

Hey Amir, the metric that matters the most aka when users get value should be your north star metric.

hello! great video. one question: is it better to come up with the Northstar Metric at the very beginning, and segment that into more granular metrics OR come up with all the metrics first then pick 1 as the NorthStar Metric at the end? I see in this video the NSM was picked first and then broken down, but some other prep videos i see them selecting NSM after listing all the success metrics. Thanks!

@diannayau

9 ай бұрын

This is a common question that comes up- I find NSM first to show more strategic and senior Pm thinking vs. brainstorming a bunch of metrics hence why I prefer that. But whichever method helps you think the easiest, should be the one you use

Hi @Dianna Yau. Advice on thinking of the user journey/Funnel and coming up with a few metrics and then picking the North Star as opposed to your method which is to pick a North Star first and break it down?

@diannayau

9 ай бұрын

Yes totally works as well! It’s not a must to start with a north star, that’s just what came most naturally to me and felt the most strategic

Is it ok to think through user actions which lead us to the north start rather than starting from North Star and break it down ? Usually I find it hard to think of North Star unless I know the product and landscape well ?

@diannayau

3 жыл бұрын

That works too! Just make sure you talk about the value of the product and why your north star you end up choosing reflects that vs. just listing metrics ;)

This is such a nice video. I like the way you describe things. However, I did not understand the 3rd and 4th steps. Trade offs and Counter Metrics. Could you please write me here, why do we need them?

This is so helpful l. I have a question. What kind of questions we can ask before starting the answer?

@diannayau

2 жыл бұрын

Best use of the clarifying questions is to ask about the product to better understand how it works

@dianna Shouldn't the North Star metric also depend in the stage of the company? e.g. a company that wants to be profitable should focus on revenue, whereas a growth stage company should focus on users acquired etc?

@Dianna: Thanks for the video, but at 4:59 I don't understand the difference between booking and number of nights booked? They seem to refer to the same entity.

@diannayau

3 жыл бұрын

Hey Ndubisi! A guest can make 1 booking but for 5 nights. A booking for 5 nights would be better for Airbnb and the host than a booking for 3 nights since both will be earning more

@NdubisiOnuora

3 жыл бұрын

@@diannayau Makes complete sense. Thanks for the clarification.

How do you breakdown your north star metric, Dianna?

Hey Diana , thanks for the helpful video. Would you mind sharing the app are you using to share your notes?

@diannayau

3 жыл бұрын

Hey Akash! it's just the apple notes app with my iPad pencil on the iPad!

@akash0126

3 жыл бұрын

@@diannayau Perfect , Thanks

@akash0126

3 жыл бұрын

Very clear thinking and structure , thanks for sharing tips. Would love to hear your approach on strategy questions like "Should KZread buy Netflix" or "Should company x launch y" or "What shud be the 5 year roadmap for Z"

@diannayau

3 жыл бұрын

@@akash0126 thanks for the suggestion! I’ll look through the most commonly asked strategy questions and see what I come up with. Would be curious if others are looking for thoughts on the same type of question

Your videos are very helpful and clear. It's just the notes on pad are hard to read for me sometimes

@diannayau

2 жыл бұрын

haha it's my terrible handwriting! my newest videos have switched over to text so it should be easier to read

Great content

@diannayau

3 жыл бұрын

Glad you found it helpful! Let me know what other videos you think the community might benefit from

@productmanagementbyutsav3069

3 жыл бұрын

Yes you may consider topics such as - Problem framing , stakeholder management, data analysis, hypothesis creation, experiment set-up, career advancement etc etc 😀😀

Hi Diana, I hope all is well. Regarding the North Star metric, what is difficult to find the intersection of all the users in the echo system? Has it been a case for you that there is no intersection? How did you deal with it?

@diannayau

2 жыл бұрын

Hmm, if there isn't an intersection of value for at least the supply and demand side, I doubt it'd be a very viable product...so I haven't come across that case for a successful product at least

How should we go about walking the interviewer though our answer? Is it best to summarize everything we will look into in the beginning?

@diannayau

2 жыл бұрын

yess start with the framework you're going to use :)

KZread should also provide only audio of the video so that can able to listen when on the go as part of Product lines

What is the goal of the Northstar metric breakdown?

thanks a lot for sharing this informative framework! I was wondering if you could explain the northstar breakdown part a bit more, do I understand correctly? # of nights booked = total # of active users * # of nights booked per user # of nights booked per user = total # of nights booked / total # of active users = (total # of lists * list viewed rate * confirmed after viewed rate) / total # of active users = (total # of lists * list viewed rate * (1-cancelled after viewed rate) ) / total # of active users thank you !

This question was asked to me in a recent interview but the interviewer kept pressing to find problems with this NorthStar of AirBnB, that is, Number of nights booked.

The elements to a healthy ecosystem seem somewhat arbitrary. Why the focus on demand growth vs. supply, and why word of mouth in particular? Short-term stays aren't necessarily a demand-first market. Per the Big Sur anecdote, it might be just as much supply-driven. I was also a little lost as to how the anecdote about high quality photos fits into the broader picture of supply quality. Is that just to demonstrate user empathy? Appreciate a reply, thanks!

Can you do the same thing for ecommerce? Amazon?

Dianna - the question asked what goal would you set. You did share the list of metrics - but I didn't get what is the goal that you would set?

@diannayau

2 жыл бұрын

When they ask for goal, they’re asking for a North Star metric and other success metrics not something like “the goal is engagement or adoption or monetization”

@sid281987

2 жыл бұрын

@@diannayau thanks for sharing. Put another way - are they only looking for metrics or for an actual goal. For ex:" I'd focus on growing no. of users transacting" or " the goal is to increase the no. of users transactions by 20% in a year "

Hi Dianna, thank you for the amazing content! For a PM interview focused on Hardware, not Software, how do you avoid the Northstar just being units sold (which doesn't matter to end users)? I am struggling to see how the framework can fit hardware solutions.

@diannayau

2 жыл бұрын

If we think about the value to users, units sold probably wouldn’t meet the mark since users derive value when they use it somehow which would be what you’d want to measure

Can you please create videos with few more examples

@diannayau

Жыл бұрын

As in with other products? What type of examples did you have in mind?

The question is what metric goal would you set for AirBnB. I understand how you broke down the question, but I didn’t hear a clear answer to the question. What metric goal did you settle on? Is your metric goal the same as your North Star?

13:30 - 14:45 is exactly what happened with ola dash.

can you explain that brr=eak down metric more clearly

Goals for food delivery app for next 6 months

*I want product analyst job at Google. Give me*

Summary: 1. highlight key user values that are derived from the product. 2. Find an intersection or common points among all the values. 3. Identify the key North star (aka most important) matrix that records the Key values. 4. Break down the north star matrix to understand what L1 or L2 matrix contribute to key matrix. 5. Identify a counter matrix so you don't get blinded by key matrix, and seek tradeoff possibilities.

@diannayau

2 жыл бұрын

Great summary! Thanks for contributing it to the community!

The content is great, the text could have been more clear. Bucketing logic isn't intuitive

Incredibly naive- these questions have never come up in any interview I’ve done

@gemini22581

3 ай бұрын

Thank your stars. These are common product management questions

@LWarrenF

2 ай бұрын

@@gemini22581 not in any of over 30 interviews I’ve done

))) toooooo complicated :)

This "tup" sound is too irritating. Couldn't watch video beyond 2:39 min.