Changelog

Note: This post contains GIFs and therefore might take a few seconds to load.
‍

Using the STARS framework on Bucket, you can quickly establish a consistent baseline for customer engagement and satisfaction of any feature.

But how does one feature compare to other key features in your product? And how do those comparisons change over time?

Answering those critical questions has just gotten a whole lot easier as we’re introducing the Bucket Audit Matrix!

The latest Bucket update introduces an essential feature for any product leader. An intuitive visual that charts all of your features side by side including changes over time with trendlines.

The Audit Matrix

The matrix is a wonderful visualization for comparing features side by side across two dimensions. The default typically shows adoption on the x-axis and frequency of use on the y-axis.

In B2B SaaS, most customers should be using key features at least once every subscription cycle. If customers don’t, they’re likely becoming a churn risk.

Therefore, if you have a monthly subscription cycle, you want to make sure that the key feature frequency is at least monthly, and ideally weekly or bi-weekly. If the feature isn’t used often and is a key feature for customers, you want to work on moving the feature upwards.

Then once the feature is sticky, you want to move it to the right and get more customers to use it.

Lastly, once the metrics look good, you want to increase customer satisfaction to make sure customers are happily retained.

Demo

Let’s see what the Bucket Audit Matrix looks like in action!

In this example, we’re looking at our fictional Slack competitor “Slick”. We’re tracking two recent feature releases - huddles and video recordings - and comparing them to one of our key features - sending chat messages.

From the list view, we jump to the matrix comparison view. We can quickly tell that our new features (marked yellow as in evaluation period) aren’t seeing the same engagement as our key feature.

We can even see in the trendlines that the engagement has been decreasing drastically since the initial release. Users showed interest and tried the features but didn’t really find them valuable enough to keep using them.

That’s alarming! The huddles feature is intended to be a new key feature in our Slick product.

To investigate further, we swap the frequency axis with satisfaction - the qualitative layer on Bucket - to see how the features compare in this dimension. As feared, the satisfaction scores aren’t very high.

To learn why, we click the huddle feature to dive into the actual customer feedback. Here’s one piece of feedback:

‍"We'll stick with Zoom until we can use huddles for all-hands, too"

This indicates that the huddles feature is appealing but simply not feature-rich enough to be a viable alternative to something like Zoom.

So, we’ve validated the feature idea based on initial adoption (interest) and qualitative feedback, but we’ve also discovered that we need to invest in this feature to make it successful. If we do so, there’s a good chance we can move it up and to the right on the audit matrix, and grab a chunk of Zoom!

Get started today

The Audit Matrix is one of the most powerful visualization methods in a product leader’s toolbox and indispensable at any roadmap planning meeting. It works out of the box on Bucket as all features are tracked using the STARS framework and therefore comparable on the same axes.

To get started, simply start at Free trial and navigate to the Matrix view in the top right corner.

Happy roadmapping! 🏄

Our mission is to empower product teams to deliver impactful features that delight and retain customers. Today, we’ve added a major addition to our service that brings us closer to our mission:

Introducing in-app qualitative feedback!

Bucket already provides product teams with turn-key engagement metrics for the features they ship. We instantly answer common questions, like “Who adopted the feature?”, “Who’s retained?”, “Churned?”, “How do these metrics look for our enterprise customers?”.

Today, we’re adding the ability to also collect in-app customer feedback, so you can complete the feedback loop. By combining quantitative analytics with qualitative feedback you’ll be getting the full picture - in one place - so you can quickly determine customer satisfaction of any feature.

Collecting in-app feedback

Whenever you release a significant feature update, use in-app feedback to provide your customers with an easy way to let you know what they think of it.

Here’s an example of what that could look like:

Once submitted, the feedback gets shared on Slack. As you can tell, the feedback is already associated with the “Account revenue chart” feature on Bucket.

On the “Account revenue chart” feature page on Bucket, you’ll now see a Feedback tab where all the feedback about this particular feature is listed:

Having feature engagement metrics and feedback on one place is powerful for several reasons:

Firstly, it provides you and your product team with a single pane of glass for your features, which enables you to get an overview of customer engagement and satisfaction, and act on it fast.

Secondly, Bucket augments the customer feedback with the customer’s actual feature engagement, like frequency of use, what other features they’re using, how many users they have, and so on. The engagement data helps you understand if the feedback is coming from a new account that is trying the feature for the first time - or from a long-time enterprise customer that has been using it for a while.

Having that context enriches the feedback so you can understand where it’s coming from and prioritize accordingly.

Getting started

Feedback is now built-in to the Bucket SDK and supported by our HTTP API. To enable your customers to provide feedback, go to Bucket and track a new feature or find an existing one. You’ll need the “featureId” from the new Feedback tab. Then, create a custom, re-usable form that gathers feature satisfaction score (CSAT) and a comment, and send the data to Bucket via the SDK or API.

Here’s an example of how to use the Bucket SDK:

That’s it!

Now you can easily add in-app feedback collection to any new feature release.

By the way, if you gather feedback via email or calls, you can enter it manually on the Feedback tab.

More updates on this topic soon! ;)

Todo -> Doing -> Done. But what happens when a feature is marked as Done? It’s deployed and live with the customers. That’s undoubtedly the most crucial time in the feature cycle, and that’s exactly where existing workflows stop today.

It’s nuts!

At Bucket, we want to add a final step to the feature delivery workflow: The Evaluation step. In the Evaluation step product teams make sure that their customers actually like the feature they’ve released. We believe most features should go through this step.

We’ve come to expect almost every other step in the feature delivery workflow, like testing, deploying to production etc, to be automated. We believe that the evaluation of features should also be as automated as possible.

Last week we announced how you can plan features on Bucket. The Planned state is for when the feature is in development.

Today, we’re announcing the remaining states: Evaluating and Done. Together, they make up a complete, automated feature evaluation workflow.

Automated evaluation

When you log in today, you’ll see these columns: Planned -> Evaluating -> Done.

When a Planned feature is deployed (and marked as Done in JIRA or Linear), it automatically goes into Evaluating mode on Bucket.

Bucket reports engagement metrics on all features in Evaluating mode to Slack every Monday.

When you have enough insights to decide if the feature has reached the impact you expected from it, you mark it as Done on Bucket. If the feature needs more work, you rinse and repeat the workflow.

Release date

We’ve also shipped the ability to set a Release date for each feature. You can set it manually or let Bucket do it. Once data for a feature starts flowing in, the feature changes state automatically from Planned to Evaluating, and Bucket will automatically set the release date to the current date if a date isn’t already set. You can modify the release date later, if needed.

The release date will also appear in the Slack reports, so you can easily track how long a feature has been in evaluation.

After 2-4 weeks, you should start to see leading indicators on adoption and churn, which will indicate feature success or not. If you need to dive deeper and speak with customers, Bucket makes that very easy, too.

Happy shipping!

Adding tracking to a feature release is often an afterthought or forgotten altogether. Many engineers have received a DM from a PM around the time of feature release saying something frantic like:

‍“did you remember to add tracking? we need to track this feature!”

We believe there’s a better workflow for this, and that workflow unlocks some very useful automations.

Today, we’re introducing Planned features on Bucket!

When a feature goes on the roadmap, there’s often a story issue created for it in the issue tracking of choice. It describes the customer problem, maybe a potential solution and ideally also a basic tracking implementation specification (tracking spec). The tracking spec describes which instrumentation to add to the code, so it can be measured and evaluated post-release.

Now, you can plan features on Bucket and hand them off to engineering as a ticket that includes the exact tracking spec - right from the Bucket UI.

Here’s how it works.

First, track a new feature. In the new feature modal, you can now enter events and/or attributes that don't exist yet. In this example, we want to fire off the “Pinned card” event whenever a customer pins a card in our product UI.

Once created, you now have a feature tracking spec that you can share with your engineering team. It contains all the information needed for the engineers to know exactly what event or attribute to track before releasing this feature.

You can share the feature tracking spec as a link, copy as Markdown or create a Linear issue straight from Bucket. You can also add a note about when to fire the event.

With the feature created on Bucket, the system will listen for events with the name “PinnedCard”. When engineering is done with the feature and deploys it, Bucket will get notified as soon as a user interacts with the feature. If you want to, you can get a Slack notification when that happens.

Besides getting the feature tracking spec out of DMs and into the issue tracking system, there’s another huge benefit to creating planned features: Automated feature evaluation! 🥁  

‍

Automated evaluation

We want to empower product teams to make impactful features. To validate impact, you need to track customer engagement. If customers aren’t adopting the feature or are churning away fast, you need to act on it.

With Planned features, Bucket will know when a new feature is released and can therefore automatically start to report feature engagement metrics to your team. By default, Bucket will send you a feature engagement report to Slack every Monday – empowering everyone in the product team (engineers, PMs and designers) to act on bad engagement or adoption.

With the Bucket insights, the product team can quickly determine if the feature is “Done for now” or needs another iteration.

If you need to dig deeper and ask for customer feedback, Bucket makes it easy to figure out which customers that are relevant to reach out to. Here’s an example of that:

That’s our workflow: Repeatable and automated. Just how we like it!

More updates soon.

If you’re detecting high churn or low activation on a key feature, you want to reach out to the relevant accounts for feedback, and learn how you might improve the feature.

We’ve now made this workflow easier on Bucket.

When you dive into an account, you can now filter by feature usage and see a list of users that have interacted with the respective feature. The users are sorted by feature interaction, so you can quickly pick the most relevant user to ask for feedback. From there, click to send the user an email.

Here’s what it looks like:

Make sure to send the reserved "name" and "email" user attributes when tracking users to see the name and email link in the Bucket interface. For example:

bucket.user(“<userId>”, {
  name: “John Doe”,
  email: “john@doe.com”
}

To see all users of a company, remove any feature filter in the top right when looking at the company page.

More updates soon.

We’ve just shipped a highly requested feature: Saved segments.

This feature allows you to group companies into reusable segments, which you can apply to any feature report. You group companies by company attributes.

Here’s some examples of common use cases for segments in B2B SaaS:

1. Active
   Find your active accounts by filtering down to accounts that have logged in recently. You may also want to add an activation threshold, so you get active companies that have also completed onboarding. For example, "completed_onboarded" is "true".
   These are the base accounts you want to measure feature retention and churn against.
   
   
2. Customers
   Create a segment just for your paying customers. You can do this by either filtering on a "plan" attribute or check if "monthlySpend" is greater than "0". We recommend the latter as it is immune to plan name changes.
   ‍
3. ‍‍Exclude staff
   ‍Filter out internal interactions by setting a filter like "name" is not "MyCompany".

Applying a segment to a feature report

When you’ve defined your segments, you can apply them to any feature report. This means the feature report data will be filtered to only include the companies that match the chosen segment.

To apply a saved segment, select it in the dropdown when tracking a new feature. Like so:

You can of course change this later. The default segment is the built-in Active segment.

Migration note to existing users: This feature replaces the individual target audience filters on features. Any such filters have been converted into segments. You can rename those segments when you log in.

Happy shipping!

Dashboards always come with a trust issue: Can you trust the metrics? Is the tracking still working?

To address this issue, the Bucket feature report now includes tracking health indicators to help ensure that the data is still coming through and that the report is based on the most recent data.

For event-based features, you’ll now see the following indicators in the sidebar. You’ll see when the event (including any attributes) was first and last seen. You’ll also see a count for the past 7 days.

If there are any events that aren't associated with a company, you’ll see the red-colored warning (screenshot to the right) since those events aren’t included in the metrics until they get associated. You can learn more about associating user events with companies in this help article.

For attribute-based features, you’ll see when there was first a match on the feature’s adoption criteria for any company. You’ll also see when there was last a change to or from the feature’s adoption criteria by any company.

Happy shipping!

‍

You can now customize your organization with your own logo. It’ll show in the top left, next to the app switcher. Simply drag and drop to set it up.

Here’s how:

More updates soon!

We’ve recently released Focus Mode and Feature Views. Today, we’ve fully integrated the two which enables you to set up Focus Slack reports per Feature View!

As your account grows on Bucket, having all features in the same place gets messy. Therefore, you want to use Views to group and organize features by product team or product area.

With today’s release, you can enable a Focus report per each View. This means that “Team Mobile” can get a dedicated report of their features to “#product-mobile” and “Team Payments” can get their weekly report to “#core-payments”. And so on.

Focus and Views works out of the box but is designed to be flexible enough to fit any organization as it scales. Once you have multiple Views on Bucket, you may want to disable the Focus report on the “All”-view, so you don’t receive duplicate feature reports.

Happy shipping!

‍

Large accounts quickly track a lot of features, which means a growing need to get those features organized. A common way to group features is by product team or by product area.

To support this, we’ve just released Feature Views!

Feature views are highly flexible, so they fit any organization. For example, you can create a view for all features that are owned by “Team Mobile”, or a view for all features related to “Payments”. You can navigate views from the updated sidebar.

Whenever you track a new feature on Bucket, you can choose an view for it.

Here’s what it looks like:

More updates soon!

‍