Frequently Asked Questions

A curated summary of the top questions asked on our Slack community, often relating to implementation, functionality, and building better products generally.
Statsig FAQs
affirm ea Univision OpenAI Notion Microsoft zoominfo Upwork Collective Nium Cricut Hatch
GENERAL

How can we improve the UX for change approvals and percentage rollouts in Statsig?

Date of slack thread: 4/18/24

Anonymous: hello! have some UX feedback

  1. requiring changes to be approved is great, but it’s nonobvious that once your change is approved, you still need to go back into the UI to commit it- we end up realizing later on (sometimes much later- today it was a change approved in Feb) that our change was never applied
  2. a callout on misconfigured % rollout would be great- we had an issue where we set a rollout as a % of any of an empty list so no one actually got the feature

Jiakan Wang (Statsig): Thanks for sharing the feedback.

re: #1, we can’t commit your change right after it’s approved by someone else, because you never want to time your release schedule based on when the reviewer decides to approve the change, e.g. Saturday midnight. This is exactly how github works too. It’s also not the same person approving and committing the change, so the author will nonetheless need to come back at a later time after they put their change up for review to commit it. We have notifications for that, but this is something people will need to learn to do, just like they need to learn to commit their code after the PR is approved.

re: #2, typically we won’t be able to tell what is “misconfigured”, unless it falls into a subset of rules that are predefined by us, e.g. if the pass % is negative, or greater than 100.

Anonymous: for 1, I didn’t mean that we don’t like the behavior, just that it would be nice if that were more obvious in the UI- eg I think when you send a change to be approved it doesn’t indicate that next steps will be on you once it is approved; reminders that we have approved but uncommitted changes would also be really nice, maybe more callouts of that state in the UI, etc

Join the #1 experimentation community

Connect with like-minded product leaders, data scientists, and engineers to share the latest in product experimentation.

Try Statsig Today

Get started for free. Add your whole team!

Why the best build with us

OpenAI OpenAI
Brex Brex
Notion Notion
SoundCloud SoundCloud
Ancestry Ancestry
At OpenAI, we want to iterate as fast as possible. Statsig enables us to grow, scale, and learn efficiently. Integrating experimentation with product analytics and feature flagging has been crucial for quickly understanding and addressing our users' top priorities.
OpenAI
Dave Cummings
Engineering Manager, ChatGPT
Brex's mission is to help businesses move fast. Statsig is now helping our engineers move fast. It has been a game changer to automate the manual lift typical to running experiments and has helped product teams ship the right features to their users quickly.
Brex
Karandeep Anand
President
At Notion, we're continuously learning what our users value and want every team to run experiments to learn more. It’s also critical to maintain speed as a habit. Statsig's experimentation platform enables both this speed and learning for us.
Notion
Mengying Li
Data Science Manager
We evaluated Optimizely, LaunchDarkly, Split, and Eppo, but ultimately selected Statsig due to its comprehensive end-to-end integration. We wanted a complete solution rather than a partial one, including everything from the stats engine to data ingestion.
SoundCloud
Don Browning
SVP, Data & Platform Engineering
We only had so many analysts. Statsig provided the necessary tools to remove the bottleneck. I know that we are able to impact our key business metrics in a positive way with Statsig. We are definitely heading in the right direction with Statsig.
Ancestry
Partha Sarathi
Director of Engineering
We use cookies to ensure you get the best experience on our website.
Privacy Policy