Skip to main content
Share Your Experience: Take the 2024 Developer Survey
20 votes

A/B testing - client wanted the test run 70/30

Your statistical power is maximized if equal numbers of users are directed to A and B. That is, assuming one design really is better than the other, you’ll achieve statistical significance with the ...
Michael Zuschlag's user avatar
4 votes

A/B testing - client wanted the test run 70/30

Run A/B test on 60% of the traffic then. Diverged exactly 50/50 into old and new variants. Diverge all other 40% of users/sessions/views to new experience (as your client requests), but ignore them in ...
Frax's user avatar
  • 141
4 votes

A/B testing - client wanted the test run 70/30

In theory, there isn't a problem with a client-ordered 70/30 test, as long as you're comparing conversion rates and not conversion amounts. If your hypothesis holds up, you'll still see the 5% dip ...
Izquierdo's user avatar
  • 12.7k
3 votes

How to display a multi-valued heatmap chart

There will be a lot of squares – this is something that we cannot avoid and we need to acknowledge that. i.e 10 categories x 10 vehicles x 10 vehicle types. Which means there will be 1000 colored ...
Kish's user avatar
  • 2,597
2 votes

Should an expandable table be collapsible?

In our online store, we have tables with a maximum height and vertical scrolling with a "highly visible" scroll button and it works perfectly with the users:
Danielillo's user avatar
  • 19.1k
2 votes
Accepted

Real-world examples of searching through data

I think Notion does a really good job of handling this. Anyone can filter the view of a page After you've created a filter there are a few actions to choose from: Reset: discard the filter and ...
Dean Hudson's user avatar
2 votes

A/B testing - client wanted the test run 70/30

Your customer wants two things: Find out with evidence which method gives better sales, and don't lose sales during the test. A 50/50 split will give you the evidence quickest. A 70/30 split ...
gnasher729's user avatar
2 votes
Accepted

How to: User offboarding with active paid subscription?

This problem probably will need a lawyer to be answered fully, but in general: If a user wants out, let them out. This means clear pathways and buttons, and no "you have to talk to support to be ...
Leo Wattenberg's user avatar
2 votes

When data is grouped in a table, should pagination be based on individual rows or groups?

(c)! My clear preference (and recommendation) is to always use continuous scrolling instead of pagination - precisely because of such problems. The design issue is caused by a development/architecture ...
virtualnobi's user avatar
  • 3,546
1 vote

Table that mixes different type of data

I think your gut feeling about adding new columns to a table upon changing a filter are correct, that's not a common pattern and it breaks some heuristics around consistency and acting like a regular ...
Izquierdo's user avatar
  • 12.7k
1 vote

Is a data download a viable text-alternative to a visual chart?

Based on what is said in WCAG's Understanding the non-text content and in sufficient techniques related to that, I'd say yes, downloading is an option but with a caveat. This is because one of the ...
locationunknown's user avatar
1 vote

Filter by values not present on the table

I would say it will look very odd and prone to confuse the users. Imagine the user actually filters with this value - how can he be sure that the filtered data set actually shows only data that ...
Gil Bronstein's user avatar
1 vote

Should an expandable table be collapsible?

No need for that. I'd go with Danielillo's approach; it's easy to understand, easy to implement, and an extremely common pattern. But... You mention that users may have many entities in their accounts....
Devin's user avatar
  • 38k

Only top scored, non community-wiki answers of a minimum length are eligible