as an e-commerce company, it's common for creatives for marketing campaigns success to be measured in terms of numbers. e.g. based on click-through rates and conversion rates. however, just numbers might not give a full picture of what are good creatives.
Lately, we are trying to focus more on qualitative research. Where we bring in actual users and show them creatives for feedback.
a hypothesis would be for example. clean and modern looking creatives bring back the customers and make them spend more in the long run than cluttered creatives with too many elements and information. besides the obvious AB test that would be to run a long-term test with both creatives running side by side, which would be resource heavy and time-consuming. could we use a qualitative research to test this and get some insights?
we had done both qualitative and quantitative research before for models used to catalogs. e.g. Asian model vs caucasian model. compared to doing multiple photoshoots in order to get insights, it proved to be much more insightful when we brought in users and showed them a few variations of different models on the same outfits.
another idea of a test would show customers the website or app with competitors images swapped in an get their feedback
I know it's more common for testing out UI and new features, but has anyone done this sort of research for campaign creatives before? If so what would be things to test to look for and how would you carry them out