I had an "interesting" conversation yesterday with
Brian Clifton, who leads the Web Analytics team for Europe Middle East and Africa.
Me: Hello there, how are you?
Brian: I am good and you?
Me: Very well thank you - so, who do you work for?
Brian: Well, I am the one who pays for the beers here
Me: oh, thanks then. So, what do you currently work on.
Brian: I lead the analytics department
Me: Great - what exciting things are coming up?
Brian: cannot tell you, or I would need to kill you. But I can do you a favour, and
tell you a bit about our objectives...
** You should never judge people on what they say during the first 5mn, but I just had the feeling at this stage that the conversation would not be very productive. **
Me: Oh, ok, listening then
Brian: We are focusing on user experience more than bringing new features in.
Me: Right. Thanks for this very useful insight - oh, some feedback you may be interested to hear about what do you call it, you know the thingy you can use for A/B testing (I am just very bad with names)
Brian: mmmh, do you mean the web optimiser. That's not A/B testing
Me: Yep that's it. The A/B testing facility or multivariant feature
Brian: that's not A/B testing
Me: ok ok, that's not A/B testing, you test more than 2 combinations, but I am just used to call it A/B testing or split testing, will make sure I call it multivariant testing from now on
Brian: yes you should, because A/B testing and multivariant testing are 2 complete different things
Me: ok, any way, what I wanted to say is that the trouble with the Google (I am so bad at names that I call it again A/B testing... ) is that you cannot really test separate templates, just different variation of content
Brian: that's not A/B testing, that' multivariant testing.
Me: Yes, ok multivariant testing, but the point I just tried to raise is that it would be nice to be able to specify different landing pages instead of just some text you can replace.
Brian: you can tests design - it is not only text, you can also change a picture for instance.
Me: Right, text, images - what I mean is that it would be nice to be able to switch templates.
Brian: you can - the instruction were probably not clear enough, or you didn't understand them properly.
Me: Oh really, well, maybe - have you got examples of clients who are testing complete different designs.
Brian: this is top secret, again, if I told you, I would have to kill
Me: ah, ok.
Brian: But you may want to join the beta program and give it a try.
Me: but... I have already joined the program ... that's the reason why I thought you may be interested in my experience and feedback.
Brian: (who looks a bit upset by the whole conversation, which doesn't lead anywhere apparently) - my glass is empty, will need a refill. Didn't offer me a beer, even though I though he was the one paying for them.
