Lost in translation - conversation with Brian Clifton

I had an "interesting" conversation yesterday with Brian Clifton, who leads the Web Analytics team for Europe Middle East and Africa.

Me: Hello there, how are you?

Brian: I am good and you?

Me: Very well thank you - so, who do you work for?

Brian: Well, I am the one who pays for the beers here

Me: oh, thanks then. So, what do you currently work on.

Brian: I lead the analytics department

Me: Great - what exciting things are coming up?

Brian: cannot tell you, or I would need to kill you. But I can do you a favour, and
tell you a bit about our objectives...

** You should never judge people on what they say during the first 5mn, but I just had the feeling at this stage that the conversation would not be very productive. **

Me: Oh, ok, listening then

Brian: We are focusing on user experience more than bringing new features in.

Me: Right. Thanks for this very useful insight - oh, some feedback you may be interested to hear about what do you call it, you know the thingy you can use for A/B testing (I am just very bad with names)

Brian: mmmh, do you mean the web optimiser. That's not A/B testing

Me: Yep that's it. The A/B testing facility or multivariant feature

Brian: that's not A/B testing

Me: ok ok, that's not A/B testing, you test more than 2 combinations, but I am just used to call it A/B testing or split testing, will make sure I call it multivariant testing from now on

Brian: yes you should, because A/B testing and multivariant testing are 2 complete different things

Me: ok, any way, what I wanted to say is that the trouble with the Google (I am so bad at names that I call it again A/B testing... ) is that you cannot really test separate templates, just different variation of content

Brian: that's not A/B testing, that' multivariant testing.

Me: Yes, ok multivariant testing, but the point I just tried to raise is that it would be nice to be able to specify different landing pages instead of just some text you can replace.

Brian: you can tests design - it is not only text, you can also change a picture for instance.

Me: Right, text, images - what I mean is that it would be nice to be able to switch templates.

Brian: you can - the instruction were probably not clear enough, or you didn't understand them properly.

Me: Oh really, well, maybe - have you got examples of clients who are testing complete different designs.

Brian: this is top secret, again, if I told you, I would have to kill

Me: ah, ok.

Brian: But you may want to join the beta program and give it a try.

Me: but... I have already joined the program ... that's the reason why I thought you may be interested in my experience and feedback.

Brian: (who looks a bit upset by the whole conversation, which doesn't lead anywhere apparently) - my glass is empty, will need a refill. Didn't offer me a beer, even though I though he was the one paying for them.