Guide #5: Introduction to Podcasting, by Erkki Mervaala.

[pdf-embedder url=”https://www.kbridge.org/wp-content/uploads/2018/12/Guide-5-Introduction-to-Podcasting-by-Erkki-Mervaala.pdf” title=”Guide #5: Introduction to Podcasting by Erkki Mervaala”]

About author: Erkki Mervaala is a former Program Manager and Digital Media Specialist for Media Development Investment Fund. He is also a member of the award-winning Finnish climate journalist collective Hyvän sään aikana and works as the managing editor for the climate news website of the same name. Mervaala has worked as a Central Europe foreign correspondent for several Finnish magazines and newspapers. He has also worked as a screenwriter for Yellow Film & TV, web developer and UI/UX designer. He has been a podcaster since 2008.

You can contact him via e-mail.

The guides are not designed to replace existing resources; on the contrary, they summarize current trends and approaches to critical issues in an easily understandable way and provide links to other resources – always with a strong emphasis on practical use and real-life examples. Over time, we will add a case study to each of the guides to highlight a particular approach undertaken by MDIF’s portfolio companies.

Guide #1: Practical Guide to Product Management in Digital Media, by Derrick Fountain.

This guide provides practical strategies and tactics for implementing the product management function in a media organization.

Please download and share the guide. We would love to hear from you – send any comments or suggestions to us at mas@mdif.org.

[pdf-embedder url=”https://www.kbridge.org/wp-content/uploads/2017/12/Guide_Product_Management.pdf” title=”Practical Guide to Product Management in Digital Media”]

About author: Derrick Fountain is a global product leader with deep experience of launching digital products in the US, the Middle East, Africa and Turkey. He is currently Head of Digital Products at TRT World in Istanbul. Prior to that, he was Principal Product Management Specialist at Al Jazeera Media Network, where he launched more than 50 web and mobile products. His professional career in media started in 2008 with US-based LAKANA, where he managed a network of 36 mobile web portals.

The auction site, which is known as Bid on Print, began trading on 24 November with more than 140 newspaper titles available to media buyers.

Bid on Print is not a programmatic or real-time bidding exchange, like its digital ad counterparts – “instead, a publisher selects inventory, applies a floor price and then sets a timeframe in which the ad must be bought. Buyers then bid with the highest offer winning, or they can simply click a ‘Buy Now’ button.”

The exchange is designed to help publishers sell less valuable inventory and free up sales teams to focus on premium stock, explains mUmBRELLA.

“We are creating commercial efficiencies for both media agencies and publishers. Media agencies can bid and book a print advertisement with a click of the mouse,” Newspaper Works chief executive Mark Hollands said. “We have made the system as simple as possible to appeal to buyers and planners, and make the transaction quick and simple.

The site has been created by The Newspaper Works and Publisher’s Internationalé. It transacted more than AUD$350,000 (USD293,000) during pre-launch trials.

“Feedback from media agencies suggests we have reduced to just a few minutes what took them hours to do previously, especially for campaign-scale purchases,” Publisher’s Internationalé CEO Charlton D’Silva said. “Newspaper publishers see the benefit of helping to create efficiencies for agencies and have keenly supported the initiative.”

In contrast to programmatic trading, allowing publishers to fix a minimum price means that rates can’t be forced below a level they find acceptable .

Read more: UK daily newspapers have doubled in price since 2004 and shrunk in size – no wonder sales are down

As is usually the case though, the most effective and helpful tool – or rather a technique from those mentioned above – is the one that also costs the least. Have you done usability testing yet? No? In that case, if you’re going to do one single thing, throw away all the other tools and techniques and start doing usability tests – they will take your website the farthest.

In this article, we’ll take a look at what you need to do and what you should know before you start testing.

What we’ll need

A usability test is nothing more than tracking a user during the time he or she is using your site. Really, that’s it. No measuring of eye movement, level of stress or anything else that needs hi-tech tracking – just a simple recorded (shot of the computer screen they’re sitting behind and their voice) dialogue between you and them. And of course the tasks you request them to do on your website.

So, no measurable indicators – CTR, time spent on site, etc.? Precisely! Questionnaires or Google Analytics will provide you with lots of data, but it doesn’t get much better than seeing the person in action with the possibility of asking what they think. I guarantee that after a usability test, you’ll know right away what needs to be done even without knowing exact percentages or having data to feed into a graph.

Like with any cooking recipe, we too will start with the ingredients we’ll need. There isn’t much of it, yet it’s still a good thing to specify them.

• A quiet room – it may sound strange but if there is something that can ruin the result of a usability test, it’s having someone disturb you. Are you in an open space office? If so, forget right away that you would do a usability test at your work station. An ideal place for a usability test is a small room, two chairs and a desk – no disturbing elements. Let people know not to disturb you during the time of the test. Turn off your phone.

• A standard computer and browser – although the object of testing during the usability test will be your website, people you’ll be working with will have a feeling you are testing them. Despite being told otherwise, they will not get rid of this feeling. Don’t add to their stress by making them learn to use your gaming mouse or keyboard with different characters. Use the most standard computer most people are used to. In the author’s country, this would be a laptop with Windows, a plain mouse and Chrome browser. Have more browsers prepared and let the participant choose which to use. The more they feel at ease and as if working with their own computer, the better for them and you too.

• Microphone and a program for recording your computer screen – During the test, you will record what the participant is saying as well as the browser window they’ll be surfing in. This is important because you won’t have time to take notes and will not remember all the issues that will come up. Laptops, as well as desktops, often have built-in microphones; however, it has proven useful to the author of this text to have an external microphone. A simple cheap mic for Skyping will do very well.

Selection of a recording program may be something of an obstacle as there aren’t many good quality solutions. For us, a good choice proved to be Camtasia Studio. It can record the screen as well as sound and later allows the recording to be cut, highlight parts of the video such as a mouse click, rolling over an element, etc. The program is not exactly cheap but has a 30-day trial version, so you can start with tests for free and later decide whether investing in the software is worth it.

What will we test?

Question “What will we test?” may sound ridiculous to you. You probably already know about the weak spots on your website – perhaps you were notified by email from users, or you’ve seen something in the statistics. Maybe you’ve asked yourself already why no one clicks on the Editorial Team link at the bottom of the page, while at the same time you get asked by users whether you’ve considered having one.

If you haven’t done usability tests before, I would guess the first ones you do will be of a very general character. You will want to look at your website as it is and its key functions, and find out whether users know how to use them or if they have a problem using them, and last but not least, how you could improve and simplify the way your website is used.

Later, you will probably concentrate more on in-depth issues and usability tests will focus on only one of the sections or just an individual function of your website. Either way, your task now is to transform all intentions into assignments for the participants in your test. How do you go about it?

Close your eyes and imagine all the key functions that make up your website. You can forget about the details for now – the most important elements will do for now. Imagine an average person and what he or she actually does on your website. Usually arrives, looks at the homepage, clicks on an article. Then what? Perhaps he wants to enter the discussion? Or maybe he wants to sign into your system email and read messages? Obviously, it’s different for every website but you should always keep in mind the most frequent and concrete scenarios of your website’s visitors.

Once you have them, you can start turning these scenarios into a story with assignments, ideally with some update theme. Set up concrete and fun assignments.

For example: “You’ve seen on TV that the government wants to increase taxes for people with higher income. You missed some parts of this information, therefore you decided to visit our website and confirm the missing details. Where would you look for this information on our website? Find out the percentage of this planned tax increase and the date the tax law should become effective”.

Notice that I haven’t used in this assignment the name of the section (go to section Economy, in the left-side menu click item xxx). This is exactly the method you should use too, as normally a user doesn’t know where things are. Since nobody tells users on the homepage where to find the information they are looking for, they have to find it on their own. Effectively, the user will now test your site for you and whether you have developed it well. Following the user’s path to finding the right link will show you how to make your website better.

Prepare about ten assignments in a similar manner. For each of them, try to create a specific situation and make it interesting or fun so as not to bore the participant. Be sure to make it clear exactly when the given assignment can be considered finished.

Are you testing one specific part of your website? It’s good to have the first two assignments of a different kind – “to trick” a little, but also for loosening up the user. When testing a specific thing, I personally try to hide it by breaking it into a number of different assignments so I don’t give away my intention. Ideally, at the end of the test, the participant shouldn’t really know what the main purpose of the whole test was.

Ready for some inspiration? A complete usability test can be found here: http://www.youtube.com/watch?v=QckIzHC99Xc

Selecting participants

How many people need to take the test in order to reach the optimal results? It may come as a shock to you, but 6-7 people will be enough.

Are you wondering why so few are needed when for any A/B testing questionnaire you need to have at least a few hundred participants to consider the data reliable? The answer is that when it comes to usability issues, we are all very much alike. You will find this out as soon as you start testing: the second participant will have very similar problems with your website as the first one, and this will repeat until you get to the last one. Using, say, 20 people instead of ten of course means finding slightly more issues on your website, but I guarantee that testing 6-7 people is absolutely sufficient for finding the most significant ones.

Which people to choose? You may be tempted to strictly adhere to demographic distribution, so here is my tip – don’t take it too seriously. (In the end, it will be hard to stick to a demographic distribution of users in a sample of 6-7 people.) Include men and women, younger and older, but the best thing you can do is to call on users that could potentially have a problem with your site.  If you call on a programmer to take part, he’ll probably be able to manage almost anything, but how about a user who isn’t so good with computers in the first place? You are better off choosing participants that will show you as many deficiencies as possible.

An important rule: never invite someone who is a “heavy user” of your site – a member of your editorial team for example, if you have a news website. Of course, there are exceptions when this rule does not apply (e.g. intranet testing), but for the majority of websites, inviting outside people – strangers not familiar with your website – is crucial. Ideally, of course, you would call on people that do not know your site at all. This, however, cannot be done in all cases – if your website targets brokers, an ordinary person won’t be able to help you much.

Another thing to consider is the question of payment for taking the test. You’ll find out in US literature that you should. My personal experience is to invite people without the promise of remuneration but rewarding them at the end anyhow (usually not with money though, but rather in the form of a small gift such as a book).

You may now have a good idea of who to invite. If not, here are a few tips from practice:

• Create a site with a simple questionnaire for people who would like to help with website development and link to it from your site. In a few hours, you are sure to have perhaps hundreds of contacts for willing people.

• If there is a place where users come, e.g. the reception area of a newspaper office where they renew subscriptions, position yourself there and ask directly whether they have time to take the usability test. Another way to do this is for the person on the desk in reception to ask and take the interested users directly to your office.

• Place an ad in the classifieds or post it on your Facebook page.

If you don’t want to do any of the above? We all have friends and acquaintances who don’t even know where we work or have never visited our websites – use them. Just one rule to keep in mind: never, never invite the same person for tests twice, especially if it’s the same test!

Carrying out a usability test

You have a quiet room, you have a computer ready (you’ve tested the recording and mic functionality), you have people coming and you have the assignments ready for them. What now? It’s time to carry out the usability test.

At the beginning of the test, you have to tell people what awaits them. In order not to influence the results, it’s ideal to tell everyone the same thing – that is, read the same text to all of them. You don’t have to come up with the wording on your own; usability expert Steve Krug has done it for you already, so don’t worry. You can download the English version of it here.

The text describes what will happen during the usability test and also includes a printable form of agreement for making sound and video recording. So now you can smoothly begin your assignments.

Now comes the most important part. You could have done everything perfectly up to now, but this is the point when everything can go wrong – your communication during the test. The following are the three most fatal mistakes. Avoiding them and sticking to the following method can make usability testing a brilliant tool.

• Do not help. Do you remember how you deliberately didn’t include specific instructions about what to do? This is exactly what you shouldn’t do either while the test is in process. Let’s say a participant has a problem with completing your assignment (can’t find a link to a page or has forgotten her password). Do not help her under any circumstances. You can try a formulation such as, “Try thinking about it some more”, “What would you do if I were not here?”, or “Unfortunately I can’t help you but as soon as the test is over, I’ll answer any of your questions”. If the participant cannot complete the assignment for a long time, end it. It is difficult not to help a person who is obviously in trouble. I personally managed to “fail” a few times when I administered my first usability test. While it is difficult, it is very important because if you help the participant, you may as well throw the results away because you can’t be sure that you didn’t bring the user somewhere she wouldn’t otherwise have got to on her own. There of course are situations when you can help – for example if a strange window, not relevant to your website, pops up, or the mouse is disconnected, etc. – but don’t ever say, “And why don’t you try clicking here?”

• Ask what they’re thinking about – keep on prompting the participant to say what he’s thinking about, to verbalize what he’s trying to do as much as possible. The instruction to do so was already included in the introductory text you read out at the beginning, however, some participants will tend to forget – you should do all you can to make sure there isn’t silence in the room and the participant speaks as much as possible. That is the key to improving your website – every one of the participant’s thoughts will move you forward.

• Praise and eat humble pie – many people you invite will say, “I’m not smart enough for this” and when they can’t do something, they will repeat the phrase. Participants will constantly feel as if you are testing their abilities. Use every opportunity to disagree with them: “I’m not sure where to click?” “Thank you – you have just found a huge shortcoming in our website. Actually, you’re doing it right, and it’s us who developed the website who got it wrong because you can’t find what you’re looking for.” After the test is over, tell them again how much they have helped you. You can even show them the right solution to their task.

After the test

The first thing that shows you’ve done the usability test right is that the results are absolutely horrible. Users had problems finishing your tasks, you’ve noticed mistakes you made in planning the site, users do things in a very different way than you thought when building the site. These are the results you’re looking for. If you, the website developer, feel miserable, be assured that this is exactly the kind of feeling you needed to reach.

In order to transform the usability test results into a better website, do the following:

• Share the results with everyone – Do not keep, under any circumstance, the test results just to yourself. Let as many colleagues as possible see the video recorded during the test. Definitely show it to designers, project managers and programmers. Don’t be shy to show it to other people who worked on the development of the site. Practically anyone from the team can learn something from a usability test. Before you show them the video, give them a pen and paper and ask them to take notes with ideas on what to change on the web in order to prevent some of the problems the next time around. I’ll bet everyone will have a paper full of various thoughts. Are you all too busy to watch a 5- or 6-hour long recording? Cut the usability test video – leave out the parts where participants succeed in their tasks and pick out the “cherries on the top”.

• Have a discussion and make a list of changes. After watching the video, compare your lists and write the problems on a big board. A huge discussion is surely to arise. A long list will be created. Set a priority for each item – mark the issues according to how big they are.

You will notice as you go along how the view of the web changes in the team. At the beginning of the exercise, someone may say something like, “Are these users completely stupid?” And then, when they see that every test participant had a problem with the same thing, they will go quiet. You will notice the effect of a usability test on the work of the team in the future. A programmer will try to simplify everything as much as possible right in the beginning. A project manager may want to run a usability test during the design stage. The owner will approve a budget for usability tests.

The possibility of seeing users utilizing your site in real time is something that will completely change the way you work.

How to solve issues discovered

One of the things that happens to you after a usability test is that you suddenly get a feeling that you completely need to change your website. You’ll probably feel that it’s badly designed; programmers may arrive with an idea to re-program the whole site. One of the worst things you could do, though, would be succumbing to these temptations.

Any usability issue found can be resolved in two ways: the complex way (total redesign) or the dilettante/superficial way (do the absolute minimum in order to remove the problem). Based on a number of years of experience, I recommend choosing the second option.

If you don’t believe me, take a look at the following list:

Dilettante solution vs. complex solution

• Much less people will be affected by the issue / No one or almost no one will be affected by the error
• Easily implemented / Requires much effort to implement
• Finished in a few minutes, a day the most / Can take a month or two, and may actually never be finished

Complex solutions seem to be clean and thorough. In reality though, it means you are starting from zero. In the end, the fact that you have done it over again doesn’t mean that you have not made the mistakes again or haven’t created new ones. On the contrary, if you redo something completely, you will end up facing a dilemma at the end what to do with the new issues.

Usability expert Steve Krug introduced a rule he calls “Do as little as possible”. Always look for the fastest solution to fix an issue. Only when that doesn’t work, use something more complex.

Here is an overview of Krug’s points:

Do not redesign, tweak (Krug’s No. 1 rule of successful mistake correction)

• Everybody hates redesigns, so if you suggest a wholly new solution, they will complain anyway.
• You may solve your problem with a redesign, however, it’s almost certain you will make at least five other, perhaps more serious, mistakes.
• Do the smallest changes possible – tweak until the problem is solved. If that doesn’t help, revert to a more serious solution.
• It often means that you want to increase the font, change the background color of a message or something along those lines.

Do not add, removing something is much better (Krug’s No. 2 rule of successful mistake correction)

• People usually feel that adding something will work better, let’s say a new notice or phrase. Often, it’s much better to remove something. Most mistakes are actually caused by organization on the site being so complicated that it becomes chaotic. This is a very frequent reason for mistakes.
• Always consider the list of issues in relation to effectiveness. If there are small issues which affect only a few users and would take too long to fix, don’t bother with them. There are probably ten larger issues that can be addressed quickly. Focus on these first and then on the others.

How do you find out whether you have improved the product? Simple, run the same usability test again … with different participants, of course.

Now you know everything important about usability tests. If you’d like to know more, I recommend two of Steve Krug’s books: Don’t make me think and Rocket surgery made easy. They are short, funny and will tell you everything you need to know.

So what is A/B testing? Simply said, A/B testing is a method which allows you to measure the effect of changes to your website on the visitors without actually making them.

Imagine as an example a web page with an article to which you make a small change – let’s say you move a picture from its current place in the right column into the center. Now comes the trick: you display the new layout version to a very small portion of your visitors. What will happen? Will visitors stay on the page for a longer or shorter time? Will a smaller or a larger percentage of readers finish reading the article?

After a few thousand views of both versions, you will be able to neatly and relatively exactly compare and determine whether the change is – or is not – an improvement. If indeed it is, you know what to do – change the picture position for everyone. If not, no problem – you can test some more.

You can test any changes this way – always on a small percentage of visitors and find out whether something works even before widely implementing it. And what is important, you are not limited to testing just one change but for example five different options. Using the same example as above, you can test positioning the photo in various places (left column, right column, top, center…) and by trial, find out where its positioning works the best.

Simply speaking, A/B testing gives you a luxury that we would probably welcome in all parts of life – the possibility of not having to make a decision every time we want to do something and then wait and worry whether we have made the right decision.

Instead, thanks to A/B testing, you have the option to choose the best solution from the multiple possibilities before making it available to all your readers.

Why should we run A/B tests?

A/B testing is one of the most practical tools for improving your website, primarily for the following reasons:

• Low cost, quick start: one of the best things about A/B testing is that, unlike using questionnaires or usability tests, you can start immediately. And if you decide to use one of the free services that are available, you won’t even incur any costs. No complicated searches for participants or long preparation times. One test idea and an observation of certain rules discussed below and you can be on your way. You don’t have to hire an expert. You can easily do it just with this article.

• The right sample: With a survey or questionnaire, you will always face questions such as “do we have the right sample of people?” or whether the group of people surveyed had been “representative”. There are no such questions in A/B testing – you know 100 percent that you have the right sample. It’s the people that come to your website, exactly those that you are improving your site for. There is no need to look for anyone elsewhere.

• Very practical: Standard questionnaire surveys often bring theoretical findings, such as people are more interested in sports news or perhaps that they would welcome more videos in articles. But what should an ideal piece of sports news look like? Where exactly should the video be in the article? A/B testing, together with usability tests, offer very practical findings, which are – as a bonus – all immediately applicable. They not only provide you with information about what to do but also how exactly to do it.

Getting started with A/B testing

So how do we do A/B testing?

1. Hypothesis. At the beginning of each test, having a “hypothesis”, i.e. a question you want answered by the test, is very important. For example – “Would visitors click more on an article if it had a larger headline?” Any new function you would like to implement on the website is also a hypothesis – e.g. will the function bring a better reaction from the visitors? You probably already have a number of ideas as to what to test. You can also find some tips below.
2. Alternate versions. The second step is the proposal of changes with which we will verify the hypothesis – let’s say the creation of alternative versions of the original website with new functionality or design. At this point, it is important not to limit yourself to just one alternative to your current site. You can come up with as many versions as you would like. This way, you can be sure that you have not missed the best solution possible. For example, if you are testing a larger headline for your article, why not include various fonts, colors and/or size? The test will let you know the best solution.
3. Test variables. Often, defining the test variables is a much underestimated step. A test variable is anything you can measure and which allows you to objectively determine which page is better. It could be the number of clicks on a certain link, the time spent on a page or even whether a visitor had completed a certain operation (confirmation of a subscription payment). People frequently measure the number of clicks, but is that always the best? Always consider carefully what to measure and test more variables. That way you can see whether your new version won’t do more harm than good (e.g. the change forces more readers to click but they leave the page immediately because they hadn’t found what they were looking for).

Which tools to use for A/B testing?

Once you have done all three things listed above, only one thing remains – deploy the test. Let’s look closely at how to do it.

Ideally, you would use one of the ready-made solutions available. There are plenty of them and some are even for free. And it is certainly simpler than having the A/B testing tool custom programmed directly for your website – a solution which is possible, but definitely not simple.

When choosing, look mainly for simple implementation (do you have a programmer at hand or will the tests be administered by someone who knows programming?). Of course, the price is also crucial. Paid tools often offer free tutorials or assistance, so free does not always equal the best.

Here is a list of some of the best known A/B testing tools:

Google Analytics is among the best known A/B testing tools. One of its main advantages when compared to competing products is the fact that it’s free. And it works in a simple way: basically, you create and add all versions of your web page to the server – if the current page is at article.php, you create article1.php, article2.php, etc.

What follows is an easy step-by-step process of implementation:

If you do not have an account in Google Analytics, create one and after registering, click “Experiments” in the “Behavior” section of your website profile. Click on “Create experiment”.

Type in the URL of the website you want to test (in our example, it’s article.php) and select the measured variable – for example average visit duration, revenue, etc. Decide the percentage of your users you want to include in the experiment – determine the number according to the number of users that usually visit your site – if you have a lot of visitors, you can test the page on 1% of your visitors. If, however, you have few visitors, you could wait for the results from a 1% sample for a long time.

Then you just add the URLs of the changed pages to be tested. The last step is to add a special JavaScript code to each one. The code will determine which page is shown to which user.

And that’s all. You can find more details on how to do A/B testing with Google Analytics here.

Optimizely.com is one of the best known paid tools for A/B testing. Other paid tools mentioned below all work in a similar way. Compared to Google Analytics, they all have one significant advantage – you do not need a programmer to run the test – it’s enough to include in the page one very simple JavaScript code. Everything else can be “clicked” and selected without needing to know the source code. It’s almost as if you were editing text in Word or some other text editor – you can play around and change the text, the font size, anything. You choose the percentage of visitors to which you’ll display the tested version and select the measured variables. The tool saves the changes and, after starting the test, it will display your altered pages to random visitors.

Other popular A/B testing tools include Unbounce.com or VisualWebsiteOptimizer.com. Choose the one that suits you best. An overview of the best known tools is here.

Understanding the results

Most of the split testing tools offer results as you go along and even calculate which version has the highest chance of winning the test. At the same time, the tool helps to determine the right sample. At this point in the process, you don’t need to do anything else.

This, however, can become a double-edged sword. Despite the simplicity of A/B testing, it can be spoiled (just like anything in life). Watch out for these common mistakes:

• One variable, one hypothesis – one of the most common mistakes in A/B testing is that we want to test too many things at the same time. An example would be two completely different article visuals (each has a completely different layout, ordering, as well as elements). Remember: one A/B test, one hypothesis you are testing, one change. This is a way to avoid potential problems of not being able to understand what actually brought the change when reading the test result. Was it the background color? Or omission of a large ad space? Always change only one thing. Then test it.

• Attention – sample size too small. The second most common error is impatience. Frequently, one of the tested versions can have much better results very early on. Do not stop the test! Continue to the end of the test – it can often have very different results at the end than it seemed at the beginning. Contemporary A/B testing tools contain a function which automatically calculates the number of users you need to test in order to ensure the test is right. Here you can find a calculator which helps you to find out the approximate sample size even before running the test. If you are testing a large number of versions, it pays off to wait a little longer for results. Also, you may want to repeat the test one more time – test fewer versions the second time (e.g. original vs. winner and runner-up from the first test).

• Poorly chosen metrics. Even if you manage all of the above well, there is still a chance you are failing in the selection of the metrics with which you’ll be measuring the effect of your changes. Is the version that gets more clicks really better for you? Or are you more interested in whether visitors, after they click, subscribe to your publication? Number of clicks tends to be an alpha and omega for online media so pay attention to other criteria that may prove significant for you.

Testing tips

You surely have many ideas on what to test. A/B testing is practical any time you want to introduce something new and you discuss in your team how to proceed the best way. Don’t limit yourself to new functions you’d like to add to your site though. Think about things already present on your site, especially:

• Things that seem self-evident to you (if you hear someone say “people love xxx”, “the best way to do this is xxx” without having A/B test results to prove it, don’t just believe the statement – try it).

• Things on your site you think are done really well (this link has many clicks, the ad in the right corner works beautifully) – what if these things can be done even better? Don’t forget that every hundredth of a conversion counts!

• Things you think don’t matter (font color, font size, or moving an ad box 10 px more to the right). If you test a lot, you’ll find out that many of the results may not make much sense to you, yet they work. Do not rely on your rational criteria only and do not think that minute details don’t matter. They do – test everything.

Here are a few tips for tests you can run right now:

• A correct looking lead on the home page – is a smaller headline, full-width photo and no lead, or a larger headline, smaller photo and more text better? Or should it be altogether different? Come up with all different possibilities and find out what users prefer.

• Ad formats – you know that when there are too many, they don’t work; when there are only a few, conversion is higher but revenue smaller – so what is the right ratio? Try out different ad distribution on your page and select the best one.

• Homepage layout – there’s an everlasting fight within online media about the homepage. Each service, each journalist wants to see his or her article there, yet they cannot all be there. What is the right number of articles for visitors to still click? Which section is better suited for the right column and which will do better in the middle? The simplest way to find out is trying it.

• Test the wording of all buttons on your page. Compare “Enter the article discussion” to “Discuss the article now” for example. Test what works best and you may be surprised.

You can find lots of ideas and inspiration for A/B testing at www.abtests.com. It includes a number of case studies, so you can see the findings right away. Many of you may be surprised by them.

Still not enough? Suggested reading about A/B testing includes Always Be Testing: The Complete Guide to Google Website Optimizer. Although recommendations related to the implementation of Google Analytics experiments (the tool was formerly known as Website Optimizer) have become obsolete, the book offers hundreds of ideas and ways to improve your web site.
So what are you waiting for? Dive into A/B testing now!

1. Know Your Exit Plan Before You Buy

This is a big, often-overlooked issue and one software providers often don’t like to address. You need to know what file format your data will be when you receive it back. The more standardized the file format, the better. Packages that operate in Microsoft SQL are the best because SQL is widespread and you will find an abundance of programmers to prepare your files for your next package, should you ever have to leave. Most, but not all, large providers use SQL, but smaller providers may use various kinds of freeware or proprietary database structures that are not easily converted to other formats. Always ask what file format your data would be returned in and also ask if there would be any charge to return your data. Some providers make it as difficult as possible to leave and do everything from charging a high fee to return your data to giving it to you in a format which is so archaic that your next software installation is likely to fail. Know your exit plan, before you buy! Don’t assume that software marriages last forever. You may outgrow it down the road or find it just wasn’t the right product for you.

2. Find Out What Kinds Of Support Packages Are Available

If you are buying a package that is worth its salt, it is powerful enough, complicated enough and customizable enough that your use, expansion and improvements in your processes will require ongoing support. Nobody who buys software wants to hear this. Software sales reps want to minimize the cost of the product, and buyers want to hear that it’s turnkey once purchased, but it’s not. Systems that run your business can be tweaked, customized and adjusted to continually improve your business. It’s not a static process. You should find out what kind of ongoing consulting packages are available, and meet regularly (preferably monthly) with your software provider, to address business systems that you find time-consuming or less than optimal. By improving and evolving your systems on a monthly basis, you’ll make your consulting fees back tenfold. Your employee costs will always be your main company costs, not your software costs, so focus on ways of improving efficiency, saving man hours and reducing labor costs and you’ll make a lot more money in the end. Buyers who go into a software relationship on the cheap have high failure rates, don’t fully utilize systems, and never achieve the kind of economic efficiency they can have if they continuously attack inefficient processes within their companies.

3. Drill Down Into The Details

The smartest companies draft up an RFP outlining what features they are hoping to have in their software package and they have the vendors fill them out. The best companies look forward to this comparison and the weaker vendors will not.

4. Require Your Potential Providers To Rank Their Competitors

The good vendors usually know the market and know what they are good at and what they are not good at. Ask them to name their competitors’ strengths and weaknesses. You’ll find out pretty quickly which competitors they respect and those they genuinely think are weak competitors.

5. How Long, How Big and How Many?

Find out how long the vendors have been around. It’s very hard to start a software company and compete with companies with mature products. The mature products have a decade or more of a head start and usually ten million dollars or more in development. Find out how many clients your vendors serve. The ones with the broadest customer base will have larger development staffs and tend to race ahead while other vendors can’t due to their small size. Find out how many full time employees each vendor has. If the answer if five, you should think twice. It’s almost impossible to provide any sort of support and development process with so few employees.

6. Touch The Product

Ask the vendors to use an actual copy of the software. There is no safer way to evaluate than to get your hands dirty and really experiment with the actual product.

7. Don’t Be Sold By “We don’t have that feature, but we’ll throw in custom development of that feature if you’ll sign right here”.

This is what companies that don’t have robust products do to try and get a deal done. Many clients are fooled into thinking that company A is more helpful than company B. But its fool’s gold. Any software company that becomes tied up in custom work for each client won’t be focused on developing new features that serve its overall client base. Custom work adds to maintenance costs of the overall software package and the best companies will focus their efforts on making their software package customizable by you, not trying to create custom reports and features for you. You may be the focus while they are trying to get you to sign on the dotted line, but they’ll move onto the next custom project once you are on board, and you’ll notice that your future needs are not being met because the company’s development staff is doing custom work for the new client. It’s a slippery slope that the best software companies don’t go down.

So, do features matter? Yes, but don’t fail to realize all of the other important considerations when investing in software for your publishing company.

In late May 2013, the Financial Times launched a new, mobile-friendly news service called fastFT. It’s a mixture of traditional news wire and Twitter-like stream with an emphasis on speed and brevity, delivered both in a newsfeed on FT.com as well as on the standalone page. The article “6 product development lessons from how the Financial Times built fastFT” summarizes lessons to be learned from the product development.

All of this represents an amazing opportunity and an incredible challenge to news organisations who want to engage with their audience and generate revenue to fund their journalism.

As the mobile phone has become the primary means of accessing information, entertainment and socialising for billions of people, mobile advertising has become the primary means of remuneration for content owners.

In many countries, mobile advertising is a mature industry.  No longer the preserve of dubious links offering “Free Crazy Frog Ringtones!!” – mobile advertising is used by global and local brands to drive engagement with users.  If it’s still in its infancy in your country, it won’t be for long. It offers a credible and sustainable way for media organisations to produce their content at no direct cost to their users.

In the old-fashioned days of advertising, every newspaper would have an ad-sales desk.  Hordes of salesmen (and it was nearly always men in my experience) would shout down the phones trying to convince companies to buy a quarter-page advert in the weekend edition.

All that has changed.  Rather than employing sales people to negotiate directly with potential advertisers, most mobile sites use an Advertising Network.

Understanding ad networks

Ad networks are really simple to understand.

• A business owner creates a space for advertising on their mobile site (or app).  This is called a “slot”.
• The advertising network analyses the content on the page and the people who are visiting it.
• The advertising network then conducts real-time bidding among the advertisers.  It looks through all the adverts that it has on its books, matches up the adverts that it thinks will get a high rate of engagement, then sees which company is willing to pay the most to be shown at that specific time, on that specific page, to that specific user.
• The advert is then shown to the user in the page’s slot.

All of this happens in just a few milliseconds.

Getting paid

Broadly speaking, there are three ways that mobile adverts make money for content owners: CPM, CPC and CPE.

CPM – Cost Per Mille is the most “traditional” way of advertising.  It is also the least profitable and is falling out of favour.  It simply measures how many times the advert is shown to a user.  For every thousand (mille) impressions a fixed sum is paid.

CPC – Cost Per Click is the most common way of measuring mobile advertising.  Whenever a user clicks on a mobile advert, a variable sum of money is paid out.  Depending on the advertiser, and the market, this can be anywhere from a tenth of cent to a dollar.

In some cases, the advertising network will track whether the user went on to purchase a product or install an app based on clicking an advert – if so, it will pay out more money to the content owner.

CPE – Cost Per Engagement is the newest – and potentially most profitable – method of mobile advertising.

Using HTML5 – the latest version of the code that creates web content – it is possible to create interactive adverts which don’t result in the user leaving the site.  For example, clicking on an advert could play a trailer for a movie.  In this case, the advertising network pays out every time a user engages with an advert.

Mobile advertising networks

There are dozens of mobile advertising networks available.  The industry is still relatively young and contains many companies which have grown rapidly in just a few years.

When choosing a mobile advertising network, be sure that the company has an account manager located in the same country as you, and also ensure that they have sales teams in the countries you wish to target your content.  Finally, make sure they support the platforms that you are currently on – and those to which you wish to expand.  For example, you may be mobile web only now, but do you have plans for an Android app?

While there are hundreds of mobile advertising networks (http://mobithinking.com/mobile-ad-network-guide), there are a few major players.

InMobi

InMobi started in Bangalore, India, and has rapidly expanded into Russia, Asia, Africa and Europe.  They support mobile web, Android, iPhone, and Windows 8. The author is a former employee of InMobi.

Google AdMob

Google is well established in the mobile advertising world.  AdMob will only work on SmartPhone apps – it will not work on mobile websites.

Google AdSense

Google’s AdSense platform allows publishers to monetize mobile websites.  If you already use AdSense for Web, you will be familiar with its layout and how it works.

Amobee

With offices from Buenos Aires to Singapore, Amobee is well placed to integrate with a variety of mobile devices in a wide range of markets.

BuzzCity

Specialising in Asia and Africa, BuzzCity is serving billions of mobile adverts every month.  It can target mobile web, Android, and iOS – as well as older devices such as BlackBerry and J2ME.

Hunt

Dedicated to the Latin American market, Hunt has seen huge growth over the last few years.  It can deliver adverts to mobile web as well as app.

In addition to choosing an ad network, there are several other things to consider when working with mobile ad networks.

Filtering adverts

It is vital that your mobile advertising network allows you to maintain quality control on the advertising you are showing.  For example, you may decide that you don’t – or legally can’t – show gambling adverts.  All good networks will offer you fine grained control over what content gets shown on your site.

All networks will let you filter out adverts by category.  Some will let you filter by keyword or destination URL.  That means you can block your competitors’ adverts from appearing on your site.

Make sure that your network will fully explain how their filtering works – your reputation may be at stake if you allow advertising which runs counter to your editorial position.

Of course, the more adverts you filter out, the fewer adverts may be shown.  This will lead to a high NFR…

NFR

One important thing to consider when choosing a mobile advertising network is their NFR – No Fill Rate.

Every time you request an advert from your network, they will perform a complex series of calculations to determine which advert will be best suited to your content and your visitors.  On occasion, they may find that they have no suitable adverts – or their advertisers’ budgets have been depleted and they cannot afford to advertise with you.

At this point, the content owner is faced with either showing the content without advertising, or using house advertising.

House adverts

Most mobile advertising networks will let you run “house ads” at no extra cost.  A house ad is an advert for your own internal products and services.  For example, a newspaper may run a house ad encouraging readers to download their branded Sudoku app or to subscribe to the paper’s print edition.

Running house ads is a great way to show off your own content to your readers.  It is also a low-cost way to deal with NFR.

Mediating networks

Why choose just one mobile advertising network?  Rather than signing a contract with a single provider, it’s possible to use an advertising mediator.

The concept behind mediation is simple, you engage multiple networks to bid against each other for your advertising locations.  If one network has a high NFR you can use another network to ensure that the advertising location is filled.

You can choose which advertising networks you want to integrate with your mediator – and which you wish to exclude.

With most mediation networks, you will still have to sign contracts with each individual advertising network.

There are two potential downsides to using mediators.  First, they may take a percentage of your earnings as commission.  So while you may get more advertising, it may not be as profitable.

Second, you run the risk of duplication.  For example, suppose that your primary advertising network has shown the user a Coca-Cola advert.  After displaying the advert 5 times, the network may conclude that as the user hasn’t engaged with the advert, it’s unlikely to elicit a response and so it will stop showing it – thus generating a NFR. At which point, your mediator will pick another advertising network which will start showing adverts for Coca-Cola.

This is a waste of time for all concerned – and is particularly likely to annoy your users if they are bombarded with the same irrelevant advertising.

Here are some of the major mediation platforms:

• Smaato
• Mopub
• AdWhirl, which is now being integrated in AdMob.

Mobile ad formats

Mobile phone screens vary in size and shape.  That’s why it is important to choose a mobile advertising network which supports a variety of advertising formats.  As well as the “traditional” banner ad – which takes up the width of the screen and usually around 10% of the height – there are several other formats which may be suitable for your content.

Rich media

Taking advantage of HTML5 features allows mobile advertisers to break out of the banner.  When a user clicks on an advert, they are not taken to the advertiser’s site – instead, the advert expands and its contents are displayed in situ.  The user can then watch an animation, view a video, interact with the contents, etc.

These sorts of adverts are popular with users due to their fun and interactive nature, but because they require a modern web browser and a high-powered phone, they aren’t available to all users.

Interstitial

An interstitial advert comes “between” the pages of a site.  For example, clicking on a news headline may take the user to a full screen advert for Volkswagen’s latest car, the user can then click through to their desired content.

Although interstitials have reasonably high engagement rates, they also can negatively impact your brand. Some users find the disruption of an enforced delay to their instant gratification deeply annoying.  Interstitial use should be very carefully tested before deploying.

How much money can a content company make?

By some estimates, the mobile game “Angry Birds” is the most popular way for people to spend time on their phones.  An estimated 65 million minutes of gameplay per day nets the company around US$1 million per month!

It’s relatively easy to construct a formula to estimate the revenue a content producer can expect to receive via mobile advertising.

Let’s make the following assumptions:

Every page on the site has 1 advert.

There’s a 5% NFR.  This is variable depending on your advertising partner and mediation network.

CPC is 10c.  Again, this is highly variable. If your site attracts viewers likely to click on adverts for Rolex watches, this could be much higher.  If your readers are less wealthy, that CPC could be lower.

The click-through-rate (CTR) is 3%.  That is, for every hundred adverts shown, three are clicked.  That’s the industry average – although it will differ depending on sector and the quality of the adverts.

Pages X Fill Rate X CTR X CPC = Earning.

If you have 100,000 page views per month, the formula is:

100,000 X .95 X .3 X .10 = $2,850

This formula contains a lot of assumptions about demographic and advertising partners.  The best way to increase your revenue is to work closely with your advertising partners, let them know the demographics you are targetting, make sure that they understand the areas that you work in, send them whatever keyword data you can so that they can expertly target the advert to the reader.

Finally, none of this works without a sizeable audience.  Make sure your content is compelling and keeps the user visiting your site.

How much are other content providers making?

Naturally, it’s hard to find detailed, commercially confidential information.  The Pew Research Center’s Project for Excellence in Journalism in the US recently published a detailed report into how newspapers are coping with mobile advertising.  It’s well worth reading.

Highlights include a newspaper making $200,000 per quarter from their “non-traditional” advertising – not bad for a circulation of 50-60,000.  Other news providers talk about expecting triple-digit mobile advertising growth over the coming year.

As the world shifts inexorably to mobile, we can expect a larger percentage of revenue to come from users engaging with content on their phones and tablets.

As audiences shift to mobile, if your advertising strategy doesn’t take this into account, you are missing an opportunity.

Choosing a mobile advertising network does not need to be a complex affair.  All good networks will make it easy for your web or app team to integrate advertising into your products.

If, at any time, you feel dissatisfied with the performance or quality, the level of competition in the market is such that it should be easy for you to switch to a different network.

Building the right kind of sensibility means building the right kind of brand that resonates. In a crowded media sector these days, the white space to create anything unique is non-existent, or at best narrow, which is why content-based startups take a longer time to gestate and build up.

Hiring and building a team present peculiar challenges for a media startup compared to any other kind of software or consumer product startup. Cultural fit becomes the driving criteria above almost any other criteria, particularly at the early stage.

Having been a student of media and media startups all my life — and now a year into building my second — I’ve learned a bunch of lessons along the way on building the right kind of teams in lean content-driven environments.

Different stages in a company require different strategies, and for this article I am focusing on the early stage, where the focus is on building editorial, product and distribution. Call it my year-one guide to hiring in a media startup.

General culture and companywide skills:

• Bringing negative energy into the company is not worth any kind of talent. This is true for co-founders, employees and even investors. Because in a daily ideas driven startup, the flow of energy back and forth matters a lot more, any negative people in the company suck up all available energy in the company. This may sound esoteric and hard to quantify, but if you’ve done this long enough, you know this matters.
• The product in a media startup changes every day, unlike any other product startup. The front entrance of your flagship product changes many times a day, and the people you hire need to understand the manic-ness that goes into doing this day in, day out.
• Product thinking: Typically media startups have been stuck in “post thinking,” as in a blog post, a story post, etc. In a multi-platform environment, product-led thinking that continually tweaks to keep the brand fresh in digital becomes the driving force. Iterate, test and build; a thinking in mainstream consumer startups, has to come to media startups as well. Hire people who get it.
• Visual and multi-platform thinking: Anyone you hire — from editor to developer to social media manager to sales to business development — has to understand the visual nature of media these days, especially in a social media-driven, multi-platform world. This is easier said than done, but people with varied and non-traditional career paths tend to get this the most.
• Living in a Google Analytics stream: Or in other words, data thinking. These days, data skills for anyone you hire across any function in the company — from editorial intern to social media manager to founders — is not an optional skill. That’s true for any startup, but for media startups that live and die in Google Analytics (and most use that at early stage, because it is free), it means making sure everyone in the company understands it, uses it, and makes decisions that are informed from it. Baking it in at the hiring stage will ensure you make it pervasive across the company as it scales.

Editorial team:

• The 4 S’s of Content: be Smart, Sharp,Surgical and Strategic. With a small team in the beginning, can the editorial talent you hire be nimble enough to understand this, and execute against it?
• Because part of the talent you will hire will likely have come from existing old-school media companies, one of the things you are looking for is how much can they unlearn what they’ve learned before. Especially if the editorial product and the voice you are trying to create is something the industry has not seen before.
• This is my personal favourite: No journalism circle jerk or moralising media people. Get the basics of reporting right, keep the future of journalism prognosticators out.
• Related to above: Avoid scenesters, above all else. Media tends to attract a lot of those because it comes with the high profile of a byline and public presence. These days with the amplification of social, people love the idea of working in high profile places and would do anything to flatter you. It will take some trial and error, but you’ll learn the necessary skill of avoiding these people.
• Curation thinking: This is another critical hiring and company culture parameter. No media startup can survive doing just original content, it has to be a mix, of original, of curated or aggregated, of licensed if that is an option. It means hiring people who have the ability to mix content types, and not be moral about it. You’ll be surprised at how many journalists look down upon curation. In a small team, curation thinking also means learning to do a lot more with lot less.

Developers:

• This is hard in the best of times, and for media startups that may not seemingly be solving rocket science tech problems, your options of how and what to attract developers with are lower. In most cases media startups are about execution, and that requires a slightly different kind of developer than a software or product company would need.
• Look to the pool of journalists turned developers, or dual majors in journalism and computer science, of which there is an increasing pool. They generally tend to get ignored by other high-profile consumer startups, and present an attractive pool to target for hiring.
• This is especially true if you are trying to create media-derived data products, and there are a lot of cross-dependencies that somebody with the media background would understand better than a regular developer.
• Developers with media background tend to understand presentation of data and information in right formats.

Cross functional agile product manager:

• Agile development, a methodology that came out of the software world, is increasingly being implemented across other parts of companies as well, especially as a buzzword by marketers. For a media startup, agile would translate into building quick, fast and dirty, with few resources, whether it is edit, business, sales, and of course tech development. That means a cross-functional product manager who is almost a junior COO, working with founders to keep everything running and launching on time, amidst the requisite amount of chaos.

Content marketing & partnerships:

• The social media editor is dead, the engagement manager has arrived. Call it whatever you want, beyond the buzzwords it means marketing your content is a full time function, and is multivariate, multi-service and multi-platform. The skills required then becomes a lot more complex than just someone who tweets and “engages” with community. It is a mix of being natively good at social, ability to focus on various social networks in different ways that those platforms require, in different formats of media. It means seeding various sites, forums and platforms beyond social; it also means part traditional business development functions of maintaining and seeding existing content partnerships.

Sales:

• The first sales hire at any media startup is a crucial and scary step. Hiring someone who can just sell banner and boxes, even if lots of them, won’t cut it. The first sales hire has to be strategic enough to think big picture, understand what the nascent brand stands for, and be on top of emerging trends in content market, native advertising and digital branding. And as digital has enabled the rise of early adopters, fanboys and prosumers across various industries, a sales hire should typically have both B2B and B2C experience to understand how companies market to various constituencies in different ways.

Caveat:

This is an early stage template. Beyond year two and beyond seed stage, the hiring guidelines and skill sets needed will evolve as product, business and strategy evolves — even if philosophies and operating principles stay rooted in founders vision.

(I have used the words “news”, “media” and “content” interchangeably here, to cast a wider net. Don’t get tripped up in the semantics of the words, larger lessons apply to any kind of content-driven startup.)

This article originally appeared on LinkedIn, and it has been republished here with the kind permission of the author.