Archive for May, 2013

Illuminating Hack: Pager Hue-ty

May 31st, 2013 by Justin

As many of you guys know, every 7 weeks at Chartbeat we have a Hack Week where we can work on any project or projects that interest us. At the end of the week, we present our creations, some of which make it to our Labs page or even become fully-fledged features for our products. 

Meet Hue.

Last year Philips released a much-hyped LED light bulb called the Hue that gives you complete control of every aspect of the bulb from your smart phone or through the Philips website. Hue lights have an API which unlocks a ton of potential for interesting integrations.  I acquired a Hue set around the holidays and ever since I’ve been wanting to hook them up to our PagerDuty alert notification system at Chartbeat.

Enter: My Hack Week project, which I’ve named “Pager Huety”.  Pager Huety is a script that controls the Philips Hue light bulbs based on triggered incidents from the PagerDuty API.

Meet me and my hack.

Part of my job as the Chartbeat Senior Web Operations Engineer requires being a part of an on-call rotation to ensure everyone’s dashboards are running smoothly 24/7.  Occasionally you may see an issue on your dashboard but luckily we’re immediately alerted to any issues via our monitoring system, which will send an alert via PagerDuty to the dedicated on-call team member.

I wrote Pager Huety to wake me up in the middle of the night with my Hue lights rather than have my phone going off with whatever less-than-awesome ringtone I’ve selected.  There’s an option to only have it alert during nighttime and filter for incidents only assigned to me.  Currently the default light sequence is to flash the bulbs red and blue a few times, then turn bright white for 10 seconds and shut off.  A video of Pager Huety in action can be seen below:

  There are a lot of cool things you can do with the Hue Bulbs and your Chartbeat data.  You can even utilize the Chartbeat API to flash Hue lights when you hit a new 30 day max – want to give it a go yourself? Tweet your results to @Chartbeat.

Shot for Shot at Internet Week

May 23rd, 2013 by Lauryn

disqus event At 5pm yesterday I was still recovering – yup, from the night before. That slightly dehydrated feeling, the craving for left over snacks in the fridge, and the sweet scent of stale keg beer are pretty solid signs of an incredible event. So let it be known, Chartbeat and Disqus know how to throw a party. And throw one we did. With our two companies focused on a similar goal of getting publishers and brands to understand the importance of true engagement -- with our recent Chartbeat Publishing for Ad Sales launch and Disqus's emphasis on transforming time spent into time invested -- we decided it was high time we paired up to tell this story together....over a few kegs and some Pies-N-Thighs deliciously deadly sliders. So we called in a couple of friends to help us tell the story around engagement from their points of view:
  1. Phillip Smith news innovator and publishing consultant lead the discussion and kept the rest of the gents in line.
  2. Joe Alicata from the best real-time data service out there (please don't tell me I have to clarify: Chartbeat) also bringing with him loads of experience leading product for ESPN.
  3. Ro Gupta VP of Strategy for Disqus and fantastic partner in crime
  4. Sam Slaughter VP of Content for Contently, an incredible company helping brands tell powerful stories
  5. Stuart Schwartzapfel VP of Audience Insights for Big Fuel, who's about the best advocate for the right kind of social and engagement measurement you could hope to find.
  6. John Keefe Data News Editor for WNYC.org spreading the word about what his team has been built on - build amazing content people engage with, and the rest will come.
To those of you who were able to make it, thank you for coming and bringing your thoughts and questions. It was fun sharing drinks, laughs, bean salad, and geekery with you. If you'd like to be kept in the loop for our upcoming events, just shoot me an email and I'll keep you posted. If you missed us this time, we'll have all of it available for your viewing pleasure via a video of the talk in the coming weeks. We'll kick it your way as soon as it's available. Until then, cheers to spreading the good word about engagement!

Screen Shot 2013-05-22 at 5.00.39 PM

How Engaged Time Affects Brand Recall

May 20th, 2013 by Josh

Last week, Chartbeat launched a new product, Chartbeat Publishing for Ad Sales. If you haven’t read Alex’s wonderful write-up of the inspiration and genesis of the product, you really ought take a few minutes to read it through. In a sentence, though, the product highlights exactly where on a site their readers spend their time reading, so that publishers can identify the ad positions that best capture their audience’s time and attention.

If you’re a skeptic like me, though, talk of Engaged Time around ads begs a question: readers come to a page to consume content, not ads — so, does higher engagement with a part of a page actually correlate with higher engagement with the ad that's in view at that position?

When we started down the road toward building this product, my first focus was on answering this question, and I want to describe some preliminary work I’ve done to understand the interaction between Engaged Time and an ad’s impact.

Experimental methodology

At its most basic, the first goal of advertising is to capture a user’s attention — a person who doesn’t see an ad doesn’t even have a chance to interact with it. One simple measure of attention is brand recall — the ability of a person to recall the content of an advertisement some time after the ad is not longer in front of him — and it's a well established metric for research on advertising's impact. There has been a great deal of research on the effect of exposure time to an ad on brand recall for TV advertising [1], and other research has found a correlation between time on page and an ad's effectiveness [2], so I decided to set up a simple experiment to measure whether the amount of time a reader is engaged on a page while a particular ad is in view affects their recall of an ad's brand. The process went like this:

  1. We created an a simple white page with a static news article and a single ad on the right rail, for a well-known national brand. No other images or headlines were on the page.

  2. Participants were asked to read the article and told they’d be given a survey about the article’s content.

  3. After a certain number of seconds, the screen was wiped and replaced with short survey: first we asked the participant to correctly identify the topic of the article, and we then asked them to identify the brand from the advertisement (the first mention we’d made of the ad at all).

We solicited 1,500 paid participants and randomly varied the amount of time participants were able to read before the screen was wiped — the only difference between each person's experience on the page was the amount of time they were allowed to read for, which ranged from 5 to 20 seconds.

When the study started, I wasn't sure what to expect, but as the numbers came in the results were clear: there was a strong correlation between Engaged Time and recall. Participants who read for 15 or more seconds were 25% more likely to recall the brand than those who read for 10 or fewer seconds. Even in this simplified environment, the amount of time the ad was in view had a dramatic effect on recall.

Correlation between brand recall and engaged time

More complexity

Next, I wanted to test if the same would hold true on a more complex page. We repeated a similar experiment, this time with 1300 people. As before, each person was shown an identical page — but this time it was an actual live page from a publisher’s site. Participants were randomly shown the article for either 5 or 10 seconds, the screen was wiped, and they were asked to identify the content of the article and the brand from the ad.

As we’d expect for a more complicated page, recall was substantially worse across the board, but we saw the same trend as before — participants who read with the ad in view for 10 seconds were about 30% more likely to recall the ad’s brand than those who had the ad in view for 5 seconds.

Conclusions

In some sense, the results I’m describing feel obvious — we'd expect the amount of time a person sees something to have an effect on his memory of it. On the other hand, the impact of display ads is challenging to understand because they’re non-disruptive — a person can consume content while an ad is in view without necessarily consuming the ad. Traditionally we've had to rely on metrics like click-through rate to talk about impact, but the results we've seen so far suggest that time itself is a meaningful indicator of the performance of an ad.

There’s much work yet to be done to understand how time and advertising go together — how to design the creative based on how much time users will see it for, how much time different types of messages might need, how time interacts with more complex metrics like brand lift — and we’re actively working with academics and other researchers on further directions of study. For now, I'm excited to be one step closer to understanding the value of engagement on advertising.

Note: Check out Ad Age's piece on our research.

Citations

[1] https://cdr.lib.unc.edu/indexablecontent?id=uuid:96863a34-efde-4726-9968-2cd7a511d036&ds=DATA_FILE [2] http://journals.cambridge.org/action/displayAbstract?fromPage=online&aid=179598

“What I’ve Learned by Leading a Startup”: Tony Haile in FastCo

May 20th, 2013 by Juliana

3003792980_803517452d_n Chartbeat CEO and sometimes polar explorer Tony Haile is featured in Fast Company today for four lessons he's learned over four years at the helm of Chartbeat. "What I Learned By leading a Startup – and Taking on Google" is a candid reflection of navigating common and not-so-common issues related to leading a rapidly-growing startup. Tony discusses why it's important to prioritize company culture, encourage individual autonomy, and look beyond a long resume. It's solid advice for anyone with an entrepreneurial bone in their body. We've included one of his lessons below – get the entire piece here. Let us know your reactions in the Comments section below or get in touch via Twitter. From "What I Learned by Leading a Startup – and Taking on Google" by Tony Haile:
2. Experience matters. But so do intelligence, drive, and guts. There’s nothing quite like hiring people with experience--those who’ve been there before, have made all the mistakes and know the path to follow. However, experience can have its limits and issues. Too often people will default to what worked at a previous company with a different culture, market, and set of challenges, leaving them frustrated when history doesn’t repeat itself. The best kind of experience comes from those who are students of what they have done, who understand why the choices were made in their last company and the conditions required for success. It’s easy to mistake one set of experiences for the other, especially when interviewing, which is why I’ve learned to value curiosity, intelligence, and drive as much as a long resume. Some of my proudest hires at Chartbeat have been people with little direct experience in the roles they’ve taken on and yet have shown a speed in learning and improvement that still amazes me. So yes, value experience but don’t let a hefty CV blind you to the opportunity to hire someone who is short on resume but long on everything else that makes a team member great.

The First Word: Chartbeat Publishing for Ad Sales

May 16th, 2013 by Juliana

brazil (brazilsocial) on Twitter

It's been a just over 24 hours since we introduced Chartbeat Publishing for Ad Sales, and we're incredibly pumped by people's reactions so far. Your tweets of support and enthusiasm have been awesome and really the reason we build this stuff in the first place – thanks a ton, Chartfans. We also want to make sure you had a chance to see what some media thought leaders have said so far, too – just so you didn't have to only hear our humble brags. We're psyched by these uber-sharp scribes covering our launch of Chartbeat Publishing for Ad Sales, and so in the spirit of a proud mum making scrapbooks, we've gathered some article quotes and links here. Check out what folks are saying: 
Mashable
Lauren Indvik,  Chartbeat Helps Publishers Sell Time, Not Pageviews Lauren owns the media and retail space over at Mashable, covering everything from start-up news to how traditional companies are evolving with today's social web. We dig her ability to explain sometimes-confusing tech topics (like, say Chartbeat's own tech). Check out her recent breakdown of social commerce. "Today, most online display ads are sold by the number of impressions or by click-throughs, metrics that favor sites that generate lots of pageviews, perhaps through short articles, sensationalized headlines or slideshows. What those metrics don't favor is long or engaging journalism — that is, truly interesting content that people spend a lot of time with."
Digiday
Josh Sternberg, Chartbeat's Bid to Measure 'Engagement' Josh frequently and fabulously discusses the intersection of publishers, brands, and content. Never shy to share the right story, Josh continues to be an industry go-to for how we'll solve the monetizable content issue. He recently wrote a piece on Hearst and Google Glass. "Publishers are caught in an unsustainable pageview arms race. This leads to bad behavior all around. But the problem is, publishers losing at this, even if by choice, are still held to the pageview metrics. This is meant as a way to allow those losing at the pageview game to use a different sort of data."
Pando Daily
Erin GriffithChartbeat crosses the Chinese wall with ad sales tools, focusing on quality over clicks As Pando's New York start-up guru, Erin knows what's up. She's a true journalist in the New York tech news scene with a knack for cutting through the BS and spotting, breaking, and spreading the next big stories. Peep her article on evolving dynamics in marketing and e-commerce. "Once someone has clicked on a link, the monetizable act is complete, regardless of if that person engages with the content. That encourages low quality link-baity content and slideshows. Chartbeat captures information about what happens between the clicks; now it’s selling that info to ad sales teams, who can presumably charge more for delivering a more engaged audience."
BuzzMachine
Jeff Jarvis, Selling ads by time, not space Professor, journalist, and industry voice of reason, Jeff Jarvis remains a go-to source for journalism and online media's most-pressing issues. He gracefully an thoughtfully navigates a range of topics from ethics in journalism to the implications of major publishers' technophobia. See his uber-relevant piece on misinformation in the news. "That’s because people quickly scroll past those banners and all the big hair on the top of the page — logos, promos, and all that — to get to the substance of an article, where they spend time. So inventory that was undervalued becomes more valuable." Hope you'll check out some of the coverage (a huge thank you to Lauren, Josh, Erin and Jeff), and feel free to tweet your thoughts @Chartbeat - we're on the look out for the good, the bad, and the ugly. And any questions or requests to check it out further can be sent to our Product Outreach gang.