January 23, 2020

Moving the target: The Netflix content engagement KPI is now 2 minutes, ridiculous

Moving the target: The Netflix content engagement KPI is now 2 minutes, ridiculous

This post originally appeared in the January 23, 2020 issue of The Content Technologist with the email subject line "We have begun our initial descent" and a review of the new Pinterest Trends tool.

The fun thing about running your own shop is that you get to decide exactly what is important to you. For me, that means choosing the types of projects I like and companies I want to work with — and as long as I can make a living, that’s really all I need. I can have the Best Year Ever according to my own internal happiness or the size of my income. Doesn’t matter to anyone but me and my clients.

Of course, have this system of capitalism and investment wherein large businesses have to prove what we’re doing is valuable to others so they can make more more, scale up, etc. But in the age of proprietary digital data where everything is top secret do not look at me just my product but still give me money and trust, companies still have to report on some sort of success metrics to be attractive to investors, shareholders, and it’s always best if you can make those metrics go up and to the right.

I’ve never taken an econ class but I know a thing or two: Growth can’t multiply forever, there are only so many target markets, you can’t please everyone, and at some point you’re going to not grow as fast as you did before.

Unless!

Three riveters say, "I mean, unless you got something better." [gif]

Unless you move the target!

Back in December, Netflix changed its content consumption KPI. Instead of watching a show or movie to 70% completion to count as a View, now Netflix counts a mere two minutes as a view. Yep. If you watch just a titch longer than your average Ramones song, Netflix counts that as a view.

If you’ve been following along, you’ll know that you should never really have a single KPI for content performance, especially not one as razzle-dazzle as view time, but hey! Anything to impress shareholders?

Tyler Coates breaks this down nicely in Wired and says it better than I can.

…Two minutes of The Irishman, which runs three and a half hours, amounts to 0.95 percent of the total film. You’d barely get through the opening tracking shot at the assisted living facility where an aging Frank Sheeran (Robert De Niro) is primed to reflect back on his long life of crime. I like to imagine me, an occasional movie critic, turning off a film after two minutes and writing a review. I mean, according to Netflix’s data, I’ve seen it. Two minutes is enough!

Netflix’s argument is that the new metric is closer to what YouTube and The New York Times counts as a video view. Technically, this is true! If you are measuring for “eyeballs,” then eyeballs you can get for two minutes.

Measuring for eyeballs is for chumps. Especially if you care about content.

Netflix produces a vastly different type of content than The New York Times or YouTube. Adopting any kind of universal standard for “digital video content” is limiting, to say the least. For the past few years, pivot-to-video folks have said things like “70% of all data consumed online is video” to sell itsy bitsy two-minute marketing videos… but they never couple that stat with the fact that professionally produced, sharply streaming Peak TV eats massively more data than anything on TikTok or YouTube (I think? We have begun our initial descent.)

There’s no chance anyone but the PR department is seriously using the two-minute metric. Netflix’s holds reams of highly meaningful data at its fingertips, more than any movie studio. It’s been organized from the start, and they give hints of it every now and then, like when they tell you about how they knew House of Cards would be a hit. (I mean, that was always a no shit, sherlock.)

Netflix’s data informs every creative risk they take, including their confidence in bankrolling stories for diverse audiences that legacy studios and TV networks wouldn’t touch. They have data about how we watch, when we watch, whether we like the shows or not, all that data from the first 10 years of streaming when I rated movies I liked from one to five stars which it does not collect anymore even though I loved that feature.

When companies that excel at data-driven storytelling reduce themselves to reductive single-metric representations, that’s a tell.

Lady Gaga says, "No he can't read my poker face"

Netflix knows the story it’s telling is mindnumbingly limiting, but media companies have never had to share their creative data. Why start now? But I wish they weren’t throwing gas on the analytics business bullshit fire.

Anyway, content and marketing folks: make sure your vendors define their terms. Make your KPIs realistic and actionable. Benchmark like a pro. And even from your best, most trusted vendors — and friends know that I will go to bat for Netflix as a Great Content Company — take it all with a grain of salt.

The good ones don’t want eyeballs. The best ones want minds, motherfuckers!

Err… the best ones want an appropriately sized audience to listen and hear their stories.

It’s been a long week.


Related articles on The Content Technologist

Content analytics | data | web | media | video


Want more Content Technologist in your inbox every Thursday? Forever free for the first 1,000 subscribers.