Welcome!

API Journal Authors: Rishi Bhargava, Pat Romanski, Elizabeth White, Kevin Benedict, Anders Wallgren

Blog Feed Post

Web Analytics: How to Handle Direct Traffic, Not Provided, Dark Social and Do Not Track

For marketers, measurement is no longer an option, but a requirement.  The C-Suite (which many marketers have now proudly joined) is looking for more than warm fuzzies, and is instead looking for reporting, results, and ROI.

A number of developments over the past couple of years—not surprisingly, led by Google—have shaped the way we measure, analyze and optimize digital marketing tactics. This is a good thing, as long as we understand what we can track—and what we can’t.

Google’s (Not Provided) Mystery

Take organic search keywords as an example.  Despite it being just over a year since Google encrypted keywords and implemented secure search for anyone logged into any Google product when searching, many people still don’t understand the impact of this (not provided) result on their analytics.  Search Engine Land explained the (not provided) issue well when released, but essentially what it means is that if people are logged into a Google product (think Gmail, YouTube, Google+, etc.) and conduct a search using Google, the referring keyword data is not passed through to your site.  This is also commonly misunderstood as an issue with Google Analytics; in fact it doesn’t matter which analytics program you are using because Google search is holding the data and never passing it through to your website, regardless of whether you are using Google Analytics, Omniture, or any other application.  For a significant number of the clients that I work with, (not provided) has become one of the top 3 keyword sources in organic keyword reports.  This means that a significant amount of keyword data isn’t being captured; it’s just gone.

We can only control what we can control, but knowing what you are seeing in your keyword data—and just as importantly what you aren’t—is critical to your evaluation of organic search strategy and results.

Can We Shine a Light on “Dark Social?”

Similarly, an article in The Atlantic last month, Dark Social: We Have the Whole History of the Web Wrong, has sparked a good bit of conversation on how to view social media metrics within your web analytics platform.  Alexis Madrigal uncovers an issue that many of us who know analytics have looked at for a while – that “Direct” traffic in your analytics reports is a big catch-all bucket, and often doesn’t mean the traffic was direct at all.  Instead, a good chunk of it can come from email links, instant message sharing, and clicks from third party social media apps.   In essence, anything that can’t capture a referring or tracking URL inaccurately shows as “Direct” and is not measured—thus the phrase “dark.”  While it’s well worth reading the whole article, the main points are the following:

1. The sharing you see on sites like Facebook and Twitter is the tip of the ‘social’ iceberg. We are impressed by its scale because it’s easy to measure.

2. But most sharing is done via dark social means like email and IM that are difficult to measure.

3. According to new data on many media sites, 69% of social referrals came from dark social. 20% came from Facebook.

4. Facebook and Twitter do shift the paradigm from private sharing to public publishing. They structure, archive, and monetize your publications.

The phrase dark social comes from the fact that it is difficult to track and manage, so there’s not a clear prescription. However, it is still important to recognize that dark social is a factor as you look at your analytics, and you should consider looking at it in the same way as The Atlantic.

Do-Not-Track

Maybe the greatest threat to your analytics and targeting data is what has been categorized as “do-not-track” (DNT) browser standards.  By default, Internet Explorer 10 will be set to encourage publishers to ignore third-party tracking cookies, and other browsers will follow suit on the privacy bandwagon.  The Interactive Advertising Bureau (IAB) has recently come out in opposition to this, saying it limits visitor choices and options.  The eye-opening stat the IAB provided was that they estimate within a year 50% of browsers could be using DNT, meaning you may not get any analytics data on at least 50% of your visitors. This could be a fundamental shift in the way we analyze data, and is worth watching.

What Does it All Mean to Me?

While there are no “magic bullet” solutions to remedying these issues, for those of us that rely on web analytics it’s important to recognize what the data is telling you, and where you may be overvaluing or undervaluing data and potentially drawing incorrect conclusions. Understanding what your analytics program is telling you, and what it might be missing, will allow you to factor it into your decision-making process.

 

Image Source

Read the original blog entry...

More Stories By Will Davis

Right Source Marketing helps organizations build their marketing strategy, organize the structure to accommodate that strategy, and deliver the specific services to execute that strategy. We do this through a unique model that provides senior level strategic consulting as well as specific services that cover every area of an organization’s marketing plan.

@ThingsExpo Stories
Fifty billion connected devices and still no winning protocols standards. HTTP, WebSockets, MQTT, and CoAP seem to be leading in the IoT protocol race at the moment but many more protocols are getting introduced on a regular basis. Each protocol has its pros and cons depending on the nature of the communications. Does there really need to be only one protocol to rule them all? Of course not. In his session at @ThingsExpo, Chris Matthieu, co-founder and CTO of Octoblu, walk you through how Oct...
Major trends and emerging technologies – from virtual reality and IoT, to Big Data and algorithms – are helping organizations innovate in the digital era. However, to create real business value, IT must think beyond the ‘what’ of digital transformation to the ‘how’ to harness emerging trends, innovation and disruption. Architecture is the key that underpins and ties all these efforts together. In the digital age, it’s important to invest in architecture, extend the enterprise footprint to the cl...
Vidyo, Inc., has joined the Alliance for Open Media. The Alliance for Open Media is a non-profit organization working to define and develop media technologies that address the need for an open standard for video compression and delivery over the web. As a member of the Alliance, Vidyo will collaborate with industry leaders in pursuit of an open and royalty-free AOMedia Video codec, AV1. Vidyo’s contributions to the organization will bring to bear its long history of expertise in codec technolo...
SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.
If you’re responsible for an application that depends on the data or functionality of various IoT endpoints – either sensors or devices – your brand reputation depends on the security, reliability, and compliance of its many integrated parts. If your application fails to deliver the expected business results, your customers and partners won't care if that failure stems from the code you developed or from a component that you integrated. What can you do to ensure that the endpoints work as expect...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
The Transparent Cloud-computing Consortium (abbreviation: T-Cloud Consortium) will conduct research activities into changes in the computing model as a result of collaboration between "device" and "cloud" and the creation of new value and markets through organic data processing High speed and high quality networks, and dramatic improvements in computer processing capabilities, have greatly changed the nature of applications and made the storing and processing of data on the network commonplace.
SYS-CON Events announced today that ReadyTalk, a leading provider of online conferencing and webinar services, has been named Vendor Presentation Sponsor at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. ReadyTalk delivers audio and web conferencing services that inspire collaboration and enable the Future of Work for today’s increasingly digital and mobile workforce. By combining intuitive, innovative tec...
Cognitive Computing is becoming the foundation for a new generation of solutions that have the potential to transform business. Unlike traditional approaches to building solutions, a cognitive computing approach allows the data to help determine the way applications are designed. This contrasts with conventional software development that begins with defining logic based on the current way a business operates. In her session at 18th Cloud Expo, Judith S. Hurwitz, President and CEO of Hurwitz & ...
The vision of a connected smart home is becoming reality with the application of integrated wireless technologies in devices and appliances. The use of standardized and TCP/IP networked wireless technologies in line-powered and battery operated sensors and controls has led to the adoption of radios in the 2.4GHz band, including Wi-Fi, BT/BLE and 802.15.4 applied ZigBee and Thread. This is driving the need for robust wireless coexistence for multiple radios to ensure throughput performance and th...
Enterprise IT has been in the era of Hybrid Cloud for some time now. But it seems most conversations about Hybrid are focused on integrating AWS, Microsoft Azure, or Google ECM into existing on-premises systems. Where is all the Private Cloud? What do technology providers need to do to make their offerings more compelling? How should enterprise IT executives and buyers define their focus, needs, and roadmap, and communicate that clearly to the providers?
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, will discuss the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports. The session will include a working demo and a technical d...
There is little doubt that Big Data solutions will have an increasing role in the Enterprise IT mainstream over time. Big Data at Cloud Expo - to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA - has announced its Call for Papers is open. Cloud computing is being adopted in one form or another by 94% of enterprises today. Tens of billions of new devices are being connected to The Internet of Things. And Big Data is driving this bus. An exponential increase is...
Digital innovation is the next big wave of business transformation based on digital technologies of which IoT and Big Data are key components, For example: Business boundary innovation is a challenge to excavate third-party business value using IoT and BigData, like Nest Business structure innovation may propose re-building business structure from scratch, as Uber does in the taxicab industry The social model innovation is also a big challenge to the new social architecture with the design fr...
The many IoT deployments around the world are busy integrating smart devices and sensors into their enterprise IT infrastructures. Yet all of this technology – and there are an amazing number of choices – is of no use without the software to gather, communicate, and analyze the new data flows. Without software, there is no IT. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the protocols that communicate data and the emerging data analy...
DevOps at Cloud Expo, taking place Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long dev...
SYS-CON Events announced today that China Unicom will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. China United Network Communications Group Co. Ltd ("China Unicom") was officially established in 2009 on the basis of the merger of former China Netcom and former China Unicom. China Unicom mainly operates a full range of telecommunications services including mobile broadband (GSM, WCDMA, LTE F...
Data is an unusual currency; it is not restricted by the same transactional limitations as money or people. In fact, the more that you leverage your data across multiple business use cases, the more valuable it becomes to the organization. And the same can be said about the organization’s analytics. In his session at 19th Cloud Expo, Bill Schmarzo, CTO for the Big Data Practice at EMC, will introduce a methodology for capturing, enriching and sharing data (and analytics) across the organizati...
SYS-CON Events announced today the Enterprise IoT Bootcamp, being held November 1-2, 2016, in conjunction with 19th Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA. Combined with real-world scenarios and use cases, the Enterprise IoT Bootcamp is not just based on presentations but with hands-on demos and detailed walkthroughs. We will introduce you to a variety of real world use cases prototyped using Arduino, Raspberry Pi, BeagleBone, Spark, and Intel Edison. Y...