Category: Digital

  • The questions in Big Data

    In my last post that touched upon Big Data, I had mentioned how the seeming intent of Big Data is to synthesise actionable insights from processed and unprocessed information at touch points related or unrelated to the enterprise, and then use it to target consumers better. While this is probably true for the short-medium term, I read a wonderful perspective at GigaOm by Beau Cronin on its true potential – the path to building the equivalent of global-scale nervous systems. As I tweeted after I read it, it reminded me of something I’d written a couple of years back before I’d heard of #BigData – if we could actually use data to go beyond that to answer life’s profound questions. Before we go into the subject, here’s a nice video by OgilvyOne titled “Big Data for smarter customer experiences” (via) though it’s skewed more towards the experience rather than the data.

    Beau Cronin has mentioned several possibilities this would give rise to, and the post made me think if something like the hive mind concept would mesh into it as well – a sort of hybrid neural network. He has also pointed out the hurdles we would face while we get there – gathering, processing and conversion into actionable insights, and how phenomena such as priming,expectations, and framing matter so much in how we perceive our physical and social environments. In essence, a fascinating read.

    I was particularly intrigued by framing, and began thinking about it in the context of the unstructured data – tweets, posts, mails, videos – that is a major component of Big Data. The fundamental question being – is it unstructured because we’re framing it ‘wrong’? Based on the enterprise’ intent and not the users’? Ironically, I couldn’t frame the questions right until I met the ever-brilliant S, who has always maintained that the answer is easy to find once the question has been framed right. He has developed (Tulpa -to build or construct in Tibetan – is the concept he enlightened me on while we were discussing semantics) something that at a rough level mashes the MECE principle with Frame Semantics and the entity-relationship model. There’s IPR involved, so no more beans shall be spilled, but as always, I learned much from the conversation.

    In essence, structure can definitely be derived from what we currently call unstructured data, provided we frame the queries right. I can intuitively begin to understand that in the era of data abundance, the only way we can make sense of all of it is by focusing on an intent that is derived from a common purpose, so that the sources of data (users) will be more open to help solve the challenges of data collection. The processing and inferences that follow would yield the best results when the right questions are asked. I have a feeling that the questions asked by a business in an earlier era might not cut it.

    until next time, role models

  • With great data…

    LinkedIn’s article curation is improving very well in my case. What I particularly like is the dash of serendipity in the list. One of the articles I recently read was “Are we all being fooled by Big Data?” Though it is less to do with business per se and is skewed towards economic forecasting, it does make for a very interesting read.

    Gartner’s 2013 Strategic Technology Trends has Strategic Big Data as one. In fact, I’d also add ‘The Internet of Things’, ‘In Memory Computing’ and ‘Actionable Analytics’ (also in the list) as related items, as a source, enabler and application respectively. While Big Data has been talked about for a while now, and has seen applications as well, I am not sure how accessible it is to the majority of organisations and brands. In essence, is it ‘mainstream’ enough? (I see organisations struggling to link existing data) Are there frameworks being built that will aid analysis and action across various functional domains – ways to nimbly access and use contextually relevant ‘packets’ from troves?

    Probably 2013 is when we will see things moving. But there’s something about data that worries me. This has come from my own experience as well as from the things I have read/heard. And that’s where the organisation’s intent becomes important, because you can find data to validate most anything! This is all the more significant because with improving technology, the volumes of data will have the potential to help brands shift paradigms and disrupt the status quo. But it can also be used for strategic/tactical blunders. As the saying goes “If you torture data long enough, it will confess to almost anything“

    All of this reminds me of social media. The hype, the evangelism, the tools and so on. And just like social, Big Data has in it the ability to amplify the inherent nature of the enterprise.

    until next time, think big

  • A new era of work

    Sometime back, I had written about institutional realignment – on how the internet will slowly eliminate the middlemen across industries and disrupt every institution that we have built thus far – political, societal, economical, professional, cultural, health and so on. This would have massive impact on our sense of identity and how we live as a society.

    A couple of weeks back, I read this interesting post at Pando Daily titled “Are we becoming a world without big companies?” The post quoted AngelList founder Naval Ravikant “the world would be increasingly made up of very small startups interacting with each other through APIs. No big corporations.” The corporation, at this point in time, plays a lot of middlemen roles – from our sense of identity to global relations – and continuing from my earlier thought, I think the internet will disrupt this one too.

    Which then makes one think of the workforce currently employed in the corporations – that’s most of us. 🙂 From 3D printing which is poised to disrupt the already shaky manufacturing industry and the not-so-shaky distribution systems to singularity, which will have major implications on our health, education and employment, there are macro changes that will affect us. Even the best minds would not have a definite answer on what/ where the jobs of the future would be. As Ray Kurzweil has stated in this interesting interview, “People couldn’t answer that question in 1800 or 1900 either. ” (when asked about the scene in 2000)

    It then brings me to something I believe will be the key to survive and flourish in the coming age – the willingness and ability to live with uncertainty. In this excellent read in the WSJ titled “Learning to Love Volatility“, Nassim Nicholas Taleb argues that rather than trying to predict black swan events, we should be building institutions that are not fragile and can withstand and even benefit from disorder and unexpected events. Though an institution is the protagonist here, I think there are lessons for individuals too.

    In a way, humans could be considered open APIs that big corporations and governments used to meet their ends, it would be interesting to see a future that reverses this. 🙂

    until next time, be the change….

  • Social grows up to be media

    On the first page of BG Verghese’ “First Draft”, he talks of The Times front page on the day he was born -21 June 1927. The paper was priced at one anna and “only carried advertisements on its cover page as was the general practice.” This was how traditional media companies had always worked. They had probably begun as journals, and later had sponsored information. (ads) In an era of information scarcity, this was probably required and appreciated. Even if they were not, the complaints would spread only as WOM. More importantly, while they took money from readers, their real survival (generalising) depended on advertisers. In the case of radio and television, it is even more evident. Then came the internet, and a story that has oft been repeated. We’re not going there.

    Though from email to BBS to Geocities to Friendster and beyond, everything can be considered social media, it began for me in the form of blogs (in 2003) became social networking via Orkut and really took flight with Twitter (May) and Facebook (July) in 2007. By this time, ads had begun to be ‘noise’ as media platforms proliferated. Twitter as well as FB served different purposes. As the cliche goes, “On Facebook, you connected with people you went to school with, and on Twitter, with people who you wished you went to school with.” In fact, such was my affection for Twitter that I even walked the talk. 🙂

    Why this long winded narration now? Because what I’d considered social is now very clearly becoming media that happens to have a social past. Facebook’s Promoted Posts will now reach people who have not Liked the brands as well, and it is working on measurement systems that resemble GRPs. From its options – a real time cloud API company and a media company, Twitter has clearly chosen. It has now started throttling the third party apps that made it the rockstar it now is. In their chosen line, this is an inevitable step to protect the ‘value’ it sells. Promoted tweets can now be targeted on the basis of interest.

    The disappointment, even if I reconcile myself to the fact that social is media, is the extent of evolution, or rather, the lack of it. Of the two, I have better hopes for Facebook now. Mark Zuck, despite the IPO, still controls it and from whatever he has spoken thus far, it seems this is not just a business for him, and though the ‘Promoted’ stuff on Facebook has now taken centre stage, the potential of the Open Graph remains and if it does evolve (as mentioned in an earlier post – last paragraph) it will continue to be interesting. Twitter? Oh well, Google’s AdWords is a megabucks one-trick, and it has Android. In the Google-like path it has chosen for itself, I can only hope that Twitter has a vision beyond being “sponsored”. If there is anything that media history has taught us, it is that irrelevance is just one service away.

    until next time, growing pains

  • Until the customer is king..

    Instagram just released v3.0. One of the biggest changes in this version is the introduction of Photo Maps, which quite obviously, plots your photos on a map. The default is opt-in, not opt-out, though they’ve done their bit to give the user control over data.  I updated despite reading this Wired article on the privacy implications and the bug that briefly exposed private photos!

    I’d written my first post that referred to Big Data recently, and the day after that, I read this very interesting post that talked about various applications including an algorithm that can identify cities based on their unique architectural elements and other distinguising characteristics. But a few weeks earlier, WSJ had an interesting post that talked of how large corporations see big data as a means to get personal with customers using information gathered by placing tracking files in people’s browsers and smartphone apps without their knowledge—so they can be stalked wherever they go, with their “experiences” on commercial websites “personalized” for them. The post describes not just its real world analogies but practices as well, and predicts a future where the user will declare your own policies, preferences and terms of engagement—and do it in ways that can be automated both for you and the companies you engage. An entire ecosystem across apps and corporations built in a consumer centric fashion.

    But as the post itself admits, the move toward individual empowerment is a long, gradual revolution. Until then, we need to define our own limits of sharing, fully understanding that it is a give and take. Not just what and where, but whom too – since all it takes a RT or a ‘Share – Public’ for something shared in a close circle to go public. How much of privacy would I give up to open myself to opportunities, or get an experience that is tailored to my needs and convenience. On the other side, a modern corporation needs to understand the choice the consumer is making and use the information to not just provide genuine value, but also make it easier for both entities to adapt to the rapidly changing landscape.

    until next time, kingmakers