Crayons. Chronicles. Captains
Meet our talented tangrams from across the Box, and find out where we’ve been making headlines
Main components of hyper personalized marketing
When California-based marketing software company, Marketo, conducted a survey in US, UK, France, Germany, and Australia in 2015, the results placed beyond any doubt the need for a change in marketing strategy. Random generic messages simply didn’t work for more than...
How overseas money transfer companies benefit from Big Data analytics
The days of depending on banks and a limited number of high street forex brokers to carry out cross-border fund transfers are long gone. Now that this field is home to several FinTech players, sending money from one country to another is no longer as time consuming,...
9 free online courses to pump up your big data and analytics skills
Big Data and analytical skills are becoming an important part of the IT industry worldwide. Hence, there is a growing demand for people who possess the required skills and above all, are competent to work in these core sectors. However, acquiring big data and...
Think big data has nothing to do with small business? Think again
There is little doubt in anyone’s mind that big data is the key to business growth and success these days. This is exactly why over half of businesses have incorporated the futuristic technology into their daily practices. However, to SMBs, big data analytics still...
Conquering the world – Chatbots gone wild [Infographic]
Chatbots have become a significant part of our everyday lives. Judging by the market situation today, it seems like chatbots are here to stay. Although chatbots aren’t being used to their full potential, the new millennium has brought a change for the better. Chatbots...
5 big challenges still facing the Internet of Things (IoT)
As the Internet of Things (IoT) continues to steer operations in the 21st century, numerous challenges are coming to light. While the IoT still has the potential to transform business for owners, employees and customers alike, those who already embrace this next-gen...
Big data and Parkinson’s disease – Causes, symptoms and treatments [Infographic]
While there remains no cure for Parkinson’s Disease as of yet, Big Data is making major strides in grossly expanding what we know about the disease—and thus making a cure more likely in years to come. Parkinson’s doesn’t just affect old people, either, as many people...
20 amazing women in AI, Machine Learning & Data Science
For a very long time, women working in the fields of science, technology, engineering and math were unwelcome and underappreciated. Take for example the story of Katherine Johnson and her colleagues, who made remarkable contributions to the early years of NASA’s space...
Personalization in online casinos – Using the power of big data
Big data is a strong currency in today’s climate in Canada, with companies and brands desperate to utilize it to streamline their own operations and save on costs, while delivering the optimum service. So it's an important aspect of nearly every single sector –...
6 methods to create a secure password (you’ll remember) – Infographic
Passwords are not just random texts that you need to gain access to your online accounts. These can completely change your life for the worse if they had gotten into the wrong hands. An average person spends about 11 hours online each day. They chat with their...
The challenges of being a data scientist in a corporate world
It’s been a couple of years since the world was introduced to an exciting new career prospect. But the hype around data science still hasn’t died down. With it being predicted to remain the ‘hottest’ job for the next couple years, it doesn’t look like the buzz around...
Top 10 prestigious universities to earn your big data certificate
Big data is the driving force behind more business decisions than ever before. As the amount of data being produced in real time continues to grow, so does the demand for people with the skill sets to help business analyze and manage all this data effectively. What...
Facebook’s betrayal of data privacy is a discussion that was long overdue
In what has been termed the biggest data theft to have ever occurred, nearly 70 million people from the United States alone have had user data leaked from their Facebook profiles. In total, as much as 87 million accounts around the world have been affected, if not...
Using real time marketing & machine learning based Analytics to drive CVM
The value of data-driven Customer Value Management or CVM cannot be underrated. Data and other algorithms/analytics that shape data are an imperative part of customer value management in a telecom company. With enhanced customer expectations, it is up to the ability...
Top 10 trends in payments 2018 (Infographic)
The universe of banking and payments is ever evolving. 2017 has seen a number of significant changes in the payments industry, thanks to advances in technology. Consumers now have access to a myriad of ways to pay. As a result, payment and shopping habits change....
Top five best data visualization techniques for 2018
People are able to process visual information much faster than textual content. For this reason, data visualization is an essential model of contemporary business intelligence. There are hundreds of techniques to present business-related information and sometimes it...
Once financially beneficial data is turning on companies that collect it
There was a time when data collection was a lucrative practice for companies. That was due to the understanding that the more a brand knows about its target market, the easier it is to address those people and meet their needs. However, recent cyberattacks have made...
Difference between data scientists, data engineers, statisticians & software engineers
Finding out the difference between data scientists, data engineers, software engineers, and statisticians can be confusing and complicated. While all of them are linked to data in a way, there is an underlying difference between the work they do and manage. The growth...
Can blockchain solve the riddle of big data regulations
Like many of the technological shifts of the past two years, the world of big data has marked a paradigm shift in how information is collected and stored across the world. Not surprisingly, legislation has fallen behind technology in this regard, but it's aiming to...
Suresh Shankar on entrepreneurship, artificial intelligence and banking
Suresh Shankar, founder of Crayon Data, talks about how entrepreneurship is all about persistence and perseverance, through one of his favourite anecdotes on the Chinese bamboo tree. One that will get all you budding entrepreneurs fired up and ready to make a change!...
5 major challenges brands and marketing agencies face with data in 2018
The rapid pace of technological innovation and the sudden emergence of Big Data has left a lot of marketers feeling left behind. In less than a generation, the marketing industry has shifted in a way nearly unprecedented in its entire history. It has gone from a...
Cognitive computing: Moving from hype to deployment
Although cognitive computing, which is many a times referred to as AI or Artificial Intelligence, is not a new concept, the hype surrounding it and the level of interest pertaining to it is definitely new. The combination of hype surrounding robot overlords, vendor...
How colocation managers can forge their own path to success
As the business and commercial world expands to include more digital platforms and content, so will the data requirements and capabilities necessary to run the industry. It’s no surprise, then, that many businesses are focusing on deploying their own data center...
The future of Artificial Intelligence – What will it look like?
The world and everything in it are in a constant evolution. Starting with things that were merely Sci-Fi concepts just ten years ago such as holograms or smartphones that can be used to scan your body and check your health, everything is evolving. But the most...
Step by step approach to perform data analysis using Python
So you have decided to learn Python, but you don’t have prior programming experience. So you are confused on where to start, and how much Python to learn. These are some of the common questions a beginner has while getting started with Python(for data centric...
Top 10 best practices in MySQL
MySQL is the second most widely used open-source relational database management system in the world. It has become so popular because of its consistent fast performance, high reliability and ease of use. This article presents some of the best practices in MySQL. Best...
How to run Linear regression in Python scikit-Learn
You know that linear regression is a popular technique and you might as well seen the mathematical equation of linear regression. But do you know how to implement a linear regression in Python?? If so don’t read this post because this post is all about implementing...
How do algorithms influence teaching and bridge the students’ knowledge gap
The essence of education traditionally has involved the transition of accumulated knowledge to younger generations for most of its history. However, as the working routine changes from repetitive work to the knowledge-based activity, the requirements put to the...
What does General Data Protection Regulation (GDPR) mean for you?
The General Data Protection Regulation, or GDPR enforcement date, is quickly closing in. It’s a sweeping and relatively new form of legislation that will change the current landscape considerably. How so? Well, it puts a lot of pressure on organizations to bolster...
US data breaches have hit an all-time high – How to protect your business
2017 was one of the worst years for data breaches yet, and it’s only downhill from here. Here’s what you need to do to prepare yourself. These days, it seems like it’s no longer a question of if your personal information will wind up in the hands of hackers, but when....
The pros and cons of using big data for employee wellness
Employee well-being is a major concern for organizations, especially when those entities are concerned about productivity. Data from the Bureau of Labor Statistics published a report revealing that in 2016, there were 2.9 million reported workplace-related injuries...
Unlocking the potential of chatbots in eCommerce (Infographic)
Chatbots are conversational tools, capable of engaging multiple users to give structured responses to the most basic queries. Due to their instantaneity and ease of use, they have demonstrated significant potential on E-Commerce websites. As users face issues getting...
AI’s impact on retail – Examples of Walmart and Amazon
Artificial Intelligence or AI is expected to be in major demand by retail consumers due to its ability to make interactions in retail as flawless and seamless as possible. Many of us do realize the potential of AI and all that it is capable of, along with the support...
Improving cryptocurrency security: Bitcoin Gold case study
After the second Bitcoin fork creating a new cryptocurrency, Bitcoin Gold (BTG), it became the victim of aDistributed Denial of Service (DDoS) attack. The DDoS attack of Bitcoin Gold caused it to go offline at a very critical moment in the new cryptocurrencies...
Poker AI: The rise of machines against human champions (Infographic)
The AI technology has been picking up steam in the past couple of years. It’s no longer a gimmick or a faraway fiction. Scientists from all around the world are slowly but surely cracking this riddle. Sure, they are still a long journey away from creating a true...
Interview with Nitin Chugh on personalization & digital transformation in banks
I recently interviewed Nitin Chugh, Country Head – Digital Banking at HDFC Bank Limited, and we discussed some hot topics in banking industry today: digital transformation, personalization, AI & machine learning, blockchain etc. HDFC Bank is an acknowledged...
Interview with Nitin Chugh on personalization & digital transformation in banks
I recently interviewed Nitin Chugh, Country Head – Digital Banking at HDFC Bank Limited, and we discussed some hot topics in banking industry today: digital transformation, personalization, AI & machine learning, blockchain etc. HDFC Bank is an acknowledged...
How to make it easier and cheaper to manage your enterprise data in AWS
Amazon Web Services (AWS) is currently the most widely used enterprise cloud data storage system, successfully competing against similar services from the likes of Microsoft and Google. In this article, we look at what AWS offers and outlines how enterprises can...
4 workflow automation tips for managing your data at workplace
Many IT professionals find, far too often, data management responsibilities consume large percentages of their workdays. Although those tasks are crucial, there are effective ways to do them more efficiently with automation, thereby freeing up more minutes — or hours...
77 interesting facts about cyber crimes one should know in 2018 (Infographic)
As a society, we cherish our right to privacy probably more than anything else. Sharing is great, and we all enjoy it, but there is always that other side, the untold story, the personal, the secret. Now, let’s extrapolate this to a societal level. How many...
Digital transformation in Banking: Past, Present and Future
Regardless of how much people earn, the jobs they have or whether they’re part of the workforce, banking is a necessary routine. It may not come to mind as one of the most technologically advanced industries, but has still undergone some significant advancements that...
9 powerful Google Analytics tips for your eCommerce website
eCommerce opened the boundaries of traditional trade and enabled entrepreneurs to reach target audience anywhere in the world. It gave rise to the plethora of new businesses but also made everyone wonder – who is my average buyer and what do I know about this person?...
‘चलो StartUp’ – Episode 2: 3 StartUp success tips to solve real India problems
Deep Bajaj got fed up of seeing his wife, mother & other women struggle with dirty public toilets. He decided to solve this real problem through a startup, and PeeBuddy was born. Faced with dirty loos, women can now stand & pee! Episode.2 of चलो StartUp...
Machine learning explained: Understanding supervised, unsupervised, and reinforcement learning
Once we start delving into the concepts behind Artificial Intelligence (AI) and Machine Learning (ML), we come across copious amounts of jargon related to this field of study. Understanding this jargon and how it can have an impact on the study related to ML goes a...
Top 10 machine learning algorithms you should know in 2018
The word “Big data” prevailed in 2017, and it’s going to keep prevailing in the following years. In our previous post, I’ve introduced some concepts about big data, machine learning, and data mining (see post: Understanding Big data, Data mining, and Machine Learning...
How to use big data to successfully fight credit card fraud
Technology vs credit card fraud is a never-ending battle, in which the stakes are high. Hackers are creating new sophisticated techniques to illicitly obtain credit card information and use it to satisfy their financial needs. To avoid losing billions of dollars,...
Feel lost in the digital world? Here's how to use data to boost customer experiance
The collection of data has grown into a substantial industry in its own right. But what too many small business owners don’t know is that big data can help them out, too — it’s not just for major corporations. But data is useless without a mission in mind — and what...
Data breaches are inevitable — or are they? [Infographic]
A data breach can take a toll on a company of any size. Here’s a look at some significant data breaches, tips to protect your business, and what to do in the event of a data breach. This infographic originally appeared here. Republished with permission. Submit your...
Components of Hadoop Architecture & Frameworks used for Data Science
Every business now recognizes the power of Big Data Analytics in developing deep actionable insights to enjoy business advantages. However, unlike before when businesses were required to deal with gigabytes of data, the present scenario requires to store and process...
‘चलो StartUp’ – Episode 1: DON’T STRESS. STARTUP KARO!
‘चलो StartUp’is a 10-episode video series that present inspiring lessons and start-up stories on how to be a successful entrepreneur & jobs creator in India. Why am I doing this? When I re-engaged with startups as a mentor & angel investor in late 2016 after a...
11 actionable steps to protect your online privacy [Infographic]
While online privacy is well recognized as a matter of paramount consideration, global internet users surprisingly, aren’t doing enough to protect it. In a statista survey, over 2.14 billion people worldwide are forecast to shop online in 2021. There were reportedly...
Retail: How to keep it personal and take care of privacy
For years the retail sector has been making use of customer data to propel their own marketing campaigns forward. What remains to be seen in this regard is, how the future of better data collection and technology, coupled with an enhanced need for customer...
Biggest challenges startups and SMBs face with Big Data (And how to overcome them)
Big data has proven to be more than just a buzzword floating around the business-world. The industry has continued to grow at a rapid pace, and the global big data market is expected to hit over $40 billion in 2018. More and more companies in multiple sectors and...
The ultimate GDPR guide for marketers and businesses
With the prospect of GDPR looming - many of us are starting to ask a lot of questions about the regulation, and what it means for our business. The astronomical penalties that will come into place for those found not complying with GDPR has lead to it becoming one of...
Top 10 trends in payments 2018 (Infographic)
The universe of banking and payments is ever evolving. 2017 has seen a number of significant changes in the payments industry, thanks to advances in technology. Consumers now have access to a myriad of ways to pay. As a result, payment and shopping habits change....
Enhanced Visualization in Tableau: Combining plots
Data Visualization is an art of presenting data in a manner that even a non-analyst can understand it. A perfect blend of aesthetic elements like colours, dimensions and labels can create visual masterpieces, hence revealing surprising business insights which in turn...
A look at all digital transformation initiatives in Travel, Aviation and Tourism
High-tech advancements and digital strategies that contribute to an increasingly digital world and digital age are evident in almost every industry imaginable. Companies know to remain competitive, they must look for ways to keep customers happy and impress other...
Top 10 free and open source business intelligence software
In today's world, the progress and growth of any business are not reliant on effective promotion and quality of its products & services alone. Instead, with the advancements and the rapidly growing popularity of big data and data science, the corporate sector is...
Six powerful ways Artificial Intelligence will benefit eCommerce businesses
AI is everywhere now! A study shows by the year 2020, 85% of the enterprises will be overtaken by Artificial Intelligence. With its effective methods AI is finding a drill in every industry at its best. Now the question rises as to what effect will AI have in the...
Digital transformation in Banking: Past, Present and Future
Regardless of how much people earn, the jobs they have or whether they’re part of the workforce, banking is a necessary routine. It may not come to mind as one of the most technologically advanced industries, but has still undergone some significant advancements that...
If web crawling helped Google so much, why not for you?
I am a big Google fan. Before I start pouring in praises for the search giant, it’s quite amusing to note that their well-loved search routine begins with the modest process of web crawling performed by crawlers (aka spiders or bots) commonly referred to as Google...
10 AI technologies that will rule the world in 2018
Artificial intelligence, machine learning and automation are poised to change not just the modern enterprise, but the world as we know it. They are completely changing the way consumers engage with companies. They are altering the way enterprise thinks and operates...
The tech future of finance: How data and AI will play a role in 2018
It is easy to forget in our busy lives how much we rely on institutions, specifically banks, financial institutions and businesses. The role of AI in these industries could facilitate improvements for employees and customers alike. Big data has surfaced as a buzzword...
Top 15 programming languages with the highest salaries
Technology always takes a dominant position in economy and society. Millions of people, therefore, found their careers, and many others have even dived into a completely different field just for entering this industry. Even so, enterprises are still trying hard to...
How to make big data work for eCommerce personalization
Gazing into the customer’s mind has never been more accessible, and retail companies are taking notice of this and acting up. Big Data is a modern crystal ball which can help eCommerce actors make the most of their offer, pinpoint their niche with high accuracy and...
Big Data in aviation – Six trending technologies
Large and Luxurious - has become a way of life for the city of impeccable architecture and style – Dubai. Apart from being the largest among UAE cities, it houses the world’s tallest building, biggest natural flower garden, the most massive mall, world’s heaviest Gold...
70 free and amazing data sources for data visualization
Every great data visualization starts with good and clean data. Most people believe that collecting big data would be a rough thing, but it’s simply not true. There are thousands of free data sets available online, ready to be analyzed and visualized by anyone. Here...
A data scientist’s story: Research into 1,001 data scientist profiles
In the age of big data and machine learning, there is one profession that stands out – data scientist. Data scientists are the investment bankers of the 21st century. The prestige associated with the title is undoubtedly sought after by most quant inclined candidates....
Big data solutions to take a bite out of fraud!
The modern economy has seen a mass migration of retailers to e-commerce and other digital platforms. The cost and convenience advantages have produced a sales revolution for a number of varied industries but have also created new vectors for fraud and abuse. The...
Medical big data: From reluctance to revolution
The role of big data in the healthcare industry has been growing rapidly in recent years. State-of-the-art analytical tools are being applied to patient medical information in order to extract meaningful health trends and provide timely preventative care. The industry...
5 big data trends expected to influence AI in 2018
Whether you’re ready or not, a new year is nearly upon us. As significant changes loom just over the horizon — most of which are spurred on by trends in artificial intelligence — the consumer market for next-gen AI is more promising than ever before. But how does big...
Total Performance Data (TPD) is the future of in-play betting?
The sports betting industry is certainly one that never stands still. With the advances made on the technology front and the growing popularity of online betting, it’s important that operators continue to find ways to keep up with the latest trends. Customers are...
Can artificial intelligence diagnose and cure diseases?
Probably in just a few years, it would difficult to find a doctor who would be sitting there with a white coat and stethoscope. Rather, your next doctor could be a bot or an automated program. And, the reason why I am making such a statement is nothing but the...
The role of machine learning in financial fraud prevention
The scope of application of artificial intelligence is almost unlimited. However, there is at least one field where the role of AI can hardly be overestimated. This field is security, or, to be more exact, the financial security of Internet services users. If your app...
Data-driven design: Should designers trust their guts — or the data?
We’ve all seen one of those movies that is widely critically acclaimed, but which we don’t enjoy watching. There are many movies like this that come out each year. The critics rave, the indie awards are heaped on, and audiences never bother to tune in. Why is that?...
Everything you need to know about Smart AI Chips
The future of artificial intelligence is here. From smart home thermostats that adjust themselves according to historical weather trends and future predictions to smartphone apps that provide relevant shopping recommendations based on your purchase history, many of us...
Artificial intelligence in Telecommunication: Intelligent operations is the new norm
The move towards an intelligent world is faster and more rapid than it ever was before. The increase in this transition has been propagated through the role of several high key stakeholders that have redefined the way we look at technology. One of the key players in...
Poker & AI: The rise of machines against humans [Infographic]
The AI technology has been picking up steam in the past couple of years. It’s no longer a gimmick or a faraway fiction. Scientists from all around the world are slowly but surely cracking this riddle. Sure, they are still a long journey away from creating a true...
How to become KPI-driven: 4 simple steps for businesses
Are you consistent in achieving your strategic goals? Perhaps, one month your team focuses on generating traffic, but the next month you suddenly switch to reducing costs (budget for marketing activities included). It turns out that many companies do change their...
Recognition – A new approach to automated data capture
Data is rapidly becoming a key resource in helping many organizations find unexplored areas of business in addition to operational inefficiencies. The challenge however, is that this data is largely trapped within unstructured data (90% of enterprise content is...
What business intelligence can do for SME growth and profitability
Businesses big and small can benefit from analyzing their business data to help them make informed decisions to drive growth and profitability. However, many small and medium enterprises are often hesitant to use business intelligence (BI) solutions, thinking that...
Customized selling and marketing: How does big data do this?
Many executives nowadays often use the term big data as a buzzword. But unlike other empty buzzwords that make people sound smart, this term is actually changing the way people do business. In fact, more and more aspects of business operations are now data-driven, and...
Infosys co-founder Kris Gopalakrishnan invests in big data startup Crayon Data
Appeared on The Economic Times BENGALURU: Singapore and Chennai-based big data company Crayon Data has received an undisclosed investment from InfosysBSE 3.06 % cofounder Senapathy (Kris) Gopalakrishnan. The investment is part of Crayon's Series A2 round of funding....
Infosys’ Kris Gopalakrishnan invests in big data and AI startup Crayon Data
Singapore/Chennai/Bengaluru –7 November, 2017 Mr. Senapathy “Kris” Gopalakrishnan, Infosys co-founder, has made a personal investment in Crayon Data, one of Asia’s hottest big data and AI companies. The investment is part of Crayon’s Series A2 round of funding....
Interview with banking expert Vikram Atal
Tell us a little about yourself, outside of the information that is publicly available and online. Ah, that’s a tricky one. Well, it may be interesting to note that before I started my career in finance, I had explored the option of doing an advanced degree at ISI...
Expert interview with Ron Shevlin about the role of big data in banking
I recently interviewed Ron Shevlin, Director of Research at Cornerstone advisors, for Big data made simple, Crayon’s big data information portal. We talked about a wide range of subjects, from how banks need to use the data they have at hand, to their business models,...
Data analysis guide: It’s time to excel by using Excel!
Businesses often make use of Microsoft Excel to input and organize various sets of information. To be precise, there are over 750 million people making use of excel across the globe. Now I am sure you must be quite familiar with excel and have a good grasp on the...
Artificial Intelligence, Deep Learning, and Neural Networks explained
Artificial intelligence (AI), deep learning, and neural networks represent an incredibly exciting and powerful machine learning-based techniques used to solve many real-world problems. For a primer on machine learning, you may want to read this five-part series that I...
Big data poses special risks for children – UNICEF
Back in 2015, privacy campaigners became aware of a new Wi-Fi-connected toy that raised considerable concern. At issue was Hello Barbie, a doll with speech recognition technology that could hold a two-way conversation with a child. Parents and others grew concerned...
What is metadata and why is it as important as the data itself?
Being data-driven is no longer just "nice to have" for most companies. If we're not currently leveraging our data to make better business decisions, then most of us are at least trying to get there. But with so much data out there in so many different systems, trying...
4 reasons why you must use big data for sales prospecting
With the continuous progress in data science, there is a huge opportunity for sales managers to achieve new insights on how to increase sales, have more satisfied customers who return again and again. But, one obstacle many organizations face is learning how to...
Ten handy python libraries for (aspiring) data scientists
Data science has gathered a lot of steam in the past few years, and most companies now acknowledge the integral role data plays in driving business decisions. Python, along with R, is one of the most handy tools in a data scientist’s arsenal. It’s also one of the...
7 things to remember while implementing a BI project in your organization
Implementing a BI solution can propel your organization to the next level, if done properly. It can provide a seamless platform that helps your employees get real-time insights from various corners of your business, and achieve operational excellence. It can also...
Big data – 5 ideas to help your sales team see results in a week
Big Data has already started influencing the way we perform our everyday functions. Today’s consumers are dealing with tons of information when they set out to search for a product on the web. Big Data has already started impacting the way these consumers find and buy...
7 data powered business tools that make big data more actionable
Big data is an incredibly useful platform for any business, big or small. It allows brands to delve deeper into the information and insights that fuel their products, services and processes. For example, you can use data collected on past product performance to make a...
What skills do I need to become a data scientist?
Leveraging the use of big data, as an insight-generating engine, has driven the demand for data scientists at enterprise-level, across all industry verticals. Whether it is to refine the process of product development, help improve customer retention, or mine through...
How to tell if a web site is protecting your data – Five signs to look for
More and more websites are requesting personal information and allowing you to make purchases at a touch of a button by storing your credit card information. With that convenience comes significant additional risk. How can you tell whether a site that you’re using has...
8 ways machine learning will improve education in the future
CMO has recently reported the shocking news: “While 16% of U.S. jobs will be lost over the next decade as the result of artificial intelligence and technology, 13.6 million jobs will be created during that time due to the trend.” Artificial Intelligence is truly...
Could AI help stop fake news in the near future?
Thanks to the internet, we have access to a wealth of information at any given time. You can find just about anything you need. Unfortunately, it also means there’s a lot of misinformation out there. It’s not difficult to create a website. You don’t need a degree or...
Big data meets design – Visual communication in big data
The Big Data landscape is defined by four Vs - volume, velocity, veracity, and variety. It also includes interactive data visuals that convey insights and engage the user. The classical understanding of visualization in analytics involves presenting the results of...
How to define your data quality problems: How to get started
To tackle any problem in a systematic and effective way, you must be able to break it down into parts. After all, understanding the problem is the first step to finding the solution. From there, you can develop a strategic battle plan. With data quality, the same...
9 golden rules of data visualization – Infographic
Data visualization is the presentation of data in a pictorial or graphical format. It enables decision makers to see analytics presented visually, so they can grasp difficult concepts or identify new patterns. This infographic explains the nine golden rules of data...
Python vs R for data analysis: An infographic for beginners
I think you’ll agree with me if I say: It’s HARD to know whether to use Python or R for data analysis. And this is especially true if you’re a newbie data analyst looking for the right language to start with. It turns out that there are many good resources that can...
How AI is dominating the marketing? 5 real time observations
Watson, IBM’s artificial intelligence platform, is loquacious: it tells jokes, answer the questions and write songs as well. Google’s AI platform can read lips better than a professional do, and it is capable enough to master video games within a short period. MIT’s...
Should you invest in a BI tool in the first 2 years of your company
The tech and business worlds are raving about the expansion of the Internet of Things (IoT), and the need to invest in tools that can handle the surge of Big Data. However, for a relatively small business that’s just getting started, you may feel like the amount of...
Preventing sports injuries with wearable tech and data analysis
Watching professional sports is a classic pastime—most of us love to gather together and enjoy ourselves while united behind our favorite teams. Unfortunately, there is a major problem with the current state of sports worldwide: player injuries. Obviously, this is an...
Review of 20 best big data visualization tools
Big Data is amazing. It describes our everyday behavior, keeps track of the places we go, stores what we like to do and how much time we spend doing our favorite activities. Big Data is made of numbers, and I think we all agree when we say: Numbers are difficult to...
Machine Learning: Linear regression and gradient descent – Part 1
The purpose of this article is to understand how gradient descent works, by applying it and illustrating on linear regression. We will have a quick introduction to Linear regression before jumping on to the estimation techniques. Please feel free to skip the...
Get personal: A secret recipe to cash in on data
Its your weekend, and that favourite haunt is tempting for the weekly brunch, you settle down and order, prefer a certain cool track to suit your mood and ambience as you unwind and so on, you have left enough reasons for Crayon Data - a five-year-old Singapore based...
Blockchain – A game changer in business technology?
Since its launch as the core technology of Bitcoin, blockchain stirred the minds of developers, marketers, and technicians. Other virtual currencies followed its pattern and as a result the total market value of virtual money exceeded 100 billion this summer. Company...
Personalisation and the changing face of banking
Today’s millennials expect a range of services, on their phones or tablets. All at the click of a button, while being on the move. Clearly, the world is going completely mobile. A significant demographic for the banking industry is that nearly 65 percent of India’s...
Can big data be used to prevent crime from happening?
If you’ve seen the movie “Minority Report” — released back in 2002 — you know the premise is both unique and far-fetched. It is, after all, a science-fiction film littered with futuristic technology and unheard-of societal norms. Drugs, for example, are consumed via...
Interview with Rick Smolan on ‘The Human Face of Big Data’
Manu: Rick, can you tell us a bit about yourself? I saw in your TED talk that you used to be a photo journalist, so how did you get started on this journey? Rick Smolan: Yes, I was always very curious as a person so it's interesting that I'd end up in a job where I...
Interview with Rick Smolan on 'The Human Face of Big Data'
Manu: Rick, can you tell us a bit about yourself? I saw in your TED talk that you used to be a photo journalist, so how did you get started on this journey? Rick Smolan: Yes, I was always very curious as a person so it's interesting that I'd end up in a job where I...
Revive your eCommerce with the help of big data and predictive analytics
Understanding your customers and how they'll behave is one of the most important things every salesman is aware of. However, it can be much harder to understand their behavior for online businesses. Nevertheless, it's possible with the help of Predictive Analytics to...
5 best ways to boost business efficiency with big data
Business data had always existed but so far had never been tapped internal efficiency. Today companies like Amazon are using this data to improve their customer relations. There are endless big data case studies where companies have leveraged Big Data to improve...
Artificial or Augmented Intelligence: Interview with Intel’s Chief Data Scientist Bob Rogers
I recently sat down with Bob Rogers. Bob is Intel’s Chief Data Scientist for Analytics and AI. I sought out answers to the some of the most popular questions related to artificial and augmented intelligence. The entire interview was illuminating, and shed some light...
Machine learning helps neuroscientists understand the brain
The human brain is an amazingly powerful biological machine. It’s thousands of neurons control everything from our bodies to our very nature. Everything we are, or could be, hides in those cells. Neuroscientists have a basic understanding of the human brain and how...
The hidden advantages data-driven sales teams have
Data. It’s something sales teams love and hate. Although it can be used effectively to boost sales and assists you in meeting your targets and goals, it’s a time-consuming process to sift through large quantities of it, and it can even seem daunting to some teams even...
The Personalization Paradox – Indian hospitality rediscovers
While it is still quite early to foretell the implications of India’s tryst with GST, there is an all pervasive air of concern in the hospitality industry regarding the same. At this very crucial juncture we will cautiously analyse how the hospitality industry aspires...
Why the financial system needs an overhaul and why cryptos might be the answer
It's not a stretch to say that the very idea of money is taken for granted these days! The fact that we exchange bits of paper for various goods and services is seen as a fact of life, one that seems to have existed since time immemorial. But the truth is that money...
Why small businesses need big data more than ever
The rise of mobile technology has created a multitude of new ways for businesses to interact with customers. Another defining feature of the digital age is the development of many powerful big data analytics tools. These two components — customer data and the tools to...
How big data will help forex brokers in the long run
Foreign exchange (Forex) trading has evolved rapidly over the past three decades. The internet made it not only accessible to new traders, but helped those traders succeed. There are just so many tools available out there for analysis and execution strategies. And, of...
Big data is the key to strategic HR decisions
Human resources play the key role in company development. However, this profession is not only about interviews and resumes anymore. In a world filled with all sorts of information, HR teams are finding new ways to improve their results and efficiency. This is...
3 reasons why it’s crucial for brands to introduce machine learning into their marketing
Every so often, a story ripples through the media along the lines of “Scientists say a ‘smart pill’ is just over the horizon to make us immediately more intelligent.” While there is no telling when we will actually see such a pill, there’s a metaphorical “smart pill”...
Why all entrepreneurs need to understand blockchain
Probably, you’ve heard the buzz surrounding blockchain and cryptocurrencies by now. It’s easy to see why blockchain is valuable, but understanding how it works can be a challenge. Blockchain is a complex piece of technology that’s capable of changing many facets of...
Innovative tech start-ups win over banks: A tale of leveraging Big Data
For many years, banks and financial institutions dominated the currency trading arena and money transfer services. Banks were viewed as the most credible, reliable and efficient means of conducting international money transfers. However, the costs of using banks for...
Possibly the simplest way to explain K-Means algorithm
Clustering is a technique for finding similarity groups in a data, called clusters. It attempts to group individuals in a population together by similarity, but not driven by a specific purpose. Clustering is often called an unsupervised learning, as you don’t have...
Review of top 10 online Data Science courses
As more and more of life’s day-to-day work and personal activities are being simplified by Big Data technologies, the need for data scientists has risen remarkably for the past several years. Companies around the world scamper desperately to grab people with data...
The Kindness of Strangers – Thank you Singapore
It was 20 years ago today The Kindness of Strangers Thank you Singapore (Sung to the tune of Sgt Pepper’s…..) It was 20 years ago today That I came to Singapore to play I’ve been going round and round in life Even found myself a wife So may I re-introduce to you The...
11 interesting Big Data case studies in Telecommunication
Telecom companies are sitting on a gold mine, as they have plenty of data. But what they require is a proper digging and analysis of both structured and unstructured data to get deeper insights into customer behaviour, their service usage patterns, preferences, and...
How data from your cloud-based phone can help different aspects of your business
The cloud has taken over the business communications sector and Gartner is predicting that cloud communications spending will grow at 3.1% CAGR through 2020. While we can discuss the benefits of how a cloud-based phone system can help different types of business, we...
5 common myths all small businesses have about big data
It is evident that big data is a potential game changer for any business that wants to stay ahead of its competitors. For instance, companies that use big data provide better customer care services, more efficient targeted ads, and stronger business relationships than...
Top 5 business intelligence (BI) solutions for your company
In today’s ultra-competitive business environment, you need all the tools you can get to have that edge over your rivals. And in this respect, BI takes on a very important role. Modern business and organizations strive on data. We’re talking of data that accumulates...
Does Big Data make or break building & manufacturing industries?
No matter what industry you're in, it's likely that big data already plays a huge role or will in the near future. That includes the building, construction and manufacturing industries, which use data analytics to make various processes more efficient. It's inevitable...
Data can predict game results: Could this change how we play games?
Big data has taken the tech world by storm in the last years, as new applications are developed every day, ranging from retail and advertising to healthcare and politics. The impact of big data analytics is now spilling over novel fields, such as sports and online...
109 common data science interview questions to remember
Preparing for an interview is not easy – naturally there is a large amount of uncertainty regarding the data science interview questions you will be asked. No matter how much work experience or technical skill you have, an interviewer can throw you off with a set of...
Eight effective and useful data visualization tools for mapping
Representation of data via maps is a rapidly developing area of visualization that has many practical applications. Today, we have a wide range of innovative tools for a visual representation of geographical data for maps and other purposes. This article offers you a...
Three ways big data is transforming the medical field
From its role in global epidemics to new wearable technology and public health analysis, big data is having a tremendous impact on the medical field. There are many potential benefits, but also possible drawbacks: while patients will be armed with more knowledge and...
How relatively unknown start-ups took on big banks and won: A tale of leveraging big data
For many years, banks and financial institutions dominated the currency trading arena and money transfer services. Banks were viewed as the most credible, reliable and efficient means of conducting international money transfers. However, the costs of using banks for...
3 things you need to know to craft a perfect presentation
Big data is growing increasingly important. It can shape many core actions businesses take. As a result, it’s important that you understand how best to communicate the importance of this data. This is especially critical, as many decision-making managers simply don’t...
Big data and the art of personalized banking
Consider this scenario. You are planning to holiday at the Dead Sea. You search the internet for information on flights and hotels around the area, sift through travel blogs and watch countless YouTube videos, posted by the more enterprising holidaymakers. You then...
Choosing big data solution providers: What you need to know
You've probably heard that Big Data is "the new oil", or "the new natural resource", and it is not at all surprising. Big Data has the potential to add value to your business operations and provide you with powerful new insights to make better decisions. These days,...
How is Artificial Intelligence (AI) influencing financial markets?
Fintech is the new gold rush for investors, growing from 10% in 2016, to a staggering $23.2 billion, with China and USA leading the market. This boost is powered by the growing capabilities of machine learning and artificial intelligence. It is an idea whose time has...
Top 12 essential analytics tools every marketeer should know
If you're spending money on digital marketing, analyzing your data should be a top priority. You need to know where that money's being spent, and whether it's having the effect you're looking for. Thankfully, there are plenty of apps out there that can help you get...
How IoT and big data are driving smart traffic management and smart cities
Have you ever sat down and imagined the capabilities and limitations of big data - a term we give to drawing insights by applying analytics to the ever-growing amounts of digital information? Sometimes, it seems tempting to think that big data can do anything. With...
R – What’s in it for me?
Although R has been around since the 90’s it’s only become widely known in the last few years. The explosion of data being produced by websites, the Internet of Things etc has led to great interest in how to analyze and use that data to best effect which is where R...
What is big data’s role in the fourth industrial revolution?
We stand at the dawn of the fourth industrial revolution, an idea that will see new breakthroughs thanks to advancements in areas including artificial intelligence, robotics, quantum computing, 3D printing and the Internet of Things. Another technological growth area...
Four cognitive biases that affect big data analysis
Data collection methods have evolved dramatically – especially with the ability to collect big data. The removal of human error by quantitatively logging information for statistical analysis improves the validity of the data collected, which intimates that whatever...
Unlocking the power of personal data: Automation & Smart Marketing
Companies are learning how to unlock the value of their customers’ personal data through the use of tools like chatbots and interactive customer service experiences, personalized recommendations, and customized credit offers. From corporate offices to hospital...
Five key components of effective data monetization strategy
Data monetization is not difficult. For example, companies have been selling their email lists (legally or otherwise) for years. If you have information that another company is willing to pay for, then data monetization is just a case of finding the right customers....
Data Monetization: What is it, and how to do it
There are very few financial firms that fully understand the value of their data. The information captured and stored by days/months/years worth of data is worth its weight in gold. It’s so valuable, in fact, that data breaches are often the target of hackers, looking...
10 useful resources for those who wants to know more about SQL
SQL, Structured Query Language, is the primary language responsible for management of data and data structures within a relational database management system. In other words, SQL is a language used to communicate with a database. It is important to mention it is one...
Why big data needs the benefits of blockchain
Big data and blockchain are two technologies that are expected to transform the way we do business the coming years. They’re powerful on their own but even more so when combined. Here’s why big data needs the benefits that blockchain provides. What Is Blockchain? The...
Hotels using Big Data to understand customer choices – an interview with Vikram Rao, CEO, Crayon Data
New Delhi, June 28, 2017: The Hotel Times: What relevance does big data hold in the hotel industry? Vikram Rao: Every hotel is a gateway to a city. The experience of a city is intrinsically linked to the experience a guest has at the hotel they choose. Being in the...
REPORT: How are companies protecting their data against modern day threats?
In a country that has just witnessed the latest epidemic in modern-day cyberattacks, namely, the National Health Service being compromised; data security is fast reaching the forefront of corporate mindsets. The truth is that no server is impenetrable and no data is...
How big data is making bigger and better mobile apps
What makes a good app? This is the question that application developers have been trying to answer for quite a few years now. The technical component of the process has been in a constant upgrade, which has actually led to a major breakthrough for the non-technical...
Four things you need to know about Cluster Programming
In the world of Big Data, information has evolved from being a merely passive construct into an active and dynamic abstraction. The language of this information is the computer code, but before diving into cluster programming, there are several things that you must...
How to get into data science from a non-technical background
DJ Patil, the current Chief Data Scientist of the United States and previously the Head of Data Products at Linkedin, is the one who first coined the term "data science". DJ posits that, “the dominant trait among data scientists is an intense curiosity—a desire to go...
General Data Protection Law (GDPR) gives personal data a broader definition
One of the trending tools modern businesses use for optimizing workflows, finding new markets and efficiently advertising products is big data analytics: a process that involves large information sets and the use of artificial intelligence and machine learning in...
Using big data in corporate training and engaging your employees
Regardless of the industry, big data is beginning to play a vital role for decision makers in business. Companies are investing in big data tools to help them collect more information and make better decisions. Once data is collected, it is then analyzed in detail and...
The new number game – Making sports smarter with big data
When we think about analytical data, we imagine information collated and used in advanced niches such as the medical and computer industries. But there’s one other industry that uses analytical data on a major scale and has done so since the dawn of time. We are of...
9 effective ways to manage data breach in your organization
Most organizations are almost running out of options on how to secure their data due to the increased rate of data leaking from organizations into the wrong hands. This can even lead to cases of mistrust in the organizations since in most cases; it is an insider...
Everything you need to know about Apple’s new AI chip
Apple typically creates a lot of buzz when it unveils new products or operating systems, but tech enthusiasts have recently been getting excited about a much smaller offering that’s still in the works. A special chip called the Apple Neural Engine is intended to...
Top 5 ways big data can make our world greener
It’s true that technology has contributed a lot to the environmental crisis we’re currently facing. Old electronics dumped into landfills, plastics, air pollution—the list goes on. While it’s easy to blame everything on technology, it’s important to remember that it’s...
Best practices for Marketing – How to take advantage of data
As big data is starting to feel comfortable, there has never been a better time to sink your teeth into the numbers. In case you're asking "What's the difference between regular data and big data?", here it is: "Big data" is a term used for the massive amounts of data...
Does your car read your expressions? AI and machine learning make this possible
Very soon, your car will recognize you when you get behind the wheel. Utilizing cameras with biometric indicators and facial recognition software, the automakers are looking to personalize your driving experience with cars that stare back at you adjusting quietly, the...
Big data as a software will revolutionize the business world?
The cloud industry is evolving rapidly, offering every year innovative and more affordable solutions for companies and individuals. At the moment, one of the trending topics in the business technology world is the fusion of Software-as-a-Service systems with the use...
Three effective methods of data collection for market research
Data collection for marketing research is a detailed process where a planned search for all relevant data is made by a researcher. The success of marketing research is contingent on the integrity and relevance of the data. And to a high degree, the quality of the data...
Look at what you can do with these 4 excel reporting tools
Excel is a little like a bicycle: it’s useful enough, for short jaunts, but it's flawed start becoming obvious when tackling any large endeavors or when trying to bring anyone along for the journey. It’s a great program, but it simply wasn’t designed for the kind of...
Big data and cloud computing – challenges and opportunities
Big Data is an umbrella term which encompasses all sorts of data which exists today. From hospital records and digital data to the overwhelming amount of government paperwork which is archived - there is more to it than we officially know. You can’t categorize Big...
Digital Wallet game: Amazon enters the digital payment market in India
Amazon India recently received its wallet license from the Reserve Bank of India, meaning it’s about to get easier for online shoppers to complete their purchases using Amazon Pay. The license took effect on March 22, 2017, and will remain valid through March 2022, as...
Big data and live video: A match made in heaven (or the cloud)?
Businesses are now fully onboard when it comes to understanding the value of big data. Once an abstract idea, it is now one of the hottest marketing technologies big businesses are investing in. Successfully analyzing big data can highlight hidden value within a...
What are Hadoop alternatives and should you look for one?
Hadoop’s development from a batch-oriented, large-scale analytics tool to an entire ecosystem comprised of various application, tools, services, and vendors goes hand in hand with the rise of big data marketplace. It is predominantly used for large scale data analysis...
The Manual for Indian Startups In conversation with lead author, Vijaya Kumar Ivaturi
The inspiration for the book ‘The Manual for Indian Startups’ is based on the premise that India needs its own manual for startups, given its diversity in market segments, business models, and consumer behavior. To succeed at scale, it is important for early stage...
Manual for Indian Start-ups: A book to help start-ups find their way around
What started off as an exercise to draw up a tool-kit for entrepreneurs as part of the CII national council on innovation and entrepreneurship, got transformed into a handy manual for start-ups in India, using Indian examples and the local context. The Manual for...
IoT-connected cars of today – Cases from Hertz, Nokia, NTT, Mojio and Concur Technologies
Imagine a world where your car not only drives itself but also says intelligent things like these: A hotel is just around the corner and you have been driving for eight hours. Would you like to reserve a room and take rest for a couple of hours? You last serviced the...
The future is bright for banking – Implementation of PSD2 and GDPR
2018 is likely to be a game-changing year for the banking and finance sector. As the General Data Protection Regulation (GDPR) and Revised Payment Service Directive (PSD2) are implemented across the European Union, the exclusive control of banks and other financial...
Crayon Data among the top 10 leading analytics solution providers in Singapore
Singapore’s government agencies are increasingly investing in data, infrastructure, and big data talents. Of late, the island country also undertook an initiative to form a consortium of researchers and think tanks to become the world’s first Smart Nation. The move...
Data analytics can take you places that you can’t imagine
Analytics has been a well-known strategy to identify opportunities, streamline work, and take decisions. Almost all businesses in some form or other make use of analytics. The scheduled annual appraisals in a company is a simple example of analytics usage. While usage...
Top 10 high paying countries for data scientist
Data—we are surrounded by it. We create 2.5 quintillion bytes of data every single day. More and more industries have begun to leverage data for business growth. And this has given rise to the big data revolution. The demand for data scientists has seen a steady rise...
Three benefits of tracking employee data for your business
Employee data tracking—sounds like a lot of extra work, right? How do you keep tabs on employee data for more productivity, better bookkeeping, and safer employees? Your employees generate a lot of data and using data tools for your business just makes sense. There...
Top 5 industries leading the way in IoT integration
With connected smart devices expecting to number in the billions over the next few years, the Internet of Things is becoming a major factor in consumer expectations and business planning. The IoT is impacting our lives more than you may realize. The following list was...
How machine learning is revolutionizing digital enterprises
According to the prediction of IDC Futurescapes, Two-thirds of Global 2000 Enterprises CEOs will center their corporate strategy on digital transformation. A major part of the strategy should include machine-learning (ML) solutions. The implementation of these...
How bad data changed the course of history [Infographic]
The ripple effect is when one small inciting event has ramifications that expand far beyond, like a pebble thrown in a pond. The pebble may be small, but the rings that radiate from the initial splash keep growing. In today’s world, bad data is the pebble, and history...
GDPR: 5 questions data-driven companies should ask to manage risks and reputation
Data is rapidly becoming the lifeblood of the global economy. In the world of Big Data and artificial intelligence, data represents a new type of economic asset that can offer companies a decisive competitive advantage, as well as damage the reputation and bottom-line...
The business of transferring data from Salesforce to Hadoop
The sustained success of Hadoop has brought about a radical change in big data management. This highly popular open-source MapReduce technology allows easy access and provides reliable answers to advanced data questions. Data management has been taken to the next...
How data and streaming are transforming entertainment as we know it
In the Digital Age of multitudinous data and online streaming, entertainment is now delivered in a more unique way than it ever was before. Thanks to streaming sites like Netflix and Hulu, TV shows and films are more accessible than ever and their online viewerships...
Top 5 ways chatbots transform the financial industry [Infographic]
Chatbots are taking over the world. Banks have started investing in this intelligent chatty friend, to make their customer conversations easier and more efficient. Human – human to human- machine? …. Better? Safer? Faster? What are chatbots? Chatbots are programs that...
Data security: How blockchain transforms five different markets
Security is a huge concern for everyone, especially when it comes to online transactions. The increasing number of cases of fraud, hacking and unauthorized personnel access of data poses a significant risk for all businesses. So, how do we secure online transactions?...
Smart video marketers now use big data to beat the competition
It's always special in the business world when two massive solutions collide. Huge brands are getting excited because they know video marketing and big data go so well together. It's no surprise videos are becoming a lot more mainstream since big data has begun to...
Get chatty: Banks and their customers have a common friend
Chatbots are taking over the world. Banks have started investing in this intelligent chatty friend, to make their customer conversations easier and more efficient. Human – human to human- machine? .... Better? Safer? Faster? What are chatbots? Chatbots are programs...
Video content analysis & security: Next big thing in big data
Video content analysis, also known as VCA, is a growing market for both big data analysis and for business intelligence. Intense interest exists in prescriptive analytics driven by real-time streams of rich video content, and it is being a potential solution to many...
Gaming industry turns to big data to understand gamers’ interests and habits
While gaming might have once traditionally been viewed as a pastime for introverted teenagers who enjoy nothing more than sitting in their bedrooms with the curtains closed, it is fair to say that current trends blow that idea completely out of the water. The term...
7 ways to improve customer experience in Banking [Infographic]
Throughout the years, financial institutions like banks have been extremely vital in making our society more prosperous, viable and stable. Across the globe, there are over tens of thousands of banks that serves billions of customers of all ages, cultures, and...
How to use customer data to improve live chat experience
Live chat is one of the best means of communicating with your customer. After all, if there is a user surfing on your website, odds are that he is at least thinking of buying your product or service. Live chat is a way of nudging him from his current state of...
Benefits and opportunities of digital personalization for marketers
Nowadays, more and more digital marketers are adopting a personalized approach for reaching their customers. They look to addresses individual concerns and start an email campaign with a personal tone. Before you do the same, it's best to know the benefits and...
Chatbots and AI will change banks’ customer interactions within 3 years
Chatbots and Artificial Intelligence (AI) will revolutionize the way banks understand the intentions and emotions of customers and interact with them in the next three years, says “Accenture Banking Technology Vision 2017” report, released by leading consultancy...
Interview with Jim Callan, entrepreneur and innovator in banking technology
We had a chance to interview Jim Callan, one of the masterminds behind The Conversation Hub™, the world's first intelligent conversation platform. Recognized as an entrepreneur and innovator in retail banking and banking technology, Jim is the founder and CEO of...
Visual content and social media: A perfect match for marketeers
In just a few short years, the Internet has come along to change virtually everything we know about the way human beings communicate with one another. Take the social media phenomenon, for example. As of today, 52% of adults in the United States have a social media...
Reasons why hadoop as a service is recommended for your business
The importance that data is playing in business is hard to downplay. Data is growing exponentially in size and as it does its ability to not only affect our business decisions but also has the potential to become the bedrock of some of the highest earning industries...
9 ways today’s entrepreneurs use big data to improve their businesses
Big data is big. The world’s largest companies have already embraced its potential and are finding new and exciting ways to harness and analyze this valuable marketing information. Companies are even springing up which have the sole purpose of mining big data and...
Systems of Intelligence: Handling big data scenarios in IoT enabled world
A daunting 2.5 billion GB of data (2.5 exabytes, to be precise) was generated per day in 2012. After a 5-year jump, today the figures will be unimaginable. Not only has the number of smartphones rocketed, new technology like the Internet of Things has begun...
Understanding personal data points: Here is how you can save a lot of money
It can be hard to know just how to groom your personal finances so as to get the best possible personal loan terms. The difference between one loan and another can be enormous. Even though two different banks might grant your loan request for $X, the differences in...
Diving into an ocean of mobile data: Can you do it?
Mobile devices have quickly reached the top of the list as the most popular platform to browse the web on. Mobile phones are cheaper than purchasing a desktop (especially in developing countries who weren’t a part of the desktop dominated phase) and mobile devices are...
Data security issues: Main challenges and threats in coming years
2016 brought the term "big data" crashing into public awareness, thanks in large part to the plethora of hacks and attempted hacks that took place during a year where cybercrime made mainstream headlines. Clearly, data hacks are a real concern for businesses of all...
Excel tips and tricks for efficient data analysis
It’s an obvious, well-known fact that data and business go hand in hand. You can’t manage one without affecting the other. And whether you’re analyzing a client’s data or using your company’s data to make executive decisions, your tools have to be able to handle the...
Using big data to understand customers’ behavior and increase the business profits
Marketers and big data have something in common: both of them share a profound desire to discover as much as possible about their target audience. However, unlike some marketers, big data can virtually answer any question one could have about the ways to increase...
How retailers are using location data to help bring in business
We are using data in so many different ways today across all different industries. Data helps businesses to operate more efficiently and smoothly, it makes information sharing possible, and provides clients and customers will new levels of service. Well now data,...
5 ways artificial intelligence is driving the automobile industry
Artificial intelligence is taking the automobile industry by storm while all the major automobile players are utilizing their resources and technology to come up with the best. The beauty of devices with artificial intelligence is that it tries to learn from sensory...
How to use data to improve customer satisfaction in call center business?
‘Big Data’ and associated technologies have been penetrating the business world at a rapid pace. The explosion of huge data volumes growing at an exponential speed has the potential to bring business value for a wide range of industries. Considering, the speed at...
Top 3 server storage companies to keep your data safe at a bargain price
Digital information has been replacing its physical counterpart at a rapid rate. Maybe it's the allure of an endless network of internet users or perhaps the virtual and weightlessness inventory that draw in the number of online content creators to it. Whatever the...
Tomorrow’s data sharing world: Infographics and beyond
At its core, data visualization is a simple concept - it involves taking data and presenting it in a graphical format, either in the form of something like a picture or a graph or an Infographic or a combination of all these techniques and more. It's an idea that has...
Five tips to make managing a supply chain easier
There are a few things that matter quite as much in the business world as efficiency. Whether it be in relation to employee productivity, vendor relationships or otherwise, an efficient business is a successful business. This couldn’t be truer when it comes to supply...
How to recover data from corrupt Elasticsearch Indices in 3 simple steps
Elasticsearch is a popular big data search engine based on Apache Lucene and it does not really need a big introduction because of its popularity. This blog will try to answer your questions regarding data recovery in case you have a corrupt index. While it is not...
Debunking five digital marketing myths around Big Data
Have you ever noticed that some companies make the wrong decisions when it comes to digital marketing strategies? Even in this age of digitalization? Surprisingly, it isn’t because of their lack of resources, opportunities or manpower. But, they fail. The result?...
This is how a typical day of a data scientist looks like
Data drives companies’ success. It is very important to manage data because it runs systems, businesses, academies and dialogue. We can predict natural disasters, improve social media reach, dethrone anarchists and sell more stuff using data. But how exactly do we use...
March 14 – 3.14159 ways to celebrate Pi Day
Pi (π) might be an irrational number, but you don’t have to be crazy to celebrate it. You finally have permission to commemorate your favorite number, as March 14th is international Pi Day. On 3/14, which sort of looks like 3.14 or the first three digits of pi,...
Big data analysis is the future of forex trading – Here is how!
Big data is the future of many forms of technology, including the world of forex. Big data could change the way we trade, the way we make decisions and the way that we reinvest our earnings. In short, it could change our entire way of trading. In this post, we look at...
Why use Hadoop? Top pros and cons of Hadoop
Big Data is one of the major areas of focus in today’s digital world. There are tons of data generated and collected from the various processes carried out by the company. This data could contain patterns and methods as to how the company can improve its processes....
How is predictive data shaping the auto industry
Predictive data is quickly changing the way that we work in a variety of industries, and the automotive world is no exception. From connected car production to inventory management, the collection and study of large amounts of data are quickly shaping how our cars are...
Big data drives Tesla – The future of Tesla and driverless cars
Thirteen years ago Elon Musk and a group of engineers formed a car company in Silicon Valley with one simple goal, “to prove that electric cars could be better than gasoline-powered cars.” Since then, Tesla has become a leader in the automotive industry. While they...
Writing about data: 3 ways to make it more interesting and engaging
Writing about data is not the easiest task that ever befell a wordsmith. Data is necessarily intangible. It’s a cluster of information that can communicate a concept if perfectly arranged. On its own, data doesn’t have a voice. It’s just points of information. As a...
4 major design principles for creating better dashboards
The following is an excerpt from our recent webinar – Telling a Story Through Data: Dashboard Design Guidelines. You can watch the full video here. Building an effective dashboard is the culmination of a comprehensive BI process that would usually include gathering...
Working for a mission, not a boss: Interview with Suresh Shankar
I had a brilliant opportunity to interview Suresh V. Shankar, founder of Crayon, at Slush Singapore 2016. At the conference, he spoke about his experience—and the difficulties he faced—as an entrepreneur. He also talked about how he overcame them. Suresh sold his...
Digital transformation in Retail Banking and the role of data
Banks are having to change Especially in the Retail sector, Banks are having to consider what they do. I think some of the reasons for these changes include: The need to understand who the customer is and what they’re expectations and needs are. Consider the different...
10 biggest cyber crimes and data breaches till date (Infographic)
Cyber criminals are becoming more sophisticated at picking our virtual pockets. And most of us remain woefully unprepared. According to a 2016 survey conducted by PricewaterhouseCoopers, organizations rank cybercrime as the second most reported type of economic crime,...
How B2B ecosystems (Big) Data can transform Sales and Marketing practices
Managing your relationships with customers, suppliers, and partners and constantly improving their experience is a proven way to build a sustainable and profitable business, and contrary to popular assumption, this doesn’t apply to B2C businesses only. With 89% of B2B...
No silver bullet in innovation
Managers have this bad habit of looking for a silver bullet. That magical holy grail that will make all of their problems go away quickly, and preferably painlessly. Those expensive consultants. That fancy new CRM system. This flashy acquisition. That confusing and...
5 very common SQL query design mistakes to avoid at all costs
To run SQL Server databases successfully, you must be keen on query design. Unfortunately, most people do not give the design process a second thought. As a result, they make simple mistakes that, though easy to avoid, have far-reaching consequences. For starters,...
The power of one sigma
Six Sigma is a quality improvement program that gets its name from the concept of 99.9997% quality. In statistics, each sigma represents the statistical measure of 1 standard deviation from the mean in a range of outcomes in a normal distribution. Six Sigma translates...
See this simple introduction to Natural Language Processing (NLP)
Today, with Digitization of everything, 80 percent of the data being created is unstructured. Audio, Video, our social footprints, the data generated from conversations between customer service reps, tons of legal document’s texts processed in financial sectors are...
5 data analytics trends that will change businesses in 2017
The amount of data being collected and stored globally is inconceivable and it grows as we speak. The end result is “big data.” As the term implies, big data is used to denote large sets of structured or unstructured data. However, the large volume isn’t what makes...
4 ways big data can help airline operations run smoothly
When you’re waiting for your plane to board, the last thing you want to hear is that your flight has been delayed or canceled, leaving you stranded at the gate. Even if your flight takes off on time, you wait anxiously at the baggage carousel, crossing your fingers...
Designing the data management infrastructure of tomorrow
Today, more than ever before, organizations realize the strategic importance of data and consider it to be a corporate asset that must be managed and protected just like any other asset. Considering the strategic importance of data, an increasing number of farsighted...
An infographic on hotel guest satisfaction – Industry Insights
Hotels owners and managers have to constantly move with the times in order to keep ahead of the game and keep customers coming through the doors. While the advent of technology has brought on the industry immensely, it has also brought with it certain challenges for...
Top 5 ways big data analytics can help your eCommerce business
As the world of online retail continues to grow at an incredible rate, the information that is possible to collect and analyze also grows along with it. We are able to access an amazing amount of detailed information, to help our online businesses make more informed...
Panel discussion: Autonomous systems and assisted navigation through haptic feedback
By invitation from NASSCOM, I recently moderated a panel discussion in Cochin. The topic was Artificial Intelligence. My co-panelists were Dr. Roshy John of TCS and Krispian Lawrence of Ducere. The focus was on autonomous systems and assisted navigation through haptic...
Fintech – Beyond innovation theatre
Beyond Innovation Theatre Innovation is all about value creation. Or at least it should be. It’s easy to get caught up in the front end of the process. Brainstorming new ideas, drawing on whiteboards, and moving different colored sticky notes around the wall is fun....
Banking needs a customer experience wakeup call
Positive customer experience is channel sensitive, with customers placing a higher weight on digital customer experiences more than physical or call center channels. In fact, in a recent J.D. Power, survey, the largest banking organizations improved in overall...
5 types of people you will meet in data analytics
*1 This is more inline with dealing with setting up large-scale data engineering platforms and integrating various technologies together. *2 These data scientists typically build the algorithm and productionize it through the data engineering infrastructure. E.g. They...
How to build a data science team [Infographic]
Businesses today need to do more than merely acknowledge big data. They need to embrace data and analytics and make them an integral part of their company. Of course, this will require building a quality team of data scientists to handle the data and analytics for the...
Do you know what is powerful real-time analytics?
In the Digital age today, world has become smaller and faster. Global audio & video calls which were available only in corporate offices, are now available to common man on the smartphone. Consumers have more information of the products and comparison than the...
Artificial intelligence in law: Embracing technology [Infographic]
Traditionally, the legal profession has been slow on embracing technology but now, at least partly it is embracing the opportunities associated with algorithm-driven computer technology. This infographic will explain how. This infographic originally appeared here....
Data Analytics – Predicting the future for success in fashion industry
The fashion industry sets styles and trends in apparels and accessories. It is a huge industry that is dynamic and is intrinsically subject to quick changes. For those who work in fashion retail, optimizing the inventory for each season is a huge challenge. In...
What are Microservices in Digital Transformation?
Today’s organizations are feeling the fear of becoming dinosaur every day. New disrupters are coming into your industry and turning everything upside down. Customers are more demanding than ever and will abandon the service that is too slow to respond. Everything is...
This is how analytics is changing the game of sports
Analytics and Big Data have disrupted many industries, and now they are on the edge of scoring major points in sports. Over the past few years, the world of sports has experienced an explosion in the use of analytics Till a few years back experience, gut feelings, and...
Top 5 best TED talks on data analytics for business leaders
What are you doing right now? If you are trying to know how data analytics can help you grow your business, you are not alone. Research suggest that as much as 55% of companies are rapidly searching for and engaging in some form of data analytics to get a hold of what...
Journey science in telecom: take customer experience to the next level
Journey Science, being derived from connected data from different customer activities, has become pivotal for the telecommunications industry, providing the means to drastically improve the customer experience and retention. It has the ability to link together...
What I always wanted to know about big data*(*but was afraid to ask)
When I first heard the term Big Data few years ago, I didn’t think much of it. Soon after, Big Data started appearing in many of my conversations with many of my tech friends. So I started asking a very simple question 'What is Big Data?'. I kept asking that question...
Interview with Penske Media's Data Scientist – Andrew Maguire
Andrew has been working in Analytics/Data Science for 7 years in various roles across many different industries. He is a Data Scientist at Penske Media Corporation focusing on both data engineering infrastructure as well as applied business analytics. Prior to this...
Big data usage, opportunities and challenges in the pensions industry
Big data is more than just another business buzzword. In the past few years, the term and idea have grown in popularity to be used by governments, private businesses and even individuals in the pensions industry. Big data is essentially the large volume of information...
7 ways workforce analytics increases productivity & sales- Infographic
This infographic will showcase 7 ways workforce analytics will increase productivity and sales. Enjoy!!
Rethinking the business analyst’s role in an agile team
With the advent of Agile methodologies, project roles and responsibilities have transformed significantly. Agile focuses on GTDQ, getting things done quickly. Anything that comes in the way of this goal, needs to be eliminated. As a result, many traditional IT careers...
What do data scientists do on a daily basis? [Infographic]
In simple terms, a data scientist’s job is to analyze data for actionable insights. Data scientists spend most of the time on data cleaning, making the data ready for the models and the cool algorithms finding the hidden patterns. Much time is also spent in writing...
Confronting the new frontier of Digital Payments
While digital payments are quickly transforming the way consumers pay, it’s clear that both paper and plastic payment methods are far from dead. There’s no question that digital payments have built a strong foundation — standardized technology is optimizing...
Why big data is crucial for your IRL marketing
Gathering and analyzing data is important for everything you do. It’s game changing. It is especially important when you're trying to branch out. Plotting out your marketing, determining who is listening, and how you can reach them is vital for any sort of effective...
Life @Crayon – Mridula
How long have you been at Crayon? A little over two years. What do you do at Crayon? All things marketing with a sprinkle of PR. What’s your average day like? A day where the unplanned usually topples the planned. What’s your favorite Crayon memory? They are...
Have we lost faith in big data? It's time to go back to basics?
As Donald Trump prepares to enter the White House, has our reliance on big data been exposed? On the eve of the US election, the Huffington Post presidential forecast gave Hillary Clinton a 98.2 percent chance of winning the race to the White House. The Huffington...
8 big data trends and predictions for 2017
The term Big Data is more than 20 years old, having been coined in 2005 by O’Reilly Media’s Roger Magoulas. What we mean by the term scales larger by the minute, seemingly, since more than 80% of all available data has been generated in the last three years as Big...
Big bata, banks and mobile payments: What is next?
Just about every industry has something to say about big data. It’s changing the way bookies make predictions; helping sports coaches make better decisions, and furnishing healthcare companies with the tools to improve patient care. The phenomenon has already produced...
Want to know how to choose a Machine Learning algorithm?
Machine Learning is the foundation for today’s insights on customer, products, costs and revenues which learns from the data provided to its algorithms. Some of the most common examples of machine learning are Netflix’s algorithms to give movie suggestions based on...
India’s relationship with money has changed dramatically: Chanda Kochhar
What makes you think banks can't be nimble? - Chanda Kochhar Can large banks like ICICI compete with innovative startups and win? Startups can be quick and nimble, whereas a bank with $100 billion in assets must test a technology extensively before rolling it out. And...
Say goodbye to boring, automated tele-conversations
Panic! One can’t truly appreciate the sense of this word until you realize you have misplaced your wallet that has your credit cards! So, you frantically call home or office just to check whether you have left your wallet over there. And you finally realize that you...
How online market places use big data to score travelers cheap airfares
If you’ve recently heard someone complain about how expensive air travel has gotten, it’s time to look past popular perception and look at the facts: Business Insider looked at federal transportation statistics for 5 major airports over the last 20 years, and found...
Fail fast approach to digital transformation
Digital Transformation is changing the way customers think & demand new products or services. Today Bank accounts are opened online, Insurance claims are filed online, patient’s health is monitored online while buying things online is the thing of past. Everything...
Say goodbye to boring, automated tele-conversations
Panic! One can’t truly appreciate the sense of this word, until you realize you have misplaced your wallet that has your credit cards! So, you frantically call home or office just to check whether you have left your wallet over there. And you finally realize that you...
Top 6 tools to master and get started with Big Data
The market is flooded with a number of Big Data tools. All of them claim to provide real business value by bringing cost efficiency, better time management, and analyzing data to discover valuable business insights. But there are only a select few that actually do...
How to discover hidden value in your customer journey
The world of business and customer service has changed immensely over the past few years. Whereas once business was largely driven by outbound marketing and advertising, in today’s world you have to consider the customer experience and your customers’ journey as they...
How big data has transformed the travel agent’s role
You see them in nearly every city you visit. Forlorn little buildings with faded signs in the windows advertising their services: travel agencies. Ask anyone on the street, and it seems like it’s a given that these agencies are dying in the Information Age when a...
BI software trends in 2017 – The role of big data analytics
Remembering Gartner’s predictions for a $16.5 billion-heavy BI industry for the current year, there is absolutely no reason to doubt another round of paramount growth in the data-driven business in 2017. From what analysts are forecasting now, big data goals are...
Will it remain an obsession the title of your connected business card?
Many years ago I thought the business cards were condemned to disappear, then I decided to start making my own private collection, not for the future economic value that could reach, but for the sentimental value that would provide me over the years. Of all the...
10 amazing facts about personalization and data [Infographic]
Personalization is the practice of dynamically tailoring a service or a product to the wants and needs of each user/customer. It is commonly used to enhance customer service and is sometimes referred to as one-to-one marketing. It is a key element in all recommender...
50 facts about mobile wallets re-shaping Fintech [Infographic]
Mobile Wallets are the hottest startups in emerging markets and here's why... More of the world is coming online than ever before. Emerging markets are flocking to the Internet and their tool of choice is their Mobile. This wave is helping Mobile Wallet Fintech gain...
Data Security: 20 simple tips to follow at work [Infographic]
Data security is the responsibility of all. Here are a few dos and don’ts to help you ensure that your sensitive business data stays secure and protected.
A visual demonstration of how much data is used every minute!
Online users are generating data at an outstanding pace. The stats of 2016 DOMO Data Never Sleeps 4.0 reveal some staggering numbers. Every minute of every day, over 18 billion megabytes of wireless data is used...by Americans alone! From Twitter to Tinder (and every...
5 key benefits of big data in telecom [Infographic]
Communication Service Providers (CSPs) handle and store a lot of data! They have to deal with hundreds of thousands of users’ call detail records, internet traffic and transaction data, usage patterns, technical fault data, and location data, to mention some. To gain...
Why blockchain? What can it do for big data?
Arguably the most significant development in information technology over the past few years, blockchain has the potential to change the way that the world approaches big data, with enhanced security and data quality just two of the benefits afforded to businesses...
Five steps to improve data security and prevent risks [Infographic]
Data security is an important aspect of any business, especially for those that provide services to clients. For law firms that handle highly sensitive and privileged information about their clients on a daily basis, the need for data security is critical. This...
How much of a benefit is big data to sports fans?
American sports fans, in particular, love big data, and analyzing every quantifiable aspect of a team’s performance is as much a part of the game as turning up to the field on game night. Taking Sunday’s NBA game between the Golden State Warriors and the Minnesota...
Top 10 tools for working with big data for successful analytics developers
The importance of data in today’s business is difficult to overstate because no meaningful decision can be made without the analysis of relevant data. The data analysis not only drives the decision making but also takes an active part in developing strategies and...
Digital channels must support retail banking strategy
The digital disconnect Even though digital channels should be an extension of the retail strategy, many organizations adopted mobile quickly and created a situation where they were providing two very different experiences. Think about it this way – What would you do...
DNA vs modern backup methods: The future of data storage
It’s difficult to wrap one’s mind around this, but it’s now possible to store vast amounts of data on a DNA strand. Isn’t it ironic that so much of the world’s data is stored via computerized data centers that are the result of many years of information technology and...
Top big data misconceptions debunked
The idea and concept of “Big Data” has been around for a while now, however it seems there are many people who still believe it is shrouded in mystery. Therefore, in the following post we are going to debunk some of the top big data misconceptions. Every business has...
Bridging RDBMS and NoSQL: Introduction to 2DX UI cluster
2DX is a Web UI framework that consists of in-memory Browser NoSQL and RDBMS hosting Stored Procedure-built JavaScript interpreter. Both NoSQL and RDBMS database components of 2DX follow same Entity-Attribute-Value database schema designed to accommodate serialized...
Big data’s evolving role against security threats
The fight against cyber attacks is never-ending. According to the latest figures from Check Point, October 2016 saw the number of malware attacks increase by 5% because of high-profile incidents such as HummingBad. The malicious software, which originated in China,...
Product recommendations in Digital Age!
By 1994 the web has come to our doors bringing the power of the online world at our doorsteps. Suddenly there was a way to buy things directly and efficiently online. Then came eBay and Amazon in 1995....... Amazon started as bookstore and eBay as the marketplace for...
Integrated loyalty: How Uber and Capital One embedded loyalty into the Customer Experience
This is the last of my special Invested in Tech series with Capital One, where I have been taking a look behind the scenes at how they are using technology, innovation, and design to create a better banking experience. In my last post, I spoke to Naveed Anwar who runs...
Cognitive computing – Transforming business analytics with Watson
Managing business data is a big trend right now. Through a couple of clicks and a couple drags, anybody can explore it. Businesses have been collecting and analyzing data since the 1950s. Data is the prime factor for businesses in order to gather information and...
8 data security tips for small business – Infographic
Data Security has become one of the hottest issues that are surrounding the news nowadays. But what is more surprising is that small businesses, in particular, are fast becoming the favored targets of digital attackers. In fact, the latest Government Security Breaches...
Refining your ecommerce business with big data
For the last few years, it seems like the concept of Big Data is inescapable. Wherever you look – whether it’s Forbes, Tech Republic or even Fortune – everyone has to say something about Big Data. But when you take a closer look and realize the potential of Big Data,...
Green data center – What makes it the next big thing in technology?
Consumers and businesses rely on a ton of data. Most of this can be attributed to the technology we use in our daily lives. After all, just about everyone carries a smartphone on their person. Then there are our work and home computers, tablets, smart TVs, streaming...
Overwhelmed by Data: How travelers use it to save money
Businesses have a new obsession: collecting as much data as possible and turning it into cash. Whether that means making their processes more efficient, providing new insights on what consumers want, or directly selling the data they collect, small and large companies...
How travel marketers can benefit from Big Data analytics [INFOGRAPHIC]
One of the buzz words in recent times among corporates is none other than ‘Big Data’. Yet multiple definitions for Big Data prevail. Tnooz CEO Gene Quinn says with a smile, “If you ask ten people about the definition of Big Data, you will get eleven answers”....
Time to Dive In: Leveraging public data with a data lake
This post has been co-authored by Adrian Botta and Meera Lakhavani. Real time, granular consumer insights are invaluable. Companies may know their customers’ basic demographics, but what if they leveraged customer travel patterns, activities, and situational...
Banking on blockchain: The future is already here?
On the first week of November, I attended an IBM blockchain discussion at Rise New York, featuring Jalak Jobanputra, Founder and Managing Partner of Future\Perfect Ventures and Brigid McDermott, Vice President of Blockchain Business Development & Ecosystem for...
The deep learning robot that recognizes your face
Robots are becoming more human-like faster than ever, thanks to the advances in Artificial Intelligence, especially deep learning. Take, for example, this recent blog release from Google where a team of researchers has been developing a mechanism for training a robot...
All about big data analytics tools: How to measure your goals
What’s important to your business may not be exactly the same as what’s important to another business—even another one that’s a competitor. Every business leader tracks different items and elements in order to get feedback and guidance for future decisions. But what...
Building better Bank-Fintech partnerships
Talk of banks and fintech companies partnering together has increased dramatically in the past year. There have definitely been some interesting partnerships announced, particularly with some of the marketplace lenders, various blockchain projects and some artificial...
5 ways Artificial Intelligence is helping a modern traveler today
The way we travel is changing as quickly as how we live. We have different expectations for planning a trip than we did a few decades ago, and today, convenience, comfort, and price matter more than anything else. Leisure travelers want unique experiences, while...
Using data science for predictive maintenance
Remember a few years ago there were two recall announcements from the National Highway Traffic Safety Administration for GM & Tesla – both related to problems that could cause fires. These caused tons of money to resolve. Aerospace, Rail industry, Equipment...
The role of big data personalization in the banking industry
According to a popular belief, banks and big banking corporations rule the world – they deliver all the funds where they are needed, handle large transactions, choose who to support, and, ultimately, decide what the world is going to look like in the future. However,...
What is edge computing?
The name edge computing signifies the corner or edge in a network diagram at which traffic enters or exits the network. Edge computing pushes computing power to the edges of a network, so instead of devices like drones or smart traffic lights needing to call home for...
Mobile enablement in digital age
Gone are the days when we used to carry big fat wallet filled with cash, coins, multiple credit cards, business cards, travel tickets, movie tickets, personal notes, papers with names, numbers and the list can go on. Mobile technologies have transformed the way we...
Life @ Crayon – Kandarp
How long have you been at Crayon? 3 Years and 6 Months What do you do at Crayon? Project Lead (Delivery) and Business Analyst What’s your average day like? I arrive at work with a plan of what I need to do for the day. This plan involves spending 50% of my time in...
Database corner: Beginner’s guide to Mysql storage engines
When a database is created, one often overlooked but critical factor in performance is the storage engine (particularly as the database grows). In many instances, the temptation is to just accept the default and continue on developing your project. This can lead to...
Applications of Predictive Analytics in various industries
They say that those who do not study history are doomed to repeat it. In no form of big data analysis is this phrase more relevant than in 'predictive analytics'. In simple terms, predictive analytics is the systematic use of data, machine learning techniques and a...
The IOT Continuum – How do you see it?
Over the past months, I have read a great deal about the Internet of Things (IoT) and how companies are moving forward with it. Looking across all the stories on the web it is clear that there is an IoT Continuum when you look at the different types of projects out...
Watch these movies for Big Data Analytics & Machine Learning
Business analytics & Big Data has not only got the business and technology industry excited, but have influenced many movie-makers across the last few decades. It would be a big miss for data scientists and business analysts alike if they don’t know these good...
Watch these movies for Big Data Analytics & Machine Learning
Business analytics & Big Data has not only got the business and technology industry excited, but have influenced many movie-makers across the last few decades. It would be a big miss for data scientists and business analysts alike if they don’t know these good...
Designing a better banking experience
Last week at Money20/20 in Las Vegas I spent some time behind the scenes at Capital One to see how they are using technology, innovation, and design to create a better banking experience. I sat down with Scott Zimmer, Capital One’s Global Head of Design, to focus on...
How powerful big data insights will transform your conversions
In today's world, the field of marketing has become irrevocably intertwined with technology and all of its advances. The multitude of new tools and methodologies constantly coming onto the market mean that marketers always have new ways in which to reach customers,...
Crayo-thon: Crayon's first Hackathon
We ran our first hackathon at Crayon. Teams from our Chennai and Singapore offices participated. And boy, did we receive some impressive prototypes. One of the great things about the Crayo-thon was that it brought people from very different teams together. All working...
VPN use and data privacy stats for 2016
We presented a host of survey findings regarding vital internet trends in a previous article. We hope you found it useful! Yet at our core, we want our readers up-to-date on the latest information regarding vpn use and data security. So, this article assimilates many...
Six challenges of big data project management
Project management always comes with a set of various challenges. In the past couple of years, as businesses have significantly grown, project management has become even more complicated. On the other side of things, a variety of software solutions were created for...
Life @ Crayon – Bhavani
How long have you been at Crayon? Eight months. 2. What do you do at Crayon? I am the CFO (Chief Financial Officer) of Crayon. 3. What’s your average day like? I mostly push people to do their work. I think I should rename my job description to Chief Pushing Officer....
Top 12 interesting careers to explore in big data [Infographic]
Did you just lose out on the promotion you were expecting and are now thinking about how you can take your career ahead? You could wait for the next promotion, but that would take some time. If changing a job is your next step, then this is the right time to explore...
Discover how big data is implemented in business today!
Big data is a collection of very large sets of data that stream into a business every day. These sets can be structured or unstructured. Big data can be analyzed to reveal trends, relations or patterns in the behavior of a company's customers. The analysis is...
How to fetch HBase table data in Apache Phoenix?
This exclusive post is shared by big data services providers to help developers in development. They tell the best way to fetch HBase table data in Apache Phoenix. Read this article and discover what they have to say about Big Data related services. The term 'Big...
Why you need to stop talking about offline and online customer experiences
Regardless of industry, customer experience is key to business growth and success. It’s simple: unhappy customers leave and happy ones not only stay, they tell their friends about your company. The Gartner 2015-16 CMO Spend Survey found that 52% of marketers rank...
What does it take to build customer loyalty in today’s retail world?
Gaining (and maintaining) customer loyalty can significantly boost revenue for retailers. However, as the needs and demands of today’s consumers change, customer loyalty is not as easy to come by. Research by Access Development reported that 79% of customers would...
What Pokémon has got to do with big data?
Last weekend I went to the park to take my baby daughter for a walk, but I knew that it would be a walk with an extra level of intrigue above the usual cooing, dribbling, and occasionally uncontrollable bawling. No, on the previous day I downloaded PokémonGo onto my...
Top 9 things you need to know about Business Intelligence software [Infographic]
There are plenty of business growth areas, and one of the most vibrant has to be business intelligence, also known as BI. In just 2016 alone, BI is expected to grow by over 5 percent. If you’re paying attention to the growth of technology shouldn’t be surprised by the...
New adventures in data sharing, healthcare, IT and business
Since healthcare information technology is currently in the spotlight due to recent technological advances in data sharing and information database analytics, as well as Healthcare IT Week, beginning September 26th, now is a great time to talk about the intersections...
Will big data open a Pandora’s Box of injustice?
Databases. They are not just confined to big business. Remember that rogue traffic warden, who gave you a parking ticket thirty seconds before your time was up? Remember that customer service agent, who was rude and unhelpful to you over the phone? Remember that...
How life will be, if the Internet of Things becomes a reality
7 AM My morning alarm buzzed at 7 AM. But I remember setting my alarm for the usual 7.30. My smart phone then notified me of a minor accident on the route to my office, leading to traffic congestion Smart traffic cameras installed on the road had sensed it. This...
How life will be, if the Internet of Things becomes a reality
7 AM My morning alarm buzzed at 7 AM. But I remember setting my alarm for the usual 7.30. My smart phone then notified me of a minor accident on the route to my office, leading to traffic congestion Smart traffic cameras installed on the road had sensed it. This...
Cohort analysis: Retention Rate Visualization with R
When conducting Cohort Analysis, one of the most important measures is Customer Retention Rate. I will share a few ideas for visualizing this parameter in this post. Last year I shared several charts for Customer Retention Rate visualization in this post. However, it...
Treat your data like an asset – Not an inconvenience
How do you look after your valuables? Do you use a safe deposit box or a postcode marker pen? You probably have the software installed on your smartphone to track it if it gets stolen, and no office is truly secure without CCTV. Taking care of business assets is key...
How do Amadeus and Red Hat innovate the open source way
No matter how you look at it, open source has become the de facto standard for enterprise software development, distribution and adoption. Amadeus’s excellent post highlights eight reasons why Amadeus has adopted open source software. And, Udo Seidel explains why open...
Data Science disruption: Virtual reality – challenges and limitations
For anyone familiar with the field of data science, it is easy to see how virtual reality can be a natural partner for big data challenges. Oftentimes, the most difficult aspect concerning big data is not the visualization process itself per se, but rather how well...
IITs revoke ban on big data company Crayon Data
NEW DELHI: All IITs (Indian Institutes of Technology) Placement Committee (AIPC) has revoked the ban on big data company Crayon Data with offices in Singapore and India. Crayon Data was among the 31 companies that recently barred by the AIPC as they failed to honour...
What is the role of Fog Computing in the IOT reference model
As if the Internet of Things (IoT) was not complicated enough, the Marketing team at Cisco introduced its Fog Computing vision in January 2014, also known as Edge Computing for other more purist vendors. Given Cisco´s frantic activity in their Internet of Everything...
Data Integration is key to shedding light on the customer journey
By now you are probably aware that the customer journey is fractured among any number of channels and devices. Multi-device and multi-channel journeys take twists and turn as consumers move from one channel to the next and back again, and may start off on one device...
The future of “The Internet of Olympic Games”
Forgive me for using this headline to attract more readers during the summer holidays. Certainly, I will include a comment in my famous post The abuse of shocking headlines in IoT or how many stupid things will be connected ?. I encourage you to continue reading. The...
Digital Transformation – Top 5 challenges to overcome
The Digital Tsunami is moving at a rapid pace, encompassing all aspects of business and society. It touches every function of business from purchasing, finance, human resources, operations, IT and technology, sales and marketing and every other division in the...
What exactly is cognitive computing?
Although computers are better for data processing and making calculations, they were not able to accomplish some of the most basic human tasks, like recognizing Apple or Orange from a basket of fruits, till now. Computers can capture, move, and store the data, but...
Is data quality essential for modern business?
If you wanted to program a computer in the early 1980s, you didn’t have the option of coding using a keyboard. You had to create a series of cards, each punched with a pattern of holes. The holes had to be entirely accurate, in both pattern and placement. A typical...
Life @ Crayon – Varun
1. How long have you been at Crayon? 3 years 2. What do you do at Crayon? I build big data applications using Java and Python. 3. What’s your average day like? The day mostly involves email, coding, chatting and working with incredibly smart co-workers, lunch...
Banks risk losing $600 billion of millennial spending
The banking industry needs to reimagine what current day banking means to millennials or risk losing out on a potential $600 billion of indirect spending that millennials can influence. By the year 2020, Asia will be home to 60 percent of the world’s millennials, who...
Hotels can use data and a bit of TLC to make a difference
Many hotels are challenged to meet short-term targets whilst having to formulate strategic priorities in a highly competitive business environment. How is it best to deal with this dilemma? NB: This is an analysis by Anna de Visser-Amundson (senior lecturer and...
Banks risk losing $600 billion of millennial spending
The banking industry needs to reimagine what current day banking means to millennials, or risk losing out on a potential $600 billion of indirect spending that millennials can influence. By the year 2020, Asia will be home to 60 percent of the world’s millennials, who...
What does Pokemon Go mean for the travel industry?
If you haven’t played, or at least heard about, Pokemon Go, you may soon be in the minority. Not only has it single-handedly brought gaming giant Nintendo back to life but sparked conversations about the future of augmented reality (AR). It may not be obvious, but the...
5 more examples of predictive analytics in travel industry
Previously, I listed 5 ways the travel industry uses predictive analytics. These ranged from recommender systems to fraud detection and conversion optimization. The travel industry also uses predictive analytics in a number of other capacities as listed below: Dynamic...
Top 5 examples of predictive analytics in the travel industry
Forget about Minority Report and its sexy gesture interface – predicting the future is very different from what you see in the movies. In reality, it’s all about finding patterns in a vast amount of data. Applying the right statistical models allows you to gain...
Does big data have a dark side?
Big Data is seen as a savior for small companies, massive corporations, and governments. However, drawing from massive datasets to obtain a better understanding of human behavior does have a potential dark side. Technology is only as good as the people using it....
The misery of choice, and the pressing need for travel curation
Japan’s iconic Sakura season. We were all really excited about our trip to the land of spiritual awakening. Who wouldn’t be? It all sounded like a dream come true, until we realized the burden of planning a trip, from beginning-to-end! As 3 women travelers taking our...
The misery of choice and the pressing need for travel curation
Japan’s iconic Sakura season. We were all really excited about our trip to the land of spiritual awakening. Who wouldn’t be? It all sounded like a dream come true, until we realised the burden of planning a trip, from beginning-to-end! As 3 women travellers taking our...
When R may be a better option than M in Power BI
Microsoft has really impressed me with Power BI. They are working very hard to improve it by making weekly updates to the Power BI service and monthly updates to the Power BI desktop. One of the recent updates that were made to Power BI desktop is the GA release of...
Banks are from Mars…
It is not news here, or anywhere else, but bankers and fintech entrepreneurs are from different planets. They are just wired differently. Just a few years ago, all of the fintech companies wanted to put traditional financial institutions out of business. Disrupt the...
Personalizing travel search: How data leads to happier travels
An overdue evolution is happening in travel search, especially in the hotel sector. Doesn’t searching for a “hotel in downtown Miami” seem archaic when the travel industry has so much more information to work with? For instance, it’s entirely possible to search for...
Top 10 tools market researchers should explore
Nowadays there is a great variety of different useful tools for market researchers that are free and open for usage. Today you can use such instruments to enhance your business and significantly improve the effectiveness of your work. Leaving you a chance to waste...
An interview with Jaiveer Singh, VP of Technology at DBS Bank, Singapore
Tell us a little bit about yourself, and how you got into the banking industry. During my school days, I was a student of commerce & finance stream, while studying for ICWAI course. I heard about computers in the early 90s and felt this is something that might...
An interview with Jaiveer Singh, VP of Technology at DBS Bank(Singapore)
Tell us a little bit about yourself, and how you got into the banking industry? During my school days, I was a student of commerce & finance stream( I was doing ICWAI course). I heard about computers in the early 90s and felt this is something that might redefine...
Machine learning becomes mainstream: how to increase your competitive advantage
First, there were big data – extremely large data sets that made it possible to use data analytics to reveal patterns and trends, allowing businesses to improve customer relations and production efficiency. Then came fast data analytics – the application of big data...
The future of Artificial Intelligence: 6 ways it will impact everyday life
Technology moves at breakneck speed, and we now have more power in our pockets than we had in our homes in the 1990s. Artificial intelligence (AI) has been a fascinating concept of science fiction for decades, but many researchers think we’re finally getting close to...
Life @ Crayon – Grace Lee
Life at Crayon by Grace 1) How long have you been at Crayon? 3 years and 8 months 2) What do you do at Crayon? I’m the Ops manager, I handle Finance, HR, Admin work, P.A, or any other ad hoc work. 3) What’s your average day like? Busy, dealing with all the urgent work...
How to become a data driven business
Data is everywhere. All businesses have access to it. Yet, turning data into actionable insights and becoming a data-driven business can be difficult to achieve. What does data-driven mean? A data-driven business utilizes data to inform every business decision they...
SAP HANA for real-time analytics [Research paper]
There is no doubt that data analytics is the most favored method for extracting viable and venerable insights out of data volumes. There are a continuous accumulation and storage of poly-structured data due to the unprecedented increase in different and distributed...
Attribution model with R: Markov chains concept – Part 1
As we know, a customer usually goes through a path/sequence of different channels/touchpoints before a purchase in e-commerce or conversion in other areas. In Google Analytics we can find some touchpoints more likely to assist to conversion than others that more...
Rick Smolan on 'The Human Face of Big Data'
Manu: Rick, can you tell us a bit about yourself? I saw in your TED talk that you used to be a photojournalist, so how did you get started on this journey? Rick Smolan: Yes, I was always very curious as a person. So it is interesting that I'd end up in a job...
Top 6 travel APIs to start prototyping your application right now
Most developers would agree that APIs should just do their job and get out of the way. Being able to focus on the application at hand is key, especially when working on a potential innovation. This is what we wanted to achieve with the Travel Innovation Sandbox. It’s...
Top 4 technology trends set to create a better travel experience
Connected baggage, robots, virtual reality, big data, and drones will be part of your travels soon. Just how will they, along with other technology trends, create a better experience for travelers? Robotics combined with artificial intelligence You can already...
The biggest Fintech Infographic (Ever)
Financial technology, or “fintech” for short, is threating to turn traditional financial fields like banking, lending, asset management, and insurance upside down. Fintech firms use various digital channels to deliver personalized services to their customers. Here is...
A poem on Crayon's Data Factory
For years, big data has been one of the hottest buzzwords across all industries. Big data is the term used to describe the process of analyzing complex data sets to discover information that can help make better decisions or find certain patterns that were previously...
Commercializing big data: frequent flyer programs
I recently shared an article on how airlines are using information to individually price airfares and extract maximum value from passengers which was thought provoking and insightful for many airline industry and big data professionals. With all the overwhelming...
How your small business can use big data successfully
The great thing about small businesses is their intimate appeal and unique nature. Without the little guys, the business world and the products and services it delivers would be homogenized and dull. But enterprises are constantly looking at ways to dominate the...
Life @ Crayon – Shobana
1) How long have you been at Crayon? Ten months. 2) What do you do at Crayon? Manage product testing. 3) What’s your average day like? First, I look at my team’s deliverables. Then these are discussed with the team to ensure that we are on the same page. The...
What makes exceptional customer service (and how to get everyone talking about it)
How much time do you think about the current state of customer service at your company? Do you know what you’re doing right—and what you’re doing wrong? Most importantly, do you have a process to improve what might be lacking? If you’re not spending time on your...
Top 10 reasons why you should learn data analytics
They say we are living in the age of information. The internet has made it easy for anyone to gather whatever information they need to achieve whatever end they desire. Did you know that you could even learn how to build your own car online? Did you know that you...
Are you ready for the millennial takeover at your workplace?
Gone are the days when you’d make demands for tasks to be completed on time. The millennials, as we know it, are changing the work force dynamics quite rapidly. They no longer feel the need to stick around in an organization as an obligation. No provision to learn and...
Rise of the AND-I’s – How to make it work in fintech?
Make way for the And-I’s. And-I’s are my name for a new phenomenon I’ve noticed in financial services job titles. “And-I” stands for the words “and innovation” tacked on to the end of existing job titles. Your “Head of Digital Banking” is now “Head of Digital...
Do you need a Chief Data Scientist?
If you are considering recruiting a C-level executive in charge of data science, you are not alone. More and more analytics-driven companies are finding office space for this critical role. Even the Commander-in-Chief is jumping on the chief-of-data-science bandwagon....
The Fintech grief cycle for bankers
As a few fintech companies like Lending Club, Betterment, and others have run into some rough patches lately, it has been interesting to note some of the reactions, especially amongst bankers (that’s just shorthand, I’m looking at you too, credit union leaders). Some...
Constraining Data flexibility in a NoSQL database
Having no constraints in a NoSQL database means complete data flexibility. This sounds appealing at first given the fact that it saves development time by not defining any columns or data types at the time of inception of your collections. But this much flexibility...
How to use DMS to manage your business data
Data management is one of the most important tasks for any modern business. Businesses need to analyze and inspect the data to find out the consumer demands and the best ways to meet these. Managing the huge amount of data requires a specialized solution. And Document...
How hotels use big data to generate new revenues
Hotel revenue management and use of analytics for room sales have remained largely unchanged for decades since the early 1980s when hotels started looking at yield and how they could optimize the revenue each room could generate. By the mid-1990s, Marriott’s...
How to build better data products: Getting started
This is the first in a multi-part series on launching successful data products. At Juice, we’ve helped our clients launch dozens of data products that generate new revenue streams, differentiate their solutions in the market and build stronger customer relationships....
Can business automation solve your data quality problems?
All businesses are at the mercy of data quality challenges. From the moment you capture your first lead, you’ll be fighting a battle against data decay. The bigger the database gets, the more problems the business can encounter, and it isn’t easy to single out a...
How will deep learning change your business?
The media interest surrounding deep learning has grown exponentially in the last few years. But what does it actually mean, and how will it change business and society? Deep learning is a subset of machine learning that refers to mapping artificial neural networks to...
The future of OTA loyalty programs
Online Travel Agents (OTAs) are known as an effective distribution channel for hotel rooms, but with more major hotel brands pushing direct bookings in an effort to reduce commissions paid out to agents– this leaves OTAs searching for the next goldmine product to fuel...
Why multi-touch attribution is critical to calculate marketing ROI
Datalicious analyzed 702 million media touch points across 104 million purchase paths and 75 thousand conversions across 5 months and 7 brands using multi- touch attribution approach. The objective of this study is to understand how key marketing channels performed...
How big data is changing the way you fly
A journey into predictive analytics and how data will drive up airline ticket prices. As airlines and frequent flyer programs gather more intelligence on your day to day lifestyle, flying and financial position - they begin to build a data profile on your interests,...
How much is that big data in the window — big data decisions impact business valuations
As both digital and more traditional companies become more and more dependent on data to compete in today’s information economy, data is starting to have an irrefutable impact on companies’ valuation and reputation. The decisions companies make about how to use data...
Strategic planning: Stacking the odds in your favour
It’s midyear already. Halftime. Two quarters down and two to go for 2016. For many financial institutions, it’s also the start of the 2017 strategic planning season. That time when boards and senior leadership teams sit down to hash out next year’s budget; working...
Big Data unravels the best time to target travellers with marketing [Infographic]
More fuel for the marketer's engine with some major crunching of numbers to understand the differences in the booking behaviour of travellers. In particular, programmatic marketing specialist Rocket Fuel analysed data from more than 240,000 travellers (generating...
How you can improve customer experience with fast data analytics
In today’s constantly connected world, customers expect more than ever before from the companies they do business with. With the emergence of big data, businesses have been able to better meet and exceed customer expectations thanks to analytics and data science....
Will machines help us to be better people?
Cisco defines the Internet of Everything (IoE) as bringing together people, process, data, and things to make networked connections more relevant and valuable than ever before-turning information into actions that create new capabilities, richer experiences, and...
Choice and the new consumer: Article 2 in a series of 5
In my last post, we talked about the growing importance of two concepts that are radically changing consumer marketing practices: The Choice Equation and the Influence Mix. The influence mix { D = f(P+M+O)}, captures the forces behind a consumer purchase decision by...
How music affects your driving – Infographic
Listening to music makes the everyday task of driving from A to B, a little bit less boring. Whether your music tastes lie with ACDC or Mozart, we all love to bop along to our favourite tunes whilst in the car. But just how does the music you listen to affect your...
Retailers struggle to deliver omnichannel experiences due to poor customer data
In the digital era where consumers are just as likely to purchase online as in a brick-and-mortar location, delivering a seamless channel experience has become the new competitive imperative. Retailers are ramping up their investments in omnichannel and multichannel...
10 useful ways to visualize your data (with examples)
Many people spend their day sifting through data, combining multiple data sources, and finally getting data ready for the moment of truth: seeing it in a data visualization. Data visualizations are the culmination of all data crunching work–they’re supposed to take...
Deep learning with Tony Jebara, director of Machine learning research at Netflix
Tony Jebara is a Professor of Computer Science at Columbia University and Director of Machine Learning Research at Netflix. His research intersects computer science and statistics to develop new frameworks for learning from data with applications in social networks,...
Is UBI the next big thing in insurance
UBI, or user based insurance, may become the new basis for personalized premium prices, as the IoT continues to grow and connect increasingly advanced technology. According to SMA Research, 36% of auto insurers will use telematics UBI by 2020. Acenture’s 2015...
Your data gets better by change – not by chance
Up to 96 percent of customer contact data is partially inaccurate, according to the Sales and Marketing Institute and D&B. This is a shocking statistic. If you run a business, this figure alone should have you leaping from your seat in panic. Can your data really be...
A report on the NPS Maturity of India Insurers – Infographic
Gauging customer loyalty is directly correlated with a company’s revenue growth. In an era where insurance companies are continuously looking out for the perfect customer feedback metric, integrating the Net Promoter Score program with their business processes assures...
A data-driven approach in insurance – How to get started
Advancements in technologies, bigger data sets, and predictive analytics have changed the game for the insurance industry. For those who want to compete, data-driven marketing approaches must drive every customer engagement strategy. According to research by Applied...
Wearable technology: Bringing digital disruption to our lives!
Do you remember Captain James Kirk using his wristwatch to communicate with the crew of the Starship Enterprise back in 1966? Today, almost after 50 years, it has finally become a reality! Digital disruption is occurring in all business functions all around the world....
The data quality tipping point
Whatever your business sector, data is your most valuable asset. Along with the machinery and stock you hold, data and insights hold the key to profit and growth. But it has the unique ability to unite every department, and every function. It can reveal problems in...
Customer satisfaction is good, but Net Promoter Score drives the action!
Possibly one of the oldest and surest ways of knowing if your customers are happy with you is to simply ask them. Customers more often than not, are keen to share their point of view, and for a long time, customer satisfaction surveys were the most oft leveraged...
Are you still in the dark about the quality of your own data?
More and more businesses are waking up to the threat of poor data quality. We’re gradually seeing the risk being taken more seriously as the shock waves of poor management are felt. Yet for many businesses, data quality is seen as an abstract concept; difficult to...
Note to banks: say “hello” to big data or “goodbye” to your customers
What is the most difficult task for a bank? Acquiring customers? Retaining customers? Growing share of customer wallet? No. Being customer centric is the most difficult task for any bank. But why is being customer centric so important? The answer is simple. A customer...
Note to banks: say “hello” to big data or “goodbye” to your customers
Originally appeared on Analytics Mag. What is the most difficult task for a bank? Acquiring customers? Retaining customers? Growing share of customer wallet? No. Being customer centric is the most difficult task for any bank. But why is being customer centric so...
Filtering big data through effective CRM for bigger real estate results
Big Data is affecting sales and marketing in every industry, so it is no surprise that it is being analyzed, packaged and sold to real estate professionals in ways they can use in real time to drive success. These include providing them with information such as: Who...
The role of big data in the travel and hospitality sector
How did you book your airline tickets for your last vacation? Kayak. How did you book the hotel stay for the last business trip? Hotels.com. How do you book your car rentals for your weekend getaways? Enterprise.com. Where do you look for the best deals for local...
5 ways how social media data can boost customer retention for insurers
Everyone has been talking about how social data can help them retain customers and improve revenues and increase profit and get more customer and get more revenue and … you get the point. But has any Insurer been able to actually leverage social to do all of this? At...
Banking on the IOT – Is this possible to combine the two?
There’s a lot of talk about the potential uses for the Internet of Things. From smart homes to connected cars, IoT offers convenience in ways that once never existed. Yet one area where the IoT hasn’t been fully realized is the financial services industry. With fewer...
Why business intelligence is no longer a luxury
Once thought of as something that was only available to Fortune-500 companies, there are fewer and fewer reasons for companies to not have a strategy for their business insights. Not only has mobile device security improved greatly in the last five years, there are a...
Data Mining tips for financial analysis of the existing business
Data mining drills the static data deeper and examines the historic business activities. Ad hoc reporting spotlights analysis of both. Thereby, the pattern and trends are tracked. Mining software spotlights the algorithms thereafter. This way, unknown business...
Why banks should personalize choices to their customers in order to gain competitive advantage
Just consider this situation. You are looking to buy an air conditioner. After going through your online research, comparing features and looking into several demos, you go to your favorite electronics retailer to buy it. You buy the best one that suits your need and...
World’s leading data scientists reveal their vision of big data for the next 10 years
It took a decade of research before scientists decrypted human DNA for the first time. Today - after 13 years of progress - the same work is done within 24 hours! We continuously sharpen data processing tools. Hence, the amount of data has grown drastically over the...
Improve customer experience via big data-social media synthesis
“Your customer doesn’t care how much you know until they know how much you care” - Damon Richards Customer experience is more significant than ever – in fact, according to Aspect, more than 60% of marketers agree that the importance of consumer experience has risen....
Innovation is an act of leadership in fintech & banking
The average lifespan atop any corporate leaderboard, whether it’s the Fortune 500 or any other peer group listing, is getting shorter and shorter. Business cycles are growing increasingly brief and volatile. Yesterday’s top companies are soon long forgotten, and...
The Masters of Big Data – Interviews with five big data experts in banking
For decades now, banks have been able to retain their customers through traditional channels. However, recent shifts in the industry are threatening this historically stable customer base. Today’s consumer is used to engaging with retailers and expects his needs to be...
The Masters of Big Data – Interviews with five big data experts in banking
For decades now, banks have been able to retain their customers through traditional channels. However, recent shifts in the industry are threatening this historically stable customer base. Today’s consumer is used to engaging with retailers and expects his needs to be...
How the banking sector can leverage the potential of big data
Big Data is more than just a technology trend; it is an important paradigm that is defining how online business will be conducted in the next few decades. To get an idea of the sheer magnitude of data being created and collected these days, consider this estimate by...
Life @ Crayon – Itzhik
How long have you been at Crayon? Since July 27th, 2015. 475 days have passed like it was a single moment. What do you do at Crayon? I lead the product management, engineering and customer deployments teams. AKA Product. What’s your average day like? No one day...
Mobile first strategy for digital transformation!!
Today we live in “always on, always connected” world, and use mobile for almost everything. On our smartphone we get answers to so many questions like “I am hungry, where can I quickly grab a bite”, “it’s time to buy a new car, which model & dealer I should go for”,...
How Block Chain is disrupting many industries
Until recently, Blockchain was a term only known to geeks and specialists. But in the last six months, it has become a buzzword. In very simple terms Blockchain is the act of recording events in a database. The database itself is referred to as the Blockchain. Once...
Top 11 key tuning checklists for Apache Hadoop
Apache Hadoop is a well know and de-facto framework for processing large big data sets through distributed & parallel computing. YARN(Yet Another Resources Negotiator) allowed Hadoop to evolve from a simple MapReduce engine to a big data ecosystem that can run...
9 inspiring quotes from experts shaping the future of banking
Who doesn’t like a good quote? We come across interesting and useful quotes all of the time in literature, news media, entertainment, and so on. A potent, succinct quote that underlines a key point or supports an important truth can be like gold. Often the value of a...
9 inspiring quotes from experts shaping the future of banking
Who doesn’t like a good quote? We come across interesting and useful quotes all of the time in literature, news media, entertainment, and so on. A potent, succinct quote that underlines a key point or supports an important truth can be like gold. Often the value of a...
Crayon Data selected to join Amadeus Next
Singapore based creators of the next generation of Choice Engines, poised to shape the future of travel Singapore/Chennai – 4 May, 2016 – Crayon Data, one of Asia’s fastest growing big data companies has been selected to be part of Amadeus’ Asia Pacific travel...
The role of big data in the banking industry
The banking industry has evolved by leaps and bounds over the past decade, when it comes to operations and service delivery. Surprisingly though, most banks have failed to utilize the information within their own databases. However, that’s all about to change as the...
Eight breakthrough changes in Apache Flink 1.0.0
Apache Flink is an open source platform for distributed stream and batch data processing. Flink’s core is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams. Flink also builds...
How data bonds sales and marketing together
So far in 2016, we’ve heard a lot about Big Data, the Internet of Things, and the hottest new marketing technique on the block: ‘hyper-personalised’ marketing. Marketers are increasingly interested in focusing their efforts on individuals, not database segments...
Big data and the entreprise – A new normal for enterprise architecture
The rise of big data systems is primarily driven by web-based application paradigms for the B2C market. The growth of B2B solutions delivered through web-based application models is driving a few shifts in enterprise architecture. It is as much about the convergence...
Big data and the entreprise: A new normal for enterprise architecture
The rise of big data systems is primarily driven by web based application paradigms for the B2C market. The growth of B2B solutions delivered through web based application models is driving a few shifts in enterprise architecture. It is as much about the convergence...
It’s hard to be a data-driven organization – Here is why!
Why is it so Hard? Do you work for a data-driven organization or one that claims to be a data-driven organization, or one that wants to be a data-driven organization? You probably do, whether you work for a big retailer or a small service provider. Every organization...
10 new exciting features of Apache Hive 2.0.0
We should be excited that Apache Hive community have released the largest release and announced the availability of Apache Hive 2.0.0. It brings great and exciting improvements in the category of new functionality, Performance, Optimizations, Security, and Usability....
The road to revenue is paved with good data – 99% of marketers agree
“Every day, three times per second, we produce the equivalent of the amount of data that the Library of Congress has in its entire print collection, right? But most of it is like cat videos on YouTube or 13-year-olds exchanging text messages about the next Twilight...
Life @ Crayon – Amrit
1) How long have you been at Crayon? Just about 4 years now. 2) What do you do at Crayon? Ah, the eternal mystery :). If anyone this knows, be sure to let me know! Besides making a general nuisance of myself, I assist our Product Engineering team. 3) What’s...
In conversation with Tim Kobe, the iconic designer behind the original Apple Stores
Manu: Tell us a little about yourself, outside of the information that is publicly available online? Tim: I am from California. I got started in business 25 years ago. I studied Bachelor of Science, environmental design at art center college of design, at Pasadena. I...
I don't think there are many banks that value human experience” – in conversation with Tim Kobe, the iconic designer behind the original Apple Stores.
Manu: Tell us a little about yourself, outside of the information that is publicly available online? Tim: I am from California. I got started in business 25 years ago. I studied Bachelor of Science, environmental design at art center college of design, at...
How to write data analysis reports. Lesson 6 – get acceptance
Data analysis reports have to go through one more hurdle after they are completely written. They have to be approved for acceptance by a gatekeeper. The approval for acceptance may involve allowing report distribution, starting the publishing process, issuing payment...
9 must watch big data technologies along with Hadoop!
Today emerging big data technology firm focused on helping enterprises build breakthrough software solutions powered by disruptive enterprise software trends like Machine learning and data science, Cyber-security, Enterprise IOT, and Cloud. So Hadoop is one of the...
Why AI and Machine Learning are not the same thing
With the evolution of digital technology, the definitions of AI and Machine Learning are quite distinct from what they were before. Add to that the complexity of people using these terms interchangeably or to mean different things, and we have a prime example of our...
“We’re witnessing the creative destruction of financial services.” says banking expert, Arvind Sankaran
I recently interviewed Arvind Sankaran, Global business leader. We talked about FinTech startups, innovation in the banking industry, big data analytics, and wealth management. He also shared about his experience working with banks like CITI, HSBC, and Barclays. Read...
“We’re witnessing the creative destruction of financial services.” says banking expert, Arvind Sankaran
I recently interviewed Arvind Sankaran, Global business leader. We talked about FinTech startups, innovation in the banking industry, big data analytics, and wealth management. He also shared about his experience working with banks like CITI, HSBC, and Barclays. Read...
What is SMACK (Spark, Mesos, Akka, and Kafka)?
This blog introduces the convergence of complementary technologies – Spark, Mesos, Akka, Cassandra and Kafka (SMACK) stack. And we will see how Apache Kafka can help us to get data under control and what is it role in our data pipeline, how Spark & Akka help us to...
How is 2016 shaping up for data science – Trends
If 2015 was the ‘year of data science’ then 2016 is when it’s going to take over completely. In the past year, we saw many applications of data science in our everyday lives- from Uber, to Amazon, to Siri, to image recognition, to generally smarter marketing...
The three pillars of insurance analytics
The insurance industry is all about assessing risk and managing the same successfully. Life insurance industry operates intrinsically by balancing risk assessment and risk management. Compiled with a large volume of data the insurance industry operates with, arriving...
The difference between UI and UX
I have been a web developer for over 6 years, and during my work life, I have worked both on front end and back end web development. In the past 6 years, I have seen innumerable people interchange UI(User Interface) and UX(User Experience), some even mid-sentence,...
The difference between UI and UX
I have been a web developer for over 6 years, and during my work life, I have worked both on front end and back end web development. In the past 6 years, I have seen innumerable people interchange UI(User Interface) and UX(User Experience), some even mid-sentence,...
Important factors that play a key role in big data security
Computers rule today's world. Gone are the days when you would sit with files and paperwork and stack up on important documents and such. Sure you would work with files and folders , but that would be over your computer screen or the smart phone. With successive...
How to write data analysis reports. Lesson 5
Perhaps the hardest part of writing a data analysis report is just getting it completed. It takes discipline and persistence to stay on track. Even so, it’s easy to get distracted. Sometimes the problem is that the story of the analysis hasn’t been thought all the way...
Demystifying data scientists [Infographic]
Data Scientists are the mystical creatures today. There is some debate around who can be qualified as a Data Scientist and who would be an analyst. In this infographic, we demystify Data Scientists! This infographic originally appeared here. Republished with...
The four people who ruin innovation in fintech & banking
Innovation is fun. Except when these types are around. How many do you know? The Hypemaster The Hypemaster is, well… a master of hype. Everything they’re working on is amazing, and you must absolutely drop everything and check it out. Right now! “Hey we’re getting...
Can Fintechs take banks to the edge of innovation?
This post was written by a guest author Banks. When was the last time you associated the words “innovation”, “forward thinking”, “futuristic” etc. with them? I would say “never!” Banks are generally thought as being traditional and conservative. But the future isn’t...
How to write data analysis reports. Lesson 4 – Get their attention
If you’re writing a report about statistics, you have to expect that many readers will lose interest after a while, if they even had it to begin with. So, in writing the report, think about how you might engage your audience. Here are five ideas. Find common ground...
Why data science and big data need to become best buddies
The past few years have witnessed the rise of Big Data to almost epic proportions. Along with Big Data, we also saw the rise of Data Science and saw the Data Scientist’s job become one of the most coveted profiles in 2015. Businesses continue to invest in Big Data and...
Why banks should hop on board the big data bus
Co-authored by Manu Jeevan. More than 70% of banking executives worldwide say that customer centricity is important to them Surprisingly, research by Capgemini indicates that only 37% of customers believe that banks understand their needs and preferences adequately....
Your fast follower strategy is riskier than you realize
In my last post Leaders, Learners and Laggards I talked of banking leaders who describe their approach to innovation as being a “fast follower, and how my typical retort is that they are half-right— most of them are definitely followers, but there usually isn’t...
How to write data analysis reports. Lesson 3—know your route.
You’ve been taught since high school to start with an outline. Nothing has changed with that. However, there are many possible outlines you can follow depending on your audience and what they expect. The first thing you have to decide is what the packaged report will...
Trends in healthcare Informatics: 2016 & beyond
The healthcare field has greatly benefited from advances in data analytics and informatics over the last few years. In general, patients will continue to be more connected to their doctors and support networks via wearable technology, and they will also have...
Get the stats! On customer experience, personalization, mobile banking and big data for banks
Technologies like big data analytics, digital personalization, and marketing tech have gone from early-adopter novelties, to main stream essentials. It's therefore no secret that the banking landscape has changed dramatically over the past few years. So we've rounded...
Four ways big data potential can detangle customer service conundrums
The most happening thing in the world of technology – ‘Big Data’ is emerging as a business opportunity and providing solutions to some of the toughest challenges faced in the business qualm. Data driven solutions stemming out of the big data world are enabling...
All about data lakes – Data Lake or Data Warehouse? [Infographic]
There has been raging debate over Data lakes and data warehouses and if one will replace the other! Data warehouses have been around for a long time, serving the requirements of enterprises big and small. The challenge with data warehouses is the fact that the most...
How to write data analysis reports. Lesson -2 know your audience.
Every self-help article about technical writing starts by telling readers to consider their audience. Even so, probably few report writers do. In a statistical analysis, you usually start by considering the characteristics of the population about which you want to...
Leaders, learners, and laggards in banking and fintech innovation
I talk with a lot of banking leaders who describe their approach to innovation as being a “fast follower. My typical retort is that they are half-right— most of them are definitely followers, but there usually isn’t anything fast about their approach. Pioneers are the...
Banking stats on customer experience, mobile banking & personalization
Technologies like big data analytics, digital personalization, and marketing tech have gone from early-adopter novelties, to main stream essentials. It's therefore no secret that the banking landscape has changed dramatically over the past few years. 30 interesting...
How big data analytics can save your brand
Big data has always existed, but it’s real value for brands become apparent in the digital age due to the increased computational capability for processing data. Although a lot of suggestions have been made and frameworks developed to show brands how they can achieve...
Net promoter score pitfalls to avoid
Net Promoter Score or NPS can be a tricky process to get right. There are many parameters that impact the execution and efficiency of the process. Even after the survey is concluded, it is paramount to close loop with the customer. In this infographic we highlight a...
96% of companies are failing when it comes to marketing data insights – Report
At a time in our history when there is more data than ever before, the overwhelming majority of companies have yet to see the full potential of better data insights. PwC and Iron Mountain recently released a survey on how well companies are gaining value from...
How to write data analysis reports. Lesson 1—Know Your Content.
In every data analysis, putting the analysis and the results into a comprehensible report is the final, and for some, the biggest hurdle. The goal of a technical report is to communicate information. However, the technical information is difficult to understand...
6 amazing big data analysis tricks to get more customers
Do you hold all the aces for running your business on successful trek? Enlisting to the names of blue chip companies requires breaking your back. If you miss it, your business will have to go back to the wall. But accurate analysis can cross the bridge of losses when...
How content marketing can empower sales teams
Although content has been an important and growing part of any marketing strategy for years, it is often overlooked, especially when it comes to sales. Sales and marketing alignment is key for a company’s growth, yet it remains to be one of the most common challenges....
K-Nearest Neighbors and curse of dimensionality in python Scikit-Learn
What is K nearest neighbors(KNN)? KNN is one of the simplest machine learning algorithm and it is a lazy algorithm, as it doesn’t run computations on a data set until you give it a new data point you are trying to test. In this tutorial, I will not only show you how...
Positive effects of big data in financial sector
The past number of decades have seen more and more of our world move into computers. Rare is the doctor’s office with file cabinets full of alphabetized patient folders or a company researcher hanging out at the library to get data for a client report. Today, our...
Where will big data have the biggest impact in smart cities?
You cannot escape mention of Smart Cities today because the biggest technology giants, the IBMs, Cisco’s and Seimens’ of the world are at the forefront of the news flow. This is hardly surprising considering the potential market opportunity – the UK Government...
Top 10 data science and big data experts to follow on Twitter
Twitter is a great source of information, and lets you quickly scan your feed and engage with content that intrigues you. Even though this eliminates a lot of unnecessary noise, you need to follow the right people, if you are on a constant lookout for great...
10 data science and big data experts to follow on Twitter
Twitter is a great source of information, and lets you quickly scan your feed and engage with content that intrigues you. Even though this eliminates a lot of unnecessary noise, you need to follow the right people, if you are on a constant lookout for great...
Myths and facts surrounding big data – Infographic
Big Data holds great promise for enterprises of all sizes. It can bring insights that help the business drive revenue and also understand gaps in service and products. However, as with any other technology, big data also has its shares of myths. Through this...
Deep bows. Firm handshakes: Mitsui & Co., Ltd. invests in award winning big data start-up, Crayon Data
Singapore based company, creators of the next generation of Choice Engines, gets support and validation from Japanese conglomerate. Singapore/Chennai – Feb 24, 2016 – Mitsui & Co., Ltd. has made an investment of an undisclosed amount, in Crayon Data, one of Asia’s...
From transactions to relationships: Innovation’s next horizon
There has never been a better time for innovation in financial services, yet most financial institutions struggle to build lasting, profitable relationships with their customer base. New ideas abound, yet actually implementing those new ideas, let alone realizing...
Big data and analytics trends 2016 – Infographic
The Big Data and Analytics acceptance and usage have come a long way since it was first introduced. Over the last few years, we have seen a lot of industries adopt advanced analytics as a core part of their overall strategy. And this adoption has been across the...
Personalization: Just do it. But don’t overdo it
We, as customers have always wanted personalized services, whether we are buying something from a store or checking into a hotel for a stay. Services that satisfy our unique taste would make our life easier and save a lot of time. Apparently, companies have begun to...
Personalization: Just do it. But don't overdo it
We, as customers have always wanted personalized services, whether we are buying something from a store or checking into a hotel for a stay. Services that satisfy our unique taste would make our life easier and save a lot of time. Apparently, companies have begun to...
Banking: How the pursuit of efficiency kills innovation
While banks are on a quest to improve efficiency ratios, I’ve noticed a recent increase in the use of the word “innovation” in more and more bank job descriptions and even in bank job titles. I view this as both good news and bad news. Good news because at least it...
Demystifying machine learning part 2: Supervised, Unsupervised, and Reinforcement Learning
In the first blog post of this series, we introduced the topic of machine learning and discussed why there is a lot of excitement around the topic. In this blog post, we explore different types of machine learning. Let’s start with a simple example that everyone can...
6 ways big data analytics can drive smarter customer service [Infographic]
Big data analytics finds immense application across the entire business. One area which can have direct, measurable and visible impact is the area of customer service. Data has been used since time immemorial to improve customer service, but it is only recently that...
How big data will impact sales [Infographic]
Big Data has become a buzzword for businesses of all sizes. One big aspect of it is its tremendous potential to boost sales. Big Data is now believed to play an imperative role in generating prospective leads that chief managers could convert into sales by devising...
Our data platform with Docker
This article has been co-authored by Rafi Syed and Sree Pratheep. As a continuation of our earlier article on Docker, here is a brief about how we started our journey in Docker. Our goal was to have a completely self-sufficient development cum integration environment...
Our data platform with Docker
This article has been co-authored by Rafi Syed and Sree Pratheep. As a continuation of our earlier article on Docker, here is a brief about how we started our journey in Docker. Our goal was to have a completely self-sufficient development cum integration environment...
Demystifying Machine Learning Part 1 – Data, processing power, and open source
This is the first of a three-post series on machine learning. Is machine learning just a fancy word for the same old computer programming we have employed for decades? Or, is machine learning a mystical computer that can learn anything? More importantly, why does it...
Bank innovation through collaboration – It’s better together!
I have been a little behind in my writing because I have been spending a lot of time on the road with some great innovators lately, at FinovateEurope and the Bank Innovators Council Lab Day in London, the FinTech Partnerships Conference and the All Payments Expo in...
Safe business data storage: what you need to know about security in the cloud
Using the cloud is convenient, but many organizations worry about the security of the data they store in it. Here are some tips and information to help assuage those fears and make you smarter about security. The Security Market Is Getting Bigger The market for...
4 reasons startups must unlock the potential of big data
With Internet of Things permeating across the world, terms such as ‘Big data, data crunching and data curation’ are looming up as the latest buzz in the tech space. Data is mounting up in abundance from everywhere, measuring in trillions of amount. Proper analysis of...
Unbundling design for innovation in big data
Visual design in big data systems has undergone a significant transformation in recent years. It is mainly driven by the emergence of tactile interfaces in UI and the trends in information systems design architecture. The rise of mobile-first designs helped fuse these...
Unbundling design for innovation in Big Data
“At Crayon, the visual design always took precedence over the systems design. This is because the experience-centric systems place a premium on user experience over the backend systems efficiency. During the early decades of my professional career, I have been trained...
5 ways to simply kill your innovation initiative
I often write and speak about the “Business Prevention Department” that lurks inside banks. Devoted to sniffing out and stamping out anything that looks “risky”, the Business Prevention Department is staffed with members committed to “protecting” their banks from...
How is cloud and big data changing healthcare in 2016
The push for medical-based Big Data analytics and an increase in the pervasive role of cloud services has launched healthcare into a new frontier. As more medical information is uploaded to the cloud and vastly more analytics carried out on Big Data repositories of...
Dealing with Unbalanced Class, SVM, Random Forest and Decision Tree in Python
So far I have talked about decision trees and ensembles. But I hope, I have made you understand the logic behind these concepts without getting too much into the mathematical details. In this post let’s get into action, I will be implementing the concepts that we...
Innovation is more than the next big idea in fintech and banking
During the last 15 years, 47 fintech companies grew from startups to “unicorns” (valued at $1 billion or greater), with another 38 companies quickly approaching that level, as Jim Bruene posted to the Finovate blog. This has caught the attention of investors, who...
Expert interview with Ron Shevlin about the role of big data in banking
I recently interviewed Ron Shevlin, Director of Research at Cornerstone advisors, for Big data made simple, Crayon’s big data information portal. We talked about a wide range of subjects, from how banks need to use the data they have at hand, to their business models,...
The art of Net Promoter Score – Infographic
Net Promoter Score (NPS) is a reliable metric used by many organizations to get a pulse on their customer satisfaction. However, like any process, it is critical to bear in mind certain best practices to follow. NPS was introduced in 2003 and since then has become a...
Interview with Eric Schneider, Asia Pacific Head of MasterCard Advisors
Tell us a little bit about yourself. I’ve been with MasterCard since 2001, and I am currently heading MasterCard Advisors, the professional services arm of the company, in the Asia Pacific region. The most exciting aspect of my job is to witness and be a part of the...
Interview with ChiefMartec’s Scott Brinker on marketing technology
Can you tell us a little bit about your career path, and what lead you to become a marketing technologist? Honestly, serendipity. I started my career as a software engineer, programming multi-player games. After that, for a number of years, I was the head of...
Gartner predicts five big data trends that will dominate 2016
Gartner has predicted 5 strategic technologies for 2016. Highlights include, the importance of machine learning, artificial intelligence, the Internet of Things and its impact on business and consumers worldwide. Even though these technologies have different names,...
Gartner predicts five big data trends that will dominate 2016
Gartner has predicted 5 strategic technologies for 2016. Highlights include the importance of machine learning, artificial intelligence, the Internet of Things and its impact on business and consumers worldwide. Even though these technologies have different names,...
How a Chief Data Officer can make your data great
Fresh data is usually pristine. It’s data in it’s clearest, most accurate form – straight from the customer or client. If you’ve put measures in place to cut back on data input errors, such as form validation, you can be reasonably sure that the newest records in your...
Do CEOs get the big data truth or they just do not?
For so long, the foundation of the CEO’s empire has been experiencing. They have risen to the top, learned as they went along, and they lean on those who have learned alongside them. They have had enough information at their disposal to make what they saw as informed...
Interview with Eric Schneider, Asia Pacific Head of MasterCard Advisors
I recently interviewed Eric Schneider, Region Head, Asia Pacific, MasterCard Advisors for Big data made simple(Crayon’s big data content hub). It was truly an honor to have the opportunity to learn from one of the most influential voices in banking. Tell us a little...
Top ten pointers in the new Apache Spark release (version 1.6)
In 2016, we should be excited that Apache Spark community launched Apache Spark 1.6. Committers – There are around 1000 contributors to Apache Spark, which has doubled. Patches – Apache Spark 1.6 version includes & covers 1000 patches. Run SQL query on files –...
5 new year resolutions for innovators in banking
Here are some New Year resolutions for the growing group of bankers who are adding “innovation” to their do-to list in 2016. Getting these right will greatly improve your chances for success in the new year. 1. Define your innovation goals So, what do you want to get...
Is wearable tech creating a data time bomb?
The company that made your smartphone is no longer a hardware manufacturer. It has become adept at harvesting and managing data from its users, too. Every device has a series of sensors, as well as user login and an account where data is stored. For manufacturers of...
Top ten retail banking trends and predictions 2016
For the fifth consecutive year, we have surveyed a panel of close to 100 global financial services leaders for their thoughts around upcoming retail banking and credit union trends and predictions. The crowdsource panel including bankers, credit union executives,...
The five myths and truths about big data – Let's face it!
While socializing with my partner (something that will abruptly stop for a while after the imminent birth of my second child), when I tell people that I recruit for Big Data & Data Science professionals, their reactions vary from a vacant, glazed look in their...
What is the role of RDDs in Apache Spark? – Part 1
This blog introduces Spark’s core abstraction for working with data, the RDD (Resilient Distributed Dataset). An RDD is simply a distributed collection of elements or objects (Java, Scala, Python, and user defined functions) across the Spark cluster. In Spark, all...
Exploratory data analysis in python using pandas, matplotlib and numpy
You already know that Pandas is a power tool for data munging. In this tutorial, I will show you how to explore a data set using Pandas, Numpy and Matplotlib. My goal for this project is to determine if the gap between Africa/Latin America/Asia and Europe/North...
Top 10 retail banking trends and predictions for 2016
For the fifth consecutive year, we have surveyed a panel of close to 100 global financial services leaders for their thoughts around upcoming retail banking and credit union trends and predictions. The crowdsource panel including bankers, credit union executives,...
The keys to becoming a data scientist: Exploring modern career frontiers
If you know someone who is obsessed with data or if that is something that interests you and you are looking for a smart career move, there are opportunities right now to become a data scientist. It is now easier than ever before to complete something like a sas...
5 ways to drive customers through your marketing funnel
The power of market funneling allows you to do more with your pre-existing traffic. Not sure what I’m talking about? Essentially, a marketing funnel is the path you’d like your visitors to take through your site, ultimately resulting in a conversion of some sort. No...
Is Apache Hadoop the only option to implement big data?
Yes, Hadoop is not only the options to big data problem. Hadoop is one of the solutions. The HPCC (High-Performance Computing Cluster) Systems technology is an open source data-driven and intensive processing and delivery platform developed by LexisNexis Risk...
10 branch banking innovation strategies for 2016 and beyond!
Non-banking industries like hospitality and travel are deploying futuristic technologies and processes to enhance their service experiences every day — conditioning consumers with higher face-to-face service expectations. When these other industries ‘raise the service...
Ten handy Python libraries for (aspiring) data scientists
Data science has gathered a lot of steam in the past few years, and most companies now acknowledge the integral role data plays in driving business decisions. Python, along with R, is one of the most handy tools in a data scientist’s arsenal. It’s also one of the...
Bridging the customer experience gap
The prevailing view of most financial industry leaders over the past decade has been that internal innovation was optional at best, and probably harmful to the way they’ve been used to doing things for so long. Meanwhile, innovation bloomed on the edges and outside of...
Does your business need a big data initiative?
“It is a very sad thing that nowadays there is so little useless information.” Oscar Wilde As far as we know Wilde did not live in a Big Data age but his quote is strangely prescient. It would seem that today almost everything we do generates data that is captured,...
Which big data personality are you? [Infographic]
According to Google Trends, in 2011, when the hype of big data had just begun. In 2015, the hype still exists, but big data has evolved beyond the hype! Companies are using big data to generate profits and receive insights about their consumers. Even companies in...
Seven pillars that form the base of an information-centric bank
As consumers, each of us is fully cognizant of and deeply entwined with the "Information" economy. Whether we use Google to search, shop on Amazon, connect with friends on Facebook or hail a cab using Uber, we hardly give a moment’s thought to the "building blocks"...
Building an "Information-Centric" enterprise
As consumers, each of us is fully cognizant of and deeply entwined with the "Information" economy. Whether we use Google to search, shop on Amazon, connect with friends on Facebook or hail a cab using Uber, we hardly give a moment’s thought to the "building blocks"...
How banking sector makes use of big data analytics [Infographic]
The Banking industry generates a huge volume of data on a day to day basis. To differentiate itself from the competition, banks are increasingly adopting big data analytics as part of their core strategy. Analytics will be the critical game changer for the banks. In...
What do we mean by a big data driven organisation – Part 1
Zaloni's fantastic book, Creating a Data-Driven Organization, is a very well narrated in this book and I like to share our learning with our big data & IoT community. Many organizations think that simply because they generate a lot of reports or have many...
“Big Data Tsunami”- are our jobs at stake?
I understand the title is super dramatic but there is a hidden fact in this article. So Keep reading… Being a big data enthusiast, I always adhere to its roots of bringing goodness to the technology but you should also think where this is taking us. Every day we...
Five things banks can learn from startups
Most bankers don’t spend a lot of time with start-up companies. The need for bankers’ loan decisions to be right 99% of the time tends to not mix well with most start-ups’ risky and voracious appetite for capital. Outside of a few bankers in Seattle, Silicon Valley,...
Crayon Data enters Indian shores, allies with GroupM
Singapore based big data start-up, Crayon Data is setting up India operations in association with WPP's media agency conglomerate GroupM. Mindshare, one of the GroupM agencies, is all set to bring its global alliance with Crayon Data to the Indian market. Mindshare...
#DataMeetsDesign: the DNA of future corporate success
We live in a world of rapidly exploding tech trends. A big data world. A mobile-first world. The collision of big data and mobile creates a unique challenge of contrasts. In such a world, #DataMeetsDesign is the biggest challenge, and the biggest opportunity. Why?...
Digitization enables hyper personalization of banking services: Nitin Chugh
1. What role do you see digital initiatives play as the banking industry is increasingly shifting from commodity banking to that of personalized, customer services? How are such e-initiatives changing the playing field? All the technology led changes in banking-the...
Framework of an Apache Spark Job Run!
Now our the big data analytics community has started to use Apache Spark in full-swing for big data processing. The processing could for ad-hoc queries, prebuilt queries, graph processing, machine learning, and even for the data streaming. Hence the understanding of...
Data is the new oil of the Digital Economy
Everyone from geeks to CEOs is on the data bandwagon. Today, for a CEO to say, “I’m not investing in data and analytics” is the same as him saying “I’m not interested in our customers”. The real question is not whether you invest in data or not. What matters is what I...
Traditionalists vs. Trailblazers – Innovation in banking and fintech
Late last year I was asked by my good friend Jim Marous of The Financial Brand to contribute to his crowdsourced list of 2015 Digital Banking Trends and Predictions. My prediction was that we would see an increase in the current trend of banks investing in innovation....
Reimagining bank product design in the experience economy
When B. Joseph Pine II and James Gilmore wrote a book called “The Experience Economy,”they built on the work of Alvin Toffler (“Future Shock”) and others on the value of creatingexperiences. They cited Disney, Starbucks, Nordstrom and other leading brands as examples....
Ratan Tata invests in award winning big data start-up, Crayon Data
Singapore based company, creators of the next generation of Choice Engines – gets Tata’s support and validation Singapore/Chennai – November 24, 2015 – Ratan Tata, Chairman Emeritus of Tata Sons, has made a personal investment of an undisclosed amount in Crayon...
The top 12 Apache Hadoop challenges
Hadoop is a large-scale distributed batch processing infrastructure. While it can be used on a single machine, its true power lies in its ability to scale to hundreds or thousands of computers, each with several processor cores. Hadoop is also designed to efficiently...
How to become a data scientist – Interview with Sean McClure
Can you introduce yourself? My name is Sean McClure and I am a data scientist working in San Francisco. As a Data Scientist, I assist organizations looking to compete analytically by applying advanced statistical and mathematical modeling, database technology, and...
7 kinds of applicants who are NOT LIKELY to get a job at Crayon
This post has been co-authored by Prarthana Jairath. Recruitment rudiments at Crayon Crayon's culture is as unique as its people. We write our own values that charter the course of rainbows to the pots of gold, at the end of it. Here's a tongue-in-cheek look at...
5 key strategies for securing health care data in BYOD
It is no longer a secret that, mobile technology has taken over virtually every sector of the world with health care not an exception. Thanks to a novel technology and engineering tactics that pushed health care in many parts of the globe for a huge positive...
How to install IPython notebook on your computer for data analysis
The tutorial is really short; just like wiki how tutorials are. Follow these steps to install I python notebook and other scientific Python packages on your computer. Installing Ipython Notebook 1) Download and install canopy on your computer. 2) To check whether...
Can today’s banks become the ‘Bank of the Future’?
Why are so many banks yet to develop a real-time, digital customer engagement offering when there is an acknowledgment of the importance of this capability? The key challenge lies in legacy systems, with nearly all banks (89%) mentioning the challenge of overcoming...
Get ignited by Apache Spark – Part 2
Thanks for your time; I definitely try to value yours. In part 1 – we discussed about Apache Spark libraries, Spark Components like Driver, DAG Scheduler, Task Scheduler, and Worker. Now in Part 2 -we will be discussing on Basics of Spark Concepts like Resilient...
How banks will compete in the future with one another!
Back in 1995 Michael Treacy and Fred Wiersema wrote a book called The Discipline of Market Leaders, and in it, they broke down the three critical strategic domains of any business– Customer Intimacy, Product Leadership, and Operational Excellence. They argued that...
Tools in the data armoury: R vs Spark
The purpose of this article is twofold. The first is to give a quick comparison between R and Spark, in terms of performance. The second is to introduce you to Spark's ML library. Background As R is inherently single threaded, it may not be wise to compare Spark and R...
Sorry, but disruptive technology will kill banks
Allegedly, John Authers recently wrote an article in the Financial Times entitled “Disruptive technology will not kill banks“. I say allegedly because despite the article being cited and commented on by two people whose analysis and opinion I respect (Chris...
Get ignited with Apache Spark – Part 1
Spark began life in 2009 as a project within the AMPLab at the University of California, Berkeley. More specifically, it was born out of the necessity to prove out the concept of Mesos, which was also created in the AMPLab. Spark was first discussed in the Mesos white...
Interview with Yahoo’s Research Scientist Miriam Redi
Miriam Redi is a Research Scientist at Yahoo Labs, London. Her research focuses on content-based social multimedia analysis. In particular, she explores ways to automatically assess image semantics, visual aesthetics, and multimedia creativity. Miriam developed a...
How data driven methods can revolutionize Pharma industry
Pharmaceutical research and development, which involves creating new drugs and making old ones safer and cheaper, is a difficult and error-prone process; not to mention its exorbitant costs. As with most research driven fields, trial and error is what's responsible...
What are the 3 S's of Spark and its effect on big data?
Many thanks for your cherished time, this time we like to share with you the details on what is 3 S’s of Spark as we all know the 3 V’s of Big Data is Volume, Variety & Velocity. And even added with kernel V’s like Veracity & Values. Big Data is defined as a...
8 best python Data Science books to read
Python is probably the programming language of choice (besides R. for data scientists for prototyping, visualization, and running data analyses on data sets. There are many libraries, applications and techniques to analyze data in Python that even experts in the field...
Banks have to upgrade, or risk being burnt to the ground – Interview with JP Nicols
For decades, banks have only competed with one another, on the same terms. As an industry not very used to change, the banking sector is currently undergoing a radical transformation. JP Nicols, a veteran from the banking sector, has spent twenty years in the space....
In conversation with banking expert Vik Atal, on the past, present, and future of banking
Over the past year or so, I've been privileged to get to know Vik Atal, and interact with him closely. In an era where reputations, especially in banking, get built and damaged so quickly, it's inspiring to see the near-universal respect that Vik commands. It's not...
Universities that offer courses in Data Science, Analytics, Business Intelligence, Data Mining, Predictive Analytics and Machine Learning
This is a list of some of the universities that offer courses in Data Science, Analytics, Business Intelligence, Data Mining, Predictive Analytics, and Machine Learning. 1. Arizona State University MS in Business Analytics The Masters in Business Analytics is...
The minimalist guide to Google Analytics
Google Analytics is a powerful tool, but it is too difficult to learn as there are lot of features in it. This is the common misconception that most people have while getting started in Google Analytics. Google Analytics is not as difficult as you think. In this post,...
“Building the Amazon for Consumer Finance” – Alexander Graubner-Müller, CTO of KREDITECH
As the founder and CTO of Kreditech, Alexander strongly believes that algorithms and statistical data are the building blocks for the next Industrial Revolution. Kreditech, one of Germany’s most data-driven FinTech companies, is a testament to that belief. Before...
In search of competitive advantage in banking and fintech
Next week I’ll be in Las Vegas for Money 20/20 the huge payments and financial services innovation conference, and as always I’ll be on the lookout not only for cool ideas and technology but in particular those that can bring a competitive advantage for financial...
Mindshare chooses Crayon Data as their big data partner to launch FAST
Singapore based Crayon Data joins Mindshare and industry leaders GroupM, Kantar, WPP Data Alliance and Jivox to create revolutionary, real-time marketing solutions. Crayon Data to provide customized analytics services for FAST Hub. Singapore/Jakarta – October 23,...
Eight key skills of a successful Data Scientist
With the rise of Big Data in the past few years, a new breed of analysts has gained massive exposure. The so-called "Data Scientists" are considered by many as the only ones capable of leveraging the true value of Big Data. Although it has now become clearer what to...
It’s too late; banking is already being disrupted
Bankers may be taking undue solace in Chris Skinner’s blog post, “Like Airlines and Pharma, Banking’s Too Big to Disrupt.” I was party to the specific round of sparring he cites in his article over whether financial technology startups will overthrow the banking...
Privacy Paradox: The ethical implications of big data
As the information that our society generates grows exponentially, and our ability to analyze this information for deep insights into peoples’ psyches crosses into the realm of creepy, we must struggle with our conflicting desires for both individual privacy and deep...
The contributions of information technologies for next-generation cities
With the faster maturity and stability of a bevy of cutting-edge technologies and enabling tools in the hot and happening ICT space, there is a greater focus and extra zeal by worldwide governments on establishing and sustaining ICT-enabled, safe, sustainable, and...
"Banks have to upgrade themselves, or risk being burnt to the ground" – an interview with banking expert JP Nicols
I recently interviewed JP Nicols, the co-founder of bank innovators council, for Big data made simple(Crayon's big data content hub). It was truly an honor to have the opportunity to speak to, and learn from, one of the most influential voices in banking. We talked...
How much should Business Intelligence cost?
With the New Year just around the corner, it’s time to start preparing for a productive year–which for many businesses means confronting their big and scary data. In fact, “organizing scattered and large data sets” is one of the top business challenges that companies...
How will be our life as retired workers in the Smart Cities we are building?
As Tejvan Pettinger wrote in his blog “The main impacts of an aging population”, we must be proud of the great achievement of the twentieth century regarding the dramatic rise in life expectancy. However, the aging population comes with many challenges for smart...
Privacy debates: The two axes that govern them
I recently read an article on Tech Crunch about Apple’s public pro-privacy stand, and Snowden’s recent public appearance on Twitter. These two events may not seem related. However, to quote the article, “pro-privacy moves by mainstream tech giants can absolutely chart...
Privacy debates: the two axes that govern them
I recently read an article on Tech Crunch about Apple’s public pro-privacy stand, and Snowden’s recent public appearance on Twitter. These two events may not seem related. However, to quote the article, “pro-privacy moves by mainstream tech giants can absolutely chart...
Why bad data is wasting your marketing efforts
The amount of money spent on marketing is growing, and the way we spend is changing. The statistics that prove this are plentiful and becoming more convincing as the years go by. Here are two very compelling examples: By 2016, we expect the amount of money spent on...
Interview with Computer Vision expert Adrian Rosebrock
Adrian Rosebrock is an entrepreneur, computer vision expert and Ph.D, who launched two successful image search engines: ID My Pill - an iPhone app and API that identifies prescription pills in the snap of a smartphone’s camera, and Chic Engine - a fashion search...
Interview with UN expert Pulak Ghosh: A big picture of big data in India
Dr. Pulak Ghosh, Professor of Quantitative Methods at the Indian Institute of Management Bangalore (IIMB), is a member of the UN Secretary-General's Big Data Privacy Advisory Group. He recently won the National Biennial award 2015 for his outstanding contribution to...
The age of the cockroach
I read an article, The Age of the Cockroach, on Medium and found myself completely agreeing with it. In fact, it hit a sweet spot. We all know there’s a lot of money chasing that all B2C internet and e-commerce start-ups need to do. These investments however happen at...
Key concepts and terms in Multivariate Statistical Methods
This is a handy list of key concepts and terms in Multivariate Statistical Methods. We've put together the list, especially for people new to the field. We hope you find this useful. You can download the complete glossary of Multivariate Statistical Methods at...
Can businesses profit from data quality?
We often refer to business data as an asset. Data is essential for every function in an organization, so it’s easy to see why it’s so valuable and vital. On our blog, we’ve discussed ways that clean data can make an organization more efficient and profitable. And we...
Notes of a Food Nomad (…with a little help from technology)
As co-founder of a startup with global ambitions, I’ve travelled 170+ days in the last year – pretty much making me a nomad of sorts. And as a self –confessed foodie, the quest for memorable food experiences on my travels has certainly been interesting. First, the...
How tech startups help food nomads to pick their favourite restaurants
As co-founder of a startup with global ambitions, I’ve travelled 170+ days in the last year – pretty much making me a nomad of sorts. And as a self –confessed foodie, the quest for memorable food experiences on my travels has certainly been interesting. First, the...
Transforming healthcare using data: Interview with Elaine Warburton
Internet has revolutionized how we share information, the Internet of Life will transform our healthcare systems, globally. In response to the growing threat of emerging infections and drug-resistant ‘Super Bugs’, QuantuMDx is digitizing biology to share pathogen data...
7 important questions to ask yourself before buying a BI solution
Every industry is unique and has its share of complexities and challenges. Their customers are unique, they have different marketing methods, they have various services and products, different budgets and goals. Thus, the data being generated by every industry is...
How banks can power their loyalty programs
I read an article on The Huffington Post the other day, about how unhappy Canadians are with their banks’ loyalty programs. It got me thinking about what Crayon is offering to the world, and just how much the world needs it. There are a lot of loyalty programs out...
How banks can power their loyalty programs
I read an article on The Huffington Post the other day, about how Canadians are unhappy with their banks’ loyalty programs. It got me thinking about what Crayon is offering to the world, and just how much the world needs it. There are a lot of loyalty programs out...
Interview with Clarifai founder Matthew Zeiler
Matthew Zeiler is the founder and CEO of deep-learning startup Clarifai, which uses machine learning and deep neural networks to develop the world’s advanced image recognition system. He received a Ph.D. in machine learning and image recognition, and his research...
Will Big Data get fans off the couch and into the stadium?
It’s no secret that analytics are everywhere. We can now measure everything, from exabytes of organizational “big data” to smaller, personal information like your heart rate during a run. And when this data is collected, deciphered, and used to create actionable...
Interview with IBM’s Nancy Kopp-Hensley on Data Warehousing
Nancy Kopp-Hensley is the director of technical marketing for IBM Analytics. Nancy has more than 20 years’ experience working in the data business in many capacities, from development and product management to sales and marketing. You have been in data warehousing...
Notes from the Centre of the Universe
About a month ago, we set up the New York office of Crayon, the big data startup that I’ve co-founded. I was wading through a mass of summer tourists at Times Square, to get to my office on Broadway & 48th. Right up ahead of me were a bunch of European teenagers....
Big Data in Banking – How can Banks derive greater value from customer data?
Dealing with information and data is turning out to be a preeminent grindstone in every sector. This is the age of big data, where every professional relies on Data Analytics for accessing, managing and altering huge volumes data. Big data analytics has found greater...
Choosing the right BI solution: Tips for a successful Proof of Concept
To read the first part (Four factors to consider before choosing a BI solution) of this article, click here. Tips for a successful POC Address future requirements as well as current ones. Consult with your own IT professionals. Refuse to invest a lot of money in a...
Data Cleansing vs Data Maintenance: Which one is most important?
There are always two aspects to data quality improvement. Data cleansing is the one-off process of tackling the errors within the database, ensuring retrospective anomalies are automatically located and removed. Another term, data maintenance, describes ongoing...
30 best tweetable quotes about Data Science
To inspire you, we've chosen some of our favorite tweetable quotes about Data Science to share with you. Read on to get inspired and share your favorites with others. The big technology trend is to make systems intelligent and data is the raw material. ~ Amod Malviya,...
Relational vs Non-Relational data bases – Part 3
In the first and second part of this blog series, we saw some basic differences between the scalability of Relational and Non-Relational Databases. In this post, I will show you how to use these databases correctly, and also tell you about some well-known companies...
Relational vs Non-Relational data bases – Part 3
In the first and second part of this blog series, we saw some basic differences between scalability of Relational and Non-Relational Databases. In this post, I will show you how to use these databases correctly, and also tell you about some well known companies that...
Four factors to consider before choosing a BI solution
How do you choose the right Business Intelligence and analytics tool for your organization, from countless vendors that all seem to offer similar features and make similar promises? Here are the four most important factors to take into consideration when vetting and...
(Big) Data in Data Lake vs. Data Warehouse – Interesting things to consider
Big data is used across verticals like Insurance, Healthcare, Manufacturing, Financial, Retail and more. Companies are using big data to improve top & bottom line revenue with business values. In this data-driven era, enterprise readiness and data management needs...
Advantages of NoSQL Databases – Everything you need to know
From the relational databases, that characterized the last two decades and more. NoSQL databases have gained popularity as a better method of data handling, and below are five reasons why: 1. Elastic Scalability In the past, the best DBA services still had to depend...
Statistics Denial Myths #5-6, Mischaracterizing Statistical Significance
This is the ninth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. Myth #5: For a large number of observations (Big Data: Volume), all the variables are significant so statistics does...
Two powerful concepts that define today’s new consumer
Today, there’s a lot of buzz around a few words. Data: the big, the small, the relevant. Social media, contextual marketing, going viral, and influencers. Digital advertising, mobile first, e-commerce. Everyone splashes around in the shallow end of tech trends. They...
Two powerful concepts that define today’s new consumer: Influence Mix and Choice Equation
Today, there’s a lot of buzz around a few words. Data: the big, the small, the relevant. Social media, contextual marketing, going viral, and influencers. Digital advertising, mobile first, e-commerce. Everyone splashes around in the shallow end of tech trends. They...
Crayon Data in the list of 15 Indian Big Data companies to watch out for
This article appeared on yourstory.com. As the data we generate every micro-second grows and accelerates at a rapid velocity, the requirement for making a business decision is shifting from hindsight-based decision making to a foresight-based approach. Companies are...
Top 10 Indian Data Scientists you should know
Education: Applied Mathematics, University of Maryland College Park Expertise: HPC, Statistical Techniques, Machine Learning, Data Mining Vertical: Government DJ Patil is one of the top global leaders of data science, who co-coined the term ‘data scientist’. He is the...
Interview With Digital Analytics Association Chairman – Jim Sterne
1) Tell me a little about yourself and how you got involved in digital analytics industry? When I first tripped over the Internet in 1993, nobody could tell me what made a website good, better or best. I spoke with everyone I could find that had something to do with...
The future of Business Analytics is in complex data
It is more than likely that you’ve already heard most of the business intelligence and analytics tropes by now: data-driven management, revealing hidden insights in your data, storytelling, etc. Everything you’ve heard isn’t necessarily wrong - certainly the world of...
A road map to become a Data Scientist
I receive a lot of questions regarding which books one should read to become a Data Miner/Data Scientist. Here is a suggested reading list, and also a proposed RoadMap(apart from the requirement of having an appropriate University degree) to become a Data Scientist....
How I chose the right programming language for Data Science
Which programming language should I learn for getting started in data science? That’s one of the most popular question for anyone who is getting started in data science. You have several programming languages to begin with. When I got started in the field of data...
Hong Kong has 'RISE'n
The Web Summit, billed as one of the “best tech conferences on the planet” by Forbes, has long been considered the gold standard in technology events. In July 2015, TWS decided to host its inaugural Asia-focused tech conference RISE in Hong Kong. And I got to go for...
Start with good science on good data, then we'll Talk 'Big Data'
We are currently witnessing a land rush of investment in Big Data architectures promising companies that they can turn their data into gold using the latest in distributed computing and advanced analytical methods. Although, there is indeed much potential in applying...
Interview with Andrew Hudson – From smart data to smart cities
Can you tell us a little about yourself and what you do? I am the Director of The Bartlett Centre for Advanced Spatial Analysis (CASA) at University College London and Professor of Digital Urban Systems. CASA is a unique lab - it is almost an entire University in a...
How to use the information collected for your business
The information collected by your business is likely to be stored on large servers, and you collect thousands of files a day. There is so much information that all the information cannot be used all at once, but your business can use the information at a right time....
A simple introduction to Data Science!
When you hear the term data scientist, what do you think of? If you’re like most people, you might think of something incredibly complex, with statistical terms and programming languages that are beyond comprehension. You might think that only Ph.D.’s in computer...
The one language every Data Scientist must master
When business leaders read about (and tackle) big data, there is a lot to take in. The field is growing so dynamically that many of the industry buzzwords would not have existed a few years ago. Just a short list of some programming languages is enough to make most...
Making sense of big data – Interview with Marketing Technologist Glenn Gow
Give us a short introduction about you. I am the CEO of Crimson Marketing, an author, a speaker, and an advisory board member. I am also the podcast host for money ball for marketing. I have been a marketing professional for over 25 years and have helped companies...
Every day has its dog
While the world has paw-marked just one day of the year to celebrate dogs everywhere, our endearing four-legged friends of Crayon may have a different tail to tell. We don’t necessarily need a day to honour the canine kind at Crayon. We celebrate them in small ways,...
Trends in India – Interview with leading data scientist Navin Manaswi
Navin Manaswi, a data scientist and a big data specialist with General Mills --a U.S.-based food company, shares insights on how they leverage data science to forecast demands of products. Give me an overview of how big data and analytics are being leveraged by Indian...
Why business strategy always trumps Data Analytics
There's a lot of hype in the business communities about data, analytics, cloud technologies, data science, and e-commerce. A cornucopia of jargon that emphasizes data (raw material) and its analytics spinoff (the service). Or is it emphasizing business? What came...
Free cheat sheet to become a successful Data Scientist
Big Data, Data Sciences, and Predictive Analytics are the talk of the town and it doesn’t matter which town you are referring to, it’s everywhere, from the White House hiring DJ Patil as the first chief data scientist to the United Nations using predictive...
New-age cab services, Venture financing and more
I took an Uber taxi ride last week to Indiranagar (Bangalore). My car was at the garage for repairs and I had a digital wallet balance to consume. The cab was a brand new Maruti Swift Dzire, and I was concerned that the man behind the wheel was just as new to driving!...
New-age cab services, Venture financing and more
I took an Uber taxi ride last week to Indiranagar (Bangalore). My car was at the garage for repairs and I had a digital wallet balance to consume. The cab was a brand new Maruti Swift Dzire, and I was concerned that the man behind the wheel was just as new to driving!...
The Rise Of The Chief Data Officer
Sometimes change has to be accompanied by numbers. That is the foundation on which the Big Data revolution is built. Without their reassuring presence, there would be little progress. Cold hard numbers are what make the world of business go round. Big Data is...
Interview with leading Data Science expert – Kirk Borne
We’d like to hear your story of how you got into data science. What motivated you to work in data science? As a professional research astronomer, I have always worked with data. For nearly 20 years, I worked with a lot of data in my day jobs: I worked on large...
Big bata, wearable tech and productivity in a workplace
Big Data offers huge opportunities to improve both our professional and personal lives. It allows us to draw conclusions that we would not previously have been able to quantify and gives certainty to decision-making where there was previously doubt. There is, however,...
Statistics Denial Myth #4, Rebranding Predictive Modeling
This is the eighth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. "The only useful function for a statistician is to make predictions, and thus provide a basis for action." — W....
Interview with Eric Siegel: A conversation about Predictive Analytics
Can you please introduce yourself? I am the founder of the Predictive Analytics World conference series, executive editor of The Predictive Analytics Times, and author of "Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die," a former Columbia...
Data makes us feel good (That is bad)
Sometimes it feels like “numbers” and “facts” have taken the place of feelings as our main decision-making mechanism. If our gut tells us one thing, but the numbers suggest another thing, many of us will be swayed by the cold hard facts. There is something substantial...
Three ways data-driven marketing drives higher ROI
At the heart of good marketing is data. And when data drives your marketing, the average return on investment (ROI) is a whopping 224%! (VB Insight) VB Insight surveyed over 3,000 marketers and looked at tools used on over 3 million websites. Even small improvements...
Statistics Denial Myth #3, Repackaging Statistics With Straddling Terms
This is the seventh instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. Myth #3: Data mining, machine learning, Big data analysis, business analytics, and data science are distinct from...
Big data meets design: Visual communication in big data
A chance encounter with Crayon's co-founder Srikant Sastri in Colombo in 2012, led to my introduction to Crayon's founder Suresh Shankar in Singapore. It took just a few meetings with Suresh, for me to realize that he is a visual story teller. In strict technical...
Big Data and privacy: big deal or not?
Big Data is trending, and will certainly remain so for quite some time, as I see it at least. And yes, Big Data does certainly open lots of possibilities and opportunities. No doubt about that. So let me be clear (especially since I am a lawyer): I am a big fan of Big...
Top 6 reasons why I love data and analytics as a fresher
I must confess that big data analysis wasn’t exactly on my radar when I started engineering at IIT Roorkee. In fact, I started out as a paper and pulp technology major. I soon lost interest in my regular classes and started to work on other projects instead. My first...
Why we chose Docker to build Crayon’s data processing platform
Historically, it has been a struggle for enterprise software vendors to control the deployment environment on their client’s installation base. Without proper control on the deployment environment, troubleshooting any issues on the client’s setup was a nightmare....
Big Data Analytics: A transformative and disruptive convergence of two strategic trends
There are two major developments tellingly touching and transforming the lives of people across the globe. The first one is that there is an unprecedented growth in data getting generated, garnered, and stored (data volume) followed by a significant increase in data...
Big data vs bad data: Impact on enterprises
This is the elephant in the Big Data room…. How much “Bad Data” is out there? Wait a minute, I hear you say, do you mean to say that not all of this data is accurate? What is the point of salivating over terabytes of Big Data if we don’t understand which bits are...
Using Twitter data to predict A&E visits in asthma
A model using big data from asthma-related tweets could help doctors target treatments and hospitals plan and make better use of resources by predicting asthma-related accident & emergency (A&E; emergency room) visits. The results are being published in the IEEE...
6 reasons why I love data and analytics
I must confess that big data analysis wasn’t exactly on my radar when I started engineering at IIT Roorkee. In fact, I started out as a paper and pulp technology major. I soon lost interest in my regular classes and started to work on other projects instead. My first...
Statistics Denial Myth #2, Traditional Practice Straw Man
This is the sixth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. Myth #2: Statisticians (and other quants), work within 'traditional statistics’ The myth that statisticians only...
7 skills and attitudes to become a better Data Scientist
Everyone in every profession and aspect of life should strive to become better each day. As the saying goes "Practice makes the master". Here I outline 7 skills/attitudes we can have to become better data scientists. 7 skills to become better data scientists...
Allreduce (or MPI) vs. Parameter server approaches
In the last 7 years or so there has been quite a bit of work on parallel machine learning approaches, enough that I felt like a summary might be helpful both for myself and others. In each case, I put in the earliest known citation. If I missed something please...
Top 7 machine learning techniques for Dimensionality Reduction
The recent explosion of data set size, in number of records and attributes, has triggered the development of a number of big data platforms as well as parallel data analytics algorithms. At the same time though, it has pushed for usage of data dimensionality reduction...
Big data in banking: Banks better see big data as an opportunity
Using Big Data in an efficient way is a crucial success factor for banks. Since banks have been sitting on a data gold mine, they have substantial capacity to turn Big Data into knowledge that can be used to unlock new revenue opportunities. There are a few banks that...
Inside a consumer’s mind with Text Analytics
In this post, I will walk you through an example on how we can choose a concept, extract what users write about this concept on Twitter, get insights on how consumers think/behave about it and finally group similar consumer thoughts and experiences using Cluster...
Statistics Denial, Myth #1: Traditional Techniques Straw Man
This is the fifth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. “You cannot reason people out of a position that they did not reason themselves into.” ― Ben Goldacre, Bad Science...
So… What is Deep Learning?
Imagine a baby coming into the world. From the moment she opens her eyes, there is a world of learning to absorb. Every action will create an imprint on her brain, and she will not stop learning until the moment she leaves the world. She develops because of her...
Sales Funnel visualization with R
Sales (purchasing or conversion) Funnel is a consumer-focused marketing model which illustrates the theoretical customer journey towards the purchase of a product or service. Classically, the Sales funnel includes at least four steps: Awareness– the customer becomes...
Statistics Denial, Best Statistical Practice
This is the fourth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. "I keep saying that the sexy job in the next 10 years will be statisticians" — Hal Varian "I keep saying that...
The data is in and it’s conclusive: America loved the marriage equality ruling
Depending on the sites you frequent and the social media you consume, you might think the Supreme Court's marriage equality ruling went over rather poorly. Maybe you spend a lot of time in the comments section of the National Review or have that one uncle from...
7 kinds of enterprises who will NOT choose Crayon’s choice engine (with 3 bonus ones!)
On the path to evangelising the concept of ‘Guided Choice’, Crayon Data has built its own choice engine Maya - in its quest to simplify the world’s choices. As I made my way into the APAC market, to drive sales for Crayon, I was met with a fair amount of apprehension...
Learn Market Basket Analysis and Recommendation Engines using real examples
A market basket analysis or recommendation engine [1] is what is behind all these recommendations we get when we go shopping online or whenever we receive targeted advertising. The underlying engine collects information about people’s habits and knows that if people...
Cohort analysis with R – "layer-cake-graph"
Cohort analysis is one of the most powerful and popular techniques available to marketers for assessing long-term trends in customer retention and calculating lifetime value. If you studied custora’s university, you would be amazed by the “layer-cake graph” they...
Should consumers in a Big Data world really stop whining about privacy?
David Brown, executive VP at Meredith Xcelerated Marketing, created a buzz last month when he published an article suggesting a 2015 New Year’s resolution for consumers. In “Consumers Should Resolve to Stop Whining About Privacy; Good Marketers Have Always Known Where...
Your privacy force Field for the Internet of Things
The Internet of Things will teach us all a broader view of privacy as much about what is coming at you as what is taken from you. Daniel Solove, the world’s greatest privacy influencer, just provided a beautiful summary of the wonderfully comprehensive and practical...
Applied Statistics is a way of thinking, not just a toolbox!
This is the third instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. Applied statistics provides our way of thinking and our approach to extracting the most information from numbers with...
Undeniable impact of big data on companies and their reputation
Big Data’s undeniable impact on companies’ goodwill and reputation has permeated the landscape of corporate valuation. Recent research confirms that companies need to face the new normal whereby corporate reputations suffer after mishaps with data under their control....
Shopping cart analysis with R – Multi-layer pie chart
In this post, we will review a very interesting type of visualization – the Multi-layer Pie Chart – and use it for one of the marketing analytics tasks – the shopping carts analysis. We will go from the initial data processing to the shopping carts analysis...
A data scientist is a hacker, programmer, analyst, story teller and artist!
Data science is being touted as the hottest career option in the 21st century. McKinsey Global Institute projects that somewhere between 1,40,000 and 1,80,000 data scientist jobs will open up by 2018 in the U.S. alone. Keeping in line with this forecast, the need for...
Internet of Things: Connecting anything and everything in Insurance
Companies want to innovate and release more and more new products faster and faster these days. This has led to machine-to-machine interactions replacing man-to-man interactions. Smart devices such as smart phones, laptops, and tablets have begun to outnumber the...
Three reasons why business users may want to learn Hadoop
Big data is a popular topic these days, not only in the tech media, but also among mainstream news outlets. Executives see Big Data as providing significant business benefits – greater insight and learning, the ability to obtain answers and make decisions faster and...
White Paper: How hotels provide amazing guest service using Big Data
Many hospitality companies are using big data today to understand trends and obtain additional customers. Many more hospitality companies want to comprehend the value of obtaining big data or correlating big data with data from their systems. For many years, hotels...
What is the best statistical programming language? – Infographic
A feature that all programming communities have in common is the numerous debates about why their programming language of choice is better, more advanced, faster, holier etc. In today’s data science community, it seems as if these discussions are omnipresent with...
Even doctors will be Data Scientists – Here is how!
We all know how it works. You walk into a doctor’s office complaining about some pain in your leg or otherwise. They take your temperature, get you on the scale, check your blood pressure, and perhaps even get out the rubber hammer. These measurements are simply...
Top 10 R packages for Machine Learning
Needless to say, R is one of the most efficient and effective tools for analysing and manipulating data for statistical purpose. To add to that, R being both inexpensive and beautiful, embellishes both the art of programming and proliferating the skill set of the...
Statistics denial, statistics debacles & the coming flood of statistical malfeasance
This is the second instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. There is a flood of statistical malfeasance heading this way. We are going to see more statistics debacles, like those...
Monetizing big data: Six recommendations to avoid pitfalls
When discussing how companies can capitalize on Big Data, we often hear about successful use cases that have helped companies achieve various business goals, such as improving sales and efficiencies, strengthening customer relationships, and providing better products...
Eight reasons why insurance companies should move to cloud
Cloud technology is nothing but hosting the applications, data storage, and software in a cloud and accessing it through internet so that it is made available to multiple users and reduces the local storage. The data or applications could be shared by multiple...
Some banks – quietly – use big data
Banks have been slow to use the data they possess, but now a few are venturing into big data, although without much fanfare. Abhi Mehta, CEO of big data specialist Tresata, said one problem is that most bankers don’t understand technology while IT people don’t...
Essays on Statistics Denial: Where do these myths come from?
UFO sightings, where do they all come from? Astronomers spend an inordinate amount of time scouring the skies. However, as far as we know, no credentialed astronomer has ever reported a UFO. None, zilch. Statistics denial myths, where do they all come from? We have...
Interview with Brian Clifton: Using Digital Analytics to follow the digital footprints
Brian Clifton PhD is internationally recognized as a Google Analytics expert, renowned author, measurement strategist and advisor. His best seller Advanced Web metrics With Google Analytics is considered to be the bible of Google Analytics. His second book Successful...
How the lack of the right data affects the promise of big data in India
Big data is the big buzzword these days. Big data refers to a collection of data sets or information too large and complex to be processed by standard tools. It is the art and science of combining enterprise data, social data, and machine data to derive new insights,...
Preparing for the coming flood… of statistical malfeasance
"The nonstatistician cannot always recognize a statistical problem when he sees one." — W. Edwards Deming "The key element for a successful (big) data analytics and data science future is statistical rigor and statistical thinking of humans." — Diego Kuonen For...
I thought of sharing seven simple Machine Learning concepts
It’s hard not to be fascinated by machine learning. It is overwhelmingly powerful. As former Microsoft CEO Steve Ballmer says, it is going to be the next era of computer science. There is a lot of excitement and buzz around machine learning. So, I thought of sharing...
Making data meaningful in major league baseball
My father played professional baseball for the Chicago White Sox and Cleveland Indians in the 1920’s and 1930’s. This was in the days of Ty Cobb and Babe Ruth, and long before anyone ever heard of computers or even the word, data. However, that did not mean the...
How to make a billion dollars from Big Data
Among the new faces making their debut on the Forbes 2015 billionaires list are a growing number who have made their fortunes from Big Data. These Big Data billionaires are at the top of their game – all of them have built empires on their ability to collect,...
Gephyrin: Big Data reveals secrets about human history and disease
Gephyrin is a protein that multitasks – it regulates receptors in the brain, it has been linked with epilepsy, Alzheimer’s disease, schizophrenia and other neurological diseases, and it means that the body can synthesize an essential trace nutrient. Using big data,...
Implementing the five most popular Similarity Measures in Python
The buzz term similarity distance measures has a variety of definitions among math and data mining practitioners. As a result, concepts involving the term and it's usage can go right over the heads of beginners. So today, I write this post to give simplified and...
Making sense of food data: Big Data knows what you should eat!
Maggi noodles is unsafe and it is banned! Every Indian and people all around the world must have heard of this recent fiasco over dangerously high level of lead and MSG levels in Maggi. Only, if it had proper Big Data tools, Nestle Maggi could have saved itself from...
Death of the funnel in the digital era: Big Data learnings for enterprises
If you are in the B2B space, you know that businesses are struggling with complex, rapidly shifting sales and market intelligence environment – data that is scattered and in silos, little visibility of future trends and an approach to demand generation that is as...
Big Data to prevent crime; cyber stop & frisk risk?
Even casual observers are well aware that Big Data is frequently used to create targeted ads, to recommend products for purchase by online shoppers, and to suggest connections on social networking sites. But people may not be aware that Big Data has become an...
Top 5 groups of Data Scientists: Which group are you in?
A data scientist is someone who performs statistical analysis, data mining and retrieval processes on a large amount of data to identify trends, figures and other relevant information and help a business gain a competitive edge. But, are all the data scientists same?...
How do TV marketers use data to target individual households for their ads?
User-specific advertising has become commonplace in online display marketing. You know the drill: you visit a website and see an ad for an item you were recently researching online but didn’t end up buying. This tactic—retargeting—is typically used by display ad...
How to drive customer engagement through ultra-personalisation
I was in New York recently, it was — 13°C, on a January morning. Being woefully unprepared for the cold, I immediately walked into the Uniqlo store on Fifth Avenue to check out their Heattech vests, long johns and socks. Much to my dismay, their long johns were out of...
Big Data: An important component of today’s data governance and corporate deals
The past few years have witnessed the unprecedented rise of Big Data. Fully 90% of today’s data was created over just the past two years. Businesses now double the amount of data they capture and store every 1.2 years. And, every two days, we create as much...
Big Data has the power to predict the exact time of your death
Have you ever thought Big Data could predict the time of your death? Recently, I encountered an App in Facebook which asked me certain questions like “how frequently do you exercise? Do you drink/smoke?” and then gave me a year when I will die. Many of you also would...
What everybody ought to know about a Data Scientist
A few years ago, The Harvard Business Review hailed the role of data scientist "The sexiest job of the 21st century”. But do you know what it means to be a data scientist? Well, let's first look into some of the most famous quotes by experts on data science and data...
How insurance industry can get a competitive advantage using Big Data
Big Data is not a new thing, but definitely a differentiating and an important thing to today’s businesses in gaining competitive advantage. Why is it a differentiating factor -- when everyone is using Big Data? Well, the differentiation lies in getting the right...
Banking needs to put emotion into customer experience!
There is more to a positive consumer experience in banking than the time it takes to do a transaction or the design of a mobile app. In a rush to innovate and improve channel delivery, most banks and credit unions have forgotten to take the time to think of how money...
Big Data changes the deal for corporate transactions
The past few years have witnessed the unprecedented rise of Big Data. Fully 90 percent of today’s data was created over just the past two years. Businesses now double the amount of data they capture and store every 1.2 years. And every two days we create as much...
Decoding Dimensionality Reduction, PCA and SVD
Every day IBM creates 2.5 quintillion bytes of data and most of the data generated are high dimensional. So it is necessary to reduce the dimensions of the data to work efficiently. One of the most common dimensionality reduction technique is filtering, in which you...
How to get a $50K+ job as a Data Analyst almost for free without a college degree
In today’s world, almost any information you could ever want to learn is now available for free or very cheap to anyone with a computer. Meanwhile, in the Western world, higher education (as with most industries that are primarily run by governments) is continuously...
Top 5 amazingly powerful Python libraries for Data Science
Have you decided to learn Python as your programming language? Then you should definitely know the different types of Python libraries to perform data analysis. In this article, we will see five amazingly powerful Python libraries for Data Science and best online...
Is Spark better than Hadoop Map Reduce?
For anyone who gets into the Big Data world, the terms Big Data and Hadoop become synonyms. As they learn the ecosystem along with the tools and their workings, people become more aware about what big data actually means, and what role Hadoop has in the big data...
Simplifying choices for the world
This article appeared on iesingapore.gov.sg Crayon Data, a Singapore-based big data company, is touted as one of the fastest growing in Asia. To date, it has raised US$7million in funding, and has also bagged prestigious industry awards such as the TiE Silicon...
The death of search and the rise of choice engines
Some 16 odd years ago, Google made search engines famous and ubiquitous. It’s sell-by date has come. Think about it. Search was the greatest thing in the world because it achieved Google’s wonderful vison of ‘organising the world’s information’. But now… what is the...
Big Data meets mobile – Personalised choices on small screens
With the emergence of multiple data-generating channels and streams, data is growing at an explosive pace. IDC, a market research firm, forecasts a 44-fold increase in data volume between2009 to 2020. This explosion in data volumes is mainly due to the increase in the...
Frequently updated Machine Learning blogs
Are you looking for some of the frequently updated Machine Learning blogs to learn what's happening in the world of Machine Learning and related areas that explore the construction and study of algorithms that can learn from data and make predictions or decisions?...
Big Data – Not just a matter of scale: 5 new trends and twists
Follow effective action with quiet reflection. From the quiet reflection will come even more effective action. Peter Drucker It is only when you reflect on your experiences do they translate into learning. And so, having been in the technology space for close to three...
How much of your customer’s data is actionable?
In one of my previous posts, I talked about how showrooming is causing offline retailers to lose business and how big data can help them attract and retain their customers. If they are your regular customers who have the store’s loyalty points card and if you’re...
Institutionalizing Big Data Strategy – Big Data … a Big ‘Change Management’
Capturing data-related opportunities to improve revenues and productivity requires not only new talent and investments in information infrastructure but also significant changes in the mind-sets and frontline training. For organizations that are just starting into Big...
How do you explain Machine Learning and Data Mining to a layman?
Suppose you go shopping for mangoes one day. The vendor has laid out a cart full of mangoes. You can handpick the mangoes, the vendor will weigh them, and you pay according to a fixed Rs per Kg rate (typical story in India). Obviously, you want to pick the sweetest,...
Privacy concerns, yes, but let’s look at the Cookie’s good side
The third party cookies' obituary has been written again with the recent media flap around Verizon’s use of super cookies, AT&T’s proposed plan to charge consumers separate rates for not tracking their internet behavior, Mozilla’s 2014 announcement that it will by...
10 Big Data startups in Singapore and India you should know
Big Data analytics has become one of the most vital tools for companies in the Internet, e-commerce, retail, banking, and insurance spaces that helps them target the right audience with customised and personalised solutions. Companies using analytics tools have seen...
Four insights from Predictive Analytics World, San Francisco
Co-located with Text Analytics World and the eMetrics Summit, this year’s Predictive Analytics World was an action packed event in the heart of San Francisco. With so much going on, it could be an exhausting, but rewarding way to learn from the world’s best...
Tracking customers’ shopping data: RFIDs, Barcodes or QR Codes?
For years now, bar codes have been a staple on merchandise of all shapes and sizes. With an incredibly low costs, bar codes have been the go-to method for tracking inventory in retail. However, RFIDs (radio frequency identification) are quickly rising in popularity....
Research papers that changed the world of Big Data
If you are looking for some of the most influential research papers that revolutionised the way how we gather, aggregate, analyze and store increasing volumes of data in a short span of 10 years, you are in the right place! These papers were shortlisted, based on...
Transforming customer feedback to customer delight in real-time
Businesses have been collecting feedback from their customers for a long time. Knowing if the customer is satisfied will help in retaining the customers and creating a sense of loyalty among them. Satisfying customers, improving their experience and delighting them...
What is Clustering in Data Mining?
Clustering is the grouping of a particular set of objects based on their characteristics, aggregating them according to their similarities. Regarding data mining, this methodology partitions the data implementing a specific join algorithm, most suitable for the...
Top 27 free Data Mining books for data miners
Are you looking for some free books to learn about Data Ming, a process of sorting through large data sets to identify patterns and establish relationships to solve problems through data analysis.? Here is an epic list of absolutely free books on Data Mining. Free...
Three golden rules to remember while choosing a visualization tool
Rule #1: No tool will turn you into a pro. Given the rapid development of visualization technology you might be tempted to adopt the latest technology thinking that it will turn you into a pro. This is not the case. There is no tool that can make you a pro, unless you...
Top 50 amazing graphic designers you should know
Inspiration: it makes your eyes wide and your brain start ticking. Most importantly, it’s a powerful force to drive new ideas. If you’re looking for inspiration for a graphic design project, there’s no better way to motivate yourself than to see good design in action....
Healthcare is facing radical new changes with data analytics, says report
A report on analytics in healthcare from CDW Healthcare indicates that the adoption of big data analytics technologies is a top priority for the majority of hospitals currently and the top motivational factors driving analytics are: the rising cost of healthcare...
Dice’s Salary Survey: 5 job markets for big data pros
Are you looking for tech professionals with right Big Data skills? Then you should know where to look to find professionals that hold these coveted skills. According to Dice’s Annual Salary Survey, the highest concentration of big data pros can be found in Seattle....
The surprising things you don’t know about Big Data [Infographic]
You’re probably familiar with the terms byte, megabyte, and gigabyte — but do you know what a terabyte is? How about a petabyte, or an exabyte? These lesser-used words describe units of Big Data, or data sets with sizes beyond the ability of commonly used software...
How does Data Crawling enhance operational efficiency?
The emergence of the digital revolution has led organizations to streamline a wide number of data sources and unstructured data. This revolution is driving the organizations to offer quick and accurate intelligence across multiple channels. The urge to move up the...
Visualizing your MP3 music collection
In this article we'll explore a neat way of visualizing your MP3 music collection. The end result will be a hexagonal map of all your songs, with similar sounding tracks located next to each other. The color of different regions corresponds to different genres of...
Five ways to get started with Big Data
Remember what life was like before big data? The term has become so prevalent in the business lexicon that sometimes it’s hard to remember that big data is a relatively recent phenomenon. Some may have viewed it as a fad, but data generated by people, processes and...
Using data analytics to improve diabetes prevention
Many companies and research groups are working to treat diabetes, but preventing the disease will have a greater impact on health in at-risk groups. A team of US researchers are using data analytics to create a precision medicine approach to prevention of diabetes...
Big Data regulation in insurance is about to cross a defining line?
We live in a new world where every individual is being tracked and recorded to an unprecedented extent! It's a world in which we are constantly being monitored in some way, often without us realising it. The huge growth in digital datasets and new analytical tools,...
Big Data – A challenge to traditional data warehouse or is it?
The growing significance of Business Intelligence (BI) is benefiting the market for data warehousing software. As a critical vehicle for delivering business intelligence, data warehousing enables consolidation of data from multiple sources with the aim of supporting...
At ITB, Berlin & GSM Mobile World Congress, Crayon Data prepares first showcase of ‘MAYA’
This news appeared on financialexpress.com Touted as one of Asia’s fastest growing big-data start-up companies, Crayon Data is all set showcase its flagship product ‘MAYA’ in two key European fairs in March 2015 – ITB in Berlin from 4th to 8th March 2015, and GSM...
Busting three myths of employee engagement and leadership (Whitepaper)
Doing more with less has become familiar to many of us—and our workforce is no exception. The World Bank estimates global GDP grew 2.3% in 2012, with expected continued moderate growth in 2013 (The World Bank, 2013). Much of this growth is driven by the human side of...
Oscar predictions: Comparing three mathematical models
Ben Zauzmer, a Harvard statistics whiz who has a 75 per cent success rate in predicting the winners of Oscar Awards every year, has correctly predicted 18 of 21 winners in 2015 Academy Awards with a success rate of 86 percent. Using his mathematical model, Zauzmer...
Who's responsible if artificial intelligence becomes a threat?
Will artificial intelligence be a threat to human existence? Some leading technologists, experts and scientists like including Elon Musk and Stephen Hawking believe that building artificial intelligence in humanity’s image will make it dangerous. However, theorist...
Ethical risks of detecting diseases with Big Data
In the past, there was no accurate way to track the outbreaks of diseases. It used to take weeks for the Center for Disease Control and Prevention's surveillance network to collect and process its data, but things have changed! Today, scientists at Google are now able...
RIP, Anand
It was with deep sadness and sorrow that we received the news of the passing away of our colleague and friend Dr. Anand Ramachandran this morning at 630 a.m IST in Delhi. Anand had been unwell for a while with a respiratory problem, and flew to Delhi about two weeks...
Top 10 data mining mistakes to avoid
Mining data to extract useful and enduring patterns is a skill arguably more art than science. Pressure enhances the appeal of early apparent results, but it’s too easy to fool yourself. How can you resist the siren songs of the data and maintain an analysis...
Forecasting the fashion future: Big Data comes to rescue fashion designers!
For years, fashion industry has had previous data and intuition at its disposal to predict customer demands which is now becoming quite irrelevant considering the fast-changing fashion trends and the tough competition in the market. More so, with more and more people...
Big Data will one day replace political Pundits and strategists
Does Big Data have any role in politics? Can it help political parties improve their door to door campaigns based on people’s responses in social media or even predict the final result of an election? If you are haunted by these questions, here is the answer. By...
How Big Data is changing recruitment forever
It used to be said that employers made up their minds whether or not to hire a prospective candidate within 5 minutes of sitting down to interview them. It’s hard to say if this is true or not, but many people in positions with responsibility for hiring would probably...
Big Data – A new steroid in Tennis?
Gone are the days when the coaches used to sit and collect information during a live match and later looked for patterns and insights in the data that might help them make better decisions for future matches. Today, coaches have the two basic ingredients for sports...
Five tips to prepare for new Big Data regulations
The ‘right to be forgotten’ has made big headlines as Google and Microsoft rush to delete out-dated information in internet searches following a ruling by the European Court of Justice. But is UK business truly ready for the next wave of data reform which is...
Privacy and protection: Obama finds a flaw in Big Data
In the backdrop of ongoing tussle between the administration against tech giants like Apple and Google over people’s data privacy, President Barack Obama gave a one-on-one interview with Re/code on a wide range of technology topics and talked about the uneasy balance...
Big Data takes Indian Railway to a new level it deserves!
The very first train journey in India took place in the year 1853, when a fourteen carriage long train drawn by three locomotives covered 21 miles between Bori Bunder (Bombay) and Thane. We have come a long way since then, and the huge strides that the Indian Railways...
Building a Taste Graph: The basic principles
This is the second part of Vijaya Kumar Ivaturi’s earlier post Big Data - Not just a matter of scale: 5 new trends and twists. In my previous post, we have discussed about five new trends, twists and some key differences in big data analytics in terms of its...
A Taste of Choice: Building a Taste Graph
This is the second part of Vijaya Kumar Ivaturi’s earlier post Big data analytics – Not just a matter of scale. “It is in the above context that the recent advances in recommender systems need to be viewed. The use of graph based systems for solving social and...
How to integrate Big Data into marketing: Five common applications
Knowledge is power. When it comes to knowledge about the people you are trying to sell to, it is even more powerful. Marketers know this and this is why the advent of big data has been a major blessing for them over the past few years. The tech-driven world of big...
Top 5 best choices of Business Management software
Whether the company you are running is large or small, it is essential that you stay on top of your day-to-day responsibilities. The right software can play an important role in boosting efficiency in the workplace. We have done the hard work comparing the different...
White House examines concerns over Big Data and price discrimination
The White House has released a report titled "Big Data and Differential Pricing" which examines the concern that companies use the consumer information to charge different prices to different customers -- a practice that economists call price discrimination. The...
Putting data to work to create seamless circular commerce [White Paper]
How can retailers transform Big Data into uber-relevant oers that make a customer’s purchase activities highly predictable and increasingly profitable? It’s not by focusing on which channel initiated the shopping journey: Rather, today's mobile-enabled customers’...
Top 15 Indian Big Data companies to watch out for in 2015
As the data we generate every micro-second grows and accelerates at a rapid velocity, the requirement for making a business decision is shifting from hindsight-based decision making to a foresight-based approach. Companies are banking upon Big Data and analytics. ...
What are the differences between Business VoIP and Cloud phone system?
Often people think that Business VoIP (Virtual PBX) and Cloud Phone Systems (Hosted PBX in the cloud) are one and the same. Despite the fact that both the business phone systems help lowering your TCO (total cost of ownership) than an on-premises phone system, they...
Big data analytics – Not just a matter of scale
Follow effective action with quiet reflection. From the quiet reflection will come even more effective action. Peter Drucker It is only when you reflect on your experiences do they translate into learning. And so, having been in the technology space for close to three...
Top 12 common problems in Data Mining
The amount of data being generated and stored every day is exponential. A recent study estimated that every minute, Google receives over 2 million queries, e-mail users send over 200 million messages, YouTube users upload 48 hours of video, Facebook users share over...
Big Data & AI can help you find a good friend and true love
There are moments in life when you favorite that you just met someone who has exactly the same tastes as yourself. About a decade ago, if you see someone in a coffee shop or on the bus reading a book which is in your top 10 list, you could approach them and kick-start...
4 best open source business intelligence tools for Analytics
There are plenty of open source business intelligence and reporting tools that help organizations gather, store, access and analyze data to make better decisions. Typically, BI tools integrate data from across the enterprise and provide reliable information and...
Three ways to overcome the lack of right data in India
The digital footprint of society is expanding the world over into fragmented mediums (blogs, tweets, reviews etc) and technologies (mobile, web, cloud/SaaS etc). Data generated from mobile devices and the internet of things are the main contributors to this data...
Top 10 heatmap analytics tools for marketers
Heatmaps are the best means to visualize complex data sets. Used to easily understand and analyze large amounts of multi-dimensional data, they are the simple graphical representation of data in which values are represented by colours. In this article, we present top...
Crayon Data looks to scale up presence in Europe, US and Middle East
This news appeared on Financial Express. Crayon Data is set to scale up its presence in Europe, US and Middle East as part of its 2015 market strategy, after making substantial inroads in developed markets. Accredited as one of the most successful and innovative big...
Top 15 social media analytics tools for marketers
Social media analytics tools are like life-sustaining organs for marketing professionals, as they are the simple ways for them to identify what’s happening around them in the digital world, especially in social media channels. Before they spend even a single penny...
The Death of Search
Some 16 odd years ago, Google made search engines famous and ubiquitous. It’s sell-by date has come. Think about it. Search was the greatest thing in the world because it achieved Google’s wonderful vison of ‘organising the world’s information’. But now… what is the...
Top 10 interesting facts & tips about MySQL
MySQL is the fastest growing open-source relational database management system with 100 million downloads till date. It is a popular choice of database for use in web applications and is currently used by many large websites, including Facebook, Twitter, Wikipedia,...
Digital transformation: how banks are cashing in
Consumers are increasingly valuing what these ‘non-bank banks’ have to offer: Accenture has found that one in five consumers would be happy to bank with PayPal – a firm born in Silicon Valley, not in the Square Mile. There is increasing pressure on banks to remain...
Three steps to become an “Analytics Superstar”SAUR
The value of analytics education is skyrocketing – thanks to the raising need for analytics professionals to process and analyze the vast amount of digital data being generated everyday by individuals and companies. Plenty of degrees, software tool trainings, online...
Do you know how e-commerce websites recommend you things?
Do you know how e-commerce website are able to predict and recommend products that a consumer is more likely to buy? Well, the trick lies in their recommendation engines! A recommendation engine is a system which helps people choose what they want, in an easy and...
The O Alliance Announces Newest Affiliate: Crayon Data
his news story appeared in Yahoo News NEW YORK: The O Alliance today announced the addition of Crayon Data to its network of world-class, transformational Affiliate members, with expertise in key areas designed to support retailers’ efforts to unlock value and achieve...
15 best books to learn Probability & Statistics
Probability theory is the mathematical study of uncertainty. It plays a central role in machine learning, as the design of learning algorithms often relies on probabilistic assumption of the data. Now, are you searching for some good books in Probability to read? Here...
Personalizing the travel experience with Big Dataanki
Not much time has passed by when we were all praying for the Malaysian Airline MH-370 to be found. Thanks to Big Workflow (a tool based on Big Data), DigitalGlobe, Tomnod.com and obviously the search team, who although couldn’t save the passengers but helped to give...
Is Big Data a game changer for offline retail stores?
Remember the time you went to an electronic shop near you to see how it feels like to hold a Samsung Galaxy Note 2 with a 5.55 inch touch screen and what titanium grey looks like? Or to a branded garment store to see for yourself the difference between crimson and...
Crayon Data launches knowledge tank for all things big data
Appeared on Financial Express Big data is driving innovation, business success and job opportunities everywhere on a large and rapid scale. Most often, big data professionals, investors, job seekers and students are clueless on where to look for the right information,...
Top 7 myths about Data Analytics Outsourcing in India
In 2001, the Knowledge Process Outsourcing (KPO) industry in India had only 9,000 professionals and it generated approximately USD 260 million in revenue. By 2007, it grew over to 75,000 professionals and in 2014, to 166,000, generating annual revenue of USD 6.21...
Popular web analytics tools for online businesses
Web analytics tools are used by online businesses and market researchers to collect and measure web traffic data for the purpose of understanding and improving the effectiveness of a website. The most commonly used metrics in web analytics reports are: unique...
Are you planning to quit? Big Data knows it before you do
Are you planning to quit? Think twice before you actually quit, because Big Data already knows it and can inform your boss before you do it. How is that possible? Workday, a company sells cloud-based HR and finance softwares, is in the final process of launching a new...
Big Data: The secret ingredient for food companies?
All food companies face an interesting dilemma: How to understand the tastes and needs of their consumers? When it comes to food or snacks, tastes and preferences vary so much that it is hard to have one single strategy that meets everyone’s needs. Besides, customers...
Key Big Data predictions and trends for 2015
2014 was big for big data and 2015 is going to be even bigger. There are lots of predictions coming about big data technologies in 2015 and here is a look at some of the key predictions by big data experts around a globe. Customers will gain more control over the use...
The search for Long Johns in cold New York
It is minus 13 °C in New York City (with the wind chill), and I feel woefully unprepared for the cold. I immediately head to the Uniqlo store on 5th Avenue - to check out their Heattech vests, long johns and socks. They are out of long johns. A sales associate tells...
Big data meets mobile – Simpler choices on smaller screens
As we begin our journey in 2015, here are a few thoughts on big data trends for mobile devices. In the age of more, we may soon see the twilight of search 15 years ago, the defining problem of the Internet age was how do I find the information I need? This gave birth...
Data Science: Frequently Asked Questions in Quora
Data Science. It is the most glamorous job in the world of Big Data today. There is a huge boom in the number of people employed as data scientists over the last few years and this trend is forecast to continue. Naturally, job seekers have tons of questions about this...
Is 2015 truly ‘The Year of Big Data’?
Will big data transform education in 2015? Will big data make government more transparent? Will big data and analytics make tremendous progress this year in the form of emerging technologies, adoption of data-driven decision making, and scientific breakthroughs? Will...
Big data meets mobile: simpler choices on smaller screens
As we begin our journey in 2015, here are a few thoughts on big data trends for mobile devices. In the age of more, we may soon see the twilight of search 15 years ago, the defining problem of the Internet age was how do I find the information I need? This gave birth...
The Best Data Visualizations of 2014
It's always tough to pick my favorite visualization projects. I mean, it's a challenge to pick and rank your favorite anything really. So much depends on what you feel like at the time, and there's a lot of good work out there. Nevertheless, I gave it a go. These are...
You Need an Algorithm, Not a Data Scientist
Mark Twain once said: “The past does not repeat itself, but it rhymes.” Although future events have unique circumstances, they typically follow familiar past patterns. Today, data scientists can predict everything from disease outbreaks to mortality to riots. It’s no...
EmployABILITY – A perception changing experience
Crayon Data recently participated in EmployABILITY – a job fair for differently able people. We were one among the 35 companies (J P Morgan, Reliance, Wipro, PayPal etc.) who participated in the event, looking for the candidates suitable to their requirements. As many...
9 qualities that make you a really good data scientist!
The term data scientist has been used lately to describe a wide variety of skills & roles. In this post I will focus on a particular flavor of data scientist. I will talk about the qualities needed to be a good data scientist-engineer who ships relevance products to...
Is Big Data a game – changer for businesses and travellers?
Data has become an integral part of our society today. Widespread use of the Internet, social media, location-based services, and multimedia are contributing to the ever-growing data explosion that is generating information about people, their preferences, likes and...
Irish flair + start-up energy, fuels the Web Summit
Jottings from the Web Summit (November 4-6, Dublin) Four of us from Crayon Data attended the Web Summit for the first time this year. Unsure of what to expect when we went in, it proved to be an unforgettable experience – here are some perspectives. A watering hole...
Bridging the gap between talent and big data analytics
his article, written by Crayon co-founder Srikant Sastri, appeared on InformationWeek. Big Data is a wonderful idea; it can revolutionize the way organisations work and solve problems. In order to turn this phenomenal idea into a reality, organizations need to gear up...
How Hospitality Industry is Leveraging the Big Data?
Appeared on hospitalitybizindia.com Data has become an integral part of our society today. Widespread use of the Internet, social media, location-based services and multimedia are contributing to the ever-growing data explosion that is generating information about...
Future Of e-commerce: 5 ways to improve business with Big Data
Big data is the buzz word of 2014. But big data will really play an enormous role in e-commerce in the near future. Of course online retailers already using cookies to store data from the shopping cart to get information about the customer behavior and needs. IP...
22 tips for better Data Science
These tips are provided by Dr. Granville, who brings 20 years of varied data-intensive experience working with successful start-ups, small companies across various industries, and eBay, Visa, Microsoft, GE and Wells Fargo. Tips for better Data Science 1. Leverage...
Exploring 5 big data training programs
With big data expertise in high demand, both universities and private companies are ramping up their education programs and big data training. Gartner expects that the BDA market will have 4.4 million jobs available by 2015, but only about one-third of them will be...
Why becoming a data scientist is NOT actually easier than you think
I was just doing some late night reading and came across this article. TL;DR - You can take the ML course on Coursera and you're magically a data scientist, because three really intelligent people did it. I disagree. I'm not claiming the people referenced in this...
5 tips for making Big Data more successful in healthcare sector
Successful 21st century healthcare organizations do not thrive based on the intuition of a few brilliant leaders; rather, they become modern data-driven businesses. Delivering better care, fostering population health and greatly reducing the per capita cost of care...
Top 7 tips to succeed with Big Data in 2014
Just when you thought big data couldn’t get any bigger, it got bigger still. Regardless of its actual size, big data is showing its value. Organizations everywhere have big data of all shapes and sizes. They recognize the importance, the opportunity, and even the...
Embracing change – how banks are adopting digital innovation
Banks are embracing innovation both internally and through third-parties such as the start-up community, as they attempt to improve customer service and compete in an increasingly digital landscape. The finance sector has typically been conservative with regards to...
Top 6 guidelines to adopt big data for Finance
The big data revolution has dramatically changed the financial services industry. The following driving factors have motivated the need for financial sector companies to collect, store and analyze massive volumes of data: 1. Changes in the delivery of financial...
AlgoMost contest for Data Scientists: Forecasting social network dynamic graph
International Data Science platform “AlgoMost”, which held a competition early this year among more than 500 data miners and data scientists, has launched a new challenge for data scientists: Forecasting development of a social networks’ dynamic graph. The competition...
VoltDB survey reveals Big Data goes to waste at most organizations
In Q1, 2014, VoltDB polled database managers, analysts, administrators and other IT professionals about the databases they use, the results of their Big Data projects, and opinions about Big Data technology advancements. The 2014 Big Data Survey reveals that most...
Eye-opening facts everyone should know about Big Data
We surely see a lot of hype surrounding big data but I believe the following 25 facts speak for themselves and help to paint a realistic picture of the phenomenon we now call ‘Big Data’ - a phenomenon that is changing the world as we know it. 1. Every 2 days we create...
Three mistakes to avoid if you are new to Machine Learning
Machine learning (ML) is one of the hottest fields in data science. As soon as ML entered the mainstream through Amazon, Netflix, and Facebook people have been giddy about what they can learn from their data. However, modern machine learning (i.e. not the theoretical...
The history of business intelligence: The 2000’s and now
Our three-part Business Intelligence series has looked at the key developments in BI from the 1960’s all the way to the late 1990s. In the first edition, we focused on the way data storage changed from hierarchical database management systems (DBMS), like IBM’s IMS in...
How to mine medical literature with added automated reasoning
How fast can you read? Probably not fast enough to keep up with scientific papers published at a rate of almost two a minute, or catch up with the around 50 million papers sitting waiting to be perused in public databases worldwide. All is not lost, though – a team of...
Data Mining creates new cancer classification system
Data mining information from more than 3500 tissue samples has found a way to classify cancer into 11 subtypes, finding characteristics that are shared between tumours that arise in different tissues. These findings could help doctors predict patients’ outcomes and...
How Formula One teams using Big Data to get the inside edge
The back room in the Infiniti Red Bull Racing garage at the Formula One U.S. Grand Prix looks more like a NASA mission control room than it does a garage. There are more computer monitors than there are eyeballs in the room, where three days before the race, several...
Cross-Channel Data Critical to Financial Marketers in the Digital Age
Big data and digital analytics are creating new opportunities for financial institutions to revolutionize their approach to marketing. It’s now possible to understand consumers at an individual level and deliver a highly targeted experience with timely, relevant...
Big Data – The perfect pill to boost the hospitality industry
Over the past several years, we have heard so many definitions of Big Data; some say it’s a “collection of data sets so large and complex that it becomes difficult to process using traditional data processing applications”, while others say it represents “the...
Top 10 ways to improve your data center energy efficiency
Many organizations have seen their storage requirements explode over the last few years, with total storage capacity growing at a compound annual growth rate of 53%, according to IDC. With that growth comes a corresponding increase in storage-related energy costs, but...
Salaries of chief data scientists touch Rs. 1 crore in India
The title has been around for less than a decade, but already ‘data scientist’ is considered to be among the sexiest jobs of the 21st century. In India it is no different. Data scientists — the term was coined in 2008 by DJ Patil and Jeff Hammerbacher — are a rare...
Nostradamus on Big Data: 5 predictions
It's almost 450 years since Nostradamus wrote his best-seller, 'Les Propheties, and gave everyone sleepless nights ever since. What predictions would he make today about Big Data in the 2015-2020 era? Prediction#1: The oppression "The hapless consumer will be troubled...
How Big Data helps me find my shoes!
I just got an email from an ecommerce website: they are offering a discount of 30% over and above the regular discounts for this weekend. I decided to check the site – on my phone – for a pair of casual shoes that I’ve been planning to buy. There were 3640 options –...
4 important questions that will change Machine Learning in coming decade
Over the past 50 years, Machine Learning has grown from the efforts of a handful of computer engineers, exploring whether computers could learn to play games, to a broad discipline that has produced fundamental statistical-computational theories of learning processes....
Top 20 questions you should always ask a Data Scientist
We all have our doubts about data and data scientists seem to know all the answers. These are the questions you should ask if you ever find a data scientist and trigger a good conversation. 1. What is the biggest data set that you processed, and how did you process...
9 ugly lessons about sex from Big Data!
Big Data: the friend you met at a bar after your usual two drinks, plus one. You leaned in, listening more intently than usual. “Digital footprint.” “Information Age.” You nodded and smiled, even though you didn’t understand. “Change the world.” “The future.” You were...
Top 5 things recruiters should ask their Big Data
Recruiting rockstars is almost as critical to the future of a business as having an amazing product offering that meets a critical market need. The human capital of any company truly is one of its most valuable assets. But unlike the technological advances in...
Are there four different types of Data Scientist?
Part of the field of predictive analytics has recently been thrust into the spotlight under a new name: Big Data. As specialist recruiters in this fast developing sector, we often fulfil an educational role with our clients – helping them define role requirements and...
9 online tools that use Big Data analytics for empowering consumers
Retailers use big data to extract as much money from the consumers as they can. For consumers, doesn’t it make sense to have ready access to the right kind of information, which enables them to make smart purchase decisions. Knowing how much to pay in order to consume...
Three simple steps to incorporate data into your marketing strategy
Data is definitely a game-changer. It opens up newer opportunities for letting you save money, save time or make more money. Effective use of data can aid in decision-making or help optimizing processes for leveraging your resources to their maximum. Big data and...
Why do we need Data Science when we’ve had Statistics for centuries?
Data Science is emerging as as one of the hottest new professions and academic disciplines in these early years of the 21st century. A number of articles have noted that the demand for data scientists is racing ahead of supply. People with the necessary skills are...
7 important things you must know about Big Data before adoption
There is absolutely no doubt that the right use of big data helps businesses become more profitable. But for this to happen, there are things businesses must know. Big data is the hottest technology trend going around right now. Crunching, analyzing and evaluating...
How to fight claims fraud with big data?
In today's highly competitive marketplace, most insurance companies have already streamlined their operations to optimise cost structures. Commoditisation of markets and lower investment returns are keeping pressure on insurers to tightly manage expense ratios....
How does employees’ personal data transform HR?
Big data will soon become an important part of the HR toolkit, according to a new report by the PwC consulting firm, bringing to workforce management the kind of data profiling many businesses currently use to zero in on customers. That may make privacy advocates...
Three simple ways to apply context to your enterprise data
Technology is a marvelous thing. There is more computing power in your pocket right now than was used to land men on the moon. Advanced computer and software technologies can predict natural disasters, stop crime and even drive driverless cars. Artificial intelligence...
Can you find true love through big data?
The history of the algorithm for dating websites date back to mid-1960s, where there was a computer service, where participants punched holes into a set of questions and a computer processed the questions from different participants and returned matches. The first...
Top 20 Big Data jobs and their responsibilities
Big Data is spreading much excitement in the IT job market worldwide and according to Gartner, by 2015, 4.4 million IT jobs globally will be created to support big data, generating 1.9 million IT jobs in the United States alone. Check out our list of top 20 Big Data...
What is Big Data: Definitions from 40+ thought leaders
“Big Data.” It seems like the phrase is everywhere. The term was added to the Oxford English Dictionary in 2013, appeared in Merriam-Webster’s Collegiate Dictionary by 2014, and Gartner’s just-released 2014 Hype Cycle shows “Big Data” passing the “Peak of Inflated...
Can Nanotechnology and Big Data be the next industrial revolution?
A report, commissioned by the Lloyd’s Register Foundation, found that nanotechnology will have a far reaching impact on almost every industry including energy, transportation, manufacturing, medical, computing and telecommunications. It also said the engineering...
Top 13 big data companies that offer food resilience innovations
Can Big Data offer the most fertile solution for countering systemic food waste and frightening future scarcity scenarios? Last month Microsoft, Amazon Web Services, Coca-Cola, Nestlé and dozens of other companies started sowing the seeds for a crop of powerful...
Big Data used mostly for Business Intelligence in India: Survey
Majority of the decision makers in Indian enterprises have ranked Business Intelligence as the major use of Big Data. They also agree that cloud computing and Big Data can give significant impact for their business. According to a survey by online education company...
Big Data and the pursuit of the body’s hidden drugs
Here are a few facts about Berg, a pharmaceutical and diagnostics company headquartered in Framingham, MA, that seem calculated to set off all the alarm bells in the head of a skeptical observer: The president and CTO, Niven Narain, claims that his company can cut the...
Seven common problems of scaling Hadoop
Every Hadoop implementation encounters the occasional crisis, including moments when the folks running Hadoop feel like their hair is on fire. Sometimes it happens before you get to production, which can cause organizations to throw the Hadoop baby out with the...
Top 20 most effective Predictive Analytics softwares
Predictive analytics is a technique in advanced analytics used to predict trends and behaviour patterns for unknown future events by analyzing massive amount of both structured and unstructrued data. It uses many techniques from data mining, statistics, modeling,...
Top 10 worst practices to avoid in Business Intelligence
Business intelligence (BI) has great potential in transforming the raw data into meaningful and useful information for businesses to identify, develop and create new strategic business opportunities. But, the right use technology plays a critical role in the success...
5 red flags that signal your business is not ready for Big Data yet
Big data has become the big thing recently and seems to be all anyone is talking about (besides it being the year of mobile, of course). By "big data," we mean a concentrated effort to gather intelligence about your business so you can accomplish a deeper analysis....
5 questions all marketers should ask their Big Data
We hear this often: big data means big headaches for marketers due to the overwhelming volumes of information that are hard to sort through to find the right data that is then actionable. In many organizations, only a data scientist or analyst can make sense of this...
Global hadoop market is expected to reach $13.95 billion by 2017
According to a new market research report, Global Hadoop Market - Industry Analysis, Size, Share, Growth, Trends, and Forecast 2012 - 2018, published by MarketsandMarkets, the total Hadoop market, which had an estimated value worth USD 1.5 billion in 2012, is expected...
Top three reasons Indian companies adopt Big Data technologies
A survey conducted by Qlik among 350 executives based in Mumbai and New Delhi found that while only 21% of respondents say they have implemented Big Data technologies, 42% said they plan to invest in Big Data technologies in the next 12 months. The survey also found...
What’s your definition of ‘digital’ in banking?
A recent post by Jin Zwicky, VP of Experience Design at OCBC Bank, on the Next Bank Facebook forum asked, “What’s your definition of ‘digital’ in banking?” It has attracted more than 100 comments from the world’s top banking innovators, sharing their thoughts on the...
Mindshare partners with Crayon Data to boost its planning
Mindshare, the flagship media agency of GroupM, has forged a partnership with big data company, Crayon Data to power its planning, insights and consultancy offering. The partnership will help in rolling out adaptive solutions for marketers, providing the ability to...
Big Data – An ultimate weapon in the field of sports?
Sports has always been associated with tons of statistics about players, teams, and performances, and this information has been used to a limited extent in the past to improve games. Today, the picture is completely different thanks to big data, the technology that...
8 important things to remember while mining data
1. Having a clearly-defined and measurable objective for a project in mind Data mining is often a difficult and time consuming task. Hence, not having a clear idea how to mine the data will severely affect the project’s focus. So having a clear idea of what, how and...
8 critical things to remember in Data Mining
Data mining is the process of sorting through large data sets to uncover hidden patterns and relationships in data which can be used to make predictions that can impact businesses. The benefits of data mining vary depending on the goal and the industry. Companies in...
Applying Big Data using Predictive Analytics: Do’s and Don’ts
A recent survey by SAS, the provider of business analytics and business intelligence software, shows the number one reason organizations are not planning on implementing Big Data is their lack of understanding of how Big Data applies to their business. The solution is...
How Big Data helps us in the fight against crime: Beyond ‘Minority Report’
In today's complex world, criminals are everywhere. There is a greater responsibility on law enforcement authorities than ever before to apprehend criminals even before they commit crimes. This idea of arresting people before they commit a crime was first featured in...
How Big Data helps us in the fight against crime: Beyond ‘Minority Report’
In today's complex world, criminals are everywhere. There is a greater responsibility on law enforcement authorities than ever before to apprehend criminals even before they commit crimes. This idea of arresting people before they commit a crime was first featured in...
How Big Data helps us in the fight against crime: Beyond 'Minority Report'
In today's complex world, criminals are everywhere. There is a greater responsibility on law enforcement authorities than ever before to apprehend criminals even before they commit crimes. This idea of arresting people before they commit a crime was first featured in...
Biggest big data security breaches since 2010
All businesses and organizations have legal and ethical responsibilities to safeguard their confidential data as well as their customers’ personal information, but data breaches happen all the time! According to the Online Trust Alliance's (OTA) 2014 Data Protection...
Digital transformation in Banking starts with consumer needs
The confluence of the financial crisis of 2008 and the rapid adoption of technology that puts increasing power in the hands of every consumer has resulted in higher demands being placed on financial providers. Today’s consumer expects their bank and credit union to...
Hadoop Glossary: 20 most important terms
This is a list of most important Hadoop terms you need to know and understand, before going into the Hadoop eco-system. [To read about top 10 most popular myths about Hadoop, click here.] Most important Hadoop terms Apache or Apache Software Foundation (ASF): A...
Most influential research papers every data scientist should read!
This is a list of some of the most influential papers in the history of Data Science. We’ve compiled these papers based on recommendations by big data enthusiasts in various social media channels. In case, we've missed out any important paper, let us know. The...
Predictive Modelling: Popular open source and commercial tools
Predictive modeling is a process of creating a statistical model to predict future behavior. It is more of the area in data mining forecasting probabilities and trends. A predictive model is made up of predictors which are factors that influence future results. For...
How to monitor migration trends using Big Data?
Monitoring migrations is not an easy task. While in today’s economy, survey data about economic confidence or public opinion are collected on a daily basis, that is not the case for migration statistics, which come from Censuses, population registers, and,...
How to solve California’s wildfire Epidemic? Just wire up all trees with Big Data!
California is currently in the grips of a major drought, one of the worst of this generation. The region's lack of precipitation has not only hindered California's agricultural industry, it's also turned our forests into tinder. But researchers at the University of...
Top 10 best free Cloud Storage services for personal use
Are you looking top Cloud Storage services to store your videos, music, movies, photos and files and access them from anywhere on the go through internet? Here is our list of top 10 Cloud Storage services where you can keep your data safe and avoid the risk of a...
How much data do you need to invest in a Data Warehouse?
As companies collect more data and leave it stored in their source locations, whether it’s a CRM, ERP, or POS, they may reach a point where they want to consolidate all that data into a single, consistently structured location. The question, then, is at what point is...
Big Data in Life Science – Turning challenges into opportunities!
We live in an era of digital revolution. The result? Big Data. Typically, the word 'Big Data' refers to data sets so large and complex that they are difficult to process using traditional applications, it has the potential to impact almost everything around us....
Climate change is here to stay, says Big Data
By now, most scientists—97 percent of them, to be exact—agree that the temperature of the planet is rising and that the increase is due to human activities such as fossil fuel use and deforestation. But until recently, the jury was still out regarding the...
10 basic data visualization tips all designers should follow
Data visualization is the graphical representation of data. It provides an easy way to understand trends, outliers, and patterns in data by using visual elements like charts, graphs, and maps. It is an effective tool to communicate. But to realize their potential,...
6 key guidelines for consumers to prevent data breaches
Today, consumers can enjoy the convenience of electronic banking, e-commerce and ATMs, but as the volume of financial transactions on computer networks increases, so does the risk... In 2014 alone, a total of 431 breaches occured so far and it represents a 20.1...
How to prevent data security breaches? Best practices for businesses
Completely eliminating security breaches may not be possible, but that doesn't mean you shouldn't do everything possible to thwart attackers. Now let's consider some best practices for businesses to prevent data security breaches. 1. Employ defense-in-depth strategies...
Exhaustive list of companies that offer Analytics jobs in India
With more and more companies venturing into the world of Analytics, which was once dominated by telecom, healthcare, retail, and financial services, analytics industry in India has soared significantly in the recent years. With the digitization in this era and the...
Top 5 best countries to host your website for data privacy!
Here are some of the countries with the strongest data privacy laws for websites and the press. 1. Iceland Despite its economic issues following the Global Financial Crisis, Iceland is well-known for its strict data privacy laws. In addition to its excellent...
Learning more like a human: 18 free eBooks on Machine Learning
Machine Learning is a type of artificial intelligence (AI) that provides computer programs with the ability to learn, grow and change when exposed to new data, without being explicitly programmed. The process of Machine Learning is similar to that of data mining. Both...
Qlik Sense Desktop: a free next-gen data visualization tool from Qlik
Qlik QLIK, a leader in data discovery, today introduced Qlik® Sense Desktop, a free version of its next-generation data visualization application that delivers a simple drag-and-drop interface for business users to rapidly create interactive visualizations, reports,...
Neglected machine learning ideas
This post is inspired by the “metacademy” suggestions for “leveling up your machine learning.” They make some halfway decent suggestions for beginners. The problem is, these suggestions won’t give you a view of machine learning as a field; they’ll only teach you...
What is Business Intelligence? 20 popular definitions
The term "Business Intelligence" (BI) was originally coined in 1865 by Richard Millar Devens in the "Cyclopaedia of Commercial and Business Anecdotes" and Devens used it to describe how the banker Sir Henry Furnese gained profit by receiving and acting upon...
Top Facebook groups for Analytics, Big Data, Data Mining, Hadoop, NoSQL, Data Science
Facebook may not be a best place for professional, but like in Linkedin, it too has a good number of Big Data groups/communities/public forums that function to spread knowledge about technologies used to mine, manage and analyse data for businesses. This is our...
Using Big Data to map relationships between human and animal diseases
Researchers at the University of Liverpool's Institute of Infection and Global Health are building the world's most comprehensive database describing human and animal pathogens, which can be used to prevent and tackle disease outbreaks around the globe. The Enhanced...
Can big data be your big ticket to stock market success?
Big data could be used to predict how the stock of a certain company will fluctuate over time given the right information. Here’s how: Big data is being used for many applications and of that, finding trends in social media is a growing field in which big data is...
What is BI? Best books on Business Intelligence
We live in the age of data and data is powerful, if we make sense of it. Business Intelligence is a solution that helps us see what is hidden in data. It uses data about yesterday and today to make better decisions about tomorrow. As Swain Scheps defines it, "Business...
Big Data meets wildlife: Can Big Data save rare species?
Big Data has always been associated with business improvements, increased profitability and even the sentiment of customers towards a particular company. In reality, this is the absolute minimum of the potential that Big Data has. Often touted as an industry worth $15...
Data Security: A talk with Gregory Shapiro
As a key protagonist in the Big Data movement, Gregory Shapiro’s website KDNuggets has become one of the most influential places to find new information and developments within data. As a prominent figure in the data revolution, he has seen himself and his website...
12 best TED videos on Data Visualization
Visualization is critical to data analysis. Data by itself, consisting of bits and bytes stored in a computer hard drive, is invisible. In order to be able to see and make any sense of data, we need to visualize it. Watch these TED videos to get deep insights on Data...
Deep dive into NoSQL: A complete list of NoSQL databases
NoSQL is an alternative to traditional relational databases in which data is placed in tables and is useful for working with large sets of distributed data. It is designed to accommodate a wide variety of data models, including key-value, document, columnar and graph...
Creating a new marketing-finance relationships with advanced analytics
When Raja Rajamannar became CMO of MasterCard Worldwide in 2013, he moved quickly to transform how the credit card giant measures marketing. His artillery: Advanced Big Data analytics. MasterCard had always been a data-driven organization. But the real power and full...
30 thought leaders and influencers in Data Visualization
This list of top 30 thought leaders in Data Visualization is based on recommendations and opinions by visualization experts in various social media channels. The names are listed alphabetically. 1. Aaron Koblin Aaron Koblin is a digital media artist, best known for...
How airliner data improves weather forecasting
When severe thunderstorms, tornadoes, flash floods, or winter storms threaten the Washington region automated observations from airliners taking off and landing at airports as far away as Philadelphia give NWS forecasters a more detailed picture of what the atmosphere...
Exploring the world of data: A complete list of Big Data blogs
This list contains almost all frequently-updated Big Data blogs, belonging to a wide range of categories: Data Science, Data Analytics, Business Intelligence, Machine Leaning, Data Visualization, Data Mining, NoSQL, Hadoop etc. The blogs are arranged alphabetically....
A journey of 9 years to build an app that can mimic the brain!
Jeff Hawkins and Donna Dubinsky started Numenta nine years ago to create software that was modeled after the way the human brain processes information. It has taken longer than expected, but the Redwood City, Calif.-based startup recently held an open house to show...
Algorithm identifies rare genetic disorders from family pics
Oxford University researchers have developed a computer program that can diagnose rare genetic disorders in children simply by analysing regular photographs. The program works by recognising certain characteristic facial structures that can be present with certain...
Find your dream job: Top 10 Big Data job websites
If you are looking for a job in big data space, this would be the most important post for you... After all, jobs are something we all ultimately look for, right! So, here is a list of job websites for Big Data professionals. 1. AnalyticTalent.com 2. BigDataJobs.com 3....
5 ways Big Data is changing Real Estate
Real estate has traditionally been a game won or lost based on old-fashioned networking and shoe-leather style hard work — deeply dependent on timing, detecting trends and more than a little bit of luck. It may not be that way for much longer, however. Big data is...
Top 20 essential Hadoop tools for crunching Big Data
Hadoop is an open source distributed processing framework which is at the center of a growing big data ecosystem. Used to support advanced analytics initiatives, including predictive analytics, data mining and machine learning applications, Hadoop manages data...
5 things Big Data CAN do in cancer research
There’s a treasure trove of data locked away in medical records and scientific studies that, if liberated and used appropriately, could help to improve cancer care. Big data is not a new concept – it’s actually been changing the face of medicine for years. The best...
20 must read books for budding data scientists
A data scientist is a professional who connects the dots between the business world and the data world. Data science is the craft that a data scientist utilizes to make this happen. In other words, Data Science is a study which deals with identification,...
Visualizing data: Top 20 web based visualisation tools
Looking for a best web-based visualisation tools to visualizing your data? Here is a list of top 20 web-based visualisation tools. 1. Datawrapper Datawrapper is an open source tool helping anyone to create simple, correct and embeddable charts in minutes. It is easy...
5 R training programs for developers
There’s little surprise in seeing Java top the list of popular programming languages for 2014, but another language is gaining traction. R, the free software programming language and developer environment for statistical computing and graphics, cracked IEEE Spectrum’s...
Top 10 key things to remember while dealing with big data
Here are the 10 key things to remember when you deal with big data. 1. More is better, may be not always! When it comes to data, more is better, may be not always! Sometimes, "more" can be messy and too much irrelevant data makes it harder to get at what you're...
What is a data scientist? 14 definitions of a data scientist!
Data scientist is a person who has the knowledge and skills to conduct sophisticated and systematic analyses of data. A data scientist extracts insights from data sets for product development, and evaluates and identifies strategic opportunities. Other popular...
Big Data redefined: 13 ways to explain big data to a five-year-old
The definitive definition of big data from the experts for the kids (and adults, too). Jonathan Birch, Head of Architecture at NTT DATA "Imagine trying to finish the last page of your colouring book, but suddenly you find that you've got more crayons than you know...
Today's travellers want to travel the world in just one way – their own way.
Today's travellers want to travel the world in just one way – their own way. They want to: 1. put together their own unique travel experiences: the average traveler uses more than 10 sources at any step of the travel journey / booking cycle 2. tap into inspiration...
5 strategic tips to avoid big data failure
Following are five strategic tips for avoiding big data failure. In many cases, the advice pertains to any data management project, regardless of the size of the data set. But the advent of massive data stores has brought with it a particular set of pitfalls. Here's...
Case study: Big data improves cardiology diagnoses by 17%
The human brain may be nature’s finest computer, but artificial intelligences fed on big data are making a convincing challenge for the crown. In the realm of healthcare, natural language processing, associative intelligence, and machine learning are revolutionizing...
Top 10 must-read articles for big data experts from IBM Big Data Hub
This is the list of top 10 must-read articles from IBM Big Data & Analytics Hub for big data experts, seeking to leverage big data and analytics on an enterprise level. 1. Data warehouse augmentation, Part 1: Big data and data warehouse augmentation: Learn how to...
Top five advantages and challenges of NoSQL
For a quarter of a century, the relational database (RDBMS) has been the dominant model for database management. But, today, non-relational, "cloud," or "NoSQL" databases are gaining mindshare as an alternative model for database management. In this article, we'll...
5 fun facts you may not know about HBase!
Here are some facts you may not have known about HBase: 1. Many companies have had HBase in production for 3+ years: Large technology companies including Trend Micro, EBay, Yahoo! and Facebook, and analytics companies RocketFuel and Flurry depend on HBase for many...
Is hybrid cloud the right choice for your company? 10 questions to ask!
Hybrid clouds, which combine internal computing infrastructure with public cloud computing resources, are one potential solution to migrating to cloud computing. Consider these 10 questions to help you decide whether a hybrid cloud is the right strategy for your...
Top 24 best books on Data Mining and CRM
There are a lot of books about data mining and CRM. This list contains what I think are the best. 1. Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management Michael Berry & Gordon Linoff / Paperback / 2004 (Revised Edition) An excellent...
Top 26 popular techniques for analysing Big Data
There are many techniques being used to analyze datasets. In this article, we provide a list of some techniques applicable across a range of industries. This list is by no means exhaustive. Indeed, researchers continue to develop new techniques and improve on existing...
Does your HR department have a data scientist?
According to a recent report by SilkRoad, 65 percent of human resources professionals surveyed said one of the biggest problems faced by companies that don't have HR tasks "integrated with automated systems" is a lack of critical data and analytics. To solve this...
7 ways to hire a data scientist, the right way
If you're looking to hire a data scientist, you're not alone. Investment in big data is rocketing, and with it, the need for talented data analysts. Indeed, McKinsey predicts a 50-60 per cent shortage of data scientists by 2018 – and this is only in the US. There may...
Top 10 books to get started with Hadoop
These books are our recommendations if you are planning to start your Big Data journey with Hadoop, - an open source distributed processing framework which is at the center of a growing big data ecosystem. The books are listed in no specific order. 1. Hadoop: The...
Driving customer engagement in the virtual environment
"Driving customer engagement in the virtual environment”, authored by Crayon co-founder Srikant Sastri was published on the April-June edition of Asian Management Review Magazine.
20 questions you should ask while considering a visualization tool
Big data has become an increasingly popular, as more business users seek to leverage analytics for innovative improvements. But, without visual representations of big data, insights can be difficult to obtain. So, it is key to choose a right visualization tool. So,...
Top 12 most influential Big Data journalists you should follow on Twitter
This is our list of most influential journalists in Big Data. Follow them on Twitter to stay up-to-date on what's happening around Big Data space. 1. Quentin Hardy – New York Times 2. Kenneth Cukier – The Economist. Co-Author of "Big Data" 3. Steve Lohr – New York...
The Ten Commandments of Big Data
1. Thou shalt decide on a business problem before committing any time, money, or animal sacrifice to the project. 2. Thou shalt start small and build, committing not to cataloging the Internet on thy first project. 3. Thou shalt not spend unnecessarily. Open Source...
Introduction to R for Data Mining: 3 YouTube videos to learn R
Are you new to R? Are you planning to learn R by yourself? Watch these videos...
Learning Data Mining: 12 books on R
R is a free and widely used programming language for data analysis and statistics. It is a dynamically typed interpreted language that possesses an extensive catalog of statistical and graphical methods. In this post, we list 12 books to help you learn R and your data...
Big Data can predict risk of metabolic syndrome
Research published today in the American Journal of Managed Care demonstrates that analysis of patient records using state-of-the-art data analytics can predict future risk of metabolic syndrome. More than a third of the U.S. population has metabolic syndrome, a...
Robots can learn faster when fed a lot of data
A trio of research projects out of Cornell, MIT and the University of Washington highlight the promise of building robots that can learn to do the things we want them to, but also suggest that patience on behalf of programmers will be a real virtue. Like any...
Airlines get the most from Big Data to improve passenger experience & increase revenues
Big Data is something we hear a lot about in the travel sector. As airlines face increasing pressure from travellers to improve the standards of air travel and create a more personal experience, while at the same time being tasked with finding new ways of generating...
Top 33 most noted Data Scientists on Twitter
Do you follow these 33 most notable Data Scientists on Twitter? 1. Hilary Mason @hmason Data Scientist in Residence at @accel. I ♥ data and cheeseburgers. 2. John Myles White @johnmyleswhite Scientist at Facebook and Julia developer. Author of Machine Learning for...
What are the skill sets data scientists need to succeed?
Thousands of new data jobs will be created in the next couple of years, making “data scientist” one of the hottest emerging job titles. New data jobs will center on “analytics, data architects, data scientists [and] data modelers,” according to Inhi Cho Suh, Vice...
Data in crime fighting: Beyond Minority Report
When we discuss Big Data in crime fighting, the analogy of Minority Report, the 2002 Tom Cruise film, always comes up. This is the idea that it would be possible to predict who is going to commit a crime and when meaning that law enforcement can stop these crimes...
Top 25 most popular Data Science blogs
Looking for most popular, frequently updated and insightful Data Science blogs? Here is our list. The blogs are arranged in no particular order. 1. FiveThirtyEight 2. The Numbers Guy 3. Freakonomics 4. OKCupid 5. DataTau 6. Data Ranker 7. Beyond The Purchase 8. Data...
Learn Hadoop with 10 SlideShare presentations
Want to learn Hadoop? Watch these presentations on SlideShare to understand Hadoop HDFS, the MapReduce algorithm, the Pig Latin language, and the Hive SQL language. 1. Introduction to MapReduce, an Abstraction for Large-Scale Computation by Ilan Horn, Google...
Best LinkedIn groups all Hadoop experts should join
There are hundreds of Hadoop groups on LinkedIn, but these are the best ones you should definitely consider joining. Join them to learn about the latest happenings in the world of Hadoop, and engage in discussions with other professionals online. 1. Hadoop Users Group...
Download 30 papers on Machine Learning
Are you looking for some serious research papers on Machine Learning? Here you go...! 1. Optimized projections for compressed sensing 2. Multiscale sparse image representation with learned dictionaries 3. Robust face recognition via sparse representation 4. Feature...
Why is climate change big data’s biggest challenge?
Global sea levels are about eight inches higher today than they were in 1880, and they are expected to rise another two to seven feet during this century. At the same time, some 5 million people in the U.S. live in 2.6 million coastal homes situated less than 4 feet...
Big Data and its threat to The Fourth Amendment
John Villasenor, Professor of Public Policy at UCLA, recently projected that it will be possible for governments to record and analyze everything an individual says and does in the near future. In the wake of the NSA revelations you could argue this already exists, so...
Big Data and its threat to The Fourth Amendment
John Villasenor, Professor of Public Policy at UCLA, recently projected that it will be possible for governments to record and analyze everything an individual says and does in the near future. In the wake of the NSA revelations you could argue this already exists, so...
Big Data and its threat to The Fourth Amendment
John Villasenor, Professor of Public Policy at UCLA, recently projected that it will be possible for governments to record and analyze everything an individual says and does in the near future. In the wake of the NSA revelations you could argue this already exists, so...
Top 17 white papers on Data Science
Check out our list of 17 White Papers on Data Science! You can download them by clicking on the links. If we have missed any, please feel free to add. 1. Building Data Science Teams by DJ Patil (2011) 2. Next-Gen Data Scientists by Dr. Rachel Schutt (2013) 3. Keep...
Can Big Data save newspapers from extinction?
For four years I had the job growing up that a lot of young men had—I was a “paperboy” for the local newspaper, in this case The Pittsburgh Press. This was back in the Stone Age, as my kids would call it, before the Internet when the news actually came to your front...
Five ways to become an effective database administrator
Big data, machine data, small data, personal data, corporate data; data is everywhere and it's the centerpiece of so many businesses. The question is, who is looking after it? The explosion of data hasn't seen a corresponding growth in the size of IT teams, so it's...
Top 30 simple Data Visualization tools
Data visualization is the presentation of quantitative information in a graphical form. A data visualization tool turns large and small datasets into visuals that are easier for the human brain to understand and process. Now, are you looking for a simple tool to...
Top 30 simple Data Visualization tools
Data visualization is the presentation of quantitative information in a graphical form. A data visualization tool turns large and small datasets into visuals that are easier for the human brain to understand and process. Now, are you looking for a simple tool to...
Top 30 simple Data Visualization tools
Data visualization is the presentation of quantitative information in a graphical form. A data visualization tool turns large and small datasets into visuals that are easier for the human brain to understand and process. Now, are you looking for a simple tool to...
How to install a Virtual Apache Hadoop Cluster with Vagrant and Cloudera Manager
It’s been a while since we provided a how-to for this purpose. Thanks, Daan Debie (@DaanDebie), for allowing us to re-publish the instructions below (for CDH 5)! I recently started as a Big Data Engineer at The New Motion. While researching our best options for...
How to install a Virtual Apache Hadoop Cluster with Vagrant and Cloudera Manager
It’s been a while since we provided a how-to for this purpose. Thanks, Daan Debie (@DaanDebie), for allowing us to re-publish the instructions below (for CDH 5)! I recently started as a Big Data Engineer at The New Motion. While researching our best options for...
Top 35 invaluable books on Data Visualization
Are you a hard-core enthusiast of data visualization? Or a beginner, who wants to learn and be able to create more effective visualisations? Check out our list of 35 invaluable books you must read for better visualization. (Some books in the list might not be directly...
Top 10 most popular myths about Hadoop
Hadoop and Big Data are practically synonymous these days. There is so much info on Hadoop and Big Data out there, but as the Big Data hype machine gears up, there's a lot of confusion about where Hadoop actually fits into the overall Big Data landscape. Let’s have a...
Deploying Big Data To Recruit And Retain Talent
Big Data is the buzzword of the year. Every leader — whether they’re managing a small team or are at the helm of a multinational corporation with thousands of employees — is wondering how they can use Big Data to better get to know their people, to create a setting...
Deploying Big Data To Recruit And Retain Talent
Big Data is the buzzword of the year. Every leader — whether they’re managing a small team or are at the helm of a multinational corporation with thousands of employees — is wondering how they can use Big Data to better get to know their people, to create a setting...
AlgoMost Contest: Can you predict future company acquisitions?
Looking for a challenging Big Data contest? Well, here is one! International data mining platform AlgoMost has launched a new competition focusing on M&A (Mergers and Acquisitions). The goal of the competition is to predict what companies are more likely to be...
How to make better pricing decisions using Big Data
It’s hard to overstate the importance of getting pricing right. On average, a 1 percent price increase translates into an 8.7 percent increase in operating profits (assuming no loss of volume, of course). Yet we estimate that up to 30 percent of the thousands of...
Watson Mobile Developer Challenge Q&A: CrayonData
Did you miss the online streaming of Crayon founder Suresh Shankar’s presentation of Maya – Crayon’s Personal Choice Assistant, before IBM’s Watson Mobile Developer Challenge judging panel last month? Here is the Youtube video.
How brain science will change computing
Treo creator Jeff Hawkins urges us to take a new look at the brain — to see it not as a fast processor, but as a memory system that stores and plays back experiences to help us predict, intelligently, what will happen next.
How brain science will change computing
Treo creator Jeff Hawkins urges us to take a new look at the brain — to see it not as a fast processor, but as a memory system that stores and plays back experiences to help us predict, intelligently, what will happen next.
Top 10 LinkedIn groups every Data Scientist should join
Are you a busy data scientist, building mathematical models and machine learning algorithms to run experiments on massive datasets? And are you struggling to find a meaningful way to stay up-to-date? Well, here is a list of Top 10 LinkedIn groups for you to stay...
For the airline industry, big data is cleared for take-off
When a customer checks into a flight with United Airlines UAL 1.34% , there is typically an array of potential add-on offers to navigate through: flight upgrades, access to the airline’s United Club, and more. Under United’s old “collect and analyze” approach to data,...
Building a basic recommendation engine using R
In our day to day life, we come across a large number of Recommendation engines like Facebook Recommendation Engine for Friends’ suggestions, and suggestions of similar Like Pages, Youtube recommendation engine suggesting videos similar to our previous...
How does a Choice Engine overcome choice problems?
Consider a typical decision – you have just arrived in a new city after a 6 hour flight, it’s 6.30 PM and you want to get a decent vegetarian meal. What do you do?You fire up Google, search for good restaurants in that city, and filter them by type, price, location...
The Metaphysics of Big Data: The Problem of Induction
How do we, human beings, acquire knowledge? Think for a second! And don’t tell me that it is from text books, TV, internet or newspapers etc!!! Scholars say that there are mainly (debatably) five valid ways (Perception, Inference, Comparison, Verbal Testimony and...
How Data Visualization Helped Me Run Faster
Could you use a data visualization lift in your life and work? I never thought I'd be that guy who tracks his fitness data. But a few months ago I tapped on the Nike+ app on my iPod Nano and after about a mile I was a running data junkie. The lure of easy information...
37 colleges to fulfill your dream of becoming a Data Scientist
Are you looking into a career as a data scientist and to become one of the most sought-after people in Big Data landscape? Here is a complete list of colleges/universities that offer Data Science degrees. Click on the links to find more details about the courses. 1....
The Era of Cloud Computing
SynapDx searches hundreds of thousands of genetic markers, looking for clues about autism in 880 children across 20 states. A few years ago, this would be the task of a major company or research institution. Thanks to cloud computing, the start-up in Lexington, Mass.,...
Understanding the power of Hadoop as a Service
Across a wide range of industries from health care and financial services to manufacturing and retail, companies are realizing the value of analyzing data with Hadoop. With access to a Hadoop cluster, organizations are able to collect, analyze, and act on data at a...
70+ websites to get large data repositories for free
Do you require GBs of data to check the performance of your app? The easiest way is to download samples of data from free data repositories available on the Web. But the main disadvantage of this approach is the data will have very less unique content and it may not...
Top 18 free and widely used, open source NoSQL databases
NoSQL is a new breed of database management systems that fundamentally differ from relational database systems. These NoSQL databases do not require tables with a fixed set of columns, avoid JOINs and typically support horizontal scaling. They are also referred to as...
Free video tutorials on Data Mining
Looking for free video tutorials on Data Mining...? Here is a list of TOP 10 SOURCES that provide free Data Mining video tutorials on the Web. They explain how to perform data mining tasks (classification, clustering, association rule and sequential pattern discovery)...
Artificial Intelligence raises new hope for cancer patients
On Monday mornings, Bob Michaels walks into the infusion center at Weill Cornell Medical College in New York City and takes a seat in a comfortable barcalounger. An oncology nurse connects the port implanted in the retired university professor’s chest to a portable IV...
Artificial Intelligence raises new hope for cancer patients
On Monday mornings, Bob Michaels walks into the infusion center at Weill Cornell Medical College in New York City and takes a seat in a comfortable barcalounger. An oncology nurse connects the port implanted in the retired university professor’s chest to a portable IV...
Artificial Intelligence raises new hope for cancer patients
On Monday mornings, Bob Michaels walks into the infusion center at Weill Cornell Medical College in New York City and takes a seat in a comfortable barcalounger. An oncology nurse connects the port implanted in the retired university professor’s chest to a portable IV...
Medicine’s Big Problem with Big Data: Information Hoarding
Researchers at IBM, Berg Pharma, Memorial Sloan Kettering, UC Berkeley and other institutions are exploring how artificial intelligence and big data can be used to develop better treatments for diseases. But one of the biggest challenges for making full use of these...
Medicine’s Big Problem with Big Data: Information Hoarding
Researchers at IBM, Berg Pharma, Memorial Sloan Kettering, UC Berkeley and other institutions are exploring how artificial intelligence and big data can be used to develop better treatments for diseases. But one of the biggest challenges for making full use of these...
Medicine’s Big Problem with Big Data: Information Hoarding
Researchers at IBM, Berg Pharma, Memorial Sloan Kettering, UC Berkeley and other institutions are exploring how artificial intelligence and big data can be used to develop better treatments for diseases. But one of the biggest challenges for making full use of these...
We’re all being mined for data – but who are the real winners?
It's exactly a year since Edward Snowden's revelations about NSA and GCHQ surveillance began to reach the public domain. As a result, we now know quite a lot about the ways the NSA and its overseas franchises have mastered "big data" technology to hoover up our...
A Tour of Machine Learning Algorithms
After we understand the type of machine learning problem we are working with, we can think about the type of data to collect and the types of machine learning algorithms we can try. In this post we take a tour of the most popular machine learning algorithms. It is...
A Tour of Machine Learning Algorithms
After we understand the type of machine learning problem we are working with, we can think about the type of data to collect and the types of machine learning algorithms we can try. In this post we take a tour of the most popular machine learning algorithms. It is...
Why we’re all so obsessed with deep learning
Summary: Deep learning is all the rage among the tech scene right now, and that’s more a result of its utility than because it sounds cool. Some questioned the feasibility of the Secret Service’s requested “sarcasm detector,” but deep learning could help there, too....
Why we’re all so obsessed with deep learning
Summary: Deep learning is all the rage among the tech scene right now, and that’s more a result of its utility than because it sounds cool. Some questioned the feasibility of the Secret Service’s requested “sarcasm detector,” but deep learning could help there, too....
100+ interesting data sets for your data science
How about reading other people’s emails? Ever wanted to do that, but can’t be bothered to train l33t hacking skills (and never mind the legality of it)? (Okay, this one I have thought about.) Well, I’ve got you covered. 1. Check out the Enron corpus. It...
Download 12 Free eBooks on Big Data
Are you looking for eBooks to upgrade your knowledge in Big Data, one of the fastest trending stream in IT? Here is a list of 12 FREE eBooks you can download. Happy reading...! Big Data Now Publication: O'Reilly Media Author: O'Reilly Radar Pages: 136 Download Big...
Data and decision-making: Top 10 Big Data videos in Youtube
Why does Big Data matter to us, after all? Why should we use tools and mathematical models to analyse data – both structured and unstructured? It’s because we believe data can deliver insights, help us find patterns in human behaviour – that we cannot distinguish with...
How to harness Big Data to improve hotel and travel businesses
Over the past few years, Big Data has transformed the way the hospitality, travel and tourism sector (HTT) functions. It has lodged a new dimension of customer care in HTT by opening up mind-boggling possibilities — spurring a ‘paradigm shift’ from simply viewing...
50 selected papers in Data Mining and Machine Learning
Here is the list of 50 selected papers in Data Mining and Machine Learning. You can download them for your detailed reading and research. Enjoy! General Data Mining and Statistics: What's the Connection? Data Mining: Statistics and More?, D. Hand, American...
What does a Data Scientist do?
Data Scientists…! We hear about them everywhere around us and there is so much hype around data science, data scientists and the slew of accompanying technologies like Hadoop, Hive, Mahout, Hbase and with keywords like big data, machine learning, information...
What does a Data Scientist do?
Data Scientists…! We hear about them everywhere around us and there is so much hype around data science, data scientists and the slew of accompanying technologies like Hadoop, Hive, Mahout, Hbase and with keywords like big data, machine learning, information...
Re-Imagining the Store of the Future
A couple of months ago, on a trip to the US, I decided to replace my aging MacBook with a MacBook Air. I placed the order online, since I also wanted to soup up the memory and hard disk. While I was at it, I decided to order a “COVER” for the machine. Four days later,...
Who are the top 10 Big Data influencers in 2014?
Big Data has come a long way during the last few years, thanks to the many analysts, researchers, bloggers and innovators. These influencers have explored different ways of implementing big data to improve productivity and the quality of life in our modern societies....
What does a Data Scientist do?
Data Scientists...! We hear about them everywhere around us and there is so much hype around data science, data scientists and the slew of accompanying technologies like Hadoop, Hive, Mahout, Hbase and with keywords like big data, machine learning, information...
Why the future of retail will blow your mind
For the past few years, brick-and-mortar retailers didn’t have a fighting chance to compete with the personalization and convenience provided by online shopping. By cultivating mountains of rich customer data, online retailers had the upper hand. Every action and...
Top big data tools used to store and analyse data
BIG DATA is a term used for a collection of data sets so large and complex that it is difficult to process using traditional applications/tools. It is the data exceeding Terabytes in size. Because of the variety of data that it encompasses, big data always brings a...
30 thought provoking Big Data quotes that you should know
There are plenty of Big Data quotes on the web! But do you know which are the most powerful and thought-provoking ones? Here is a list of 30 best Big Data quotes that you should know. 1. "Big Data is like teenage sex: everyone talks about it, nobody really knows how...
Why your kids will want to be data scientists
In the days of yore parents pushed their children to pursue noble lucrative professions – doctor, lawyer, banker – but as times change they may soon encourage another career path: data scientist. Big data is being billed as the next big thing – the key to gaining a...
Search vs Choice – A new type of engine for a new kind of age!
Around 15 years ago, the defining problem of the Internet age was how I find the information I need? This gave birth to search engines and Google’s great vision of “organizing the world’s information”. A decade later, as Google continues to improve its search with...
Search vs Choice – A new type of engine for a new kind of age!
Around 15 years ago, the defining problem of the Internet age was how I find the information I need? This gave birth to search engines and Google’s great vision of “organizing the world’s information”. A decade later, as Google continues to improve its search with...
Search vs Choice – A new type of engine for a new kind of age!
Around 15 years ago, the defining problem of the Internet age was how I find the information I need? This gave birth to search engines and Google’s great vision of “organizing the world’s information”. A decade later, as Google continues to improve its search with...
Data Visualization for Dummies, a book every BI practitioner needs
In this era of big data and sophisticated analytics those tortured souls whose job it is to explain and inform have a big problem: How to to make understandable and actionable what the data reveals. The “traditional” methods of business intelligence (BI) show and tell...
Virtual Reality brings Big Data visualization to life
Data visualization tools have made it somewhat easier to glean intelligence from a mass of information. But today’s tools are still extremely inefficient, as they fail to incorporate the science of human visual perception into their data visualization techniques. This...
Virtual Reality brings Big Data visualization to life
Data visualization tools have made it somewhat easier to glean intelligence from a mass of information. But today’s tools are still extremely inefficient, as they fail to incorporate the science of human visual perception into their data visualization techniques. This...
Big Data and Analytics In Sports: A Game Changer
If there is one area in which big data is literally guaranteed to be a game-changer, it’s sports. Sports have for a long time been accompanied by a wealth of statistics – what’s different today is the amount of data and the multitude of ways that we have to analyze...
Big Data Banking Is Not Just for Big Banks
All banks, large and small, are swelling with data. The growth in data is not only coming from the traditional relational data stored in product and customer-servicing systems, but in voice call logs, emails, website click streams, and in social media sites. Data...
New Algorithm Turns the Emotion of Language into Music
The future of e-books, or any electronic text, may be soundtracked. A new experiment in automation is generating music in response to the emotion of words in literature. TransPose was created by Hannah Davis, a programmer, artist, and musician based in New York, and...
Business or Pleasure? – why not both: The Roadmap to ‘Hadoop in the Cloud’
The Twitter ball started rolling again just now. Matt Asay posed an interesting question about Forrester suggesting Hadoop isn't a great fit for the cloud. (Even) without context Vijay Vijayasankar and I started firing off questions and answers which inevitable led to...
Big data’s pivotal role in mitigating electronics counterfeiting
News surfaced in late 2012 that the U.S. Defense Logistics Agency (DLA) wanted to reduce the risk of counterfeit parts in its supply chain and issued an authentication-marking requirement for electronic microcircuits. "Implementation of this new requirement will...
Nine large problems with big data
Big data is suddenly everywhere. Everyone seems to be collecting it, analyzing it, making money from it and celebrating (or fearing) its powers. Whether we’re talking about analyzing zillions of Google search queries to predict flu outbreaks, or zillions of phone...
Leveraging Big Data To Improve TV Targeting Precision
Big data now represents the next step in improving television program selection and targeting precision. Merge, append, fuse and model are all terms that can bring increased precision for reaching high value prospects. These methods are discussed below: This is is a...
Data Science vs. Statistics – One in the Same?
I recently ran across a thought-provoking post on the USC Anneberg Innovation Lab blog – “Why Do We Need Data Science when We’ve Had Statistics for Centuries.” With all the debate of late surrounding the relatively new “data science” term, I’ve been thinking a lot...
Actually, Every Company Is a Big Data Company
Every day companies collect data about their customers and industries, simply as an artifact of the act conducting business. As I listened to a panel on Big Data yesterday at the MIT Sloan CIO Symposium in Cambridge, Mass., I had an epiphany: every company is a Big...
4 ways eCommerce merchants misuse data!
The use of customer data can help you make smarter decisions that can improve your store, enhance the shopper experience, and increase conversions. When used incorrectly, however, data can waste resources and alienate your visitors. Below are four ways that ecommerce...
Crayon Data gets global recognition
India (Chennai) and Singapore based Crayon Data has been declared winner at TieCon 2014 held at Santa Clara US, in which it competed with top 50 global technology startups, shortlisted from 2800 companies worldwide. The start-up has been getting attention lately at...
Big data? Internet of things? Sport of Kings inches into high tech
In Clare Balding’s autobiography My Animals and Other Family she relates the story of her father, a renowned horse trainer, telling an owner after Mrs Thatcher’s 1979 election victory that “it’s going to take a while to get used to a woman running the country”. The...
Despite Worries, Big Data Can Be Key For Student Success
The idea that a company is keeping tabs on a student's every computer click is a scary concept for parents. A recent article compared this monitoring to NSA spying and raised questions such as who gets access to the students' data and what will be its ultimate use....
Deconstructing Taste – The Crayon Way
Crayon’s product manager Ajay Kashyap explains how Crayon’s proprietary taste algorithm helps in understanding customer taste in a holistic way; not bounded by traditional constraints of category, availability, costs and location proximity, in conversation with...
Why you still don’t need a chief data officer
For those who have followed my writings on the subject of the chief data officer (CDO), you know well that I am no advocate of this role. Having endured one wave of hype after another on this subject and being that I just attended the CDO Summit in London, I felt that...
Big Data meets big-time basketball
Not long ago, if the Los Angeles Clippers had wanted to figure out how to best defend Warriors star guard Steph Curry, they might have sent a scout to a game or watched video clips. For their recent first-round playoff matchup, they had another way. As of this year,...
Big data needs to be more than just expensive noise
For all the vaunted potential of big data, the consumer benefits aren’t fully apparent yet. Netflix still recommends me movies I don’t want to watch, Spotify still nudges me towards bands I don’t particularly like and most of the companies targeting ads at me on...
How Wearable Tech Is Changing Exercise Research
The technology in fitness trackers is changing the way researchers study exercise, allowing them to gather much more detailed information about how people move throughout the day, experts say. The change is being driven, in part, by advances in accelerometers, the...
Do We Still Need Database Design in the Era of Big Data?
Many big data application implementations seem to begin with an existing data warehouse, one or more new high-volume data streams, and some specialized hardware and software to support data storage and business analytics. The data storage issue is often accommodated...
The future of Big Data is linked to Cloud
Data volumes are growing exponentially. Unstructured data from Twitter, LinkedIn, Mailling Lists, etc. has the potential to transform many industries if it could be combined with structured data. Machine learning, natural language processing, sentiment analysis, etc....
Big data decisions: Why C-level is wrong to tell IT to butt out
IT departments have been told so often they don't understand the business that many are now fearful of standing up against bad C-level technology decisions. That reticence, added to a lack of access for IT to top executives, is hampering businesses' ability to make...
Big data brings new power to open-source intelligence
In November 2013, the New Yorker published a profile of Eliot Higgins – or Brown Moses as he is known to almost 17,000 Twitter followers. An unemployed finance and admin worker at the time, Higgins was held up as an example of what can happen when we take advantage of...
Can big data predict the next cyber attack?
The battle to secure private data, whether financial information or intellectual property, may be won through big data analysis. That, at any rate, is what Bob Griffin, cybersecurity firm RSA’s chief security architect, thinks. “The ability to take massive volumes of...
Re-Imagining the Store of the Future – Part II
You are in a department store. After waiting in line, you get to the fitting room - and try out the outfit you've picked out. You love it, except…..it’s the wrong size. You now have to change back into your clothes - go out pick the right size, and get back to the...
Why Machine Learning Matters
Like it or not big data is here to stay. While some businesses may have been skeptical or intimidated at the prospect of incorporating big data into their operations, the reality is that without big data analytics, a company is likely to fall behind its competitors....
Beyond Big Data: Why Human Interpretation Still Counts
Many companies boast that they are "data driven," and rely heavily on customer information gathered from a variety of sources. But if you blindly follow that data, you'll miss the motivations behind it — the human emotions and factors that drive customers to make the...
Buyers, beware: The analytics field is consolidating
Most technology sectors go through a certain maturity cycle. At the beginning of the cycle a number of pure-play companies, flush with venture capital in their pockets, come in for the gold rush. Next, a few of them crash and burn while a few others gain revenue...
How big data is going to help feed nine billion people by 2050
To feed the world's rapidly-expanding population in the coming decades, agriculture must produce more. Big data holds one of the keys for farmers, but it's also a weapon that could be used against them. Dusty wooden stairs lead up to the barn office, which overlooks...
How Hollywood is reshaping Big Data visualization
Hollywood storytelling is reshaping the world Big Data. We’ve heard plenty about Big Data changing business, but here is an interesting angle on how the Hollywood business is reshaping Big Data. One great example comes by way of Tableau, the data visualization...
Defining Big Data
As the field of big data grows, increasing numbers are introduced to its concepts, and I often hear the basic question of “is my data big enough to be big data?” Seven terabytes? Seventy terabytes? Seven hundred? It’s too late now to change the name, of course, but...
Hadoop, big data, and the elephant in the room
In the 1800s, John Godfrey Saxe wrote a poem about six blind men and an elephant based on an old Indian story. In an effort to discover what the elephant is, each man touches a different part of the creature and subsequently draws his own unique — and incorrect —...
Analytics Will Be Embedded into Every Piece of Decision Making in Coming Years
What are the top trends seen in big data analytics space in India today? In today’s fast-paced and edgy market environment, firms are looking at ways in which they can gain a competitive advantage by exploiting the opportunities presented by big data. In retail,...
Are medical devices safe?
Medical device cybersecurity issues arrive at the Heart Rhythm Society's annual meeting, with reps from industry and regulation making the case for collaboration in the interest of patient safety. It'll take a village to ensure that medical devices are ready to face...
How Big Data Builds The Sensor Society
As our cars, phones and computers get “smarter” they — and the companies that provide them — know a lot more about us than they used to. A large part of this data collection stems from the fact that these devices act as sensors, collecting information we’d probably...
5 technologies that will help big data cross the chasm
We’re on the cusp of a real turning point for big data. Its applications are becoming clearer, its tools are getting easier and its architectures are maturing in a hurry. It’s no longer just about log files, clickstreams and tweets. It’s not just about Hadoop and...
Maya from Crayon Data shortlisted for IBM challenge
Crayon Data, a new generation big data analytics company focused on simplifying the world’s choices, announced it has been selected as one of the top list of companies for the IBM’s Watson Mobile Developer Challenge. The short list allows Crayon’s entry, the Maya...
5 big data solutions for small businesses like yours
Big Data isn't just for big businesses with even bigger budgets. Today, small business, too, can reap the benefits of the massive amounts of online and offline information to make wise, data-driven decisions to grow their businesses. Although most Big Data discussions...
How Big Data Influences Design
Big data is influencing every aspect of our lives, both on and offline. On Friday, May 2, Umbel joined IBM, along with Peter Kim, to talk about how the big data revolution is affecting design. In the 30 minute talk, held monthly by IBM's David Pittman, we touched on...
Can big data save horse-racing industry?
On Saturday, May 3, the 140th running of the Kentucky Derby took place. Twenty 3-year-old Thoroughbreds took a 1.25-mile sprint in what is commonly referred to as “The Greatest Two Minutes in Sports.” For casual horse-racing fans, the Derby is likely one of only a...
45 surprising facts about big data!
What will Big-Data convey with some of it’s startling factoids. I recently ran through google to find some good factoids. I stumble upon some of these facts which are worth mentioning and keeping a note on. 1. Google’s Eric Schmidt claims that every two days now we...
Top 30 simple tools for Data Visualization
There have never been more technologies available to collect, examine, and render data. Here are 30 different notable pieces of data visualization software good for any designer's repertoire. They're not just powerful; they're easy to use. In fact, most of these tools...
Relational Vs Non-Relational databases – Part 2
In my previous post, we have seen some fundamental differences between Relational and Non-Relational databases. In this post, let's talk about Scalability of these two. Scalability It is an ability of a system that can easily accommodate the rapid incoming data...
Can an Algorithm Solve Twitter’s Credibility Problem?
On October 29, 2012, when Hurricane Sandy made landfall, I was in my Brooklyn apartment, refreshing Twitter. The news on my timeline consisted mostly of grim dispatches from amateur storm spotters tracking Sandy’s march up the coast. By the time the storm reached New...
Car-sharing, GPS data changing transportation patterns
Why drive a car when you can tap out a ride on your smartphone and get picked up in minutes. Need to drive? Rent a car by the hour and then leave it on the street when you’re done with it. But if you must own a car, one California automaker is betting it won’t use...
What The Heck Is Machine Learning?
Machine learning is a computer’s way of learning from examples, and it is one of the most useful tools we have for the construction of artificially intelligent systems. It starts with the effort of incredibly talented mathematicians and scientists who design...
Five Key Properties of Interactive Data Visualization
According to renowned AT&T Bell Telephone Laboratories statistician John Tukey, “data may not contain the answer. The coordination of some data and an aching desire for an answer will not ensure that a reasonable one can be extracted from a given body of data.” While...
Finance sector is too slow with big data analytics
Financial services organisations need to move more quickly when it comes to the practical implementation of big data analytics. Many of the larger banks and insurance companies are just taking too long to make this happen, and there are no excuses as we, as an...
My Experiment Opting Out of Big Data Made Me Look Like a Criminal
This week, the President is expected to release a report on big data, the result of a 90-day study that brought together experts and the public to weigh in on the opportunities and pitfalls of the collection and use of personal information in government, academia, and...
Meet The Woman Who Did Everything In Her Power To Hide Her Pregnancy From Big Data
Janet Vertesi, assistant professor of sociology at Princeton University, had an idea: would it be possible to hide her pregnancy from big data? Thinking about technology—the way we use it and the way it uses us—is her professional life’s work. Pregnant women, she...
Case study: How big data powers the eBay customer journey
With 50TB of machine-generated data produced daily and the need to process 100PB of data all together, eBay's data challenge is truly astronomical. This deluge of data is helping eBay to emulate the know-how that customers used to get from a local shop owner; the only...
Saving Big Data from Big Mouths
SA Forum is an invited essay from experts on topical issues in science and technology. It has become fashionable to bad-mouth big data. In recent weeks the New York Times, Financial Times, Wired and other outlets have all run pieces bashing this new technological...
Knowing Your Customers Too Well Might Be Hurting Your Business
Data-driven marketing has become incredibly powerful for businesses large and small. That's undeniable. Whether you're automatically sending marketing emails based on previous clicks, or you're using dynamic remarketing in PPC to follow your website visitors around...
Re-Imagining the Store of the Future
A couple of months ago, on a trip to the US, I decided to replace my aging MacBook with a MacBook Air. I placed the order online, since I also wanted to soup up the memory and hard disk. While I was at it, I decided to order a “COVER” for the machine. Four days later,...
Big Data & E-commerce
Let’s say you’re walking past a store and your eye catches a fancy gadget that you decide you must have, but you’re in a tearing hurry. So what do you do? You take a picture of the doodad with your smartphone, and hey presto, the store’s technology enables you to get...
How One Woman Hid Her Pregnancy From Big Data
For the past nine months, Janet Vertesi, assistant professor of sociology at Princeton University, tried to hide from the Internet the fact that she's pregnant — and it wasn't easy. Pregnant women are incredibly valuable to marketers. For example, if a woman decides...
Boosting Customer Loyalty with Big Data
Are you paying attention to your existing customers? If not, you may want to reconsider your priorities: According to a new report, more than half of the annual revenue for 61 percent of small business owners comes from repeat buyers. The report found that 80 percent...
How Big Data Could Undo Our Civil-Rights Laws
Big Data will eradicate extreme world poverty by 2028, according to Bono, front man for the band U2. But it also allows unscrupulous marketers and financial institutions to prey on the poor. Big Data, collected from the neonatal monitors of premature babies, can...
You Can Quit Looking for Data Scientists
Data scientists are hard to find and expensive to keep, but that doesn’t mean that big data insights are beyond your reach. And, no, we’re not suggesting that you outsource your most important work to a team of analysts in a distant land. After all, there’s a new...
5 big data Ted Talks everyone needs to watch now
Big data may be a big buzzword, but it's implications are bombarding the business world, offering new insights to old problems and connecting the dots where previously no dots were even seen. It's a changing space out there, where what you like on Facebook can tell a...
Big Data: profitability, potential and problems in banking
More than 70% of banking executives worldwide say customer centricity is important to them. However, achieving greater customer centricity requires a deeper understanding of customer needs. Research from Capgemini indicates that only 37% of customers believe that...
Big Data: Your Secret Weapon to Retail Marketing
Big data. You know it’s out there. You know it’s accumulating in mind-boggling volumes and at breakneck speeds. And you know you need to do something about it to drive your retail content marketing efforts. If the words “big data” get your pulse racing, make you toss...
New face recognition algorithm knows you better than you know yourself
Every now and then, something comes along that promises to reboot the debate on a hot button issue. A new algorithm developed at the Chinese University of Hong Kong looks set to do just that, pitting privacy advocates against technologists in a fresh fight over facial...
Parents win against cloud storage of US students’ private information
People are a little touchy about data collection nowadays. They were most certainly touchy about inBloom, a non-profit that was offering to house and manage student data for public school districts across the US by extracting a dizzying array of information - we're...
Backing up SQL Databases with the VDP Advanced SQL Agent
In this article I'm going to show you how to backup SQL databases using the VMware Data Protection Advanced SQL agent. The first thing you need to do is download and install the SQL agent on your SQL server (If using SQL 2012 then please refer to this blog article)....
Should autonomous cars behave like automatons or act like human drivers?
At Nokia’s Here connected car division in Chicago, researchers are pouring over crowdsourced vehicle data from all of the world, trying to figure out how our future autonomous vehicles should comport themselves on the road. By comparing high-definition mapping data...
Top 10 tech topics IT leaders should stay on top of
At the Interop conference in Las Vegas a few weeks ago, I noticed some strong trends in the topics covered. As a matter of fact, most of the topics fit into a dozen or so categories. Here are 10 hot topics that are clearly on the minds of business and IT leaders. 1:...
Relational vs. non-relational databases – Part 1
For the past few years, NoSQL or Non-relational database tools have gained much popularity in terms of storing huge amount of data and scaling them easily. There are debates on whether non-relational databases will replace relational databases in the future. With the...
How to Get Started with Machine Learning in Python
The Python conference PyCon2014 has held recently and the videos for the conference are online. I have been working my way through the interesting machine learning ones and will share a few on this over the coming weeks. A great talk, if you are starting out in data...
I analyzed more than a million bitcoin tweets. Here’s what that looks like
I recently got my hands on more than 1.3 million tweets, all mentioning bitcoin or creator Satoshi Nakamoto, spanning the entire month of February 2014. My goal was to get a sense of who’s actually interested in bitcoin (enough to tweet about it, at least) and to see...
How big data is saving bankers’ bonuses
This year will see the enforcement of the EU’s clampdown on bankers’ bonuses, which requires banks to restrict bonuses to 100% of salary. This has already had a major impact on the market with the likes of HSBC and Goldman Sachs finding ways to circumvent the cap...
Big data insight without action is wasted effort – data scientist
Having moved on from a period when the focus for leading edge businesses was on experimenting with new capabilities such as Hadoop, 2014 looks set to be characterised as the year of action, not experimentation – running valuable analytics for tangible results. The...
Introduction to Hadoop: The Basics
This session assumes absolutely no knowledge of Apache Hadoop and will provide a complete introduction to all the major aspects of the Hadoop ecosystem of projects and tools. If you are looking to get up to speed on Hadoop, trying to work out what all the Big Data...
Evolution as a Cybersecurity Strategy
Albert Einstein was quoted as saying, “Look deep into nature, and then you will understand everything better.” People describe the Internet as a hostile network — which is true — and that got me thinking about other hostile environments where a successful strategy...
HBase: 5 tips for running on low memory EC2
When running on EC2, you often can't win when it comes to instance types. One of the more cost-effective types available is the c1.xlarge. It has enough CPU to handle compactions, a decent amount of disk, and high network I/O. However, we've found that the relatively...
Hadoop’s ability to deliver business growth is worth the bother
Hadoop is going to be big, but today, its adoption is still small. According to Gartner, there are only 1,000 Hadoop systems in production, with most companies not moving Hadoop beyond the proof of concept phase. Partly, this is a matter of difficulty: Hadoop isn't...
New cloud service uses big data sources to improve emergency response
A new cloud service from Swan Island Networks allows cities to tie information together from multiple "big data" sources to improve the response to natural disasters and man-made catastrophes. "Trusted Information Exchange Service [TIES] promises to allow city...
Top LinkedIn Groups in 2014 for Analytics, Big Data, Data Mining and Data Science
Here is a complete list of most active Linkedin groups for Analytics, Big Data, Data Mining and Data Science. Advanced Business Analytics, Data Mining and Predictive Modeling Big Data / Analytics / Strategy / FP&A / S&OP / Strategic Planning / Predictive & Business...
Big Data Wants to be Your Shopping Buddy
Imagine a nice Friday afternoon walking around your local mall. You walk into your favorite browsing for a new outfit to wear to your friend's party later in the evening. Although you usually shop in-store, sometimes you shop online, as many people all over the world...
9 Free Books for Learning Data Mining & Data Analysis
Data mining, data analysis, these are the two terms that very often make the impressions of being very hard to understand – complex – and that you’re required to have the highest grade education in order to understand them. I can only disagree, and as with anything in...
Relational Vs Non-Relational databases – Part 1
In this post, we have seen some of the Big data technologies that are used to store and analyse data. For the past few years NoSQL or Non-relational database tools have gained much popular in terms of storing huge amount of data and scaling them easily. There are...
Fighting tax fraud with big data
John F. Kennedy famously said "It is a paradoxical truth that tax rates are too high today and tax revenues are too low," and with April 15 right around the corner, chances are your tax returns leave you hoping that everyone else is planning on paying their fair share...
Eyes on the Medicare data dump: Cautions and cautionary tales
On Wednesday came the government release, finally, of Big Data on Medicare payments to medical practitioners for 2012. The beginning, one hopes, of release of many more years of data in aid of trend-spotting. Also, surely, some reining in of the grossest of these...
Not Using Big Data for Hiring? You May Be Missing Out on the Best Candidates
According to a survey by Silicon Valley Bank, 90 percent of startups believe finding talent is their biggest challenge. Yet, a solution to this problem could lie with Big Data -- massive amounts of structured and unstructured data that's difficult to process using...
Why you don’t need petabytes for a big data opening
Big data isn't necessarily big and can be as much about the complexities of processing information as about volumes or data types. Personal genetic-profiling services such as 23andMe, which charges $99 to sequence an individual's genome, illustrate the point,...
Why Your Analytics are Failing You
Many organizations investing millions in big data, analytics, and hiring quants appear frustrated. They undeniably have more and even better data. Their analysts and analytics are first-rate, too. But managers still seem to be having the same kinds of business...
Big Data Changed How We Measure Success
Who's No.1? How do you assess and define success? Who are the most popular artists and recordings at any given time? Ever since there has been a music industry, these questions have obsessed record company executives and artists alike. And to answer these questions,...
Data Scientists Explain Why You Don’t Need Data Scientists
We don't like to throw around the term "smart data." It seems to so many like a lofty idea, perhaps a dream product for digital media companies and their audiences alike. And we agree -- it is all those things. So, we nabbed our in-house data scientists, convinced...
Top 4 big data challenges that universities face
The rise of big data and big science have provided universities with an opportunity to work together on ways to technologically manage worldwide research projects. Misfolding proteins that cause Alzheimer's disease and the mysteries of dark matter and dark energy are...
Getting Serious about MySQL and Hadoop
Lean, mean MySQL and hulking Hadoop clusters may seem like an odd couple, but tying them together is now priority #1 for many MySQL users. This keynote talk on 1st day of this year's Percona Live MySQL Conference & Expo 2014 explores the data management trends...
This Hidden Big Data Play Beats Estimates
Investors looking for a hot sector of IT spending should look no further than data analytics. IT companies like IBM (NYSE: IBM ) and Oracle (NYSE: ORCL ) managed to generate growth with their analytics solutions. In addition, there is also a burgeoning opportunity for...